Die Präsentation wird geladen. Bitte warten

Die Präsentation wird geladen. Bitte warten

© Fraunhofer MEVIS Frank Heckel 1, Stefan Braunewell 1, Grzegorz Soza 2, Christian Tietjen 2, Horst K. Hahn 1 Sketch-based Image-independent Editing of.

Ähnliche Präsentationen


Präsentation zum Thema: "© Fraunhofer MEVIS Frank Heckel 1, Stefan Braunewell 1, Grzegorz Soza 2, Christian Tietjen 2, Horst K. Hahn 1 Sketch-based Image-independent Editing of."—  Präsentation transkript:

1 © Fraunhofer MEVIS Frank Heckel 1, Stefan Braunewell 1, Grzegorz Soza 2, Christian Tietjen 2, Horst K. Hahn 1 Sketch-based Image-independent Editing of 3D Tumor Segmentations using Variational Interpolation 1 Fraunhofer MEVIS, Germany, 2 Siemens AG, Healthcare Sector, Imaging & Therapy Division, Computed Tomography, Germany

2 © Fraunhofer MEVIS 1 / 15Frank Heckel et al.Sketch-based Image-independent Editing of 3D Tumor Segmentations28. Sept Motivation Segmentation is one of the essential tasks in medical image analysis Many sophisticated automatic segmentation algorithms exist … … which might fail in some cases (low contrast, noise, biological variability) What to do? Manual segmentation? Takes too long Different algorithm? Might fail as well Locally correct the error! Why do we need efficient segmentation editing tools? Solution Results Outlook Conclusion

3 © Fraunhofer MEVIS 2 / 15Frank Heckel et al.Sketch-based Image-independent Editing of 3D Tumor Segmentations28. Sept Motivation Requirements: Intuitive interaction in 2D – estimate the users intention in 3D Local modifications Real-time feedback Provide a general tool (for different objects and modalities) Be independent of the preceding automatic algorithm The user expects the tool to allow him or her to correct all errors With only a few steps! The segmentation problems are typically hard (noise, low contrast, …) Do not use the image! What makes segmentation editing a difficult problem? Solution Results Outlook Conclusion

4 © Fraunhofer MEVIS 3 / 15Frank Heckel et al.Sketch-based Image-independent Editing of 3D Tumor Segmentations28. Sept Solution Use methods known from object reconstruction Contour-based representation Can be treated as a point cloud Reconstruct a smooth surface using variational interpolation Segmentation Formulated as an Object Reconstruction Problem Results Outlook ConclusionMotivation

5 © Fraunhofer MEVIS 4 / 15Frank Heckel et al.Sketch-based Image-independent Editing of 3D Tumor Segmentations28. Sept Solution Hole-handling: Recursively check the level of embedding Holes have an odd level Invert the sign of the normals Segmentation Formulated as an Object Reconstruction Problem without hole-handlingwith hole-handling Results Outlook ConclusionMotivation

6 © Fraunhofer MEVIS 5 / 15Frank Heckel et al.Sketch-based Image-independent Editing of 3D Tumor Segmentations28. Sept Solution Sketch-based Editing in 2D User inputCorrection resultEdited region Part containing the center of gravity Results Outlook ConclusionMotivation

7 © Fraunhofer MEVIS 6 / 15Frank Heckel et al.Sketch-based Image-independent Editing of 3D Tumor Segmentations28. Sept Solution We have to deal with imperfection: Sketch-based Editing in 2D add remove add + remove replcae Results Outlook ConclusionMotivation

8 © Fraunhofer MEVIS 7 / 15Frank Heckel et al.Sketch-based Image-independent Editing of 3D Tumor Segmentations28. Sept Solution A correction might generate new holes: Remove all contours whose level of embedding has changed Sketch-based Editing in 2D Results Outlook ConclusionMotivation

9 © Fraunhofer MEVIS 8 / 15Frank Heckel et al.Sketch-based Image-independent Editing of 3D Tumor Segmentations28. Sept Solution Compute a correction depth Reconstruct the new surface between start and end 3D Extrapolation using Variational Interpolation Results Outlook ConclusionMotivation

10 © Fraunhofer MEVIS 9 / 15Frank Heckel et al.Sketch-based Image-independent Editing of 3D Tumor Segmentations28. Sept Solution Making the correction local: Dilate the edited region Duplicate it to all slices of the reconstruction Use new segmentation in this region only 3D Extrapolation using Variational Interpolation Results Outlook ConclusionMotivation

11 © Fraunhofer MEVIS 10 / 15Frank Heckel et al.Sketch-based Image-independent Editing of 3D Tumor Segmentations28. Sept Solution Manual Correction Workflow Corrections can be performed in any view User can arbitrarily switch between views Previously performed corrections should be part of the new surface Keep all user-inputs and use them for reconstruction Results Outlook ConclusionMotivation user-input (1 st step, axial view) user-input (2 nd step, sagittal view)

12 © Fraunhofer MEVIS 11 / 15Frank Heckel et al.Sketch-based Image-independent Editing of 3D Tumor Segmentations28. Sept Solution Results Outlook ConclusionMotivation

13 © Fraunhofer MEVIS 12 / 15Frank Heckel et al.Sketch-based Image-independent Editing of 3D Tumor Segmentations28. Sept Results Data: 89 tumors in CT (lung nodules, liver metastases, lymph nodes) Participants: 2 technical experts with 6+ years experience in tumor segmentation and assessment Qualitative rating of the correction tool Median: 4 steps (53s), Avg. time per step: 0.4s 1 1 Intel Xeon X5550 (2.66GHz), 12GB RAM, Windows 7 64-Bit, 4 cores used Outlook ConclusionSolution 92.1%

14 © Fraunhofer MEVIS 13 / 15Frank Heckel et al.Sketch-based Image-independent Editing of 3D Tumor Segmentations28. Sept Outlook Main problem currently: Contradictory user inputs Reconstruction is currently too slow for large objects (like the liver) Comparison the other methods Strongly depends on the specific segmentation task and the experience and requirements of the users Proposal: Segmentation editing challenge ConclusionResults

15 © Fraunhofer MEVIS 14 / 15Frank Heckel et al.Sketch-based Image-independent Editing of 3D Tumor Segmentations28. Sept Conclusion Segmentation editing is an indispensable step in the segmentation process Efficient editing in 3D is challenging Sketching provides an intuitive interface for segmentation editing in 2D We have proposed a general, efficient editing tool 2D corrections are extrapolated to 3D using object reconstruction Can be used for any 3D modality and any compact object Outlook

16 © Fraunhofer MEVIS 15 / 15Frank Heckel et al.Sketch-based Image-independent Editing of 3D Tumor Segmentations28. Sept Thank you!

17 © Fraunhofer MEVIS 16 / 15Frank Heckel et al.Sketch-based Image-independent Editing of 3D Tumor Segmentations28. Sept Grafische Elemente Kästen, Pfeile, Verbindungen und Linien (Auswahl) folgende Elemente können hier per Rechtsklick kopiert und an gewünschter Stelle in der neuen Präsentation per Rechtsklick wieder eingesetzt werden: Linien Fraunhofer-Grün, bis 1 pt auch Schwarz Linienstärke gestrichelt: 1 pt Linienstärke durchgezogen: 1, 2, 3, 4 und 5 pt Pfeile und Verbindungen Fraunhofer-Grün Kasten mit Outline Fraunhofer-Grün Linienstärke je nach Größe 2, 4, 6, 8 pt Je größer der Kasten, desto stärker die Linie Kasten gefüllt Grau ! DIESE FOLIE AUS FINALER PRÄSENTATION LÖSCHEN !

18 © Fraunhofer MEVIS 17 / 15Frank Heckel et al.Sketch-based Image-independent Editing of 3D Tumor Segmentations28. Sept Farben folgende Farben können über die Powerpoint-Farbauswahl hier aufgenommen und damit in der neuen Präsentation angewendet werden: Überschriften / Fließtext / Quellenangaben / Bildunterschriften / Grafikauszeichnungen Grafikauszeichnungen Aufzählungen / Nummerierungen erster Ebene / grafische Elemente Grafiken Fonds hinter Grafiken ! DIESE FOLIE AUS FINALER PRÄSENTATION LÖSCHEN !

19 © Fraunhofer MEVIS 18 / 15Frank Heckel et al.Sketch-based Image-independent Editing of 3D Tumor Segmentations28. Sept Fhe: Weitere grafische Elemente ! DIESE FOLIE AUS FINALER PRÄSENTATION LÖSCHEN ! Diese Box kann z.B. für Definitionen verwendet werden. Leider wird die Stärke der Abrundung der Ecken mit der Größe der Box verändert. Die Rundung muss dann per Hand korrigiert werden. Die Gesamtanzahl der Folien (xx in der Fußzeile) wird aktuell leider nicht automatisch eingefügt und muss per Hand im Folienmaster angepasst werden.


Herunterladen ppt "© Fraunhofer MEVIS Frank Heckel 1, Stefan Braunewell 1, Grzegorz Soza 2, Christian Tietjen 2, Horst K. Hahn 1 Sketch-based Image-independent Editing of."

Ähnliche Präsentationen


Google-Anzeigen