System and method for performing a virtual endoscopy

• US 7,304,644 B2
• Filed: 03/08/2004
• Issued: 12/04/2007
• Est. Priority Date: 03/12/2003
• Status: Expired due to Fees

• Current Assignee: Siemens Medical Solutions USA Incorporated (Siemens AG)
• Original Assignee: Siemens Medical Solutions USA Incorporated (Siemens AG)
• Inventors: Geiger, Bernhard
• Primary Examiner(s): Zimmerman; Mark
• Assistant Examiner(s): MATHEWS, CRYSTAL ANN
• Application Number:
  US10/795,918
• Publication Number:
  US 20040202990A1
• Time in Patent Office: 1,366 Days
• Field of Search: 345/424
• US Class Current: 345/424
• CPC Class Codes: G06T 15/08 Volume rendering
• CPC Class Codes: G06T 19/00 Manipulating 3D models or images for computer graphics
• CPC Class Codes: G06T 2207/10072 Tomographic images
• CPC Class Codes: G06T 2207/30028 Colon; Small intestine
• CPC Class Codes: G06T 2207/30061 Lung
• CPC Class Codes: G06T 2210/41 Medical
• CPC Class Codes: G06T 7/0012 Biomedical image inspection
• CPC Class Codes: G06T 7/11 Region-based segmentation

Abstract

A system and method for performing a virtual endoscopy is provided. The method comprises the steps of: calculating a distance map using three-dimensional (3D) data of a lumen; calculating a multiplanar reconstruction (MPR) of the lumen, wherein the MPR is calculated orthogonal to the lumen at an endoscope position; performing a first region growing on the MPR of the lumen at the endoscope position, wherein data associated with the first region is marked; calculating a minimum distance and a maximum distance from the marked data of the first region growing using corresponding distances from the distance map; performing a second region growing on the MPR of the lumen for data outside the first region growing, wherein data associated with the second region is marked; and performing a 3D rendering of the marked data associated with the first region growing and the second region growing.

Claims

1. A method for performing a virtual endoscopy, comprising:

calculating a multiplanar reconstruction (MPR) of a lumen;

performing a two-dimensional (2D) region growing in a portion of the lumen on the MPR;

marking data in the portion of the lumen during the 2D region growing as a candidate for three-dimensional (3D) rendering;

performing a 3D rendering on the portion of the lumen within the marked data;

replacing the marked data with the 3D rendered portion of the lumen; and

displaying an image of the MPR with the 3D rendered portion of the lumen in an area that originally included the marked data.

2. The method of claim 1, further comprising:

acquiring image data from the lumen.

3. The method of claim 2, wherein the image data is acquired by one of computed tomographic (CT), helical CT, x-ray, positron emission tomographic, fluoroscopic, ultrasound, and magnetic resonance (MR) imaging techniques.

4. The method of claim 1, wherein the lumen is one of a colon, a pancreas, a bronchi, a larynx, a trachea, a sinus, an ear canal, a blood vessel, a urethra and a bladder.

5. The method of claim 1, wherein the MPR is calculated orthogonal to the lumen.

6. The method of claim 1, wherein the MPR is calculated at an endoscope position.

7. The method of claim 1, wherein the 2D region growing is performed at the endoscope position.

8. The method of claim 1, wherein the 3D rendering is performed using one of raycasting, surface rendering and volume rendering techniques.

9. A method for performing a virtual endoscopy, comprising:

calculating a distance map using three-dimensional (3D) data of a lumen;

calculating a multiplanar reconstruction (MPR) of the lumen, wherein the MPR is calculated orthogonal to the lumen at an endoscope position;

performing a first two-dimensional (2D) region growing in a desired portion of the lumen on the MPR at the endoscope position;

marking first data in the desired portion of the lumen during the first 2D region growing as a candidate for 3D rendering;

calculating a minimum distance and a maximum distance to the endoscope position in the desired portion of the lumen within the first marked data by using the distance map to identify a part of the desired portion of the lumen that was not included in the first 2D region growing;

performing a second 2D region growing in the part of the desired portion on the MPR;

marking second data in the part of the desired portion during the second 2D region growing as another candidate for 3D rendering;

performing a 3D rendering on the desired portion of the lumen within the first marked data and the part of the desired portion within the second marked data;

replacing the first marked data with the 3D rendered desired portion of the lumen and the second marked data with the 3D rendered part of the desired portion; and

displaying an image of the MPR with the 3D rendered desired portion of the lumen in an area that originally included the first marked data and the 3D rendered part of the desired portion in an area that originally included the second marked data.

10. The method of claim 9, further comprising:

acquiring the 3D data from the lumen.

11. The method of claim 10, wherein the 3D data is acquired by one of computed tomographic (CT), helical CT, x-ray, positron emission tomographic, fluoroscopic, ultrasound, and magnetic resonance (MR) imaging techniques.

12. The method of claim 9, wherein the lumen is one of a colon, a pancreas, a bronchi, a larynx, a trachea, a sinus, an ear canal, a blood vessel, a urethra and a bladder.

13. The method of claim 9, wherein the 3D rendering is performed using one of raycasting, surface rendering and volume rendering techniques.

14. The method of claim 9, wherein the second 2D region growing is performed within a threshold associated with the calculated minimum and maximum distances.

15. A system for performing a virtual endoscopy, comprising:

a memory device for storing a program;

a processor in communication with the memory device, the processor operative with the program to;

calculate a distance map using three-dimensional (3D) data of a lumen;

calculate a multiplanar reconstruction (MPR) of the lumen, wherein the MPR is calculated orthogonal to the lumen at an endoscope position;

perform a first two-dimensional (2D) region growing in a desired portion of the lumen on the MPR at the endoscope position;

mark first data in the desired portion of the lumen during the first 2D region growing as a candidate for 3D rendering;

calculate a minimum distance and a maximum distance to the endoscope position in the desired portion of the lumen within the first marked data by using the distance map to identify a part of the desired portion of the lumen that was not included in the first 2D region growing;

perform a second 2D region growing in the part of the desired portion on the MPR;

mark second data in the part of the desired portion during the second 2D region growing as another candidate for 3D rendering;

perform a 3D rendering on the desired portion of the lumen within the first marked data and the part of the desired portion within the second marked data;

replace the first marked data with the 3D rendered desired portion of the lumen and the second marked data with the 3D rendered part of the desired portion; and

display an image of the MPR with the 3D rendered desired portion of the lumen in an area that originally included the first marked data and the 3D rendered part of the desired portion in an area that originally included the second marked data.

16. The system of claim 15, wherein the processor is further operative with the program code to:

acquire the 3D data of the lumen.

17. The system of claim 16, wherein the 3D data is acquired by a scanning device using one of computed tomographic (CT), helical CT, x-ray, positron emission tomographic, fluoroscopic, ultrasound, and magnetic resonance (MR) imaging techniques.

18. The system of claim 15, wherein the image is displayed by a display device.

19. A computer program product comprising a computer useable medium having computer program logic recorded thereon for performing a virtual endoscopy, the computer program logic comprising:

program code for calculating a distance map using three-dimensional (3D) data of a lumen;

program code for calculating a multiplanar reconstruction (MPR) of the lumen, wherein the MPR is calculated orthogonal to the lumen at an endoscope position;

program code for performing a first two-dimensional (2D) region growing in a desired portion of the lumen on the MPR at the endoscope position;

program code for marking first data in the desired portion of the lumen during the first 2D region growing as a candidate for 3D rendering;

program code for calculating a minimum distance and a maximum distance to the endoscope position in the desired portion of the lumen within the first marked data by using the distance map to identify a part of the desired portion of the lumen that was not included in the first 2D region growing;

program code for performing a second 2D region growing in the part of the desired portion on the MPR;

program code for marking second data in the part of the desired portion during the second 2D region growing as another candidate for 3D rendering;

program code for performing a 3D rendering on the desired portion of the lumen within the first marked data and the part of the desired portion within the second marked data;

program code for replacing the first marked data with the 3D rendered desired portion of the lumen and the second marked data with the 3D rendered part of the desired portion; and

program code for displaying an image of the MPR with the 3D rendered desired portion of the lumen in an area that originally included the first marked data and the 3D rendered part of the desired portion in an area that originally included the second marked data.

20. The computer program product of claim 19, wherein the computer program logic further comprises:

program code for acquiring the 3D data from the lumen.

21. The computer program product of claim 20, wherein the 3D data is acquired by one of computed tomographic (CT), helical CT, x-ray, positron emission tomographic, fluoroscopic, ultrasound, and magnetic resonance (MR) imaging techniques.

22. The computer program product of claim 19, wherein the lumen is one of a colon, a pancreas, a bronchi, a larynx, a trachea, a sinus, an ear canal, a blood vessel, a urethra and a bladder.

23. The computer program product of claim 19, wherein the 3D rendering is performed using one of raycasting, surface rendering and volume rendering techniques.

24. A system for performing a virtual endoscopy, comprising:

means for calculating a distance map using three-dimensional (3D) data of a lumen;

means for calculating a multiplanar reconstruction (MPR) of the lumen, wherein the MPR is calculated orthogonal to the lumen at an endoscope position;

means for performing a first two-dimensional (2D) region growing in a desired portion of the lumen on the MPR at the endoscope position;

means for marking first data in the desired portion of the lumen during the first 2D region growing as a candidate for 3D rendering;

means for calculating a minimum distance and a maximum distance to the endoscope position in the desired portion of the lumen within the first marked data by using the distance map to identify a part of the desired portion of the lumen that was not included in the first 2D region growing;

means for performing a second 2D region growing in the part of the desired portion on the MPR;

means for marking second data in the part of the desired portion during the second 2D region growing as another candidate for 3D rendering;

means for performing a 3D rendering on the desired portion of the lumen within the first marked data and the part of the desired portion within the second marked data;

means for replacing the first marked data with the 3D rendered desired portion of the lumen and the second marked data with the 3D rendered part of the desired portion; and

means for displaying an image of the MPR with the 3D rendered desired portion of the lumen in an area that originally included the first marked data and the 3D rendered part of the desired portion in an area that originally included the second marked data.

25. A method for performing a virtual endoscopy, comprising:

acquiring three-dimensional (3D) data from a lumen;

calculating a distance map using the 3D data of the lumen;

positioning an endoscope in the lumen;

calculating a multiplanar reconstruction (MPR) of the lumen, wherein the MPR is calculated orthogonal to the lumen at the endoscope position;

performing a two-dimensional (2D) region growing in a desired portion of the lumen on the MPR at the endoscope position;

marking data in the desired portion of the lumen during the 2D region growing as a candidate for 3D rendering;

calculating a minimum distance and a maximum distance to the endoscope position in the desired portion of the lumen within the marked data by using the distance map to identify parts of the desired portion of the lumen that were not included in the 2D region growing;

performing a 2D region growing in each of the parts of the desired portion on the MPR;

marking data in each of the parts of the desired portion as a candidate for 3D rendering;

performing a 3D rendering on the desired portion of the lumen within its corresponding marked data and each of the parts of the desired portion within each part'"'"'s corresponding marked data;

replacing the marked data corresponding to the desired portion of the lumen with the 3D rendered desired portion of the lumen and the marked data corresponding to each of the parts of the desired portion with the 3D rendered parts of the desired portion; and

displaying an image of the MPR with the 3D rendered desired portion of the lumen in an area that originally included its corresponding marked data and the 3D rendered parts of the desired portion in areas that originally included each part'"'"'s corresponding marked data.

26. The method of claim 25, wherein the parts of the desired portion of the lumen that were not included in the 2D region growing are identified by data that is outside the marked data in the desired portion of the lumen and that is within a threshold associated with the calculated minimum and maximum distances.