System and method for performing a three-dimensional virtual segmentation and examination

• US 6,331,116 B1
• Filed: 06/29/1999
• Issued: 12/18/2001
• Est. Priority Date: 09/16/1996
• Status: Expired due to Term

• Current Assignee: The Research Foundation for The State University of New York (State University of New York)
• Original Assignee: The Research Foundation for The State University of New York (State University of New York)
• Inventors: Liang, Zhengrong, Wax, Mark R., Kaufman, Arie E., Wan, Ming, Chen, Dongquing
• Primary Examiner(s): Rovnak, John Edmund
• Application Number:
  US09/343,012
• Time in Patent Office: 903 Days
• Field of Search: 434/262, 434/267, 434/272, 345/112, 345/418, 345/419, 345/420, 345/424, 345/426, 345/473, 345/474, 345/952, 345/959
• US Class Current: 434/262
• CPC Class Codes: G06T 15/04 Texture mapping
• CPC Class Codes: G06T 15/08 Volume rendering
• CPC Class Codes: G06T 19/20 Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
• CPC Class Codes: G06T 2207/10081 Computed x-ray tomography [CT]
• CPC Class Codes: G06T 2207/20156 Automatic seed setting
• CPC Class Codes: G06T 2207/30032 Colon polyp
• CPC Class Codes: G06T 2210/28 Force feedback
• CPC Class Codes: G06T 2210/41 Medical
• CPC Class Codes: G06T 2219/2021 Shape modification
• CPC Class Codes: G06T 7/0012 Biomedical image inspection
• CPC Class Codes: G06T 7/11 Region-based segmentation
• CPC Class Codes: G06V 10/147 Details of sensors, e.g. sensor lenses fingerprint or palmprint sensors G06V40/13; vascular sensors G06V40/145; eye sensors G06V40/19
• CPC Class Codes: G06V 10/28 Quantising the image, e.g. histogram thresholding for discrimination between background and foreground patterns
• CPC Class Codes: G06V 2201/03 Recognition of patterns in medical or anatomical images

Abstract

A system and method for generating a three-dimensional visualization image of an object such as an organ using volume visualization techniques and exploring the image using a guided navigation system which allows the operator to travel along a flight path and to adjust the view to a particular portion of the image of interest in order, for example, to identify polyps, cysts or other abnormal features in the visualized organ. An electronic biopsy can also be performed on an identified growth or mass in the visualized object. Virtual colonoscopy can be enhanced by electronically removing residual stool, fluid and non-colonic tissue from the image of the colon, by employing bowel preparation followed by image segmentation operations. Methods are also employed for virtually expanding regions of colon collapse using image segmentation results.

Claims

1. A method for electronically cleansing a virtual object, formed from image data, comprising:

converting the image data to a plurality of volume elements forming the virtual object, each volume element having an intensity value;

classifying the volume elements into a plurality of clusters in accordance with the intensity values; and

removing at least one cluster of volume elements from the virtual object.

2. The method for electronically cleansing a virtual object according to claim 1, wherein the classifying operation further comprises evaluating a plurality of volume elements of the image data with respect to a plurality of neighboring volume elements to determine a neighborhood similarity value for the volume elements.

3. The method for electronically cleansing a virtual object according to claim 2, wherein the clusters are classified according to the similarity value of the volume elements.

4. The method for electronically cleansing a virtual object according to claim 2, wherein the clusters are further classified by applying a mixture probability function to the clusters to classify voxels whose intensity value results from inclusion of more than one material type.

5. The method for electronically cleansing a virtual object according to claim 1, wherein the classifying operation further comprises:

performing feature vector analysis on at least one of the clusters which include image data for a material of interest; and

performing high level feature extraction to remove volume elements from the virtual object which are not substantially indicative of the material of interest.

6. The method for electronically cleansing a virtual object according to claim 5, wherein the image data represents a region of the human body including at least a portion of the colon and the material of interest is tissue of a colon.

7. The method for electronically cleansing a virtual object according to claim 1, wherein the image data represents a region of the human body including at least a portion of the colon.

8. The method for electronically cleansing a virtual object according to claim 7, wherein the removing operation removes volume elements representing at least one of intracolonic fluid, residual stool within the colon, bone, and non-colonic tissue.

9. A method for preparing image data for virtual colonoscopy comprising:

acquiring an image data set including at least a portion of the colon;

converting the image data set to a plurality of volume elements, each volume element having an intensity value;

classifying the volume elements into a plurality of clusters in accordance with the intensity values, each cluster representing at least one material proximate the colon; and

removing at least one cluster of volume elements from the image data set.

10. The method for preparing image data for virtual colonoscopy, according to claim 9, further comprising enhancing the intensity values of volume elements of fluid and stool residing within the colon prior to the acquiring operation.

11. The method of performing virtual colonoscopy, according to claim 10, wherein the enhancing operation comprises the step of a patient ingesting material to enhance the image intensity of stool and fluid within the colon.

12. The method of performing virtual colonoscopy, according to claim 11, wherein the ingesting step includes ingesting at least one of Barium Sulfate, Diatrizoate Meglumine and Diaztrizoate Sodium solution.

13. The method of performing virtual colonoscopy according to claim 10, wherein the at least one material proximate the colon includes colon wall tissue and at least one of bone, fluid, stool and non-colonic material.

14. The method of performing virtual colonoscopy according to claim 13, wherein one of the plurality of clusters includes the intensity enhanced volume elements representing fluid and stool, and this cluster is removed during the removing operation.

15. The method of performing virtual colonoscopy according to claim 9, wherein one of the plurality of clusters includes volume elements of the colon wall and other colon wall-like materials and a further classification operation is performed on this cluster to identify the volume elements of the colon wall.

16. The method of performing virtual colonoscopy according to claim 15, further comprising:

identifying the interior of the colon;

generating a centerline for navigating through the interior of the colon;

detecting a collapsed region of the interior of the colon; and

extending the centerline through the collapsed region.

17. The method of performing virtual colonoscopy according to claim 16, wherein entropy values are calculated for the intensity values proximate the centerline and the detecting operation includes identifying at least one of the entropy values being above a threshold value.

18. The method of performing virtual colonoscopy according to claim 17, further comprising virtually expanding a detected collapsed region of the colon in accordance with properties of the colon wall.

19. An imaging system including an image segmentation feature, comprising:

an imaging scanner for acquiring image data;

a processor, said processor converting the image data into a plurality of volume elements forming a volume element data set, each volume element having an intensity value, the processor performing an image segmentation operation on the volume element data set comprising classifying the volume elements into a plurality of clusters in accordance with the intensity values and removing at least one cluster of volume elements from the image data; and

a display unit operatively coupled to the processor for displaying a representation of the image data with the at least one cluster of volume elements removed.

20. The imaging system according to claim 19, wherein the classifying operation performed by the processor further comprises evaluating a plurality of volume elements of the image data with respect to a plurality of neighboring volume elements to determine a neighborhood similarity value for the volume element.

21. The imaging system according to claim 20, wherein the classifying operation performed by the processor classifies the clusters according to the similarity value of the volume elements.

22. The imaging system according to claim 19, wherein the classifying operation performed by the processor includes a mixture probability algorithm to classify voxels whose intensity value results from inclusion of more than one material type.

23. The imaging system according to claim 19, wherein the classifying operation performed by the processor further comprises:

performing feature vector analysis on at least one of the clusters which include image data for a material of interest; and

performing high level feature extraction to remove volume elements from the image which are not substantially indicative of the material of interest.

24. The imaging system according to claim 23, wherein the imaging scanner is adapted to acquire image data of a human body including at least a portion of the colon and the material of interest is tissue of a colon.

25. The imaging system according to claim 19, wherein the imaging scanner is adapted to acquire image data of a region of the human body including at least a portion of the colon.

26. The imaging system according to claim 19, wherein the classifying operation performed by the processor removes volume elements from the volume element data set which represent at least one of intracolonic fluid, residual stool within the colon, bone, and non-colonic tissue.