Automatic analysis in virtual endoscopy

• US 7,853,310 B2
• Filed: 12/11/2006
• Issued: 12/14/2010
• Est. Priority Date: 10/27/1994
• Status: Expired due to Fees

• Current Assignee: Wake Forest University Health Sciences
• Original Assignee: Wake Forest University Health Sciences
• Inventors: Ge, Yaorong, Ahn, David K., Salido, Tiffany W., Stelts, David R., Vining, David J., Hemler, Paul F., Hunt, Gordon W.
• Primary Examiner(s): Casler; Brian
• Assistant Examiner(s): KISH, JAMES M
• Application Number:
  US11/637,207
• Publication Number:
  US 20070276228A1
• Time in Patent Office: 1,464 Days
• Field of Search: 600/407, 600/410, 600/416, 600/425, 600/436, 600/437, 382/128, 382/131, 382/154, 382/173, 382/181, 382/190, 382/199, 382/232, 382/233
• US Class Current: 600/425
• CPC Class Codes: A61B 5/1076 for measuring dimensions inside body cavities, e.g. using catheters A61B3/1005 takes precedence
• CPC Class Codes: G06T 15/08 Volume rendering
• CPC Class Codes: G06T 17/00 Three dimensional [3D] modelling, e.g. data description of 3D objects
• CPC Class Codes: G06T 17/20 Finite element generation, e.g. wire-frame surface description, tesselation
• CPC Class Codes: G06T 2207/10081 Computed x-ray tomography [CT]
• CPC Class Codes: G06T 2207/20012 Locally adaptive
• CPC Class Codes: G06T 2207/30032 Colon polyp
• CPC Class Codes: G06T 2207/30064 Lung nodule
• CPC Class Codes: G06T 7/0012 Biomedical image inspection
• CPC Class Codes: G06T 7/11 Region-based segmentation
• CPC Class Codes: G06T 7/155 involving morphological operators
• CPC Class Codes: G09B 23/285 for injections, endoscopy, bronchoscopy, sigmoidscopy, insertion of contraceptive devices or enemas
• CPC Class Codes: Y02A 90/10 Information and communication technologies [ICT] supporting adaptation to climate change, e.g. for weather forecasting or climate simulation
• CPC Class Codes: Y10S 128/92 Computer assisted medical diagnostics

Abstract

A computer system and a computer-implemented method are provided for interactively displaying a three-dimensional rendering of a structure having a lumen and for indicating regions of abnormal wall structure. A three-dimensional volume of data is formed from a series of two-dimensional images representing at least one physical property associated with the three-dimensional structure. An isosurface of a selected region of interest is created by a computer from the volume of data based on a selected value or values of a physical property representing the selected region of interest. A wireframe model of the isosurface is generated by the computer wherein the wireframe model includes a plurality of vertices. The vertices are then grouped into populations of contiguous vertices having a characteristic indicating abnormal wall structure by the computer. The wireframe model is then rendered by the computer in an interactive three-dimensional display to indicate the populations of abnormal wall structure.

Claims

1. A method for interactively displaying three-dimensional structures comprising the steps of:

a. forming a three-dimensional volume of data representing at least one physical property associated with a three-dimensional body;

b. isolating a selected region of interest by comparing the value of each of a selected number of voxels in the volume of data to a value range of selected values of the physical property that represent the selected region of interest to remove those voxels having a value outside the selected value range; and

c. rendering the isolated region of interest in an interactive three-dimensional display,

wherein the step of isolating the selected region of interest comprises a morphological dilation step.

2. The method as recited in claim 1 wherein the body comprises a human body.

3. The method as recited in claim 1 wherein the forming step comprises an image acquisition step wherein a series of two-dimensional images is acquired from which the three-dimensional volume of data is formed.

4. The method as recited in claim 1 wherein the body comprises a colon.

5. The method as recited in claim 4 wherein the rendering step comprises simulating movement along a line which passes along the center of the lumen of the colon.

6. The method as recited in claim 4 wherein the rendering step comprises splitting the colon open in lengthwise sections and displaying the split open colon so that inner surfaces of the split open colon are visible.

7. The method as recited in claim 6 wherein the splitting step includes the steps of:

a. defining a cutting plane through the isolated region of interest; and

b. rendering all portions of the three-dimensional display on one side of the cutting plane transparent.

8. The method as recited in claim 4 wherein the isolation step comprises a step of determining colon wall thickness.

9. The method as recited in claim 8 wherein the step of determining the colon wall thickness comprises displaying a cross-sectional image through the colon.

10. The method as recited in claim 8 wherein the step of determining colon wall thickness comprises a step of identifying a thickened section of the colon by visually differentiating a thickened section on a displayed image from normal thickness of the colon wall.

12. The method as recited in any one of claim 1, 4, or 11 wherein the three-dimensional volume of data comprises x-ray images.

13. The method as recited in any one of claim 1, 4, or 11 wherein the step of isolating the selected region of interest comprises a thresholding step for determining threshold values corresponding to the selected values of the physical property to isolate the selected region of interest.

14. The method recited in claim 13 wherein the thresholding step comprises:

a. a threshold selection step for selecting a threshold range corresponding to the selected values of the physical property representing the selected region of interest; and

b. a threshold adjustment step for adjusting the threshold values to provide the threshold range for isolating the selected region of interest.

15. The method as recited in claim 14 wherein the threshold adjustment step comprises:

a. an orthoslice step of providing an orthoslice through the volume of data; and

b. a display step for displaying the orthoslice and a corresponding thresholded image of the orthoslice, so that the threshold values can be adjusted while comparing the thresholded image to the corresponding orthoslice.

16. The method as recited in claim 13 wherein the wherein the morphological dilation step comprises the steps of:

a. undersegmenting the selected region of interest from the volume of data; and

b. adding a layer of voxels to the undersegmented region of interest to form a segmented region of interest.

17. The method as recited in any one of claim 1, 4, or 11 wherein the region of interest comprises at least one of a bone-tissue interface, a bone-air interface, and an air-tissue interface.

18. The method as recited in any one of claim 1, 4, or 11 wherein the three-dimensional volume of data comprises images taken at regularly spaced grid locations within the body.

19. The method as recited in claim 18 wherein the spacing between successive grid locations is selected to produce isocubic voxels for three-dimensional display.

20. The method as recited in any one of claim 1, 4, or 11 wherein the physical property includes x-ray attenuation.

21. The method as recited in any one of claim 1, 4, or 11 wherein the three-dimensional volume of data comprises computed tomography images.

22. The method as recited in any one of claim 1, 4, or 11 wherein the region of interest comprises an air column.

23. The method as recited in any one of claim 1, 4, or 11 wherein the isolation step comprises a step of segmenting the selected region of interest.

24. The method as recited in any one of claim 1, 4, or 11 wherein the step of isolating the selected region of interest comprises a region growing step.

25. The method as recited in any one of claim 1, 4, or 11 wherein the rendering step comprises a volume rendering step.

26. The method as recited in any one of claim 1, 4, or 11 wherein the rendering step comprises a surface rendering step.

27. The method as recited in any one of claim 1, 4, or 11 the isolated region of interest is rendered as a surface rendering in an interactive three-dimensional display, therein producing a virtual three-dimensional environment, and wherein the rendering step comprises a volume rendering step for rendering selected volumes adjacent the isolated region of interest.

11. A method for interactively displaying three-dimensional structures comprising the steps of:

a. forming a three-dimensional volume of data representing at least one physical property associated with a three-dimensional body;

b. isolating a selected region of interest by comparing the value of each of a selected number of voxels in the volume of data to a value range of selected values of the physical property that represent the selected region of interest to remove those voxels having a value outside the selected value range; and

c. rendering the isolated region of interest in an interactive three-dimensional display wherein the body comprises a tracheobronchial airway, a portion of the tracheobronchial airway is rendered transparent, and a portion of the tracheobronchial airway is rendered semi-transparent.

28. A method for interactively displaying three-dimensional structures comprising the steps of:

a. forming a three-dimensional volume of data representing at least one physical property associated with a three-dimensional body;

b. isolating a selected region of interest by comparing the value of each of a selected number of voxels in the volume of data to a value range of selected values of the physical property that represent the selected region of interest to remove those voxels having a value outside the selected value range;

c. rendering the isolated region of interest in an interactive three-dimensional display;

d. forming an isosurface wireframe model of the isolated selected region of interest

wherein the step of rendering an image includes the step of rendering a three-dimensional display of the wireframe model comprising a volume rendering step, and wherein the volume rendering step comprises an opacity adjusting step for adjusting opacity values.

29. The method as recited in claim 28 wherein the opacity adjustment step comprises the step of adjusting the opacity values to the values determined along the inverse of a histogram curve representing the number of voxels of a given voxel value as a function of voxel value.

30. A method for interactively displaying three-dimensional structures comprising the steps of:

a. forming a three-dimensional volume of data representing at least one physical property associated with a three-dimensional body;

b. isolating a selected region of interest by comparing the value of each of a selected number of voxels in the volume of data to a value range of selected values of the physical property that represent the selected region of interest to remove those voxels having a value outside the selected value range; and

c. rendering the isolated region of interest in an interactive three-dimensional display comprising a data reduction step for reducing the size of the volume of data before rendering the isolated region of interest.

31. The method as recited in claim 30 wherein the reduction step comprises reducing pixel resolution.

32. The method as recited in claim 30 wherein the reduction step comprises reducing spatial resolution.

33. The method as recited in claim 30 wherein the reduction step comprises creating a subvolume of data.

34. A system for interactively displaying three-dimensional structures comprising:

a. volume formation means for forming a three-dimensional volume of data representing at least one physical property associated with a three-dimensional body;

b. isolation means for isolating a region of interest by comparing the value of each of a selected number of voxels in the volume of data to a value range of selected values of the physical property that represent the selected region of interest to remove those voxels having a value outside the selected value range, the isolation means comprising a morphological dilation means for adjusting the isolated region of interest; and

c. rendering means for rendering the isolated region of interest in an interactive three-dimensional display.

35. The system as recited in claim 34 wherein the isolation means comprises a thresholding means for determining a threshold range used to isolate the region of interest.

36. The system as recited in either of claim 35 or 34 including means for producing a wireframe model of the isolated region of interest.

37. The system recited in either of claim 35 or 34 wherein the thresholding means comprises:

a. a threshold selection means for selecting threshold values; and

b. a threshold adjustment means for adjusting the threshold values.

38. The system as recited in claim 37 wherein the threshold adjustment means comprises:

a. orthoslice means for taking an orthoslice through the region of interest to produce an orthoslice image; and

b. display means for displaying the orthoslice image and a corresponding thresholded image, so that the threshold values can be adjusted while comparing the thresholded image to the corresponding orthoslice.

39. The system as recited in claim 34 wherein the isolation means comprises a segmentation means for segmenting a region of interest from the volume of data.

40. The system as recited in claim 34 wherein the rendering means comprises simulation means for simulating movement along a center line through the isolated region of interest of the three-dimensional display.

41. The system as recited in claim 34 wherein the rendering means comprises a volume rendering means.

42. The system as recited in either claim 34 or claim 41 wherein the rendering means comprises a surface rendering means.

43. The system as recited in claim 34 wherein the rendering means comprises a surface rendering means for rendering the isolated region of interest as a surface rendering and wherein the rendering means comprises a volume rendering means for rendering selected volumes adjacent the isolated region of interest.

44. The system as recited in claim 34 wherein the morphological dilation means comprises:

a. undersegmentation means for undersegmenting the region of interest from the volume of data; and

b. layer means for adding a layer of voxels to the undersegmented region of interest to form an isolated region of interest.

45. A system for interactively displaying three-dimensional structures comprising:

a. volume formation means for forming a three-dimensional volume of data representing at least one physical property associated with a three-dimensional body;

b. isolation means for isolating a region of interest by comparing the value of each of a selected number of voxels in the volume of data to a value range of selected values of the physical property that represent the selected region of interest to remove those voxels having a value outside the selected value range;

c. rendering means for rendering the isolated region of interest in an interactive three-dimensional display; and

d. reduction means for reducing the size of the volume of data.

46. A system for interactively displaying three-dimensional structures comprising:

a. volume formation means for forming a three-dimensional volume of data representing at least one physical property associated with a three-dimensional body;

b. isolation means for isolating a region of interest by comparing the value of each of a selected number of voxels in the volume of data to a value range of selected values of the physical property that represent the selected region of interest to remove those voxels having a value outside the selected value range; and

c. rendering means for rendering the isolated region of interest in an interactive three-dimensional display, wherein the rendering means includes transparency means for rendering a portion of the region of interest semi-transparent.

47. A system for interactively displaying three-dimensional structures comprising:

a. volume formation means for forming a three-dimensional volume of data representing at least one physical property associated with a three-dimensional body;

b. isolation means for isolating a region of interest by comparing the value of each of a selected number of voxels in the volume of data to a value range of selected values of the physical property that represent the selected region of interest to remove those voxels having a value outside the selected value range; and

c. rendering means for rendering the isolated region of interest in an interactive three-dimensional display, wherein the rendering means includes splitting means for splitting the three-dimensional display open in selected split open sections and displaying means for displaying the split open sections so that inner surfaces of the split three-dimensional display are visible, and

wherein the splitting means includes center line splitting means for splitting open the three-dimensional display of the isolated region of interest along a line which passes along a center of the three-dimensional display of the segmented region of interest, the center line splitting means including;

a. selection means for selecting a seed point which lies within the region of interest;

b. plane determining means for determining a plane of minimum area through the region of interest that passes through the seed point;

c. center point determining means for determining the center point of the region of interest that is dissected by the plane of minimum area; and

d. point selecting means for selecting a new point which is spaced from the previous center point in a perpendicular direction relative to the plane of minimum area.

48. A system for interactively displaying three-dimensional structures comprising:

a. volume formation means for forming a three-dimensional volume of data representing at least one physical property associated with a three-dimensional body;

b. isolation means for isolating a region of interest by comparing the value of each of a selected number of voxels in the volume of data to a value range of selected values of the physical property that represent the selected region of interest to remove those voxels having a value outside the selected value range; and

c. rendering means for rendering the isolated region of interest in an interactive three-dimensional display, wherein the rendering means includes splitting means for splitting the three-dimensional display open in selected split open sections and displaying means for displaying the split open sections so that inner surfaces of the split three-dimensional display are visible, and

wherein the splitting means includes center line splitting means for splitting open the three-dimensional display of the isolated region of interest along a line which passes along a center of the three-dimensional display of the segmented region of interest, the center line splitting means including;

a. erosion means for iteratively eroding the region of interest until all of the region of interest disappears, thereby determining the last portions of the region of interest to disappear; and

b. connection means for connecting the last portions of the region of interest to disappear by erosion.

49. A system for interactively displaying three-dimensional structures comprising:

a. volume formation means for forming a three-dimensional volume of data representing at least one physical property associated with a three-dimensional body;

b. isolation means for isolating a region of interest by comparing the value of each of a selected number of voxels in the volume of data to a value range of selected values of the physical property that represent the selected region of interest to remove those voxels having a value outside the selected value range; and

c. rendering means for rendering the isolated region of interest in an interactive three-dimensional display, wherein the rendering means comprises simulation means for simulating movement along a center line through the isolated region of interest of the three-dimensional display and wherein the simulation means includes;

a. selection means for selecting a seed point which lies within the region of interest;

b. plane determining means for determining a plane of minimum area through the region of interest that passes through the seed point;

c. center point determining means for determining the center point of the region of interest that is dissected by the plane of minimum area; and

d. point selecting means for selecting a new point which is spaced from the previous center point in a perpendicular direction relative to the plane of minimum area.

50. A system for interactively displaying three-dimensional structures comprising:

a. volume formation means for forming a three-dimensional volume of data representing at least one physical property associated with a three-dimensional body;

b. isolation means for isolating a region of interest by comparing the value of each of a selected number of voxels in the volume of data to a value range of selected values of the physical property that represent the selected region of interest to remove those voxels having a value outside the selected value range; and

c. rendering means for rendering the isolated region of interest in an interactive three-dimensional display, wherein the rendering means comprises simulation means for simulating movement along a center line through the isolated region of interest of the three-dimensional display and wherein the simulation means includes;

a. erosion means for iteratively eroding the region of interest until all of the region of interest disappears, thereby determining the last portions of the region of interest to disappear; and

b. connection means for connecting the last portions of the region of interest to disappear by erosion.

51. A method for interactively displaying three-dimensional structures comprising the steps of:

a. forming a three-dimensional volume of data representing at least one physical property associated with a three-dimensional body;

b. isolating a selected region of interest by comparing the value of each of a selected number of voxels in the volume of data to a value range of selected values of the physical property that represent the selected region of interest to remove those voxels having a value outside the selected value range; and

c. rendering the isolated region of interest in an interactive three-dimensional display,

wherein the body comprises a colon and the rendering step comprises simulating movement along a line which passes along the center of the lumen of the colon, and wherein the step of simulating movement along the center line through the isolated region of interest of the three-dimensional display includes the steps of;

a. selecting a seed point which lies within the region of interest;

b. determining a plane of minimum area through the region of interest that passes through the seed point;

c. determining the center point of the region of interest that is dissected by the plane of minimum area; and

d. selecting a point which is spaced from the center point in a perpendicular direction relative to the plane of minimum area.

52. A method for interactively displaying three-dimensional structures comprising the steps of:

a. forming a three-dimensional volume of data representing at least one physical property associated with a three-dimensional body;

b. isolating a selected region of interest by comparing the value of each of a selected number of voxels in the volume of data to a value range of selected values of the physical property that represent the selected region of interest to remove those voxels having a value outside the selected value range; and

c. rendering the isolated region of interest in an interactive three-dimensional display,

wherein the body comprises a colon and the rendering step comprises simulating movement along a line which passes along the center of the lumen of the colon, and wherein the step of simulating movement along the center line includes the steps of;

a. iteratively eroding the region of interest until all of the region of interest disappears, thereby determining the last portions of the region of interest to disappear; and

b. connecting the last portions to disappear by erosion.

53. A method for interactively displaying three-dimensional structures comprising the steps of:

a. forming a three-dimensional volume of data representing at least one physical property associated with a three-dimensional body;

b. isolating a selected region of interest by comparing the value of each of a selected number of voxels in the volume of data to a value range of selected values of the physical property that represent the selected region of interest to remove those voxels having a value outside the selected value range; and

c. rendering the isolated region of interest in an interactive three-dimensional display,

wherein the body comprises a colon, and the rendering step comprises simulating movement along a line which passes along the center of the lumen of the colon and splitting the colon open in lengthwise sections and displaying the split open colon so that inner surfaces of the split open colon are visible, and wherein the rendering step comprises generating the split open sections along a line which passes along the center of the colon comprising the steps of;

a. selecting a seed point which lies within the region of interest;

b. determining a plane of minimum area through the region of interest that passes through the seed point;

c. determining the center point of the region of interest that is dissected by the plane of minimum area; and

d. selecting a point which is spaced from the center point in a perpendicular direction relative to the plane of minimum area.

54. A method for interactively displaying three-dimensional structures comprising the steps of:

a. forming a three-dimensional volume of data representing at least one physical property associated with a three-dimensional body;

b. isolating a selected region of interest by comparing the value of each of a selected number of voxels in the volume of data to a value range of selected values of the physical property that represent the selected region of interest to remove those voxels having a value outside the selected value range; and

c. rendering the isolated region of interest in an interactive three-dimensional display,

wherein the body comprises a colon, and the rendering step comprises simulating movement along a line which passes along the center of the lumen of the colon and splitting the colon open in lengthwise sections and displaying the split open colon so that inner surfaces of the split open colon are visible, and wherein the rendering step comprises generating the split open sections along a line which passes along the center of the colon comprising the steps of;

a. iteratively eroding the region of interest until all of the region of interest disappears, thereby determining the last portion of the region of interest to disappear; and

b. connecting the last portion of the region of interest to disappear by erosion.