Stereo display of tube-like structures and improved techniques therefor ("stereo display")

• US 20050148848A1
• Filed: 11/03/2004
• Published: 07/07/2005
• Est. Priority Date: 11/03/2003
• Status: Abandoned Application

• Current Assignee: Bracco Imaging S.p.A. (Bracco SPA)
• Original Assignee: Bracco Imaging S.p.A. (Bracco SPA)
• Inventors: Keong, Eugene Lee Chee, Kockro, Ralf Alfons, Guang, Yang
• Application Number:
  US10/981,058
• Publication Number:
  US 20050148848A1
• Time in Patent Office: Days
• US Class Current: 600/407
• CPC Class Codes: G06T 19/00 Manipulating 3D models or images for computer graphics
• CPC Class Codes: G06T 2210/41 Medical
• CPC Class Codes: G06T 2210/62 Semi-transparency
• CPC Class Codes: G06T 2219/028 Multiple view windows (top-side-front-sagittal-orthogonal)
• CPC Class Codes: G09B 23/285 for injections, endoscopy, bronchoscopy, sigmoidscopy, insertion of contraceptive devices or enemas

Abstract

Improved systems and methods for stereoscopically displaying and virtually viewing tube-like anatomical structures are presented. Stereoscopic display of such structures can provide a user with better depth perception of the structure being viewed and thus make a virtual examination more real. In exemplary embodiments according to the present invention, ray shooting, coupled with appropriate error correction techniques, can be utilized for dynamic adjustment of an eye convergence point for stereo display. In exemplary embodiments of the present invention, the correctness of a convergence point can be verified to avoid a distractive and uncomfortable visualization. Additionally, in exemplary embodiments of the present invention, convergence points in consecutive time frames can be compared. If rapid changes are detected, the system can compensate by interpolating transitional convergence points. In exemplary embodiments according to the present invention ray shooting can also be utilized to display occluded areas behind folds and protrusions in the inner colon wall. In exemplary embodiments according to the present invention, interactive display control functionalities can be mapped to a gaming-type joystick or other three-dimensional controller, freeing thereby a user from the limits of a two-dimensional computer interface device such as a standard mouse or trackball.

Claims

1. A method of virtually displaying a tube-like anatomical structure, comprising:

obtaining scan data of an area of interest of a body which contains a tube-like structure;

constructing a volumetric data set from the scan data;

virtually displaying some or all of the tube-like structure by processing the volumetric data set,

wherein the tube-like structure is displayed stereoscopically.

2. The method of claim 1, wherein a small segment of the tube-like structure is displayed in a main viewing window, and the inner wall of the entire tube-like structure is displayed transparently in an adjacent overall view window.

3. The method of claim 2, wherein the overall view window has additional visual aids including one of path traversed so far and current position within tube-like structure.

4. The method of claim 1, wherein the tube-like structure can be displayed using a variety of stereoscopic formats, including anaglyphic red-green stereo, anaglyphic red- blue stereo, anaglyphic red-cyan stereo, interlaced display and autostereoscopic display.

5. The method of claim 1, wherein a small segment of the tube-like structure is displayed at any given time in a fly-through interactive display.

6. The method of claim 1, wherein the wall of the tube-like structure is displayed using a variety of color lookup tables.

7. The method of claim 1, wherein the wall of the tube like structure is extracted from the volumetric data set based upon a difference in voxel intensity between the tube-like structure and the air within it.

8. The method of claim 1, wherein the tube-like structure is a human or mammalian colon.

9. The method of claim 1, wherein the tube-like structure is a human or mammalian artery or vascular structure.

10. A method of generating a centerline of a tube-like structure, comprising:

shooting a set of rays from a first viewpoint;

obtaining a set of points on the inner wall of the structure where the rays hit;

averaging the three-dimensional co-ordinates of the hit points to obtain a centerline point;

using the centerline point as the next viewpoint;

repeating the process until the end of the tube-like structure has been reached; and

connecting all of the centerline points.

11. The method of claim 10, wherein the tube-like structure is a colon and wherein the first viewpoint is at or near either the rectum or the cecum.

12. The method of claim 10, wherein after obtaining each centerline point, an additional set of rays are shot from it to verify its validity as a centerline point.

13. The method of claim 12, wherein the additional set of rays are shot from the tentative centerline point in directions perpendicular to the then current viewing direction.

14. The method of claim 13, wherein if as a result of the additional ray shooting the tentative centerline point is found not to be at a position equidistant from the colon wall the centerline point is moved to a corrected position.

15. A method of dynamically adjusting a stereoscopic convergence point for viewing a tube-like structure, comprising:

shooting a ray from a viewpoint along the direction of the viewpoint;

obtaining a point on the inner wall of the structure where the ray hits;

setting the hit point as the stereoscopic convergence point.

16. The method of claim 15, further comprising testing the stereoscopic convergence point by shooting additional rays from each eyepoint and analyzing their hit points.

17. The method of claim 15 wherein the process is repeated each time the viewpoint changes.

18. The method of claim 17, wherein if the co-ordinates of the stereoscopic convergence point change from one to the next in excess of a predetermined amount, one or more intermediate stereoscopic convergence points are interpolated between the prior stereoscopic convergence point and the next stereoscopic convergence point.

19. A method of optimizing user interaction with and control of a display of a tube-like organ obtained by volume rendering of a three-dimensional data set, comprising:

mapping navigation and control functions to one or more of a joystick and a 6D controller.

20. The method of claim 19, wherein the tube-like organ is a human colon, and the mapped functions include one or more of translation in each of three dimensions, yaw, pitch, clockwise roll, counterclockwise roll, guided moving toward cecum, guided moving towards rectum, manual moving towards, cecum, manual moving towards rectum, viewpoint direction, set starting point, set ending point and zoom.

21. A method of interactively virtually displaying a tube-like structure, comprising:

obtaining scan data of an area of interest of a body which contains a tube-like structure;

constructing a volumetric data set from the scan data;

virtually displaying some or all of the tube-like structure by processing the volumetric data set;

displaying the tube-like structure stereoscopically; and

using ray shooting techniques to;

calculate a centerline of the tube-like structure; and

dynamically adjust a stereo convergence point of a viewpoint as that viewpoint is moved within the tube-like structure.

22. The method of claim 21, wherein the viewpoint is automatically moved within the tube-like structure.

23. The method of claim 21, wherein the viewpoint is moved within the tube-like structure by the interactive control of a user.

24. The method of claim 21, wherein ray shooting techniques are additionally used to warn a user when the viewpoint is within a predetermined distance of an obstacle.

25. The method of claim 24, wherein ray shooting techniques are additionally used to detect one or more of folds in a wall of the tube-like structure and blind spots behind said folds.

26. The method of claim 25, wherein when the fold is detected it is set to be transparent when the viewpoint is within a predetermined distance of the fold.

27. A computer program product comprising a computer usable medium having computer readable program code means embodied therein, the computer readable program code means in said computer program product comprising means for causing a computer to:

obtain scan data of an area of interest of a body which contains a tube-like structure;

construct a volumetric data set from the scan data; and

virtually display some or all of the tube-like structure by processing the volumetric data set,

wherein the tube-like structure is displayed stereoscopically.

28. A program storage device readable by a machine, tangibly embodying a program of instructions executable by the machine to perform a method for virtually displaying a tube-like anatomical structure, said method comprising:

obtaining scan data of an area of interest of a body which contains a tube- like structure;

constructing a volumetric data set from the scan data;

virtually displaying some or all of the tube-like structure by processing the volumetric data set,

wherein the tube-like structure is displayed stereoscopically.

29. A computer program product comprising a computer usable medium having computer readable program code means embodied therein, the computer readable program code means in said computer program product comprising means for causing a computer to:

obtain scan data of an area of interest of a body which contains a tube-like structure;

construct a volumetric data set from the scan data;

virtually display some or all of the tube-like structure by processing the volumetric data set;

display the tube-like structure stereoscopically; and

use ray shooting techniques to;

calculate a centerline of the tube-like structure; and

dynamically adjust a stereo convergence point of a viewpoint as that viewpoint is moved within the tube-like structure.

30. A program storage device readable by a machine, tangibly embodying a program of instructions executable by the machine to perform a method for virtually displaying a tube-like anatomical structure, said method comprising:

obtaining scan data of an area of interest of a body which contains a tube-like structure;

constructing a volumetric data set from the scan data;

virtually displaying some or all of the tube-like structure by processing the volumetric data set;

displaying the tube-like structure stereoscopically; and

using ray shooting techniques to;

calculate a centerline of the tube-like structure; and

dynamically adjust a stereo convergence point of a viewpoint as that viewpoint is moved within the tube-like structure.