Virtual internal cavity inspection system

• US 5,611,025 A
• Filed: 11/23/1994
• Issued: 03/11/1997
• Est. Priority Date: 11/23/1994
• Status: Expired due to Term

• Current Assignee: General Electric Company
• Original Assignee: General Electric Company
• Inventors: Lorensen, William E., Jolesz, Ferenc A., Kikinis, Ron
• Primary Examiner(s): Zimmerman, Mark K.
• Assistant Examiner(s): Fetting, Anton W.
• Application Number:
  US08/344,445
• Time in Patent Office: 839 Days
• Field of Search: 395/119, 395/120, 395/124, 395/152, 128/653.1, 128/653.2, 128/660.01, 434/262, 364/413.13, 364/413.14
• US Class Current: 345/419
• CPC Class Codes: G09B 23/285 for injections, endoscopy, bronchoscopy, sigmoidscopy, insertion of contraceptive devices or enemas

Abstract

A virtual internal cavity inspection system non-invasively provides images of cavities of a subject from a viewpoint within the cavity. An acquisition unit acquires imaging information about internal structures of a subject. This imaging information is segmented into separate structures, and a 3D surface model is constructed. An operator views an image of the 3D model to select a goal viewpoint and a start viewpoint. A viewpoint path is created linking the start viewpoint and the goal viewpoint. Images are created with a viewpoints along the viewpoint path. A variety of additional visualization techniques aid the viewer'"'"'s localization of the current image viewpoint, and its relation to the subject.

Claims

1. A method of simulating endoscopy comprising the steps of:

a) acquiring image information of internal structures of a subject;

b) creating a three-dimensional (3D) surface model of the image information;

c) selecting a start viewpoint in an internal cavity;

d) selecting a goal viewpoint in the internal cavity;

e) calculating a viewpoint path around obstacles linking the start point and the goal point by;

i. calculating a distance, passing around obstacles as a wavefront would travel, from each voxel of the surface model to the goal viewpoint,

ii. labeling each voxel with its calculated distance,

iii. setting a voxel containing the start point as the current voxel,

iv. adding the current voxel to the viewpoint path,

v. determining a voxel adjacent the current voxel having the lowest labeled distance value,

vi. setting the voxel with the lowest labeled distance value to the current voxel, and

vii. repeating steps "iv"-"vi" until a voxel containing the goal viewpoint is reached;

f) creating a plurality of internal images having viewpoints along the viewpoint path; and

g) displaying the images in sequential fashion according to position along the viewpoint path thereby simulating endoscopy.

2. The method of claim 1 wherein the step of calculating a viewpoint path comprises the steps of:

a) displaying to an operator images of the 3D model;

b) interacting with the operator to select viewpoints between the start and goal viewpoints, being keyframes, which the viewpoint path is to pass through; and

c) fitting the start viewpoint, the goal viewpoint and intermediate keyframes into a smoothed viewpoint path.

3. The method of claim 1 further comprising the steps of:

a) selecting a viewpoint outside of the viewpoint path;

b) producing another image with a field-of-view substantially larger than the internal images produced with a viewpoint along the viewpoint path to act as a `map image`;

c) displaying an arbitrary symbol on the map image indicating the viewpoint being used to create the currently displayed internal image.

4. The method of claim 1 further comprising the steps of:

a) producing cross-sectional image from the image information of internal structures of the subject having a field-of-view substantially larger than the internal images produced with a viewpoint along the viewpoint path to act as a `map image`; and

b) displaying an arbitrary symbol on the cross-sectional image indicating the viewpoint being used to create the currently displayed internal image.

5. The method of claim 1 wherein:

a) a plurality of stereoscopic pairs of internal images are created having viewpoints along the viewpoint path; and

b) the stereoscopic pairs are provided to the operator in a sequential fashion according to position along the viewpoint path thereby simulating stereoscopic endoscopy.

6. A virtual inspection system for viewing internal cavities of a subject comprising:

a) a memory for storing image information;

b) a three-dimensional (3D) model display means coupled to the memory for displaying the image information stored in the memory as viewed from selected viewpoints along a viewpoint path;

c) a graphical interface for interacting with an operator to define start and goal viewpoints within an internal cavity;

d) navigation volume calculation unit coupled to the memory for determining distances around obstacles as a wavefront would propagate, from each voxel through said cavity to the goal viewpoint and for creating a navigation volume having voxels each labeled with its corresponding distance;

e) a path calculation unit coupled to the memory for determining a shortest distance around obstacles between the start viewpoint and the goal viewpoint being the viewpoint path, and storing this path in the memory allowing the 3D model display means to create a series of images as viewed from points along this calculated viewpoint path.

7. The virtual inspection system of claim 6 further comprising a path smoothing unit coupled to the memory for smoothing the viewpoint path before the 3D model display means creates the series of images.