Method and system for selecting at least one optimal view of a three dimensional image

• US 6,342,889 B1
• Filed: 03/12/1999
• Issued: 01/29/2002
• Est. Priority Date: 11/27/1998
• Status: Expired due to Term

• Current Assignee: Merge Healthcare Incorporated (International Business Machines Corporation)
• Original Assignee: Dicomit Dicom Information Technologies Corp.
• Inventors: Callahan, Terrance
• Primary Examiner(s): Zimmerman, Mark
• Assistant Examiner(s): Santiago, Enrique L
• Application Number:
  US09/266,891
• Time in Patent Office: 1,054 Days
• Field of Search: 345/419, 345/420, 345/421, 345/427, 345/437
• US Class Current: 345/427
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
• CPC Class Codes: G06T 19/00 Manipulating 3D models or images for computer graphics
• CPC Class Codes: G06T 2200/24 involving graphical user interfaces [GUIs]
• CPC Class Codes: G06T 2210/41 Medical
• CPC Class Codes: G06T 2219/008 Cut plane or projection plane definition

Abstract

A method and system for selecting at least one optimal view of a computer-generated three dimensional image. The three dimensional image is generated by mapping image properties onto a coordinate space modeled by the computer. Then, selected coordinates of the coordinate space are projected onto a display to show a view of the three dimensional image. Points of interest can be selected and the view can be changed to include projections of different selected coordinates of the coordinate space. After at least two points have been selected, at least one optimal view is determined so as to include the selected points, and is projected onto the display.

Claims

1. A method of selecting at least one optimal view of a selected sub-image of a three dimensional image generated from an image-defining array using a data processor having a coordinate space modeling means for modeling and manipulating a coordinate space, and a display for showing a plurality of views of the coordinate space, the image-defining array having a plurality of ordered image properties, each ordered image property in the plurality of ordered image properties having a unique associated coordinate in the coordinate space such that the three dimensional image is generated in the coordinate space by mapping each ordered image property in the plurality of ordered image properties onto the unique associated coordinate in the coordinate space, each view in the plurality of views having an associated view-defining subarray in the image-defining array, such that each view in the plurality of views is shown on the display by being generated in the coordinate space by mapping each ordered image property in the associated view-defining subarray onto the associated coordinate in the coordinate space and by being projected from the coordinated space onto the display, the method comprising the steps of

(a) selecting a plurality of selection points in the sub-image of interest from the plurality of views;

(b) determining the at least one optimal view in order to contain a maximum number of said plurality of selection points;

(c) showing the at least one optimal view on the display.

7. The method as defined in claim 1 wherein said plurality of selection points are selected automatically.

2. A method of selecting at least one optimal surface of a three dimensional image, the three dimensional image wherein

being generated in a coordinate space by an image-defining array having a plurality of ordered image properties, each ordered image property in the image-defining array having a unique associated spatial coordinate in the coordinate space such that each ordered image property is mappable to the unique associated spatial coordinate,

having a plurality of surfaces, each surface of the plurality of surfaces having an associated image-defining subarray in the image-defining array such that each surface of the plurality of surfaces is generated by mapping each ordered image property of the associated image-defining subarray onto the unique associated spatial coordinate, and

having a selected visible surface shown in a display, the selected visible surface being one of the plurality of surfaces of the three dimensional image;

the display

having a plurality of display coordinates,

selectably displaying views such that a series of distinct selected visible surfaces of the plurality of surfaces of the three dimensional image are viewable thereon, and

having an associated one-to-one projection means for protecting each selected visible surface of the three dimensional image onto the display, such that a view-specific one-to-one correspondence exists between each display coordinate and the spatial coordinate projected thereon;

the method being implemented using a data processor having

a memory, the memory having access to the image-defining array,

a coordinate space modeling means loaded in memory for modeling and manipulating the coordinate space, the coordinate space modeling means being responsive to a group of commands to

(1) rotate the coordinate space;

(2) translate a selected visible surface of the coordinate space; and

,

(3) pivot a selected visible surface about an arbitrary axis on the selected visible surface;

a user interface means for selecting commands from the group of commands, the user interface means communicating with the coordinate space modeling means to relay selected commands to the coordinate space modeling means; and

mapping means operable for each visible surface of the three dimensional image to map each ordered image property of the associated image-defining subarray for each visible surface onto the unique associated spatial coordinate in the coordinate space to generate the visible surface of the three dimensional image;

such that the at least one optimal surface includes at least two spatial coordinates of interest;

the method comprising

(a) interacting with the coordinate space via the user interface means and the coordinate space modeling means to generate a series of views of the three dimensional image in the display, each view including at least one selected visible surface of the three dimensional image;

(b) selecting a plurality of spatial coordinates of interest from said series of views, each spatial coordinate of interest in said plurality of spatial coordinates of interest being selected by selecting a display coordinate in an associated view in said series of views using the user interface means, and by determining the spatial coordinate of interest based on said associated view and the view-specific one-to-one correspondence between said selected display coordinate and said spatial coordinate of interest mapped thereon;

(c) manipulating the coordinate space via the coordinate space modeling means to orient a selected visible surface of the coordinate space, such that the selected visible surface of the coordinate space corresponds to said at least one optimal surface;

and wherein

the three dimensional image includes a selected sub-image of interest;

step (a) comprises interacting with the coordinate space via the user interface means and the coordinate space modeling means to generate a series of sub-image views of said selected sub-image in the display; and

said plurality of spatial coordinates of interest are selected from said series of sub-image views.

3. The method as defined in claim 2 wherein

said selected sub-image of interest is a blood vessel;

each of said series of sub-image views is a cross-sectional view of the blood vessel; and

,

said plurality of spatial coordinates of interest are selected to define a line extending lengthwise within the blood vessel.

4. The method as defined in claim 3 wherein

the at least one optimal surface includes two orthogonal optimal surfaces,

step (c) comprises manipulating the coordinate space via the coordinate space modeling means to orient two selected visible surfaces of the coordinate space to be aligned with said two orthogonal optimal surfaces.

5. The method as defined in claim 4 wherein said two orthogonal optimal surfaces are concurrently projected onto the display.

6. The method as defined in claim 3 wherein step (c) comprises manipulating the coordinate space modeling means to orient a sequence of selected contiguous surfaces of the coordinate space into alignment with the at least one optimal surface, each of said sequence of selected contiguous surfaces being projected onto the display in succession to provide a moving view along the length of the blood vessel.

8. A system for selecting at least one optimal view of a selected sub-image of a three dimensional image generated from an image-defining array using a data processor having a coordinate space modeling means for modeling and manipulating a coordinate space, and a display for showing a plurality of views of the coordinate space, the image-defining array having a plurality of ordered image properties, each ordered image property in the plurality of ordered image properties having a unique associated coordinate in the coordinate space such that the three dimensional image is generated in the coordinate space by mapping each ordered image property in the plurality of ordered image properties onto the unique associated coordinate in the coordinate space, each view in the plurality of views having an associated view-defining subarray in the image-defining array such that each view in the plurality of views is shown on the display by being generated in the coordinate space by mapping each ordered image property in the associated view-defining subarray onto the associated coordinate in the coordinate space and by being projected from the coordinated space onto the display, the system comprising:

(a) selection means for selecting a plurality of selection points in the sub-image of interest from the plurality of views; and

,

(b) optimal view generation means for generating the at least one optimal view to contain a maximum number of said plurality of selection points.

14. The system as defined in claim 8 further comprising

recognition means for recognizing the sub-image of interest; and,

automatic point selection means for automatically selecting said plurality of selection points.

9. A system for selecting at least one optimal surface of a three dimensional image wherein

generated in a coordinate space by an image-defining array having a plurality of ordered image properties, each ordered image property in the image-defining array having a unique associated spatial coordinate in the coordinate space such that each ordered image property is mappable to the unique associated spatial coordinate,

having a plurality of surfaces, each surface of the plurality of surfaces having an associated image-defining subarray in the image-defining array such that each surface of the plurality of surfaces is generated by mapping each ordered image property of the associated image-defining subarray onto the unique associated spatial coordinate, and

having a selected visible surface shown in a display, the selected visible surface being one of the plurality of surfaces of the three dimensional image;

the display

having a plurality of display coordinates,

selectably displaying views such that a series of distinct selected visible surfaces of the plurality of surfaces of the three dimensional image are viewable thereon, and

having an associated one-to-one projection means for projecting each selected visible surface of the three dimensional image onto the display, such that a view-specific one-to-one correspondence exists between each display coordinate and the spatial coordinate projected thereon;

the three dimensional image being generated using a data processor having

a memory, the memory having access to the image-defining array;

a coordinate space modeling means loaded in memory for modeling and manipulating the coordinate space, the coordinate space modeling means being responsive to a group of commands to

(1) rotate the coordinate space;

(2) translate a selected visible surface of the coordinate space; and

,

(3) pivot a selected visible surface about an arbitrary axis on the selected visible surface;

a user interface means for selecting commands from the group of commands, the user interface means communicating with the coordinate space modeling means to relay selected commands to the coordinate space modeling means; and

mapping means operable for each visible surface of the three dimensional image to map each ordered image property of the associated image-defining subarray for each visible surface onto the unique associated spatial coordinate in the coordinate space to generate the visible surface of the three dimensional image;

such that the at least one optimal surface includes at least two spatial coordinates of interest;

the system comprising

(a) coordinate selection means operable to select a plurality of spatial coordinates of interest from a series of views generated using user interface means and the coordinate space modeling means, each view including at least one selected visible surface of the three dimensional image, each spatial coordinate of interest in said plurality of spatial coordinates of interest being selected by selecting a display coordinate in an associated view in said series of views using the user interface means, and by determining the spatial coordinate of interest based on said associated view and the view-specific one-to-one correspondence between said selected display coordinate and said spatial coordinate of interest mapped thereon;

(b) optimal surface generation means operable to manipulate the coordinate space via the coordinate space modeling means to orient a selected visible surface of the coordinate space, such that the selected visible surface of the coordinate space corresponds to said at least one optimal surface;

and wherein

the three dimensional image includes a selected sub-image of interest;

said user interface means and said coordinate space modeling means are operable to generate a series of sub-image views of said selected sub-image;

said coordinate selection means is operable to select said plurality of spatial coordinates of interest from said series of sub-image views.

10. The system as defined in claim 9 wherein

said selected sub-image of interest is a blood vessel;

said user interface means and said coordinate space modeling means are operable to generate said series of sub-image views as a plurality of cross-sectional views of the blood vessel; and

,

said plurality of spatial coordinates of interest are selected to define a line extending lengthwise within the blood vessel.

11. The system as defined in claim 10 wherein

the at least one optimal surface includes two orthogonal optimal surfaces;

said optimal surface generation means is operable to manipulate the coordinate space via the coordinate space modeling means to orient two selected visible surfaces of the coordinate space to be aligned with the two orthogonal optimal surfaces.

12. The system as defined in claim 11 wherein said display and said associated one-to-one projection means are operable to concurrently project said two orthogonal optimal surfaces onto the display.

13. The system as defined in claim 10 wherein

said coordinate space modeling means is operable to orient a sequence of selected contiguous surfaces of the coordinate space into alignment with the at least one optimal surface, and,

said one-to-one projection means is operable to successively project each of said sequence of selected contiguous surfaces onto the display to provide a moving view along the length of the blood vessel.