IMAGE PROCESSING SYSTEM, IMAGE PROCESSING APPARATUS, AND IMAGE PROCESSING METHOD

• US 20140071132A1
• Filed: 11/15/2013
• Published: 03/13/2014
• Est. Priority Date: 05/16/2011
• Status: Active Grant

• Current Assignee: Toshiba Medical Systems Corporation (Canon Inc.)
• Original Assignee: Toshiba Medical Systems Corporation (Canon Inc.), Kabushiki Kaisha Toshiba (Toshiba Corporation)
• Inventors: NOSHI, Yasuhiro, MAEDA, Tatsuo, ADACHI, Akira, HARA, Takumi
• Granted Patent: US 9,542,771 B2
• Time in Patent Office: Days
• US Class Current: 345/427
• CPC Class Codes: A61B 6/022 Stereoscopic imaging
• CPC Class Codes: A61B 6/466 adapted to display 3D data
• CPC Class Codes: A61B 6/5211 involving processing of medical diagnostic data
• CPC Class Codes: A61B 8/466 adapted to display 3D data 3D imaging and stereoscopic displays in devices for short-range imaging with acoustic waves G01S15/8993 and G01S7/52068, respectively; 3D image rendering G06T15/00; manipulating 3D models for computer graphics G06T19/00
• CPC Class Codes: A61B 8/483 involving the acquisition of a 3D volume of data
• CPC Class Codes: A61B 8/5215 involving processing of medical diagnostic data
• CPC Class Codes: G06T 15/08 Volume rendering
• CPC Class Codes: G16H 50/20 for computer-aided diagnosis, e.g. based on medical expert systems
• CPC Class Codes: H04N 13/275 from 3D object models, e.g. computer-generated stereoscopic image signals
• CPC Class Codes: H04N 13/282 for generating image signals corresponding to three or more geometrical viewpoints, e.g. multi-view systems

Abstract

An image processing system according to an embodiment includes a stereoscopic display apparatus, a rendering processor, and a display controller. The stereoscopic display apparatus displays a stereoscopic image enabled for a stereoscopic vision using a plurality of parallax images. The rendering processor generates a plurality of parallax images by applying a rendering process to volume data that is three-dimensional medical image data from a plurality of viewpoint positions having different relative positions with respect to the volume data. The display controller causes the stereoscopic display apparatus to display a graphic image that is an image of a given graphic indicating a depth-direction position of a cursor that is operable by a given input unit in a three-dimensional stereoscopic image space in which a stereoscopic image is displayed, together with the parallax images.

Claims

1. An image processing system comprising:

a stereoscopic display apparatus configured to display a stereoscopic image enabled for a stereoscopic vision using a plurality of parallax images;

a rendering processor configured to generate a plurality of parallax images by applying a rendering process to volume data that is three-dimensional medical image data, from a plurality of viewpoint positions having different relative positions with respect to the volume data; and

a display controller configured to cause the stereoscopic display apparatus to display a graphic image that is an image of a given graphic indicating a depth-direction position of a cursor that is operable by a given input unit in a three-dimensional stereoscopic image space in which a stereoscopic image is displayed on the stereoscopic display apparatus, together with the parallax images generated by the rendering processor.

2. The image processing system according to claim 1, further comprising:

a graphic image generator configured to generate a plurality of graphic images by generating three-dimensional graphic data by plotting image data of the given graphic indicating the depth-direction position of the cursor in a cursor virtual space that is a three-dimensional space represented by a same coordinate system as that of the volume data and in which position information of the cursor is managed, and applying a rendering process to the three-dimensional graphic data thus generated from the viewpoint positions, wherein

the display controller is configured to cause the stereoscopic display apparatus to display superimposed images in which, over the parallax images generated by the rendering processor, the respective graphic images generated by the graphic image generator and having a matched viewpoint position are superimposed.

3. The image processing system according to claim 1, further comprising:

a graphic image generator configured to generate three-dimensional graphic data by plotting image data of the given graphic indicating the depth-direction position of the cursor in a cursor virtual space that is a three-dimensional space represented by a same coordinate system as that of the volume data and in which position information of the cursor is managed, wherein

the rendering processor is configured to generate the parallax images by applying a rendering process to volume data in which the three-dimensional graphic data generated by the graphic image generator is synthesized with the volume data, from the viewpoint positions.

4. The image processing system according to claim 2, wherein

the graphic image generator is configured

to generate the three-dimensional graphic data based on a position of an image of a region in a subject represented by the volume data, by plotting image data of a line connecting the cursor and the image of the region, as the image data of the given graphic, on a plane at a same depth-direction position as the cursor in the cursor virtual space.

5. The image processing system according to claim 2, wherein the graphic image generator is configured to generate the three-dimensional graphic data based on a position of an image of a region in a subject represented by the volume data, by plotting image data of a plane including the position of the cursor and the position of the image of the region, as the image data of the given graphic, on a plane at a same depth-direction position as the cursor in the cursor virtual space.

6. The image processing system according to claim 5, wherein the graphic image generator is configured to generate the three-dimensional graphic data by plotting image data of a plane including the position of the cursor and the position of the image of the region, and image data of a perpendicular plane perpendicularly intersecting with the plane, as the image data of the given graphic, in the cursor virtual space.

7. The image processing system according to claim 1, further comprising:

an operation controller configured to enable the cursor to be moved between positions in the cursor virtual space in which the image data of the given graphic is plotted by the graphic image generator in response to a given operation performed while a stereoscopic image is displayed on the stereoscopic display apparatus.

8. The image processing system according to claim 2, wherein the graphic image generator is configured to generate the three-dimensional graphic data based on a position of an image of a region in a subject represented by the volume data, by plotting image data of a contour line indicating a depth-direction component to a position corresponding to a surface of the image of the region in the cursor virtual space.

9. The image processing system according to claim 2, wherein the graphic image generator is configured to generate the three-dimensional graphic data by plotting image data of a cursor that is applied with a different color corresponding to the depth-direction position of the cursor, as the image data of the given graphic, in the cursor virtual space.

10. The image processing system according to claim 9, wherein the graphic image generator is configured to generate the three-dimensional graphic data by plotting image data of a graphic indicating a distribution of colors that are applied to the cursor corresponding to the depth-direction position, the image data having a shape extending in the depth direction, in the cursor virtual space.

11. The image processing system according to claim 2, further comprising:

a light source setting module configured to set a virtual light source that is a virtual light source to a given position in the cursor virtual space, wherein

the graphic image generator is configured, when an image of a region in a subject represented by the volume data is present between the virtual light source set by the light source setting module and the cursor, to generate the three-dimensional graphic data by plotting image data of the cursor on which a shadow of the image of the region is projected in the cursor virtual space.

12. The image processing system according to claim 11, wherein the graphic image generator is configured to change lightness of the shadow of the image of the region projected on the cursor depending on a distance between the cursor and the image of the region.

13. The image processing system according to claim 2, wherein the display controller is configured to display the stereoscopic image with lightness or contrast varied in radial directions, centering on the position of the cursor in response to a given operation.

14. The image processing system according to claim 13, wherein the display controller is configured to display the stereoscopic image so that lightness or contrast of a given area including the position of the cursor is varied in response to a given operation.

15. The image processing system according to claim 2, wherein the display controller is configured to display a given area including the position of the cursor and an area other than the given area in different colors, contrast, or lightness in response to a given operation.

16. An image processing apparatus comprising:

a stereoscopic display apparatus configured to display a stereoscopic image enabled for a stereoscopic vision using a plurality of parallax images;

a rendering processor configured to generate a plurality of parallax images by applying a rendering process to volume data that is three-dimensional medical image data from a plurality of viewpoint positions having different relative positions with respect to the volume data; and

a display controller configured to cause the stereoscopic display apparatus to display a graphic image that is an image of a given graphic indicating a depth-direction position of a cursor that is operable by a given input unit in a three-dimensional stereoscopic image space in which a stereoscopic image is displayed on the stereoscopic display apparatus, together with the parallax images generated by the rendering processor.

17. An image processing method executed by an image processing system including a stereoscopic display apparatus that displays a stereoscopic image enabled for a stereoscopic vision using a plurality of parallax images, the image processing method comprising:

generating a plurality of parallax images by applying a rendering process to volume data that is three-dimensional medical image data from a plurality of viewpoint positions having different relative positions with respect to the volume data; and

displaying a graphic image that is an image of a given graphic indicating a depth-direction position of a cursor that is operable by a given input unit in a three-dimensional stereoscopic image space in which a stereoscopic image is displayed on the stereoscopic display apparatus, together with the parallax images generated, on the stereoscopic display apparatus.