Insertion support system for specifying a location of interest as an arbitrary region and also appropriately setting a navigation leading to the specified region

• US 8,049,777 B2
• Filed: 04/27/2006
• Issued: 11/01/2011
• Est. Priority Date: 10/31/2003
• Status: Active Grant

• Current Assignee: Olympus Corporation
• Original Assignee: Olympus Corporation
• Inventors: Ishida, Takashi, Moriya, Hiroshi, Yamazaki, Koichi, Asano, Fumihiro, Akimoto, Shunya, Ohnishi, Junichi
• Primary Examiner(s): Patel; Jayanti K
• Assistant Examiner(s): TORRENTE, RICHARD T
• Application Number:
  US11/412,397
• Publication Number:
  US 20060195033A1
• Time in Patent Office: 2,014 Days
• Field of Search: 348/65
• US Class Current: 348/65
• CPC Class Codes: A61B 1/2676 Bronchoscopes
• CPC Class Codes: A61B 5/06 Devices, other than using radiation, for detecting or locating foreign bodies for removing same A61B17/50 ; determining position of probes within or on the body of the patient
• CPC Class Codes: A61B 6/00 Apparatus or devices for radiation diagnosis; Apparatus or devices for radiation diagnosis combined with radiation therapy equipment instruments measuring radiation intensity for application in the field of nuclear medicine, e.g. in vivo counting, G01T1/161; apparatus for taking X-ray photographs G03B42/02
• CPC Class Codes: A61B 90/10 for stereotaxic surgery, e.g. frame-based stereotaxis

Abstract

According to an insertion support system of the present invention, when a biopsy area is specified at a periphery of the bronchi, the barycenter of the biopsy area is extracted. A circle centering on the barycenter is determined as a search area. The search area is expanded until the bronchi are located within the search area. A point in the search area to which the bronchi first reach is determined as an end point. A first route choice connecting the end point and a start point is determined. If the first route choice has not been registered yet, the first route choice is registered as a first registered route. Accordingly, a location of interest can be specified as an arbitrary region, and navigation leading to the specified region is appropriately set.

Claims

1. A multi-planar reformatted image generating apparatus comprising:

a three-dimensional image data storing unit for obtaining three-dimensional image data of a subject obtained by reformatting, on the basis of image data of a plurality of cross-sectional images in a three-dimensional region of the subject, the plurality of cross-sectional image data, and storing the obtained three-dimensional image data;

a multi-planar reformatted image generating unit for generating at least one multi-planar reformatted image which is a two-dimensional image of the subject on the basis of image data of a three-dimensional region in the subject stored in the three-dimensional image data storing unit;

a luminal organ information extracting unit for extracting information concerning the shape of the three-dimensional region of a predetermined luminal organ, on the basis of the image data of the three-dimensional region in the subject stored in the three-dimensional image data storing unit;

an extracted luminal organ image superimposing unit for superimposing an extracted luminal organ image, in which a result of the luminal organ extraction obtained by the luminal organ information extracting unit is reflected, on a predetermined cross-sectional image in the at least one multi-planar reformatted image to correspond to the predetermined cross-sectional image in the multi-planar reformatted image; and

a route setting unit for setting a route for inserting an endoscope in a duct of the luminal organ, on a superimposed two-dimensional image wherein the extracted luminal organ image is superimposed on the multi-planar reformatted image.

2. The multi-planar reformatted image generating apparatus according to claim 1, comprising:

an extracted luminal organ image transparency changing unit for changing the transparency of the extracted luminal organ image superimposed on the multi-planar reformatted image.

3. The multi-planar reformatted image generating apparatus according to claim 2, comprising:

a multi-planar reformatted image transparency changing unit for changing the transparency of the multi-planar reformatted image on which the extracted luminal organ image is superimposed.

4. The multi-planar reformatted image generating apparatus according to claim 1, comprising:

a multi-planar reformatted image transparency changing unit for changing the transparency of the multi-planar reformatted image on which the extracted luminal organ image is superimposed.

5. The multi-planar reformatted image generating apparatus according to claim 1, further comprising:

an insertion support system comprising;

an input device for specifying, on the multi-planar reformatted image, an end point in a luminal organ in the subject and repeating to specify desired passing points up to a predetermined position; and

the route setting unit further for repeating to obtain a coordinate of the endpoint and coordinates of the desired passing points in the three-dimensional region, determining whether or not the end point and the desired passing points are in the luminal duct, registering the desired passing points between the end point and a desired start point where insertion support is to be started in the duct, performing an interpolation processing by interpolating a plurality of virtual points between the desired passing points at predetermined intervals, and deleting passing points not existing in the duct.

6. The insertion support system according to claim 5, comprising:

a luminal organ extracting unit for extracting segmentation, which is data of the shape of the three-dimensional region of the luminal organ, on the basis of the image data of the three-dimensional region in the subject; and

a coordinate position identifying unit for determining whether either one of the coordinate of the three-dimensional region of the end point specified by the end point coordinate specifying unit and the coordinate of the three-dimensional region of the passing point specified by the passing point coordinate specifying unit is located within the three-dimensional region occupied by the segmentation extracted by the luminal organ extracting unit.

7. The insertion support system according to claim 6, further comprising:

a luminal organ image generating unit for generating a three-dimensional image of the luminal organ on the basis of the segmentation extracted by the luminal organ extracting unit; and

a plotting unit for plotting the end point and the passing point on the three-dimensional image of the luminal organ generated by the luminal organ image generating unit.

8. The insertion support system according to claim 7, comprising:

an interpolation performing unit for performing interpolation between the end point and one of the passing points, between the passing points, and between another one of the passing points and the start point; and

a route setting unit for setting a result of the processing performed by the interpolation performing unit as a route connecting the start point and the end point.

9. The insertion support system according to claim 8,

wherein a marker indicating either one of the end point specified by the end point coordinate specifying unit and the passing point specified by the passing point coordinate specifying unit is superimposed on the multi-planar reformatted image.

10. The insertion support system according to claim 9,

wherein the marker includes:

a position mark portion for specifying the position of either one of the end point and the passing point; and

a region mark portion for indicating a predetermined region including the position of either one of the end point and the passing point.

11. The insertion support system according to claim 7,

wherein a marker indicating either one of the end point specified by the end point coordinate specifying unit and the passing point specified by the passing point coordinate specifying unit is superimposed on the multi-planar reformatted image.

12. The insertion support system according to claim 11,

wherein the marker includes:

a position mark portion for specifying the position of either one of the end point and the passing point; and

a region mark portion for indicating a predetermined region including the position of either one of the end point and the passing point.

13. The insertion support system according to claim 6, comprising:

an interpolation performing unit for performing interpolation between the end point and one of the passing points, between the passing points, and between another one of the passing points and the start point; and

a route setting unit for setting a result of the processing performed by the interpolation performing unit as a route connecting the start point and the end point.

14. The insertion support system according to claim 13,

wherein a marker indicating either one of the end point specified by the end point coordinate specifying unit and the passing point specified by the passing point coordinate specifying unit is superimposed on the multi-planar reformatted image.

15. The insertion support system according to claim 14,

wherein the marker includes:

a position mark portion for specifying the position of either one of the end point and the passing point; and

a region mark portion for indicating a predetermined region including the position of either one of the end point and the passing point.

16. The insertion support system according to claim 6,

wherein a marker indicating either one of the end point specified by the end point coordinate specifying unit and the passing point specified by the passing point coordinate specifying unit is superimposed on the multi-planar reformatted image.

17. The insertion support system according to claim 16,

wherein the marker includes:

a position mark portion for specifying the position of either one of the end point and the passing point; and

a region mark portion for indicating a predetermined region including the position of either one of the end point and the passing point.

18. The insertion support system according to claim 6,

wherein the multi-planar reformatted image generating unit is controlled to superimpose a segmentation image, in which the segmentation is reflected, on the multi-planar reformatted image.

19. The insertion support system according to claim 5, comprising:

an interpolation performing unit for performing interpolation between the end point and one of the passing points, between the passing points, and between another one of the passing points and the start point; and

a route setting unit for setting a result of the processing performed by the interpolation performing unit as a route connecting the start point and the end point.

20. The insertion support system according to claim 19,

wherein a marker indicating either one of the end point specified by the end point coordinate specifying unit and the passing point specified by the passing point coordinate specifying unit is superimposed on the multi-planar reformatted image.

21. The insertion support system according to claim 20,

wherein the marker includes:

a position mark portion for specifying the position of either one of the end point and the passing point; and

a region mark portion for indicating a predetermined region including the position of either one of the end point and the passing point.

22. The insertion support system according to claim 5,

wherein a marker indicating either one of the end point specified by the end point coordinate specifying unit and the passing point specified by the passing point coordinate specifying unit is superimposed on the multi-planar reformatted image.

23. The insertion support system according to claim 22,

wherein the marker includes:

a position mark portion for specifying the position of either one of the end point and the passing point; and

a region mark portion for indicating a predetermined region including the position of either one of the end point and the passing point.