Endoscope system

• US 8,894,566 B2
• Filed: 11/22/2013
• Issued: 11/25/2014
• Est. Priority Date: 03/06/2012
• Status: Active Grant

• Current Assignee: Olympus Corporation
• Original Assignee: Olympus Medical Systems Corporation (Olympus Corporation)
• Inventors: Ikuma, Soichi, Onishi, Junichi
• Primary Examiner(s): Nguyen, Anhtuan T
• Assistant Examiner(s): CHOU, WILLIAM B
• Application Number:
  US14/087,450
• Publication Number:
  US 20140088357A1
• Time in Patent Office: 368 Days
• Field of Search: 600/117, 600/118, 600/109, 600/110, 600/103, 600/139, 600/145, 600/146
• US Class Current: 600/117
• CPC Class Codes: A61B 1/00009 of image signals during a use of endoscope
• CPC Class Codes: A61B 1/0005 combining images e.g. side-by-side, superimposed or tiled
• CPC Class Codes: A61B 1/00194 adapted for three-dimensional imaging
• CPC Class Codes: A61B 6/12 Arrangements for detecting or locating foreign bodies
• CPC Class Codes: A61B 6/463 characterised by displaying multiple images or images and diagnostic data on one display
• CPC Class Codes: A61B 6/547 involving tracking of position of the device or parts of the device
• CPC Class Codes: G02B 23/2415 Stereoscopic endoscopes

Abstract

An endoscope system includes: an image processing portion that constructs three-dimensional data based on preoperative multi-slice image data and extracts a predetermined luminal organ; a position detection apparatus that acquires position information of an image pickup portion; a position alignment portion that makes position information of the image pickup portion correspond to coordinates of the three-dimensional data; and an image processing portion that generates trail information based on the position information of the image pickup portion, and based on a result of the position alignment portion, creates an image in which past trail information, insertion shape information including current distal end position information with respect to the image pickup portion, and determination information obtained by determining whether or not the image pickup portion passes through a duct in three-dimensional data of the predetermined luminal organ are superimposed in a distinguishable manner on three-dimensional image information of the predetermined luminal organ.

Claims

1. An endoscope system, comprising:

a storage portion that stores image information for constructing three-dimensional image information relating to a subject that is previously acquired;

a luminal organ extraction portion that, by constructing the three-dimensional image information based on the image information, extracts a predetermined luminal organ that is present in the three-dimensional image information;

an image pickup portion that picks up an image of inside the subject;

a position information acquisition portion that acquires position information of the image pickup portion;

a position alignment portion that makes the position information acquired by the position information acquisition portion correspond to position information of three-dimensional image coordinates of the predetermined luminal organ; and

an image processing portion that generates trail information based on the position information of the image pickup portion, and based on a result of the position alignment portion, creates an image in which current distal end position information of the image pickup portion and determination information indicating a place that an image pickup portion distal end reaches inside the predetermined luminal organ and a place that the image pickup portion distal end has not reached, which are determined from the trail information, in different display forms are superimposed in a distinguishable manner on three-dimensional image information of the predetermined luminal organ.

2. The endoscope system according to claim 1, further comprising a determination portion that, based on a result of the position alignment portion, determines whether or not the image pickup portion passes through a duct in the predetermined luminal organ.

3. The endoscope system according to claim 2, wherein the determination portion determines whether or not the image pickup portion passes through based on distance information regarding a distance between a past position and a current position of the image pickup portion distal end.

4. The endoscope system according to claim 1, further comprising a virtual endoscopic image generation portion that generates a virtual endoscopic image in which the predetermined luminal organ is endoscopically seen from a predetermined observation point,

wherein the image processing portion generates trail information based on the position information of the image pickup portion, and superimposes the trail information on the three-dimensional image information of the predetermined luminal organ, the virtual endoscopic image, or the image that is picked up by the image pickup portion, and displays the resulting image.

5. The endoscope system according to claim 1, wherein the image processing portion creates an image in which the determination information is superimposed in different colors.

6. The endoscope system according to claim 1, further comprising:

an X-ray image acquisition portion that acquires X-ray information that is obtained by irradiating the subject with X-rays; and

an extraction portion that extracts a predetermined structure from the X-ray information;

wherein;

the position alignment portion makes the predetermined structure correspond to the three-dimensional image information of the predetermined luminal organ; and

the image processing portion superimposes the predetermined structure on the three-dimensional image information of the predetermined luminal organ and displays the resulting information.

7. The endoscope system according to claim 6, further comprising a determination portion that determines whether or not the image pickup portion passes through the predetermined structure based on a result of the position alignment portion,

wherein if the determination portion determines that the image pickup portion passes through the predetermined structure, the image processing portion creates an image in which a display form of the predetermined structure is changed on the three-dimensional image information.

8. An endoscope system, comprising:

a storage portion that stores image information for constructing three-dimensional image information relating to a subject that is previously acquired;

a luminal organ extraction portion that, by constructing the three-dimensional image information based on the image information, extracts a predetermined luminal organ that is present in the three-dimensional image information;

an image pickup portion that picks up an image of inside the subject;

a position information acquisition portion that acquires position information of the image pickup portion;

a position alignment portion that, makes the position information acquired by the position information acquisition portion correspond to position information of three-dimensional image coordinates of the predetermined luminal organ;

a determination portion that, based on a result of the position alignment portion, determines whether or not the image pickup portion passes through a duct in the predetermined luminal organ by setting a point that is nearest to centerline data of the predetermined luminal organ in the three-dimensional image information to be a trail point with respect to respective position coordinates of an image pickup portion distal end; and

an image processing portion that, based on the result of the position alignment portion, generates trail information from the position information of the image pickup portion, and superimposes past trail information in the trail information on centerline data of a range in which the trail point exists, and creates an image in which insertion shape information including current distal end position information of the image pickup portion, and determination information which is obtained by determining whether or not the image pickup portion passes through a duct in the predetermined luminal organ are superimposed in a distinguishable manner on three-dimensional image information of the predetermined luminal organ.