Endoscope system with insertion support apparatus

• US 9,326,660 B2
• Filed: 09/16/2014
• Issued: 05/03/2016
• Est. Priority Date: 03/12/2013
• Status: Active Grant

• Current Assignee: Olympus Corporation
• Original Assignee: Olympus Corporation
• Inventors: Onishi, Junichi, Ito, Mitsuhiro, Akimoto, Syunya
• Primary Examiner(s): Leubecker, John P
• Application Number:
  US14/487,611
• Publication Number:
  US 20150057498A1
• Time in Patent Office: 595 Days
• US Class Current: 1/1
• CPC Class Codes: A61B 1/00009 of image signals during a use of endoscope
• CPC Class Codes: A61B 1/0002 provided with data storages
• CPC Class Codes: A61B 1/00043 provided with output arrangements
• CPC Class Codes: A61B 1/0005 combining images e.g. side-by-side, superimposed or tiled
• CPC Class Codes: A61B 1/00147 Holding or positioning arrangements
• CPC Class Codes: A61B 1/05 characterised by the image sensor, e.g. camera, being in the distal end portion
• CPC Class Codes: A61B 1/2676 Bronchoscopes
• CPC Class Codes: A61B 2034/2065 Tracking using image or pattern recognition
• CPC Class Codes: A61B 5/065 Determining position of the probe employing exclusively positioning means located on or in the probe, e.g. using position sensors arranged on the probe
• CPC Class Codes: A61B 6/032 Transmission computed tomography [CT]
• CPC Class Codes: A61B 6/5223 generating planar views from image data, e.g. extracting a coronal view from a 3D image
• CPC Class Codes: G06T 19/003 Navigation within 3D models or images
• CPC Class Codes: G06T 2210/41 Medical

Abstract

An endoscope system includes: an image storage section that stores image information associated with position information of a luminal organ of a subject; a virtual endoscopic image generating section that generates a virtual endoscopic image endoscopically depicted; an image pickup section that picks up an image in the luminal organ; a position registration processing section that compares the virtual endoscopic image and an endoscopic image, and extracts an virtual endoscopic image similar to the endoscopic image; a position estimation section that estimates a distal end position of an endoscope insertion portion; a feature region determination section that determines whether or not the distal end position exists in a feature region; a storage section that stores information for presentation; and a candidate information presentation control section that presents the virtual endoscopic image based on the information in the storage section, to a display section as candidate information.

Claims

1. An endoscope system comprising:

an image storage section that stores image information associated with position information of a luminal organ of a subject;

a virtual endoscopic image generating section that generates a virtual endoscopic image endoscopically depicted from an arbitrary view point position based on the image information;

an image pickup section that is provided in an endoscope and picks up an image in the luminal organ of the subject;

a position registration processing section that compares the virtual endoscopic image generated by the virtual endoscopic image generating section and an endoscopic image generated by image pickup by the image pickup section, and extracts an virtual endoscopic image similar to the endoscopic image;

a position estimation section that estimates a distal end position of an endoscope insertion portion in the luminal organ of the subject based on position information associated with the virtual endoscopic image extracted by the position registration processing section;

a feature region determination section that determines whether or not the distal end position of the endoscope insertion portion estimated by the position estimation section exists in a feature region related to a branch in the luminal organ;

a storage section that stores, when it is determined that the distal end position of the endoscope insertion portion exists in the feature region by the feature region determination section, the distal end position of the endoscope insertion portion estimated by the position estimation section; and

a candidate information presentation control section that, when the position registration processing section fails to extract a virtual endoscopic image similar to the endoscopic image, presents the virtual endoscopic image corresponding to the distal end position of the endoscope insertion portion which is determined to exist within the feature region by the feature region determination section based on the distal end position of the endoscope insertion portion stored in the storage section, to a display section as candidate information.

2. An endoscope system according to claim 1, further comprising:

a luminal organ extracting section that extracts a specified luminal organ from the image information and generates a three-dimensional luminal organ image; and

a route data generating section that generates route data from an insertion start position to a target position in at least the specified luminal organ based on the image information,

wherein the candidate information presentation control section superimposes the route data on the three-dimensional luminal organ image or a two-dimensional tomographic image which is obtained by cutting the image information in an arbitrary direction, and presents the candidate information upon the route data or in a vicinity of the route data.

3. An endoscope system according to claim 2, comprising a storage limiting section that limits storage of the distal end position of the endoscope insertion portion within a limit distance which is set in accordance with a distance between adjacent branch points in the specified luminal organ when storing the distal end position of the endoscope insertion portion in the storage section.

4. An endoscope system according to claim 1, wherein the feature region determination section determines whether or not the distal end position of the endoscope insertion portion exists in the feature region based on a distance between the distal end position of the endoscope insertion portion and a branch portion at which the lumen branches in the luminal organ.

5. An endoscope system according to claim 1, wherein the candidate information presentation control section presents candidate position information about the distal end position of the endoscope insertion portion corresponding to the virtual endoscopic image in addition to the virtual endoscopic image.

6. An endoscope system according to claim 5, wherein the candidate information presentation control section presents the candidate position information as the candidate information when a position of a distal end of the endoscope insertion portion is moved away from the route data by a predetermined distance.

7. An endoscope system according to claim 1, wherein the candidate information presentation control section presents information of a line of sight of an objective optical system at a distal end of the endoscope insertion portion as the candidate information in addition to the virtual endoscopic image.

8. An endoscope system according to claim 1, wherein the candidate information presentation control section presents information of an inner diameter of the lumen calculated from the endoscopic image as the candidate information in addition to the virtual endoscopic image.

9. An endoscope system according to claim 1, wherein the position estimation section estimates the distal end position of the endoscope insertion portion using a sensor provided at a distal end of the endoscope insertion portion.

10. An endoscope system according to claim 1, wherein the storage section further stores the endoscopic image corresponding to the distal end position of the endoscope insertion portion.

11. An endoscope system according to claim 1, wherein the storage section stores the distal end position of the endoscope insertion portion to include information of numbers stored to be respectively ordered in different feature regions so as to limit the number of pieces of the information which are read from the storage section and presented as the candidate information by the candidate information presentation control section.

12. An endoscope system according to claim 1, wherein the storage section further stores a virtual endoscopic image corresponding to the distal end position of the endoscope insertion portion.