ENDOSCOPE SYSTEM

• US 20150196228A1
• Filed: 03/27/2015
• Published: 07/16/2015
• Est. Priority Date: 04/15/2013
• Status: Active Grant

• Current Assignee: Olympus Corporation
• Original Assignee: Olympus Medical Systems Corporation (Olympus Corporation)
• Inventors: AKIMOTO, Syunya, ONISHI, Junichi, ITO, Mitsuhiro
• Granted Patent: US 9,357,945 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: A61B 1/00009 of image signals during a use of endoscope
• CPC Class Codes: A61B 1/00147 Holding or positioning arrangements
• CPC Class Codes: A61B 1/05 characterised by the image sensor, e.g. camera, being in the distal end portion
• CPC Class Codes: A61B 2034/2065 Tracking using image or pattern recognition
• CPC Class Codes: A61B 2090/365 augmented reality, i.e. correlating a live optical image with another image
• CPC Class Codes: A61B 2090/373 using light, e.g. by using optical scanners
• CPC Class Codes: A61B 5/061 Determining position of a probe within the body employing means separate from the probe, e.g. sensing internal probe position employing impedance electrodes on the surface of the body A61B1/00158 takes precedence
• CPC Class Codes: A61B 5/065 Determining position of the probe employing exclusively positioning means located on or in the probe, e.g. using position sensors arranged on the probe
• CPC Class Codes: A61B 90/37 Surgical systems with images on a monitor during operation

Abstract

An endoscope system includes: a position and posture calculating portion that estimates a position of a distal end and a longitudinal direction of a distal end portion; a condition determining portion that, based on the shape information at the position of the distal end that is estimated, determines whether or not an angle that a core line direction of the luminal organ and the longitudinal direction estimated by the position and posture calculating portion form is equal to or less than a predetermined threshold value; and a position and posture information recording portion that, when the angle that the core line direction and the longitudinal direction form is equal to or less than the predetermined threshold value, records information regarding the position and the longitudinal direction of the distal end.

Claims

1. An endoscope system capable of previously acquiring shape information that is associated with positional information regarding a luminal organ of a subject, comprising:

a position and posture calculating portion that estimates a position of a distal end of an endoscope insertion portion and a longitudinal direction of a distal end portion of the endoscope insertion portion;

a condition determining portion that, based on the shape information at a position of the distal end of the endoscope insertion portion estimated by the position and posture calculating portion, determines whether or not an angle that a core line direction of a core line that is positioned at approximately a center of the luminal organ and a longitudinal direction of the distal end portion of the endoscope insertion portion that is estimated by the position and posture calculating portion is equal to or less than a predetermined threshold value; and

a position and posture information recording portion configured to, in a case where an angle that the core line direction and the longitudinal direction of the distal end portion of the endoscope insertion portion form is equal to or less than a predetermined threshold value, record information regarding the position of the distal end of the endoscope insertion portion and the longitudinal direction of the distal end portion of the endoscope insertion portion that is estimated by the position and posture calculating portion.

2. The endoscope system according to claim 1, wherein:

the position and posture calculating portion further estimates a posture of the distal end portion of the endoscope insertion portion that includes a longitudinal direction of the distal end portion of the endoscope insertion portion; and

in a case where an angle that the core line direction and the longitudinal direction of the distal end portion of the endoscope insertion portion form is equal to or less than a predetermined threshold value, the position and posture information recording portion records information regarding a position of the distal end of the endoscope insertion portion and a posture of the distal end portion of the endoscope insertion portion that is estimated by the position and posture calculating portion.

3. The endoscope system according to claim 2, further comprising:

a direction comparing portion that compares the core line direction of the luminal organ of the subject and a longitudinal direction of the distal end portion of the endoscope insertion portion;

wherein;

the direction comparing portion performs a comparison between a past longitudinal direction that is based on information regarding the longitudinal direction that is recorded in the past in the position and posture information recording portion and a current longitudinal direction that is estimated by the position and posture calculating portion; and

the positional information recording portion records information regarding a position and a posture of the distal end of the endoscope insertion portion in a case where an angle that the past longitudinal direction that is obtained by the direction comparing portion and the current longitudinal direction that is estimated by the position and posture calculating portion form is greater than a second predetermined threshold value.

4. The endoscope system according to claim 3, wherein the direction comparing portion performs a comparison between the core line direction and the longitudinal direction in a case where a movement distance of the distal end of the endoscope insertion portion in the luminal organ is greater than or equal to a predetermined distance interval.

5. The endoscope system according to claim 3, comprising an image pickup portion that is provided in the endoscope and is configured to pick up an image of inside of the luminal organ, and further comprising:

a direction change detecting portion configured to detect a change in a direction of an endoscopic image that is acquired by the image pickup portion;

wherein the position and posture information recording portion records information regarding a position and a posture of the distal end of the endoscope insertion portion in a case where a change that is greater than or equal to a threshold value is detected with respect to an angle formed by a direction of the endoscopic image that is detected by the direction change detecting portion and a direction of an endoscopic image that is recorded in the position and posture information recording portion.

6. The endoscope system according to claim 2, the endoscope system being capable of previously acquiring image information corresponding to the shape information, further comprising:

an image pickup portion that is provided in the endoscope and is configured to pick up an image of inside of the luminal organ;

a virtual endoscopic image generating portion configured to generate a virtual endoscopic image that is endoscopically rendered from a predetermined viewing point position based on the image information; and

an image comparing portion configured to compare an endoscopic image of inside of the luminal organ that is picked up by the image pickup portion and the virtual endoscopic image;

wherein the position and posture calculating portion estimates information regarding a position and a posture of the distal end of the endoscope insertion portion based on a comparison result of the image comparing portion.

7. The endoscope system according to claim 3, the endoscope system being capable of previously acquiring image information corresponding to the shape information, further comprising:

an image pickup portion that is provided in the endoscope and is configured to pick up an image of inside of the luminal organ;

a virtual endoscopic image generating portion configured to generate a virtual endoscopic image that is endoscopically rendered from a predetermined viewing point position based on the image information; and

an image comparing portion configured to compare an endoscopic image of inside of the predetermined luminal organ that is picked up by the image pickup portion and the virtual endoscopic image;

wherein the position and posture calculating portion calculates information regarding a position and a posture of the distal end of the endoscope insertion portion based on a comparison result of the image comparing portion.

8. The endoscope system according to claim 6, wherein, together with the information regarding a position and a posture of the distal end of the endoscope insertion portion, the position and posture information recording portion records the virtual endoscopic image and information regarding a direction of an endoscopic image that is picked up by the image pickup portion that correspond to the position and the posture of the distal end of the endoscope insertion portion.

9. The endoscope system according to claim 6, further comprising:

a luminal shape image generating portion configured to generate a luminal shape image of the luminal organ based on the shape information; and

a display portion configured to, in a case where image matching by comparing the endoscopic image and the virtual endoscopic image using the image comparing portion cannot be performed within a set accuracy, superimpose information regarding a position and a posture of the distal end of the endoscope insertion portion that is recorded in the position and posture information calculating portion on the luminal shape image and display a resulting image.

10. The endoscope system according to claim 3, further comprising:

a route data generating portion configured to, in a case where a target site is specified with respect to shape information of the subject, generate route data from an insertion starting position of the distal end of the endoscope insertion portion in the luminal organ to a target position that is in a vicinity of the target site based on the shape information and a luminal shape image of the luminal organ that is extracted by the luminal organ extracting portion; and

a branch information recording portion configured to record branch information including a three-dimensional position and a branching angle of a branch point at which the luminal organ branches during the course of arriving at the target position of the route data;

wherein;

the branch information recording portion automatically determines the second predetermined threshold value in accordance with the branch information of the branch point; and

the direction comparing portion performs a comparison using the second predetermined threshold value that is determined.

11. The endoscope system according to claim 10, wherein, based on a three-dimensional position of the distal end of the endoscope insertion portion at a time that a current longitudinal direction is detected by the position and posture calculating portion, the branch information recording portion automatically determines the second predetermined threshold value based on branch information of a next branch point that exists at a location that is further along a target position side than the three-dimensional position.