Endoscopy system and method therefor

• US 8,353,816 B2
• Filed: 03/04/2009
• Issued: 01/15/2013
• Est. Priority Date: 03/10/2008
• Status: Expired due to Fees

• Current Assignee: Fujifilm Corporation (Fujifilm Holdings Corporation)
• Original Assignee: Fujifilm Corporation (Fujifilm Holdings Corporation)
• Inventors: Shimizu, Kunimasa, Otani, Kenichi, Kinjo, Naoto
• Primary Examiner(s): Leubecker, John P
• Assistant Examiner(s): TORRES DIAZ, ARNALDO
• Application Number:
  US12/397,409
• Publication Number:
  US 20090227837A1
• Time in Patent Office: 1,413 Days
• Field of Search: 600/103, 600/109, 600/113, 600/117, 600/160, 600/178, 600/180, 348/65, 348/72, 348/74, 382/128
• US Class Current: 600/113
• CPC Class Codes: A61B 1/000094 extracting biological structures
• CPC Class Codes: A61B 1/00016 using wireless means
• CPC Class Codes: A61B 1/0005 combining images e.g. side-by-side, superimposed or tiled
• CPC Class Codes: A61B 1/00082 Balloons
• CPC Class Codes: A61B 1/00096 Optical elements
• CPC Class Codes: A61B 1/041 Capsule endoscopes for imaging
• CPC Class Codes: A61B 1/0676 at distal tip of an endoscope
• CPC Class Codes: A61B 1/0684 using light emitting diodes [LED]
• CPC Class Codes: A61B 1/2736 Gastroscopes
• CPC Class Codes: A61B 5/0075 by spectroscopy, i.e. measuring spectra, e.g. Raman spectroscopy, infrared absorption spectroscopy A61B5/0071 takes precedence
• CPC Class Codes: A61B 5/0084 for introduction into the body, e.g. by catheters A61B5/1459 takes precedence
• CPC Class Codes: A61B 5/065 Determining position of the probe employing exclusively positioning means located on or in the probe, e.g. using position sensors arranged on the probe
• CPC Class Codes: A61B 5/073 Intestinal transmitters

Abstract

A capsule endoscope is swallowed by a patient, to capture images from inner wall surfaces of patient'"'"'s digestive tract, while detecting imaging positions of the capsule endoscope. A doctor observes the images captured by the capsule endoscope, to select an aimed point image that contains a portion suspected of a lesion, and some images that represent pass points on an insertion route of a balloon endoscope. While a probing tip of the balloon endoscope is being inserted into the patient for the sake of thorough examination of the suspected portion, a degree of similarity between an image captured by the balloon endoscope and an image of a destination point, which is one of the pass points and the aimed point, is detected to judge by the similarity whether the probing tip has reached the destination point or not. So the doctor can get the probing tip to the aimed point easily.

Claims

1. An endoscopy system comprising:

a capsule endoscope swallowed by a test body to capture first kind of images from internal portions of the test body;

an image processor for processing image data of the first kind of images, to display the first kind of images on a monitor for a doctor to interpret them;

a flexible endoscope having a flexible inserter with an imaging device, said flexible inserter being inserted in the test body to capture second kind of images by said imaging device when the doctor finds it necessary to make a thorough examination of an aimed point inside the test body as a result of interpretation of the first kind of images;

an aimed point selection device for selecting an aimed point image that contains said aimed point from among the first kind of images in response to an operation by the doctor;

a similarity detection device for detecting similarity between said aimed point image and the second kind of images as captured by said imaging device while said flexible inserter is being moved toward said aimed point;

a position information obtaining device for obtaining information on a relative position of said imaging device of said flexible endoscope inside the test body on the basis of the similarity detected by said similarity detection device;

a display device for displaying the information on the relative position of said imaging device;

a pass point selection device for selecting at least a pass point image from among the first kind of images, said pass point image being representative of a pass point on a route from an inlet of said flexible inserter to said aimed point, wherein said similarity detection device further detects similarity between said pass point image and the second kind of images while said flexible inserter is being inserted into the test body, and said position information obtaining device obtains the information on the relative position of said imaging device to said pass point or to said aimed point on the basis of the similarity between said pass point image and the second kind of images or the similarity between said aimed point image and the second kind of images, respectively;

a first image characteristic value taking device for taking image characteristic values respectively from said aimed point image and said pass point image; and

a second image characteristic value taking device for taking image characteristic values from the second kind of images, wherein said similarity detection device detects the similarity between said pass point image and the second kind of images by calculation using the image characteristic values of said pass point image and the second kind of image, and the similarity between said aimed point image and the second kind of images by calculation using the image characteristic values of said aimed point image and the second kind of image.

2. An endoscopy system as recited in claim 1, wherein said display device displays information as to whether said imaging device has reached said pass point or said aimed point as the information on the relative position of said imaging device.

3. An endoscopy system as recited in claim 1, further comprising:

a first spectral image producing device for producing spectral images of appropriately selected spectral frequency bands from said aimed point image and said pass point image respectively; and

a second spectral image producing device for producing a spectral image from each of the second kind of images so that said spectral image has the same spectral frequency band as said spectral image of said pass point has while said imaging device of said inserter is moving toward said pass point, and that said spectral image has the same spectral frequency band as the spectral image of said aimed point has while said imaging device of said inserter is moving from said pass point toward said aimed point, wherein said first image characteristic value taking device takes the image characteristic values from said spectral images of said aimed point and said pass point, whereas said second image characteristic value taking device takes the image characteristic values respectively from said spectral images of the second kind of images.

4. An endoscopy system as recited in claim 1, wherein the image characteristic values taken by said first and second image characteristic value taking devices represent blood vessel patterns in the internal portions of the test body.

5. An endoscopy system as recited in claim 1, wherein the image characteristic values taken by said first and second image characteristic value taking devices represent surface asperities of the internal portions of the test body.

6. An endoscopy system as recited in claim 5, wherein said capsule endoscope comprises a number of light sources, which are disposed at different positions and sequentially emit light to illuminate the same portion inside the test body, and said capsule endoscope captures a corresponding number of images to the number of said light sources from the same portion synchronously with the sequential emissions of said light sources toward the same portion, and wherein said first image characteristic value taking device estimates the surface asperities of said pass point and said aimed point on the basis of images captured from said pass point and images captured from said aimed point respectively.

7. An endoscopy system as recited in claim 6, wherein said inserter of said flexible endoscope is provided with a plurality of illumination windows on different sides of said imaging device, to project illumination light sequentially from one illumination window after another toward the same portion inside the test body, and said imaging device of said flexible endoscope captures a corresponding number of images to said illumination windows from the same portion synchronously with the sequential projection of illumination light from said illumination windows toward the same portion, and wherein said second image characteristic value taking device estimates the surface asperities of the same portion on the basis of the images captured by said imaging device of said flexible endoscope from the same portion.

8. An endoscopy system as recited in claim 1, wherein the first kind of images as captured by said capsule endoscope are omniazimuth images, and the second kind of images as captured by said flexible endoscope are planer images, and wherein said similarity detection device expands the first kind of image of said aimed point to be a planer image and compares the second kind of images with the expanded planer image of said aimed point.

9. An endoscopy system as recited in claim 1, wherein the first kind of images as captured by said capsule endoscope are omniazimuth images, and the second kind of images as captured by said flexible endoscope are planer images, and wherein said similarity detection device expands the first kind of image of said pass point to be a planer image and compares the second kind of images with the expanded planer image of said pass point.

10. An endoscopy system as recited in claim 1, wherein said capsule endoscope is provided with an attitude detector for detecting attitude of said capsule endoscope, and wherein said endoscopy system further comprises a storage device for storing information on the attitude of said capsule endoscope at said aimed point in association with said aimed point image, and said display device displays the information on the attitude of said capsule endoscope at said aimed point besides the information on the relative position of said imaging device of said flexible endoscope to said aimed point.

11. An endoscopy system as recited in claim 1, wherein said capsule endoscope is provided with an attitude detector for detecting attitude of said capsule endoscope, and wherein said endoscopy system further comprises a storage device for storing data of the attitude of said capsule endoscope at said pass point in association with said pass point image, and said display device displays the information on the attitude of said capsule endoscope at said pass point besides the information on the relative position of said imaging device of said flexible endoscope to said pass point.

12. An endoscopy method using a capsule endoscope swallowed by a test body to capture first kind of images from internal portions of the test body, and a flexible endoscope having a flexible inserter with an imaging device, said flexible inserter being inserted into the test body to capture second kind of images by said imaging device when the doctor finds it necessary to make a thorough examination of an aimed point inside the test body as a result of interpretation of the first kind of images, said endoscopy method comprising steps of:

selecting an aimed point image that contains said aimed point from among the first kind of images;

detecting similarity between said aimed point image and the second kind of images as captured by said imaging device while said flexible inserter is being moved toward said aimed point;

obtaining information on a relative position of said imaging device of said flexible endoscope inside the test body on the basis of the similarity between said aimed point image and the second kind of images;

displaying the obtained information on the relative position of said imaging device;

selecting at least a pass point image from among the first kind of images, said pass point image being representative of a pass point on a route from an inlet of said flexible inserter to said aimed point, wherein said similarity detection device further detects similarity between said pass point image and the second kind of images while said flexible inserter is being inserted into the test body, and said position information obtaining device obtains the information on the relative position of said imaging device to said pass point or to said aimed point on the basis of the similarity between said pass point image and the second kind of images or the similarity between said aimed point image and the second kind of images, respectively;

taking first image characteristic values respectively from said aimed point image and said pass point image; and

taking second image characteristic values from the second kind of images, wherein said similarity detection device detects the similarity between said pass point image and the second kind of images by calculation using the image characteristic values of said pass point image and the second kind of image, and the similarity between said aimed point image and the second kind of images by calculation using the image characteristic values of said aimed point image and the second kind of image.