Endoscope system, processor of endoscope system, and image producing method

• US 9,706,953 B2
• Filed: 10/20/2011
• Issued: 07/18/2017
• Est. Priority Date: 12/15/2010
• Status: Active Grant

• Current Assignee: Fujifilm Corporation (Fujifilm Holdings Corporation)
• Original Assignee: Fujifilm Corporation (Fujifilm Holdings Corporation)
• Inventors: Saito, Takaaki
• Primary Examiner(s): Leubecker, John P
• Assistant Examiner(s): El Alami, Rajaa
• Application Number:
  US13/277,759
• Publication Number:
  US 20120157768A1
• Time in Patent Office: 2,098 Days
• Field of Search: 600101, 348 30, 348 40, 348 45, 348 68- 71
• CPC Class Codes: A61B 1/000094 extracting biological structures
• CPC Class Codes: A61B 1/043 for fluorescence imaging
• CPC Class Codes: A61B 1/045 Control thereof
• CPC Class Codes: A61B 1/063 for monochromatic or narrow-band illumination
• CPC Class Codes: A61B 1/0638 providing two or more wavelengths
• CPC Class Codes: A61B 1/0646 with illumination filters
• CPC Class Codes: A61B 1/0653 with wavelength conversion
• CPC Class Codes: A61B 1/0655 Control therefor
• CPC Class Codes: A61B 5/14551 for measuring blood gases
• CPC Class Codes: A61B 5/6852 Catheters
• CPC Class Codes: G06T 2207/10024 Color image
• CPC Class Codes: G06T 2207/10068 Endoscopic image
• CPC Class Codes: G06T 2207/10152 Varying illumination
• CPC Class Codes: G06T 2207/30101 Blood vessel; Artery; Vein; Vascular
• CPC Class Codes: G06T 7/0012 Biomedical image inspection

Abstract

First illumination light of a first wavelength range, in which light absorption coefficient of blood hemoglobin varies with oxygen saturation thereof, is projected into a test subject body, to capture a first image signal from the first illumination light as reflected from inside the test subject body. Then second illumination light of a second wavelength range different from the first wavelength range is projected into a test subject body, to capture a second image signal from the second illumination light as reflected from inside the test subject body. A subject image of the test subject is produced from the second image signal. Oxygen saturation levels of the test subject are calculated using the first and second image signals. According to the calculated oxygen saturation levels, color properties of the subject image are changed to produce an oxygen saturation image.

Claims

1. An endoscope system comprising:

a light projecting device for projecting a first illumination light of a first wavelength range and a second illumination light of a second wavelength range different from the first wavelength range into a test subject body, wherein a light absorption coefficient of blood hemoglobin varies with an oxygen saturation thereof in the first wavelength range;

an image signal capturing device using an imaging device to capture a first image signal from the first illumination light as reflected from inside the test subject body and a second image signal from the second illumination light as reflected from inside the test subject body;

an image producing device for producing a subject image of the test subject from the second image signal;

an oxygen saturation calculating device for numerically calculating oxygen saturation levels of the test subject using the first image signal;

a gain memory for memorizing oxygen saturation levels in association with gains for changing pixel levels of the subject image according to the oxygen saturation levels;

an image color processing device that determines, with reference to said gain memory, the gains corresponding to the oxygen saturation levels calculated by said oxygen saturation calculating device, and the pixel levels of the second image signal being multiplied by the determined gains to produce an oxygen saturation image by changing color properties of the subject image according to the calculated oxygen saturation levels; and

a display device for displaying the oxygen saturation image,

wherein the second illumination light comprises white light, and the subject image comprises an ordinary image captured under the white light,

wherein the gains are constant regardless of the oxygen saturation levels in a range above a given oxygen saturation level in the ordinary light image, and

wherein the gains increase or decrease depending on the oxygen saturation levels in a range below the given oxygen saturation level in the ordinary light image.

2. The endoscope system as recited in claim 1, wherein the gains have approximately linear relations to the oxygen saturation levels in said gain memory.

3. The endoscope system as recited in claim 1, wherein the gains increase or decrease at rates variable gradually according to the oxygen saturation levels.

4. The endoscope system as recited in claim 1, wherein the oxygen saturation level given to said gain memory as a threshold to increase or decrease the gains are revised in response to information input by a user.

5. The endoscope system as recited in claim 2, wherein

said imaging device comprises a color imaging device having red pixels with red color filters, green pixels with green color filters, and blue pixels with blue color filters, outputting red, green and blue signals respectively;

red, green and blue signals as captured under the second illumination light constitute the second image signal; and

said oxygen saturation image producing device is configured to lower pixel levels of the red signal among the second image signal with respect to those pixels for which the oxygen saturation levels are calculated to be lower than a given value.

6. The endoscope system as recited in claim 1, wherein

said light projecting device projects narrowband light as the first illumination light, and blue, green and red rays as the second illumination light, sequentially toward the test subject body;

said imaging device sequentially outputs a narrowband signal captured under the narrowband light as the first image signal, and blue, green and red signals as the second image signal under the blue, green and red rays respectively; and

said oxygen saturation image producing device is configured to lower pixel levels of the red signal among the second image signal with respect to those pixels for which the oxygen saturation levels are calculated to be lower than a given value.

7. The endoscope system as recited in claim 1, wherein said oxygen saturation calculating device extracts information about the oxygen saturation from among various kinds of biological information contained in the first or the second image signal on the basis of the first and second image signals in combination.

8. The endoscope system as recited in claim 1, wherein the first wavelength range is from 460 nm to 480 nm, and the second wavelength range is from 450 nm to 700 nm.

9. The endoscope system as recited in claim 1,

wherein said imaging device comprises a color imaging device having red pixels with red color filters, green pixels with green color filters, and blue pixels with blue color filters, outputting red, green and blue signals respectively,

wherein a first red signal (R1), a first green signal (G1), and a first blue signal (B1) are output as the first image signal from said color imaging device at the time of projecting the first illumination light, and a second red signal (R2), a second green signal (G2), and a second blue signal (B2) are output as the second image signal from said color imaging device at the time of projecting the second illumination light, and

wherein said oxygen saturation calculating device calculates the oxygen saturation levels on the basis of the first blue signal (B1), the second green signal (G2), and the second red signal (R2) in combination.

10. The endoscope system as recited in claim 9, wherein the oxygen saturation calculation device calculates a signal ratio between corresponding pixels of the image signals.

11. The endoscope system as recited in claim 9,

wherein the oxygen saturation calculation device calculates a signal ratio of the first blue signal (B1) to the second green signal (G2) and a signal ratio of the second red signal (R2) to the second green signal (G2).

12. The endoscope system as recited in claim 9,

wherein the oxygen saturation calculating device calculates a signal ratio B1/G2 of the first blue signal (B1) to the second green signal (G2) and a signal ratio R2/G2 of the second red signal (R2) to the second green signal (G2), and

wherein oxygen saturation corresponding to the calculated B1/G2 and R2/G2 is calculated, with reference to correlation between B1/G2, R2/G2 and said oxygen saturation.

13. The endoscope system as recited in claim 1,

wherein said light projecting device projects narrowband light as the first illumination light, and blue, green and red rays as the second illumination light, sequentially toward the test subject body,

wherein said imaging device sequentially outputs a narrowband signal (N) captured under the narrowband light as the first image signal, and a blue signal (B), a green signal (G), and a red signal (R) captured under the blue, green and red rays respectively as the second image signal, and

wherein said oxygen saturation calculating device calculates the oxygen saturation levels on the basis of the narrowband signal N, the green signal G, and the red signal R in combination.

14. The endoscope system as recited in claim 1, wherein offset values corresponding to the gains are added to the second image signal.

15. A processor for an endoscope system including an endoscope that projects a first illumination light of a first wavelength range and a second illumination light of a second wavelength range different from the first wavelength range into a test subject body, and captures a first image signal and a second image signal respectively from the first illumination light and the second illumination light as reflected from inside the test subject body, wherein a light absorption coefficient of blood hemoglobin varies with oxygen saturation thereof in the first wavelength range, said processor comprising:

a signal receiving device for receiving the first and second image signals from said endoscope;

an image producing device for producing a subject image of the test subject from the second image signal;

an oxygen saturation calculating device for numerically calculating oxygen saturation levels of the test subject using the first image signal; and

a gain memory for memorizing oxygen saturation levels in association with gains for changing pixel levels of the subject image according to the oxygen saturation levels; and

an image color processing device that determines, with reference to said gain memory, the gains corresponding to the oxygen saturation levels calculated by said oxygen saturation calculating device, and the pixel levels of the second image signal being multiplied by the determined gains to produce an oxygen saturation image by changing color properties of the subject image according to the calculated oxygen saturation levels,

wherein the second illumination light comprises white light, and the subject image comprises an ordinary image captured under the white light,

wherein the gains are constant regardless of the oxygen saturation levels in a range above a given oxygen saturation level in the ordinary light image, and

wherein the gains increase or decrease depending on the oxygen saturation levels in a range below the given oxygen saturation level in the ordinary light image.

16. An image producing method comprising:

projecting a first illumination light of a first wavelength range and a second illumination light of a second wavelength range different from the first wavelength range into a test subject body, wherein a light absorption coefficient of blood hemoglobin varies with oxygen saturation thereof in the first wavelength range;

capturing a first image signal from the first illumination light as reflected from inside the test subject body;

capturing a second image signal from the second illumination light as reflected from inside the test subject body;

producing a subject image of the test subject from the second image signal;

numerically calculating oxygen saturation levels of the test subject using the first image signal; and

memorizing oxygen saturation levels in association with gains for changing pixel levels of the subject image according to the oxygen saturation levels;

determining, with reference to said gains memory, the gains corresponding to the oxygen saturation levels calculated by said oxygen saturation calculating device, and the pixel levels of the second image signal being multiplied by the determined gains to produce an oxygen saturation image by changing color properties of the subject image according to the calculated oxygen saturation levels,

wherein the second illumination light comprises white light, and the subject image comprises an ordinary image captured under the white light,

wherein the gains are constant regardless of the oxygen saturation levels in a range above a given oxygen saturation level in the ordinary light image, and

wherein the gains color increase or decrease depending on the oxygen saturation levels in a range below the given oxygen saturation level in the ordinary light image.