Image pickup apparatus

• US 8,212,892 B2
• Filed: 09/13/2010
• Issued: 07/03/2012
• Est. Priority Date: 05/14/2009
• Status: Active Grant

• Current Assignee: Olympus Corporation
• Original Assignee: Olympus Medical Systems Corporation (Olympus Corporation)
• Inventors: Yamazaki, Kenji
• Primary Examiner(s): Ho, Tuan
• Assistant Examiner(s): Trehan, Akshay
• Application Number:
  US12/880,529
• Publication Number:
  US 20110069199A1
• Time in Patent Office: 659 Days
• Field of Search: 348/229.1, 348/620, 348/70, 348/326, 348/745, 600/476, 600/181, 600/109, 600/921, 600/160, 382/151
• US Class Current: 348/229.1
• CPC Class Codes: A61B 1/0005 combining images e.g. side-by-side, superimposed or tiled
• CPC Class Codes: A61B 1/00059 provided with identification means for the endoscope
• CPC Class Codes: A61B 1/042 characterised by a proximal camera, e.g. a CCD camera
• CPC Class Codes: A61B 1/045 Control thereof
• CPC Class Codes: H04N 23/555 for picking-up images in sites, inaccessible due to their dimensions or hazardous conditions, e.g. endoscopes or borescopes
• CPC Class Codes: H04N 23/56 provided with illuminating means
• CPC Class Codes: H04N 23/741 by increasing the dynamic range of the image compared to the dynamic range of the electronic image sensors

Abstract

An image pickup apparatus includes a light source section that can radiate light of the same wavelength onto the same region of a subject twice within a one-frame period making up one image, a brightness detection section that detects brightness of two returning light images when light has been radiated twice, and a synthetic image generation section that generates a synthetic image obtained by synthesizing the two returning light images using the light of the same wavelength and under the same exposure quantity based on the detection result of the brightness.

Claims

1. An image pickup apparatus, comprising:

a light source section that can radiate at least two light beams of the same wavelength onto the same region of a subject at different timings within a one-frame period making up one image;

a brightness detection section that detects brightness of two returning light images based on the radiation of the at least two light beams of the same wavelength;

an amount-of-misalignment detection section that detects an amount of pixel misalignment between the at least two returning light images;

a determining section that determines whether or not to generate a synthetic image based on the detection result of the amount-of-misalignment detection section when the detection result of the brightness detection section is darker than a target brightness; and

a synthetic image generation section that generates the synthetic image obtained by synthesizing the two returning light images using the light beams of the same wavelength and under substantially the same exposure quantity based on the determination result of the determining section.

2. The image pickup apparatus according to claim 1, wherein the amount-of-misalignment detection section shifts a pixel of one of the two returning light images, detects an amount of misalignment of the pixel in the case of a maximum value where a correlation value with the other pixel reaches a maximum,

the determining section determines whether or not to generate the synthetic image or an alternate image based on whether or not the maximum value exceeds a predetermined threshold, and

when the maximum value is determined to exceed the predetermined threshold, the synthetic image generation section shifts pixels by the amount of misalignment of the pixel in the case of the maximum value and adds up the pixels and thereby generates the synthetic image.

3. The image pickup apparatus according to claim 2, wherein a normalized correlation value corrected based on signal intensity of each pixel is used as the correlation value.

4. The image pickup apparatus according to claim 2, further comprising an alternate image generation section that generates an image obtained by multiplying one of the two returning light images by a gain value exceeding 1 as the alternate image,

wherein when the maximum value is determined to be equal to or below the predetermined threshold, the alternate image generation section generates the alternate image.

5. The image pickup apparatus according to claim 1, wherein the light source section can radiate light of a wavelength different from the at least two light beams of the same wavelength, and

comprises an output section that multiplies a returning light image based on radiation of the light of the different wavelength by a gain value based on the detection result of the brightness detection section and outputs the multiplication result.

6. An image pickup apparatus, comprising:

a light source section that can radiate at least two light beams of the same wavelength onto the same region of a subject at different timings within a one-frame period making up one image;

a light quantity adjusting section provided in the light source section for adjusting a light quantity from the light source;

a brightness detection section that detects brightness of two returning light images based on the radiation of the at least two light beams of the same wavelength;

a synthetic image generation section that generates a synthetic image obtained by synthesizing the two returning light images using the light beams of the same wavelength and under substantially the same exposure quantity based on the adjustment result of the light quantity adjusting section and the detection result of the brightness detection section;

an auto gain adjusting section that performs auto gain adjustment so that an image signal corresponding to the synthetic image generated by the synthetic image generation section has a predetermined amplitude; and

a control section that controls the light quantity adjusting section, the synthetic image generation section and the auto gain adjusting section, so as to realize a target brightness in descending order of priority of light quantity adjustment by the light quantity adjusting section, adjustment of the amount of addition between the two returning light images by the synthetic image generation section and auto gain adjustment by the auto gain adjusting section, when the brightness detection result of the brightness detection section is darker than the target brightness.

7. The image pickup apparatus according to claim 6, further comprising:

an amount-of-misalignment detection section that detects an amount of pixel misalignment between at least two returning light images from light of the same wavelength; and

a determining section that determines whether or not to generate the synthetic image or an alternate image that substitutes for the synthetic image based on the detection result of the amount-of-misalignment detection section.

8. The image pickup apparatus according to claim 6, further comprising:

a motion vector detection section that divides the two returning light images from the light of the same wavelength into a plurality of blocks respectively and detects a motion vector between the returning light images corresponding to the plurality of divided blocks; and

a determining section that determines whether or not to generate the synthetic image based on the detection result of the motion vector detection section.

9. The image pickup apparatus according to claim 6, further comprising:

an amount-of-misalignment detection section that detects an amount of pixel misalignment between at least two returning light images from light of the same wavelength;

a determining section that determines whether or not to generate the synthetic image or an alternate image that substitutes for the synthetic image based on the detection result of the amount-of-misalignment detection section; and

an alternate image generation section that generates an image obtained by multiplying one of the two returning light images by a first value or a weighted average image obtained by weighted-averaging the two returning light images and multiplying the weighted average image by a second value as the alternate image;

wherein when control is performed so as to achieve the target brightness according to the brightness detection result of the brightness detection section, if the alternate image generation section generates the alternate image according to the determination result of the determining section, brightness of the alternate image is adjusted by the first value or the second value.

10. The image pickup apparatus according to claim 6, wherein the brightness detection section detects brightness of two returning light images of the same wavelength reflected on the same region of the subject based on the radiation of the at least two light beams of the same wavelength.

11. An image pickup apparatus, comprising:

a light source section that can radiate at least two light beams of the same wavelength onto the same region of a subject at different timings within a one-frame period making up one image;

a light quantity adjusting section provided in the light source section for adjusting a light quantity from the light source section;

a brightness detection section that detects brightness of two returning light images based on the radiation of the at least two light beams of the same wavelength;

a synthetic image generation section that generates a synthetic image obtained by synthesizing the two returning light images using the light beams of the same wavelength and under substantially the same exposure quantity based on the adjustment result of the light quantity adjusting section and the detection result of the brightness detection section; and

an auto gain adjusting section that performs auto gain adjustment so that an image signal corresponding to the synthetic image generated by the synthetic image generation section has a predetermined amplitude;

wherein when the brightness detection result of the brightness detection section is brighter than a target brightness, the auto gain adjusting section, the synthetic image generation section and the light quantity adjusting section are controlled so as to realize the target brightness in descending order of priority of auto gain adjustment by the auto gain adjusting section, adjustment of the amount of addition between the two returning light images by the synthetic image generation section and light quantity adjustment by the light quantity adjusting section.

12. The image pickup apparatus according to claim 11, further comprising:

an amount-of-misalignment detection section that detects an amount of pixel misalignment between at least two returning light images from light of the same wavelength; and

a determining section that determines whether or not to generate the synthetic image or an alternate image that substitutes for the synthetic image based on the detection result of the amount-of-misalignment detection section.

13. The image pickup apparatus according to claim 11, further comprising:

a motion vector detection section that that divides the two returning light images from the light of the same wavelength into a plurality of blocks respectively and detects a motion vector between the returning light images corresponding to the plurality of divided blocks; and

a determining section that determines whether or not to generate the synthetic image based on the detection result of the motion vector detection section.

14. The image pickup apparatus according to claim 11, further comprising:

an amount-of-misalignment detection section that detects an amount of pixel misalignment between at least two returning light images from light of the same wavelength;

a determining section that determines whether or not to generate the synthetic image or an alternate image that substitutes for the synthetic image based on the detection result of the amount-of-misalignment detection section; and

an alternate image generation section that generates an image obtained by multiplying one of the two returning light images by a first value or a weighted average image obtained by weighted-averaging the two returning light images and multiplying the weighted average image by a second value as the alternate image;

wherein when control is performed so as to achieve the target brightness according to the brightness detection result of the brightness detection section, if the alternate image generation section generates the alternate image according to the determination result of the determining section, brightness of the alternate image is adjusted by the first value or the second value.

15. The image pickup apparatus according to claim 11, wherein the brightness detection section detects brightness of two returning light images of the same wavelength reflected on the same region of the subject based on the radiation of the at least two light beams of the same wavelength.

16. An image pickup apparatus, comprising:

a light source section that can radiate at least two light beams of the same wavelength onto the same region of a subject at different timings within a one-frame period making up one image;

a brightness detection section that detects brightness of two returning light images based on the radiation of the at least two light beams of the same wavelength;

a motion vector detection section that divides the two returning light images from the light of the same wavelength into a plurality of blocks respectively and detects a motion vector between the returning light images corresponding to the plurality of divided blocks;

a determining section that determines whether or not to generate a synthetic image based on the detection result of the motion vector detection section when the detection result of the brightness detection section is darker than a target brightness; and

a synthetic image generation section that generates a synthetic image obtained by performing an aligned addition of the two returning light images using the light beams of the same wavelength and under substantially the same exposure quantity based on the determination result of the determining section.

17. The image pickup apparatus according to claim 16, wherein the determining section determines whether or not to generate the synthetic image based on a determination of whether or not the motion vector detected by the motion vector detection section substantially matches each other among at least a predetermined number of blocks, and when the motion vector detected by the motion vector detection section is determined to substantially match each other among at least a predetermined number of blocks, the synthetic image generation section performs an aligned addition using a motion vector that matches each other among at least a predetermined number of blocks and thereby generates the synthetic image.

18. The image pickup apparatus according to claim 17, further comprising an alternate image generation section that generates a weighted average image obtained by weighted-averaging the two returning light images as an alternate image,

wherein when the determining section determines that the motion vector does not match each other among at least a predetermined number of blocks, the alternate image generation section generates the alternate image.