REDUCING NOISE IN A COLOR IMAGE

• US 20120154596A1
• Filed: 08/25/2009
• Published: 06/21/2012
• Est. Priority Date: 08/25/2009
• Status: Abandoned Application

• Current Assignee: Dual Aperture International Co. Ltd.
• Original Assignee: Dual Aperture International Co. Ltd.
• Inventors: Wajs, Andrew Augustine
• Application Number:
  US13/392,101
• Publication Number:
  US 20120154596A1
• Time in Patent Office: Days
• US Class Current: 348/164
• CPC Class Codes: G06T 2207/10024 Color image
• CPC Class Codes: G06T 2207/10048 Infrared image
• CPC Class Codes: G06T 5/20 using local operators
• CPC Class Codes: G06T 5/50 using two or more images, e.g. averaging or subtraction
• CPC Class Codes: G06T 5/70 Denoising; Smoothing
• CPC Class Codes: H04N 23/10 for generating image signals from different wavelengths
• CPC Class Codes: H04N 23/11 for generating image signals from visible and infrared light wavelengths
• CPC Class Codes: H04N 23/20 for generating image signals from infrared radiation only
• CPC Class Codes: H04N 5/33 Transforming infrared radiation cameras or camera modules for generating image signals from infrared radiation H04N23/20; circuitry of SSIS for transforming infrared radiation into image signals H04N25/20

Abstract

A method and an imaging system is described for providing a low noise color image. The method comprises the steps of: exposing an image sensor to visible spectral energy and non-visible spectral energy, said image sensor comprising pixels for obtaining first image data associated with said visible spectral energy and pixels for obtaining second image data associated with said non-visible spectral energy; generating first and second image data; subjecting said first image data to a low-pass filt and said second image data to a high-pass filter; and, forming a color image by adding at least part of the high frequency components of said second image data to at least part of the low frequency components of said first image data.

Claims

1. Method of providing a low noise color image, the method comprising:

exposing an image sensor to visible spectral energy and non-visible spectral energy, said image sensor comprising pixels for obtaining first image data associated with said visible spectral energy and pixels for obtaining second image data associated with said non-visible spectral energy;

generating first and second image data;

subjecting said first image data to a low-pass filter and said second image data to a high-pass filter;

forming a color image by adding at least part of the high frequency components of said second image data to at least part of the low frequency components of said first image data.

2. Method according to claim 1, wherein said pixels for obtaining said first image data comprise one or more color pixel filters configured for transmitting at least part of said visible spectral energy.

3. Method according to claim 1, wherein said pixels for obtaining said second image data comprise one or more infrared transmissive pixels filters configured for transmitting a substantial part of said non-visible spectral energy and blocking a substantial part of said visible spectral energy.

4. Method according to claim 1, wherein said pixels for obtaining first and second image data comprise two or more vertically stacked photo-sensors, at least one of said photo-sensors being responsive to a predetermined part of said visible spectral energy and at least one of said photo-sensor being responsive to a predetermined part of said non-visible spectrum.

5. Method according to claim 1, wherein said image sensor is exposed to said visible spectral energy using at least a first aperture and to said non-visible spectral energy using at least a second aperture.

6. Method according to claim 5, wherein said first aperture is configured to control exposure of said image sensor to at least part of said non-visible spectral energy and wherein said second aperture is configured to control exposure of said image sensor to at least part of said visible spectral energy.

7. Method according to claim 5, wherein said method further comprises amplifying the filtered high-frequency components of said second image data in proportion to the ratio of the first aperture relative to the second aperture.

8. Method according to claim 1, said method further comprising amplifying one or more image sensor signals associated with said visible spectral energy according to at least a first ISO speed and amplifying one or more image sensor signals associated with said non-visible spectral energy according to at least a second ISO speed, wherein said first ISO speed is larger than said second ISO speed,

9. Method according to claim 1, said method further comprising setting the exposure time for exposing one or more pixels associated with said non-visible spectral energy to a lower value than the exposure time for exposing one or more pixels associated with said visible spectral energy.

10. Method according to claim 1, said method further comprising:

providing mosaic image data generated by said image sensor,

generating on the basis of said image data at least one or more first color image data associated one or more color pixels and second image data associated with said infrared pixels using a demosaicing algorithm.

16. Method according to claim 8, wherein the ratio between said first and second ISO value being approximately between 2 and 8.

11. Image processing apparatus, comprising:

an input for receiving image data generated by exposing an image sensor to visible and non-visible spectral energy, said image data comprising first image data associated with visible spectral energy and second image data associated with non-visible spectral energy;

a noise reduction unit configured to subject said first image data to a low-pass filter and said second image data to a high-pass filter;

a blending unit for adding said high-pass filtered infrared image data to said low-pass filtered color image data.

12. Imaging system, comprising:

an image sensor configured for exposure to visible spectral energy and non-visible spectral energy, said image sensor comprising pixels for obtaining first image data associated with said visible spectral energy and pixels for obtaining second image data associated with said non-visible spectral energy;

an aperture system configured to control exposure of the image sensor to the visible and non-visible spectral energy, and,

an image processing apparatus, comprising;

an input for receiving image data generated by exposing the image sensor to visible and non-visible spectral energy, said image data comprising first image data associated with visible spectral energy and second image data associated with non-visible spectral energy;

a noise reduction unit configured to subject said first image data to a low-pass filter and said second image data to a high-pass filter;

a blending unit for adding said high-pass filtered infrared image data to said low-pass filtered color image data.

13. Imaging system according to claim 12, wherein said aperture system comprises at least a first aperture configured to control exposure of the image sensor to at least part of said non-visible spectral energy and at least a second aperture configured to control exposure of said image sensor to at least part of said visible spectral energy.

14. Image sensor for use in an imaging system according to claim 12, the sensor comprising:

a pixel array defining one or more color pixels sensitive to visible spectral energy and one or more infrared pixels sensitive to non-visible spectral energy;

at least one first amplifier associated with at least a part of said color pixels for setting ISO speed associated with said color pixels to a first ISO speed value and a second amplifier associated with at least a part of said infrared pixels for setting the ISO speed associated with said infrared pixels to a second ISO speed value, said first ISO speed value being larger than said second ISO speed value, preferably said first and second amplifier being configured such that the ratio between said first and second ISO speed value may be controlled approximately between 2 and 8.

17. Method according to claim 14, wherein the pixel array is a two-dimensional pixel array.

15. A non-transitory computer-readable storage medium with an executable computer program product stored thereon, wherein the computer program product instructs a computer processor to perform a method comprising:

exposing an image sensor to visible spectral energy and non-visible spectral energy, said image sensor comprising pixels for obtaining first image data associated with said visible spectral energy and pixels for obtaining second image data associated with said non-visible spectral energy;

generating first and second image data;

subjecting said first image data to a low-pass filter and said second image data to a high-pass filter;

forming a color image by adding at least part of the high frequency components of said second image data to at least part of the low frequency components of said first image data.