Image Sensor Including Color and Infrared Pixels

• US 20110228097A1
• Filed: 03/19/2010
• Published: 09/22/2011
• Est. Priority Date: 03/19/2010
• Status: Active Grant

• Current Assignee: Pixim, Inc. (Sony Group Corp.)
• Original Assignee: Pixim, Inc. (Sony Group Corp.)
• Inventors: Motta, Ricardo J.
• Granted Patent: US 8,619,143 B2
• Time in Patent Office: Days
• US Class Current: 348/164
• CPC Class Codes: H04N 2209/046 Colour interpolation to calculate the missing colour values
• CPC Class Codes: H04N 23/12 with one sensor only
• CPC Class Codes: H04N 23/843 Demosaicing, e.g. interpolating colour pixel values
• CPC Class Codes: H04N 25/131 including elements passing infrared wavelengths
• CPC Class Codes: H04N 25/135 based on four or more different wavelength filter elements
• CPC Class Codes: H04N 5/33 Transforming infrared radiation cameras or camera modules for generating image signals from infrared radiation H04N23/20; circuitry of SSIS for transforming infrared radiation into image signals H04N25/20

Abstract

An image sensing system includes an IR notch filter configured to block transmission of spectral energy having wavelengths in an interface region between the visible and the invisible spectra and enable transmission of spectral energy having wavelengths in at least the visible spectrum and the near-infrared (IR) spectrum, a digital image sensor including a two-dimensional array of pixel elements and configured to generate output signals at each pixel element as pixel data representing an image of a scene, and a color filter array including a two-dimensional array of selectively transmissive filters superimposed on and in registration with the two-dimensional array of pixel elements. The color filter array includes a first group of selectively transmissive filters disposed to transmit spectral energy in one or more colors of the visible spectrum and a second group of gray color filters disposed to transmit spectral energy in at least the near-infrared (IR) spectrum.

Claims

1. An image sensing system, comprising:

an IR notch filter configured to block transmission of spectral energy having wavelengths in an interface region between the visible spectrum and the invisible spectrum and enable transmission of spectral energy having wavelengths in at least the visible spectrum and the near-infrared (IR) spectrum;

an image sensor comprising a two-dimensional array of pixel elements, the digital image sensor configured to generate output signals at each pixel element as pixel data representing an image of a scene; and

a color filter array comprising a two-dimensional array of selectively transmissive filters superimposed on and in registration with the two-dimensional array of pixel elements, the color filter array comprising a first group of selectively transmissive filters disposed to transmit spectral energy in one or more colors of the visible spectrum and a second group of gray color filters disposed to transmit spectral energy in at least the near-infrared (IR) spectrum.

2. The image sensing system of claim 1, wherein the IR notch filter is configured to block transmission of spectral energy having wavelengths between approximately 650 nm and approximately 780 nm.

3. The image sensing system of claim 2, wherein the IR notch filter is configured to further block transmission of spectral energy having wavelengths above approximately 950 nm.

4. The image sensing system of claim 1, wherein the color filter array is formed by a repeating pattern of a pixel block, the pixel block comprising selectively transmissive filters disposed to transmit spectral energy in the red, green and blue colors of the visible spectrum and a gray color filter disposed to transmit spectral energy in the infrared spectrum.

5. The image sensing system of claim 1, wherein the gray color filter is formed using a linear combination of the red, green and blue color filters.

6. The image sensing system of claim 5, wherein the gray color filter is manufactured using the same material as the red, green and blue color filters.

7. The image sensing system of claim 5, wherein the gray color filter transmits spectral energy in the red, green and blue colors of the visible spectrum at 30% intensity and transmits spectral energy of the infrared spectrum at wavelengths above about 780 nm.

8. The image sensing system of claim 1, wherein each of the pixel elements comprises a photodetector generating an output signal, and the image sensing system further comprises:

a plurality of analog-to-digital conversion (ADC) circuits configured to convert the output signal from each pixel element to a digitized pixel voltage signal.

9. The image sensing system of claim 8, wherein the plurality of analog-to-digital conversion (ADC) circuits are located within the image sensor, each of the ADC circuits being connected to one or more photodetectors for converting the output signal of each pixel element to a digitized pixel voltage signal.

10. A digital imaging system, comprising:

an IR notch filter configured to block transmission of spectral energy having wavelengths in an interface region between the visible spectrum and the invisible spectrum and enable transmission of spectral energy having wavelengths in at least the visible spectrum and the near-infrared (IR) spectrum;

an image sensor comprising a two-dimensional array of pixel elements, the digital image sensor configured to generate output signals at each pixel element as pixel data representing an image of a scene;

a color filter array comprising a two-dimensional array of selectively transmissive filters superimposed on and in registration with the two-dimensional array of pixel elements, the color filter array comprising a first group of selectively transmissive filters disposed to transmit spectral energy in one or more colors of the visible spectrum and a second group of gray color filters disposed to transmit spectral energy in at least the near-infrared (IR) spectrum;

a data memory in communication with the digital image sensor and configured to store the pixel data; and

a digital image processor in communication with the digital image sensor and the data memory and configured to process the pixel data to generate image data indicative of the image of the scene.

11. The digital imaging system of claim 10, wherein the digital image processor performs four-channel demosacing to generate a first image using pixel data in the red, green blue colors and a second image using pixel data from the infrared spectrum.

12. A method for sensing an image of a scene comprising:

receiving incident light at a digital image sensing system;

blocking transmission of spectral energy having wavelengths in an interface region between the visible spectrum and the invisible spectrum while enabling transmission of spectral energy having wavelengths in at least the visible spectrum and the near-infrared (IR) spectrum;

sensing the incident light at a digital image sensor overlaid with a color filter array, comprising;

sensing the incident light using a first group of selectively transmissive filters disposed to transmit spectral energy in one or more colors of the visible spectrum; and

sensing the incident light using a second group of gray color filters disposed to transmit spectral energy in at least the near-infrared (IR) spectrum; and

generating output signals at each pixel element of the image sensor as pixel data representing an image of a scene.

13. The method of claim 12, wherein blocking transmission of spectral energy having wavelengths in an interface region between the visible spectrum and the invisible spectrum while enabling transmission of spectral energy having wavelengths in at least the visible spectrum and the near-infrared (IR) spectrum comprises:

blocking transmission of spectral energy having wavelengths in an interface region between approximately 650 nm and approximately 780 nm.

14. The method of claim 13, wherein blocking transmission of spectral energy having wavelengths in an interface region between the visible spectrum and the invisible spectrum while enabling transmission of spectral energy having wavelengths in at least the visible spectrum and the near-infrared (IR) spectrum further comprises blocking transmission of spectral energy having wavelengths above approximately 950 nm.

15. The method of claim 12, wherein sensing the incident light at a digital image sensor overlaid with a color filter array comprises:

sensing the incident light using a color filter array formed by a repeating pattern of a pixel block, the pixel block comprising selectively transmissive filters disposed to transmit spectral energy in the red, green and blue colors of the visible spectrum and a gray color filter disposed to transmit spectral energy in the infrared spectrum.