Ambient Light Rejection In Digital Video Images

• US 20070263099A1
• Filed: 07/28/2006
• Published: 11/15/2007
• Est. Priority Date: 05/09/2006
• Status: Abandoned Application

• Current Assignee: Pixim, Inc. (Sony Group Corp.)
• Original Assignee: Pixim, Inc. (Sony Group Corp.)
• Inventors: Motta, Ricardo J., Chen, Ting, Tao, Douglas K., Montalbo, Joseph D.
• Application Number:
  US11/460,884
• Publication Number:
  US 20070263099A1
• Time in Patent Office: Days
• US Class Current: 348/222.100
• CPC Class Codes: H04N 23/74 by influencing the scene brightness using illuminating means

Abstract

A method for generating an ambient light rejected output image includes providing a sensor array including a two-dimensional array of digital pixels where the digital pixels output digital signals as digital pixel data representing the image of the scene, capturing a pair of images of a scene within the time period of a video frame using the sensor array where the pair of images includes a first image being illuminated by ambient light and a second image being illuminated by the ambient light and a light source, storing the digital pixel data associated with the first and second images in a data memory, and subtracting the first image from the second image to obtain the ambient light rejected output image.

Claims

1. A method for generating an ambient light rejected output image comprising:

providing a sensor array including a two-dimensional array of digital pixels, the digital pixels outputting digital signals as digital pixel data representing the image of the scene;

capturing a pair of images of a scene within the time period of a video frame using the sensor array, the pair of images including a first image being illuminated by ambient light and a second image being illuminated by the ambient light and a light source;

storing the digital pixel data associated with the first and second images in a data memory; and

subtracting the first image from the second image to obtain the ambient light rejected output image.

2. The method of claim 1, wherein the time period of a video frame comprises 1/60 seconds.

3. The method of claim 1, wherein subtracting the first image from the second image to obtain the ambient light rejected output image comprises subtracting digital pixel data associated with the first image from digital pixel data associated with the second image on a pixel-by-pixel basis.

4. The method of claim 1, wherein capturing a pair of images of a scene within the time period of a video frame using the sensor array comprises:

capturing the first image of the scene using the sensor array; and

within the same video frame, activating the light source and capturing the second image of the scene using the sensor array.

5. The method of claim 4, wherein the first image is captured before the second image.

6. The method of claim 4, wherein the second image is captured before the first image.

7. The method of claim 4, wherein capturing the first image and capturing the second image each comprises:

resetting the sensor array;

integrating at each digital pixel incident light impinging on the sensor array for a given exposure time; and

generating digital pixel data at each digital pixel corresponding to an analog signal indicative of the light intensity impinging on the digital pixel.

8. The method of claim 1, wherein storing the digital pixel data of the first and second images in a data memory comprises:

storing digital pixel data in M bits for each digital pixel in the first image and the second image.

9. The method of claim 8, wherein subtracting the first image from the second image to obtain the ambient light rejected output image comprises:

providing a look-up table being indexed by an N-bit input data value where N=2M, the look-up table providing data output values indicative of the difference between two M bits digital pixel data;

forming a first input data value by combining an M-bit digital pixel data for a first digital pixel in the first image and an M-bit digital pixel data for the first digital pixel in the second image;

indexing the look-up table using the first input data value; and

obtaining a first data output value associated with the first input data value, the first data output value being indicative of the difference between the M-bit digital pixel data for the first digital pixel in the first image and the M-bit digital pixel data for the first digital pixel in the second image.

10. The method of claim 9, wherein providing a look-up table comprises providing a look-up table being indexed by an N-bit input data value where N=2M, the look-up table providing data output values indicative of the difference between two M bits linearized digital pixel data.

11. The method of claim 1, wherein:

capturing a pair of images of a scene within the time period of a video frame using the sensor array comprises capturing a plurality of pairs of images of a scene within the time period of a video frame using the sensor array, each pair of images including a first image being illuminated by ambient light and a second image being illuminated by the ambient light and a light source;

storing the digital pixel data comprises storing the digital pixel data associated with the plurality of pairs of images in the data memory; and

subtracting the first image from the second image comprises subtracting the first image from the second image for each pair of images to obtain a plurality of difference images and summing the plurality of difference images to obtain the ambient light rejected output image.

12. The method of claim 1, wherein capturing a pair of images of a scene within the time period of a video frame using the sensor array comprises:

capturing the pair of images after a first delay time from the start of each video frame, the first delay time being a pseudo random delay time.

13. The method of claim 1, wherein capturing a pair of images of a scene within the time period of a video frame using the sensor array comprises:

capturing a first image where the entire scene is illuminated by ambient light and a selected portion of the scene is illuminated by a second light source; and

capturing a second image where the entire scene is illuminated by the light source,

wherein when the first image is subtracted from the second image, the ambient rejected output image includes a blacked out portion corresponding to the selected portion of the scene.

14. The method of claim 13, wherein the intensity of the second light source is the same as the intensity of the first light source.

15. A digital imaging system, comprising:

a sensor array including a two-dimensional array of digital pixels, the digital pixels outputting digital signals as digital pixel data representing the image of the scene;

a data memory, in communication with said sensor array, for storing the digital pixel data;

a first processor, in communication with the sensor array and the data memory, for controlling the sensor array and a light source,

wherein the first processor operates the sensor array to capture a first image of a scene being illuminated by ambient light and operates the sensor array and the light source to capture a second image of the scene being illuminated by the ambient light and the light source, the first image and the second image being captured within a video frame, and

wherein the first image is subtracted from the second image to generate an ambient light rejected output image.

16. The digital imaging system of claim 15, wherein the light source comprises a light emitting diode.

17. The digital imaging system of claim 15, wherein the first processor further controls a second light source, the second light source being used to illuminate a selected portion of the scene when the first image is being captured.