Image Sensor Flicker Detection

• US 20150163392A1
• Filed: 09/30/2014
• Published: 06/11/2015
• Est. Priority Date: 12/09/2013
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Malone, Michael R., Lee, Chiajen, Zeleznik, Christopher G.
• Granted Patent: US 9,473,706 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: H04N 23/745 Detection of flicker frequency or suppression of flicker wherein the flicker is caused by illumination, e.g. due to fluorescent tube illumination or pulsed LED illumination
• CPC Class Codes: H04N 25/62 Detection or reduction of noise due to excess charges produced by the exposure, e.g. smear, blooming, ghost image, crosstalk or leakage between pixels
• CPC Class Codes: H04N 25/702 SSIS architectures characterised by non-identical, non-equidistant or non-planar pixel layout
• CPC Class Codes: H04N 25/703 SSIS architectures incorporating pixels for producing signals other than image signals
• CPC Class Codes: H04N 25/75 Circuitry for providing, modifying or processing image signals from the pixel array

Abstract

An image sensor includes an imaging area and one or more flicker detection regions. The imaging area includes pixels that capture one or more images. Each flicker detection region includes pixels that are sampled multiple times while an image is being captured. The samples can be analyzed to detect flicker in the scene being imaged.

Claims

1. An image sensor, comprising:

an imaging area that includes a plurality of pixels; and

one or more flicker detection regions each comprising one or more pixels, wherein at last one of the one or more pixels in at least one flicker detection region is sampled multiple times while at least one pixel in the imaging area captures an image.

2. The image sensor as in claim 1, further comprising first readout circuitry operatively connected to one or more pixels in the imaging area.

3. The image sensor as in claim 2, further comprising second readout circuitry operatively connected to the one or more pixels in a flicker detection region.

4. The image sensor as in claim 3, further comprising a processing device operatively connected to the readout circuitry.

5. The image sensor as in claim 3, wherein the second readout circuitry comprises:

a first terminal of a transfer transistor operatively connected to a photodetector;

a second terminal of the transfer transistor operatively connected to a gate of a readout transistor;

a first terminal of a switch transistor operatively connected to the gate of the readout transistor;

a first terminal of a select transistor operatively connected to a first terminal of a readout transistor;

a second terminal of the select transistor operatively connected to a column line; and

a second terminal of the readout transistor and a second terminal of the switch transistor operatively connected to a voltage source; and

a variable capacitor operatively connected between the voltage source and the gate of the readout transistor.

6. An imaging system, comprising:

an imaging area that includes a plurality of pixels; and

one or more flicker detection regions each comprising one or more pixels, wherein the one or more pixels in at least one flicker detection are sampled multiple times while the plurality of pixels in the imaging area capture an image; and

a processor adapted to enable the plurality of pixels in at least one flicker detection region to be sampled multiple times while the plurality of pixels in the imaging area capture an image and adapted to detect flicker in the image based on the samples read out of the plurality of pixels in the at least one flicker region.

7. The imaging system as in claim 6, further comprising first readout circuitry operatively connected to the plurality of pixels in the imaging area.

8. The imaging system as in claim 7, further comprising second readout circuitry operatively connected to the one or more pixels in a flicker detection region.

9. The imaging system as in claim 7, wherein the processor is operatively connected to the first readout circuitry.

10. The imaging system as in claim 8, wherein the processor is operatively connected to the second readout circuitry.

11. A method for capturing an image in an image sensor, wherein the image sensor includes an imaging area comprising one or more pixels and one or more flicker detection regions each comprising one or more pixels, the method comprising:

capturing an image with at least one pixel in the imaging area;

substantially simultaneously accumulating charge in the one or more pixels in at least one flicker region;

performing multiple readout operations to obtain samples from the one or more pixels in the at least one flicker detection region while the at least one pixel in the imaging area captures the image; and

detecting flicker in the image by analyzing the samples.

12. The method as in claim 11, further comprising compensating for the flicker.

13. The method as in claim 12, wherein compensating for the flicker comprises adjusting an exposure time for capturing the image.

14. The method as in claim 11, further comprising prior to analyzing the samples, averaging the samples obtained in each readout operation.

15. The method as in claim 11, further comprising prior to performing multiple readout operations to obtain samples from the one or more pixels in the at least one flicker detection region, averaging the samples by combining the samples on a common sense node operatively connected to each pixel in the at least one flicker detection region.

16. The method as in claim 11, further comprising prior to performing multiple readout operations to obtain samples from the one or more pixels in the at least one flicker detection region, averaging the samples by combining the samples on a common photo-current summing node operatively connected to each pixel in the at least one flicker detection region.

17. The method as in claim 11, wherein analyzing the samples to detect flicker comprises performing a Fourier transform on the samples.

18. The method as in claim 11, wherein analyzing the samples to detect flicker comprises performing a correlation with the samples and a known flicker pattern to detect flicker.

19. The method as in claim 11, wherein analyzing the samples to detect flicker comprises performing measuring a distance between maxima and minima in the samples to detect flicker.

20. The method as in claim 11, further comprising determining a frequency of the detected flicker.

21. A method for enabling a flicker detection mode in an image sensor that includes an imaging area comprising one or more pixels and one or more flicker detection regions each comprising one or more pixels, the method comprising:

determining whether flicker is to be detected using at least one flicker detection region when an image is to be captured by at least one pixel in the imaging area;

if flicker is to be detected, reading out charge in the one or more pixels in the at least one flicker detection region multiple times while the image is being captured by the at least one pixel in the imaging area.

22. The method as in claim 21, further comprising if flicker will not be detected, capturing the image using the one or more pixels in the at least one flicker detection region and the at least one pixel in the imaging area.