Line-interleaved image sensors

• US 9,894,304 B1
• Filed: 08/17/2015
• Issued: 02/13/2018
• Est. Priority Date: 08/18/2014
• Status: Active Grant

• Current Assignee: Rambus Inc.
• Original Assignee: Rambus Inc.
• Inventors: Smith, Craig M., Guidash, Michael, Vogelsang, Thomas, Endsley, Jay, Ching, Michael T.
• Primary Examiner(s): Nguyen, Luong T
• Application Number:
  US14/827,838
• Time in Patent Office: 911 Days
• CPC Class Codes: G06T 3/4015 Image demosaicing, e.g. colour filter arrays [CFA] or Bayer patterns
• CPC Class Codes: H04N 2209/046 Colour interpolation to calculate the missing colour values
• CPC Class Codes: H04N 23/843 Demosaicing, e.g. interpolating colour pixel values
• CPC Class Codes: H04N 25/583 with different integration times
• CPC Class Codes: H04N 25/589 with different integration times, e.g. short and long exposures
• CPC Class Codes: H04N 25/75 Circuitry for providing, modifying or processing image signals from the pixel array

Abstract

Photocharge is integrated within a first plurality of pixels of an integrated-circuit image sensor during a first exposure interval. A read-out signal is output from each pixel of the first plurality of pixels upon conclusion of the first exposure interval, each read-out signal indicating a respective level of photocharge integrated within the corresponding pixel during the first exposure interval. Photocharge is also integrated within a second plurality of pixels during a second exposure interval that transpires concurrently with the first exposure interval and has a duration not more than half the duration of the first exposure interval. A read-out signal is output from each pixel of the second plurality of pixels at least twice with respect to the second exposure interval, with each such read-out signal indicating a respective level of photocharge integrated within the corresponding pixel during at least a portion of the second exposure interval.

Claims

1. A method of operation within an integrated-circuit image sensor, the method comprising:

integrating photocharge within a first plurality of pixels during a first exposure interval;

outputting a read-out signal from each pixel of the first plurality of pixels upon conclusion of the first exposure interval, the read-out signal output from each pixel of the first plurality of pixels indicating a respective level of photocharge integrated within that pixel during the first exposure interval;

integrating photocharge within a second plurality of pixels during a second exposure interval that transpires concurrently with the first exposure interval and has a duration not more than half the duration of the first exposure interval; and

outputting a read-out signal from each pixel of the second plurality of pixels at least twice with respect to the second exposure interval, the read-out signal output from each pixel of the second plurality of pixels indicating a respective level of photocharge integrated within that pixel during at least a portion of the second exposure interval.

2. The method of claim 1 wherein the outputting the read-out signal from each pixel of the second plurality of pixels at least twice with respect to the second exposure interval comprises outputting a first read-out signal from each pixel of the second plurality of pixels after a first fraction of the second exposure interval transpires, and outputting a second read-out signal from each pixel of the second plurality of pixels after a second fraction of the second exposure interval transpires, the first and second fractions of the second exposure interval transpiring nonconcurrently.

3. The method of claim 2 wherein the first and second fractions of the second exposure interval have different durations and wherein outputting a read-out signal from each pixel of the second plurality of pixels at least twice comprises outputting first and second read-out signals from each pixel of the second plurality of pixels, the method further comprising:

generating respective first and second digital values corresponding to the first and second read-out signals from each pixel of the second plurality of pixels;

scaling at least one of the first and second digital values to compensate for the different durations of the first and second fractions of the second exposure interval; and

after scaling at least one of the first and second digital values, summing the first and second digital values to generate at least a portion of a short-exposure digital pixel value for a corresponding pixel of the second plurality of pixels.

4. The method of claim 2 wherein the outputting the first read-out signal from each pixel of the second plurality of pixels comprises outputting a partial read-out signal from a first pixel of the second plurality of pixels, determining from the partial read-out signal whether a threshold level of charge has integrated within the first pixel and, if the threshold level of charge is determined to have integrated within the first pixel, outputting a full read-out signal from the first pixel representative of total charge integrated within the first pixel during the first fraction of the second exposure interval.

5. The method of claim 1 wherein outputting a read-out signal from each pixel of the second plurality of pixels at least twice comprises outputting first and second read-out signals from each pixel of the second plurality of pixels, the method further comprising:

generating respective first and second digital values corresponding to the first and second read-out signals from each pixel of the second plurality of pixels; and

summing the first and second digital values to generate at least a portion of a short-exposure digital pixel value for a corresponding pixel of the second plurality of pixels.

6. The method of claim 5 further comprising generating a long-exposure digital pixel value corresponding to the read-out signal output from each pixel of the first plurality of pixels, and generating a finalized output image based at least in part on a comparison of the long-exposure digital pixel value and the short-exposure digital pixel value.

7. The method of claim 1 wherein the first and second exposure intervals conclude contemporaneously.

8. The method of claim 1 wherein outputting a read-out signal from each pixel of the second plurality of pixels at least twice with respect to the second exposure interval comprises outputting a read-out signal from each pixel of the second plurality of pixels at least three times with respect to the second exposure interval, including outputting a first read-out signal from each pixel of the second plurality of pixels after a first fraction of the second exposure interval transpires, outputting a second read-out signal from each pixel of the second plurality of pixels after a second fraction of the second exposure interval transpires, and outputting a third read-out signal from each pixel of the second plurality of pixels after a third fraction of the second exposure interval transpires, the first, second and third fractions of the second exposure interval transpiring nonconcurrently and collectively spanning the second exposure interval.

9. An integrated-circuit image sensor comprising:

a pixel array including spatially interleaved first and second pixel subarrays; and

read-out circuitry to;

enable each pixel of the first pixel subarray to output a respective read-out signal upon conclusion of a first exposure interval, the read-out signal output from each pixel of the first pixel subarray indicating a respective level of photocharge integrated within that pixel during the first exposure interval, and

enable each pixel of the second pixel subarray to output a respective read-out signal at least twice with respect to a second exposure interval, the read-out signal output from each pixel of the second pixel subarray indicating a respective level of photocharge integrated within that pixel during at least a portion of the second exposure interval.

10. The integrated-circuit image sensor of claim 9 wherein the read-out circuitry to enable each pixel of the second pixel subarray to output the respective read-out signal at least twice with respect to the second exposure interval comprises circuitry to enable each pixel of the second pixel subarray to output a first read-out signal after a first fraction of the second exposure interval transpires and a second read-out signal after a second fraction of the second exposure interval transpires, the first and second fractions of the second exposure interval transpiring nonconcurrently.

11. The integrated-circuit image sensor of claim 10 wherein the first and second fractions of the second exposure interval have different durations, wherein the read-out circuitry further comprises analog-to-digital conversion circuitry to generate respective first and second digital values corresponding to the first and second read-out signals from each pixel of the second pixel subarray, and wherein the integrated-circuit image sensor further comprises reconstruction circuitry to:

scale at least one of the first and second digital values to compensate for the different durations of the first and second fractions of the second exposure interval; and

after scaling at least one of the first and second digital values, sum the first and second digital values to generate at least a portion of a short-exposure digital pixel value for a corresponding pixel of the second pixel subarray.

12. The integrated-circuit image sensor of claim 10 wherein the circuitry to enable each pixel of the second pixel subarray to output the first read-out signal after the first fraction of the second exposure interval transpires and the second read-out signal after the second fraction of the second exposure interval transpires comprises conditional-read circuitry to:

enable a first pixel of the second pixel subarray to output a partial read-out signal;

determine from the partial read-out signal whether a threshold level of charge has integrated within the first pixel; and

if the threshold level of charge is determined to have integrated within the first pixel, enable the first pixel to output a full read-out signal representative of total charge integrated within the first pixel during the first fraction of the second exposure interval.

13. The integrated-circuit image sensor of claim 9 wherein the read-out circuitry to enable each pixel of the second pixel subarray to output a respective read-out signal at least twice with respect to the second exposure interval comprises analog-to-digital conversion circuitry to generate respective first and second digital values corresponding to first and second read-out signals output from each pixel of the second pixel subarray, and wherein the integrated-circuit image sensor further comprises circuitry that sums the first and second digital values to generate at least a portion of a short-exposure digital pixel value for the corresponding pixel of the second pixel subarray.

14. The integrated-circuit image sensor of claim 13 wherein the read-out circuitry comprises analog-to-digital conversion circuitry to generate a long-exposure digital pixel value corresponding to the read-out signal output from each pixel of the first pixel subarray, and wherein the integrated-circuit image sensor further comprises reconstruction circuitry to generate a finalized output image based at least in part on a comparison of the long-exposure digital pixel value and the short-exposure digital pixel value.

15. The integrated-circuit image sensor of claim 9 wherein the first and second intervals conclude contemporaneously.

16. The integrated-circuit image sensor of claim 9 wherein the read-out circuitry to enable each pixel of the second pixel subarray to output a respective read-out signal at least twice with respect to the second exposure interval comprises circuitry to enable each pixel of the second pixel subarray to output a read-out signal at least three times with respect to the second exposure interval, including a first read-out signal from each pixel of the second pixel subarray after a first fraction of the second exposure interval transpires, a second read-out signal from each pixel of the second pixel subarray after a second fraction of the second exposure interval transpires, and a third read-out signal from each pixel of the second pixel subarray after a third fraction of the second exposure interval transpires, the first, second and third fractions of the second exposure interval transpiring nonconcurrently and collectively spanning the second exposure interval.

17. A method of operation within an integrated-circuit image sensor, the method comprising:

integrating photocharge within a first plurality of pixels during a first exposure interval;

outputting a read-out signal from each pixel of the first plurality of pixels upon conclusion of the first exposure interval, the read-out signal output from each pixel of the first plurality of pixels indicating a respective level of photocharge integrated within that pixel during the first exposure interval;

integrating photocharge within a second plurality of pixels during a second exposure interval that transpires concurrently with the first exposure interval and has a duration not more than half the duration of the first exposure interval; and

outputting read-out signals from the second plurality of pixels in each of at least two subintervals of the second exposure interval, including outputting read-out signals from the second plurality of pixels that indicate a combined level of photocharge integrated within respective groups of at least two pixels of the second plurality of pixels during at least a portion of the second exposure interval.

18. The method of claim 17 wherein the outputting read-out signals from the second plurality of pixels in each of at least two subintervals of the second exposure interval comprises outputting a first read-out signal from a first group of at least two pixels of the second plurality of pixels after a first fraction of the second exposure interval transpires, and outputting a second read-out signal from the first group of at least two pixels of the second plurality of pixels after a second fraction of the second exposure interval transpires, the first and second fractions of the second exposure interval transpiring nonconcurrently.

19. The method of claim 17 wherein the outputting read-out signals from the second plurality of pixels that indicate a combined level of photocharge integrated within respective groups of at least two pixels of the second plurality of pixels comprises outputting read-out signals that indicate a combined level of photocharge integrated within respective groups of at least two pixels in which the constituent pixels of each respective group are disposed in either a single row of pixels within the integrated-circuit image sensor or in a single column of pixels within the integrated-circuit image sensor.

20. The method of claim 17 wherein outputting read-out signals from the second plurality of pixels that indicate a combined level of photocharge integrated within respective groups of at least two pixels of the second plurality of pixels comprises outputting read-out signals that indicate a combined level of photocharge integrated within respective groups of at least four pixels, each group of at least four pixels including pixels disposed in different rows of pixels within the integrated-circuit image sensor and pixels disposed in different columns of pixels within the integrated-circuit image sensor.