Sensor architecture using frame-based and event-based hybrid scheme

• US 9,986,179 B2
• Filed: 09/24/2015
• Issued: 05/29/2018
• Est. Priority Date: 09/30/2014
• Status: Active Grant

• Current Assignee: Qualcomm, Inc.
• Original Assignee: Qualcomm, Inc.
• Inventors: Govil, Alok
• Primary Examiner(s): Haskins, Twyler
• Assistant Examiner(s): Garces-Rivera, Angel L
• Application Number:
  US14/864,700
• Publication Number:
  US 20160094796A1
• Time in Patent Office: 978 Days
• CPC Class Codes: H04N 25/44 by partially reading an SSIS array
• CPC Class Codes: H04N 25/445 by skipping some contiguous pixels within the read portion of the array
• CPC Class Codes: H04N 25/711 Time delay and integration [TDI] registers; TDI shift registers
• CPC Class Codes: H04N 25/75 Circuitry for providing, modifying or processing image signals from the pixel array
• CPC Class Codes: H04N 25/771 comprising storage means other than floating diffusion

Abstract

A hybrid camera sensor offers efficient image sensing by periodically evaluating pixels at a certain frame rate and disregarding values of pixels that have changed less than a threshold amount. Because only a fraction of pixels in the camera sensor may change values from frame to frame, this can result in faster readout times, which can optionally enable increased frame rates.

Claims

1. An apparatus for providing image sensing, the apparatus comprising:

a pixel array having a plurality of pixels arranged in two dimensions, wherein;

input sensed by each pixel of the plurality of pixels results in a value associated with each pixel,

each pixel of the plurality of pixels is configured to be periodically evaluated at a frame rate, and

each pixel of the plurality of pixels comprises at least one output, the at least one output comprises an analog output that provides an output signal to peripheral circuitry only when the value associated with each pixel has changed above a threshold level since the previous evaluation of the pixel.

2. The apparatus of claim 1, wherein the at least one output further comprises a digital output indicative of whether the value associated with the pixel has changed beyond the threshold level since the previous evaluation of the pixel.

3. The apparatus of claim 1, further comprising, for at least one pixel of the plurality of pixels, an analog-to-digital converter (ADC) coupled with the analog output of the least one pixel and configured to be in a low-power mode when it is determined, from a digital output signal of the pixel, that the value associated with the pixel has not changed beyond the threshold level since the previous evaluation of the pixel.

4. The apparatus of claim 1, further comprising:

an analog-to-digital converter (ADC) coupled with the analog output of at least one pixel of the plurality of pixels; and

additional circuitry coupled with an output of the ADC, wherein the additional circuitry is configured to ignore an output signal of the ADC when it is determined, from a digital output signal of the at least one pixel, that the value associated with the at least one pixel has not changed beyond the threshold level since the previous evaluation of the at least one pixel.

5. The apparatus of claim 1, further comprising a processing unit configured to adjust an integration time.

6. The apparatus of claim 5, wherein the processing unit is further configured to modify a pixel exposure value associated with a pixel of the plurality of pixels based on the integration time.

7. The apparatus of claim 1, further comprising a processing unit configured to adjust the frame rate.

8. A method for providing image sensing, the method comprising:

for each pixel in a plurality of pixels in a pixel array, sensing a value associated with the pixel;

periodically evaluating each pixel in the plurality of pixels at a frame rate; and

providing, at each pixel of the plurality of pixels, at least one output, the at least one output comprising an analog output that provides an output signal to peripheral circuitry only when the value associated with the pixel has changed beyond above a threshold level since a previous evaluation of the pixel.

9. The method of claim 8, wherein the at least one output further comprises a digital output indicative of whether the value associated with the pixel has changed beyond the threshold level since the previous evaluation of the pixel.

10. The method of claim 8, further comprising operating an analog-to-digital converter (ADC) coupled with the analog output of the least one pixel of the plurality of pixels in a low-power mode when it is determined, from a digital output signal of the pixel, that the value associated with the pixel has not changed beyond the threshold level since the previous evaluation of the pixel.

11. The method of claim 8, further comprising ignoring an output signal of an analog-to-digital converter (ADC) coupled with the analog output of at least one pixel of the plurality of pixels when it is determined, from a digital output signal of the at least one pixel, that the value associated with the at least one pixel has not changed beyond the threshold level since the previous evaluation of the at least one pixel.

12. The method of claim 8, further comprising adjusting an integration time of at least one pixel of the plurality of pixels.

13. The method of claim 12, further comprising modifying a pixel exposure value associated with the at least one pixel based on the integration time.

14. The method of claim 8, further comprising adjusting the frame rate.

15. An apparatus comprising:

means for sensing, for each pixel in a plurality of pixels in a pixel array, a value associated with the pixel;

means for periodically evaluating each pixel in the plurality of pixels at a frame rate; and

means for providing, at each pixel of the plurality of pixels, at least one output, the means for providing at least one output comprising means for providing an analog output signal to peripheral circuitry only when the value associated with each pixel has changed above a threshold level since a previous evaluation of the pixel.

16. The apparatus of claim 15, wherein the means for providing at least one output further comprise means for providing a digital output indicative of whether the value associated with the pixel has changed beyond the threshold level since the previous evaluation of the pixel.

17. The apparatus of claim 15, further comprising:

means for causing an analog-to-digital converter (ADC) coupled with the means for providing an analog output signal of the least one pixel of the plurality of pixels to operate in a low-power mode when it is determined, from a digital output signal of the pixel, that the value associated with the pixel has not changed beyond the threshold level since the previous evaluation of the pixel.

18. The apparatus of claim 15, further comprising means for ignoring an output signal of an analog-to-digital converter (ADC) coupled with the analog output of at least one pixel of the plurality of pixels when it is determined, from a digital output signal of the at least one pixel, that the value associated with the at least one pixel has not changed beyond the threshold level since the previous evaluation of the at least one pixel.

19. The apparatus of claim 15, further comprising means for adjusting an integration time of at least one pixel of the plurality of pixels.

20. The apparatus of claim 19, further comprising means for modifying a pixel exposure value associated with the at least one pixel based on the integration time.

21. The apparatus of claim 15, means for adjusting the frame rate.

22. A non-transitory computer-readable medium having instructions embedded thereon for processing an image, the instructions, when executed by one or more processing units, cause the one or more processing units to:

periodically evaluate each pixel in a plurality of pixels at a frame rate, wherein input sensed by each pixel of the plurality of pixels results in a value associated with each pixel; and

receive, for each pixel of the plurality of pixels, at least one output, the at least one output comprising an analog output that provides an output signal to peripheral circuitry only when the value associated with the pixel has changed above a threshold level since a previous evaluation of the pixel.

23. The non-transitory computer-readable medium of claim 22, wherein the instructions for causing the one or more processing units to receive the at least one output include instructions for receiving a digital output indicative of whether the value associated with the pixel has changed beyond the threshold level since the previous evaluation of the pixel.

24. The non-transitory computer-readable medium of claim 22, further comprising instructions for causing the one or more processing units to operate an analog-to-digital converter (ADC) coupled with the analog output of the least one pixel of the plurality of pixels in a low-power mode when it is determined, from a digital output signal of the pixel, that the value associated with the pixel has not changed beyond the threshold level since the previous evaluation of the pixel.

25. The non-transitory computer-readable medium of claim 22, further comprising instructions for causing the one or more processing units to ignore an output signal of an analog-to-digital converter (ADC) coupled with the analog output of at least one pixel of the plurality of pixels when it is determined, from a digital output signal of the at least one pixel, that the value associated with the at least one pixel has not changed beyond the threshold level since the previous evaluation of the at least one pixel.

26. The non-transitory computer-readable medium of claim 22, further comprising instructions for causing the one or more processing units to adjust an integration time of at least one pixel of the plurality of pixels.

27. The non-transitory computer-readable medium of claim 26, further comprising instructions for causing the one or more processing units to modify a pixel exposure value associated with the at least one pixel based on the integration time.

28. The non-transitory computer-readable medium of claim 22, further comprising instructions for causing the one or more processing units to adjust the frame rate.