Image Sensor with Sensitivity Control and Sensitivity based Wide Dynamic Range

• US 20100302407A1
• Filed: 05/26/2010
• Published: 12/02/2010
• Est. Priority Date: 05/28/2009
• Status: Active Grant

• Current Assignee: Pixim, Inc. (Sony Group Corp.)
• Original Assignee: Pixim, Inc. (Sony Group Corp.)
• Inventors: Adams, Chris, Ayers, Tom, Kang, Jinsuk, Monti, John, Reyneri, Justin
• Granted Patent: US 8,537,241 B2
• Time in Patent Office: Days
• US Class Current: 348/230.1
• CPC Class Codes: H04N 25/46 by combining or binning pixels
• CPC Class Codes: H04N 25/585 with pixels having different sensitivities within the sensor, e.g. fast or slow pixels or pixels having different sizes
• CPC Class Codes: H04N 25/767 Horizontal readout lines, multiplexers or registers
• CPC Class Codes: H04N 25/771 comprising storage means other than floating diffusion
• CPC Class Codes: H04N 25/772 comprising A/D, V/T, V/F, I/T or I/F converters

Abstract

In one embodiment, a method for sensing an image of a scene includes receiving incident light at a image sensing device including an array of at least two regions of pixel elements, providing one or more control parameters where each of the control parameters modifies the sensitivity of the pixel elements, generating control signals for the one or more control parameter for each region of pixel elements where the sensitivity of the pixel elements is varied on a region by region basis. In another embodiment, method for sensing an image of a scene includes generating control signals for controlling two or more control parameters for controlling the pixel elements of an entire array to provide continuous fine grain control of the sensitivity of the pixel elements.

Claims

1. A method for sensing an image of a scene, comprising:

receiving incident light at an image sensing device, the image sensing device comprising an array of pixel elements, the array comprising at least two regions of pixels elements, each region comprising one or more pixel elements;

providing one or more control parameters, each control parameter modifying the sensitivity of the pixel elements in the array;

generating one or more control signals, each control signal for varying a control parameter for a given region of pixel elements of the array, the one or more control signals being generated to vary the sensitivity of the pixels elements on a region by region basis within the array in accordance with the scene; and

generating output signals at the output of the image sensing device indicative of the pixel data at each pixel element, the pixel data of the array of pixel elements collectively representing the image of the scene.

2. The method of claim 1, wherein generating one or more control signals comprises:

generating a plurality of control signals for controlling two or more control parameters for each given region of pixel elements of the array to provide continuous fine grain control of the sensitivity of the pixel elements of the image sensing device.

3. The method of claim 1, wherein the image sensing device comprises a one-dimensional or two-dimensional array of pixel elements.

4. The method of claim 1, wherein providing one or more control parameters comprises:

providing circuitry implementing the one or more control parameters within the array.

5. The method of claim 1, wherein providing one or more control parameters comprises:

providing circuitry implementing the one or more control parameters outside of the array.

6. The method of claim 1, wherein generating one or more control signals comprises:

generating a first set of control signals for controlling a set of control parameters for a first region of pixel elements in the array; and

generating a second set of control signals for controlling the set of control parameters for a second region of pixel elements in the array,

wherein each of the first and second regions of pixel elements comprises one or more pixel elements of the array.

7. The method of claim 1, wherein generating one or more control signals, each control signal for varying a control parameter for a given region of pixel elements of the array, comprises:

generating a control signal to vary a control parameter modifying a size of a photodetector in each pixel or selecting an alternate sized photodetector in each pixel.

8. The method of claim 1, wherein generating one or more control signals, each control signal for varying a control parameter for a given region of pixel elements of the array, comprises:

generating a control signal to control a control parameter modifying a capacitance value used for performing charge-to-voltage conversion in each pixel element.

9. The method of claim 1, wherein generating one or more control signals, each control signal for varying a control parameter for a given region of pixel elements of the array, comprises:

generating a control signal to vary a control parameter modifying an analog gain in each pixel.

10. The method of claim 1, wherein generating one or more control signals, each control signal for varying a control parameter for a given region of pixel elements of the array, comprises:

generating a control signal to vary a control parameter modifying an operating voltage range of an analog-to-digital converter in the image sensing device.

11. The method of claim 1, wherein generating one or more control signals comprises generating the one or more control signals to vary the sensitivity of the pixel elements in the array on a region by region basis in accordance with a lighting level in the scene.

12. The method of claim 1, wherein generating one or more control signals comprises generating the one or more control signals to vary the sensitivity of the pixel elements in the array on a region by region basis in accordance with a content of the scene determined from previous frames of pixel data or determined from predetermined settings.

13. The method of claim 1, further comprising:

storing the one or more control signal for each control parameter in one or more memory elements located in the array adjacent to one or more pixel elements.

14. The method of claim 1, further comprising:

generating a digitized pixel voltage signal indicative of the output signal of each pixel element.

15. The method of claim 14, wherein generating a digitized pixel voltage signal comprises:

generating the digitized pixel voltage signal at each pixel element within the array.

16. An image sensing device, comprising:

an image sensor comprising an array of pixel elements, the array comprising at least two regions of pixels elements, each region comprising one or more pixel elements, the image sensor being configured to generate output signals at each pixel element as pixel data representing an image of a scene, the image sensor implementing one or more control parameters, each control parameter modifying the sensitivity of the pixel elements in the array; and

a control circuit configured to generate one or more control signals, each control signal for varying a control parameter for a given region of pixel elements of the array, the one or more control signals being generated to vary the sensitivity of the pixels elements on a region by region basis within the array in accordance with the scene.

17. The image sensing device of claim 16, wherein the control circuit is fabricated on the same integrated circuit as the image sensing device.

18. The image sensing device of claim 16, wherein the control circuit is fabricated on an integrated circuit separate from the image sensing device.

19. The image sensing device of claim 16, wherein the control circuit generates the one or more control signals in accordance with a content of the scene determined from previous frames of pixel data or determined from predetermined settings.

20. The image sensing device of claim 16, wherein the image sensor implements two or more control parameters and the control circuit generates a plurality of control signals for controlling the two or more control parameters to provide continuous fine grain control of the sensitivity of the pixel elements of the image sensing device.

21. The image sensing device of claim 16, wherein each of the pixel elements comprises a photodetector generating an output signal, and the image sensing device further comprises:

a plurality of analog-to-digital conversion (ADC) circuits configured to convert the output signal from each pixel element to a digitized pixel voltage signal.

22. The image sensing device of claim 21, wherein the plurality of analog-to-digital conversion (ADC) circuits are located within the array of pixel elements, each of the ADC circuits being connected to one or more photodetectors for converting the output signal of each pixel element to a digitized pixel voltage signal.

23. The image sensing device of claim 16, wherein the image sensor comprises a one-dimensional or two-dimensional array of pixel elements.

24. The image sensing device of claim 16, wherein the image sensor comprises circuitry implementing the one or more control parameters within the array.

25. The image sensing device of claim 16, wherein the image sensor comprises circuitry implementing the one or more control parameters outside of the array.

26. The image sensing device of claim 16, wherein the control circuit is configured to generate a first set of control signals for controlling a set of control parameters for a first region of pixel elements in the array and a second set of control signals for controlling the control parameters for a second region of pixel elements in the array, each of the first and second regions of pixel elements comprising one or more pixel elements in the array.

27. The image sensing device of claim 16, wherein the control circuit is configured to generate a first control signal to control a first control parameter modifying a size of a photodetector in each pixel or selecting an alternate sized photodetector in each pixel.

28. The image sensing device of claim 16, wherein the control circuit is configured to generate a second control signal to control a second control parameter modifying a capacitance value used for performing charge-to-voltage conversion in each pixel

29. The image sensing device of claim 16, wherein the control circuit is configured to generate a third control signal to control a third control parameter modifying an analog gain in each pixel

30. The image sensing device of claim 16, wherein the control circuit is configured to generate a fourth control signal to control a fourth control parameter modifying an operating voltage range of an analog-to-digital converter in the image sensing device

31. The image sensing device of claim 16, wherein the control circuit is configured to generate the one or more control signals to vary the sensitivity of the pixel elements in the array on a region by region basis in accordance with a lighting level the scene.

32. The image sensing device of claim 16, wherein the image sensor further comprises one or more memory elements, each memory element being associated with and located adjacent to one or more pixel elements in the array, each memory elements being configured to store the control signal for each control parameter.

33. The image sensing device of claim 16, wherein the image sensor comprises a digital image sensor selected from the group of a CMOS APS image sensor, a CCD image sensor and a DPS image sensor.

34. A method for sensing an image of a scene, comprising:

receiving incident light at an image sensing device, the image sensing device comprising an array of pixel elements;

providing a plurality of control parameters, each control parameter modifying the sensitivity of the pixel elements in the array;

generating a plurality of control signals, each control signal for controlling a control parameter for the entire array of pixel elements, the plurality of control signals being generated to vary the sensitivity of the pixels elements to provide continuous fine grain control of the sensitivity of the pixel elements in accordance with the scene; and

generating output signals at the output of the image sensing device indicative of the pixel data at each pixel element, the pixel data of all pixel elements collectively representing the image of the scene.

35. The method of claim 34, wherein generating a plurality of control signals comprises generating a plurality of control signals in accordance with the scene and determined from previous frames of pixel data or in accordance with predetermined settings.

36. The method of claim 34, wherein generating a plurality of control signals comprises:

generating a first control signal to control a first control parameter modifying a size of a photodetector in each pixel or selecting an alternate sized photodetector in each pixel.

37. The method of claim 34, wherein generating a plurality of control signals comprises:

generating a second control signal to control a second control parameter modifying a capacitance value used for performing charge-to-voltage conversion in each pixel element.

38. The method of claim 34, wherein generating a plurality of control signals comprises:

generating a third control signal to control a third control parameter modifying an analog gain in each pixel.

39. The method of claim 34, wherein generating a plurality of control signals comprises:

generating a fourth control signal to control a fourth control parameter modifying an operating voltage range of an analog-to-digital converter in the image sensing device.

40. The method of claim 34, further comprising:

generating a digitized pixel voltage signal indicative of the output signal of each pixel element.

41. The method of claim 34, wherein generating a digitized pixel voltage signal comprises:

generating the digitized pixel voltage signal at each pixel element within the array.

42. The method of claim 34, wherein providing a plurality of control parameters comprises:

providing circuitry implementing the one or more control parameters within the array.

43. The method of claim 34, wherein providing a plurality of control parameters comprises:

providing circuitry implementing the one or more control parameters outside of the array.

44. An image sensing device, comprising:

an image sensor comprising an array of pixel elements, the image sensor being configured to generate output signals at each pixel element as pixel data representing an image of a scene, the pixel data of all pixel elements collectively representing the image of the scene, the image sensor implementing a plurality of control parameters, each control parameter modifying the sensitivity of the pixel elements in the array; and

a control circuit configured to generate a plurality of control signals, each control signal for controlling a control parameter for the entire array of pixel elements, the plurality of control signals being generated to vary the sensitivity of the pixels elements to provide continuous fine grain control of the sensitivity of the pixel elements in accordance with the scene.

45. The image sensing device of claim 44, wherein each of the pixel elements comprises a photodetector generating an output signal, and the image sensing device further comprises:

a plurality of analog-to-digital conversion (ADC) circuits configured to convert the output signal from each pixel element to a digitized pixel voltage signal.

46. The image sensing device of claim 45, wherein the plurality of analog-to-digital conversion (ADC) circuits are located within the array of pixel elements, each of the ADC circuits being connected to one or more photodetectors for converting the output signal of each pixel element to a digitized pixel voltage signal.

47. The image sensing device of claim 44, wherein the image sensor comprises a one-dimensional or two-dimensional array of pixel elements.

48. The image sensing device of claim 44, wherein the control circuit generates the plurality of control signals in accordance with a content of the scene determined from previous frames of pixel data or determined from predetermined settings.

49. The image sensing device of claim 44, wherein the image sensor comprises circuitry implementing the one or more control parameters within the array.

50. The image sensing device of claim 44, wherein the image sensor comprises circuitry implementing the one or more control parameters outside of the array.

51. The image sensing device of claim 44, wherein the control circuit is configured to generate a first control signal to control a first control parameter modifying a size of a photodetector in each pixel or selecting an alternate sized photodetector in each pixel.

52. The image sensing device of claim 44, wherein the control circuit is configured to generate a second control signal to control a second control parameter modifying a capacitance value used for performing charge-to-voltage conversion in each pixel

53. The image sensing device of claim 44, wherein the control circuit is configured to generate a third control signal to control a third control parameter modifying an analog gain in each pixel

54. The image sensing device of claim 44, wherein the control circuit is configured to generate a fourth control signal to control a fourth control parameter modifying an operating voltage range of an analog-to-digital converter in the image sensing device

55. The image sensing device of claim 44, wherein the control circuit is configured to generate the plurality of control signals to vary the sensitivity of the pixel elements in the entire array in accordance with a lighting level the scene.

56. The image sensing device of claim 44, wherein the image sensor comprises a digital image sensor selected from the group of a CMOS APS image sensor, a CCD image sensor and a DPS image sensor.