Multiple sampling via a time-indexed method to achieve wide dynamic ranges
First Claim
1. An image sensor, comprising:
- a sensor array comprising a two-dimensional array of pixel elements, each of said pixel elements of said sensor array outputting digital signals as pixel data representing an image of a scene, said digital signals being serial bit streams indicative of a light intensity impinging upon each pixel element, and said sensor array generating multiple sets of pixel data indicative of multiple representations of said image at a plurality of exposure times;
a data memory, in communication with said sensor array, for storing said pixel data for each of said pixel, elements where said pixel data for each pixel element is associated with a representation of said image taken at one of said plurality of exposure times; and
a threshold memory, in communication with said sensor array, for storing a threshold flag for each of said pixel elements, said threshold flag having a first value when said pixel data associated with a pixel element exceeds a predetermined threshold value and having a second value when said pixel data does not exceed the predetermined threshold value, wherein said threshold flag, once being set to said first value at one of said plurality of exposure times, retains said first value through the remaining exposure times of said plurality of exposure times,wherein said data memory stores pixel data for each pixel element associated with a representation of said image at each of the plurality of exposure times when said threshold flag in said threshold memory associated with the respective pixel element has said second value; and
wherein said sensor array, said data memory and said threshold memory are fabricated in an integrated circuit.
3 Assignments
0 Petitions
Accused Products
Abstract
An architecture for a digital pixel sensor is disclosed in which the dynamic range of the sensor is increased by taking samples of a subject to be recorded, where each sample is taken over an interval of a different duration than the other samples. In the preferred embodiment of the invention, an array of pixel elements is fabricated in an integrated circuit. Each of the pixel elements outputs a digital signal and comprises a photodetector and an analog to digital converter. The photodetector is integrated with the analog to digital converter. An array of threshold memory cells, each corresponding to one of the pixel elements, is also provided. An array of time memory cells, each corresponding to one of the pixel elements, establishes a different sampling time for each of the pixel elements for each of multiple samples. An array of memory elements, each coupled to one of the pixel elements, is also provided. The memory elements are also fabricated in the integrated circuit. The memory elements only receive a value from a corresponding one of the pixel elements when the content in a corresponding one of the threshold memory cells permits. In this way, multiple samples may be collected for a subject to be recorded to thereby extend the dynamic range of a photodetector. Integration of the photodetector and the memory that implements this mechanism into the same integrated circuit avoids the latency that would be experienced if an external memory was used.
-
Citations
13 Claims
-
1. An image sensor, comprising:
-
a sensor array comprising a two-dimensional array of pixel elements, each of said pixel elements of said sensor array outputting digital signals as pixel data representing an image of a scene, said digital signals being serial bit streams indicative of a light intensity impinging upon each pixel element, and said sensor array generating multiple sets of pixel data indicative of multiple representations of said image at a plurality of exposure times; a data memory, in communication with said sensor array, for storing said pixel data for each of said pixel, elements where said pixel data for each pixel element is associated with a representation of said image taken at one of said plurality of exposure times; and a threshold memory, in communication with said sensor array, for storing a threshold flag for each of said pixel elements, said threshold flag having a first value when said pixel data associated with a pixel element exceeds a predetermined threshold value and having a second value when said pixel data does not exceed the predetermined threshold value, wherein said threshold flag, once being set to said first value at one of said plurality of exposure times, retains said first value through the remaining exposure times of said plurality of exposure times, wherein said data memory stores pixel data for each pixel element associated with a representation of said image at each of the plurality of exposure times when said threshold flag in said threshold memory associated with the respective pixel element has said second value; and wherein said sensor array, said data memory and said threshold memory are fabricated in an integrated circuit. - View Dependent Claims (2, 3, 4, 5, 6)
-
-
7. A method for generating electrical signals representing an image in a digital image sensor, comprising:
-
generating digital signals as pixel data at a plurality of exposure times, multiple sets of pixel data being generated indicative of multiple representations of said image at said plurality of exposure times, said digital signals being serial bit streams generated at each pixel element in a sensor array of pixel elements formed on an integrated circuit and corresponding to a level of an analog signal indicative of a light intensity impinging on said pixel element; providing a threshold memory on the same integrated circuit including a plurality of threshold flag, each threshold flag associated with a pixel element in said sensor array; setting each threshold flag in said threshold memory to a first value; at each exposure time before the last exposure time of said plurality of exposure times, determining if said pixel data of a first pixel element in said sensor array exceeds a predetermined threshold value; if said pixel data exceeds said predetermined threshold value and said threshold flag associated with said first pixel element has said first value, storing said pixel data in a location in a data memory provided on the same integrated circuit associated with said first pixel element and setting said threshold flag associated with said first pixel element to a second value, said threshold flag having said second value for preventing further update of pixel data for said first pixel element, wherein said threshold flag, once being set to said second value at one of said plurality of exposure times, retains said second value through the remaining exposure times of said plurality of exposure times; and if said pixel data does not exceed said predetermined threshold value and said threshold flag associated with said first pixel element has said first value, storing said pixel data for said first pixel element in said location in said data memory. - View Dependent Claims (8, 9, 10)
-
-
11. A method for generating electrical signals representing an image in a digital image sensor, comprising:
-
generating digital signals as pixel data at a plurality of exposure times, multiple sets of pixel data being generated indicative of multiple representations of said image at said plurality of exposure times, said digital signals being serial bit streams generated at each pixel element in a sensor array of pixel elements formed on an integrated circuit and corresponding to a level of an analog signal indicative of a light intensity impinging on said pixel element; providing a threshold memory on the same integrated circuit including a plurality of threshold flag, each threshold flag associated with a pixel element in said sensor array; setting each threshold flag in said threshold memory to a first value; at a first exposure time, storing said pixel data for each of said pixel elements of said sensor array in a data memory on the same integrated circuit; determining if pixel data of each of said pixel elements exceeds a predetermined threshold value; when said pixel data of a pixel element exceeds said predetermined threshold value, setting said threshold flag associated with said pixel element to a second value, said threshold flag having said second value for preventing further update of pixel data for said pixel element, wherein said threshold flag, once being set to said second value at said first exposure time, retains said second value through the remaining exposure times of said plurality of exposures times; at each exposure time after the first exposure time, determining if pixel data of each of said pixel elements exceeds said predetermined threshold value; if said pixel data of a pixel element exceeds said predetermined threshold value and said threshold flag associated with said pixel element has said first value, storing said pixel data in a location in a data memory associated with first pixel element and setting said threshold flag associated with said pixel element to said second value; and if said pixel data of a pixel element does not exceed said predetermined threshold value and said threshold flag associated with said pixel element has said first value, storing said pixel data for said pixel element in said location in said data memory. - View Dependent Claims (12, 13)
-
Specification