Image sensor apparatus and method for obtaining multiple exposures with zero interframe time

• US 10,382,702 B2
• Filed: 02/07/2018
• Issued: 08/13/2019
• Est. Priority Date: 09/04/2012
• Status: Active Grant

• Current Assignee: Duelight LLC
• Original Assignee: Duelight LLC
• Inventors: Rivard, William, Feder, Adam, Kindle, Brian
• Primary Examiner(s): Jerabek, Kelly L
• Application Number:
  US15/891,251
• Publication Number:
  US 20180183989A1
• Time in Patent Office: 552 Days
• Field of Search: 3482231, 3482291, 348370-371, 382162, 382167-169, 382284
• CPC Class Codes: G06T 2207/20208 High dynamic range [HDR] image processing
• CPC Class Codes: G06T 2207/20221 Image fusion; Image merging
• CPC Class Codes: G06T 5/50 using two or more images, e.g. averaging or subtraction
• CPC Class Codes: H04N 23/6811 based on the image signal
• CPC Class Codes: H04N 23/72 Combination of two or more compensation controls
• CPC Class Codes: H04N 23/741 by increasing the dynamic range of the image compared to the dynamic range of the electronic image sensors
• CPC Class Codes: H04N 23/76 by influencing the image signals

Abstract

A system, method, and computer program product are provided for obtaining multiple exposures with zero interframe time. In use, a first an analog signal associated with an image is received from at least one pixel of an image sensor. Next, a first amplified analog signal associated with the image is generated by amplifying the analog signal utilizing a first gain. Further, a second amplified analog signal associated with the image is generated by amplifying the analog signal utilizing a second gain. Finally, the first amplified analog signal and the second amplified analog signal are transmitted.

Claims

1. An apparatus, comprising:

circuitry for;

receiving an analog signal associated with an image of an image sensor, wherein the analog signal includes;

i) at least one analog pixel value of a pixel array of the image sensor;

ii) a line of analog pixel values associated with a line of pixels of the pixel array;

or

iii) a frame of analog pixel values associated with a frame of pixels of the pixel array;

generating a first amplified analog signal associated with the image by amplifying the analog signal utilizing a first gain, wherein the first gain is applied to the analog pixel values associated with (i), (ii), or (iii);

generating a second amplified analog signal associated with the image by amplifying the analog signal utilizing a second gain, wherein the second gain is applied to the analog pixel values associated with (i), (ii), or (iii);

transmitting the first amplified analog signal and the second amplified analog signal to an analog-to-digital converter circuit;

converting the first amplified analog signal to a first digital signal utilizing the analog-to-digital converter circuit;

converting the second amplified analog signal to a second digital signal utilizing the analog-to-digital converter circuit; and

combining the first digital signal and the second digital signal to create a high dynamic range (HDR) image.

2. The apparatus of claim 1, wherein the apparatus is operable such that the analog signal is amplified utilizing the first gain simultaneously with the amplification of the analog signal utilizing the second gain.

3. The apparatus of claim 1, wherein the apparatus is operable such that the analog signal is amplified utilizing the first gain in serial with the amplification of the analog signal utilizing the second gain.

4. The apparatus of claim 1, wherein the first amplified analog signal is converted to the first digital signal concurrent with the conversion of the second amplified analog signal to the second digital signal.

5. The apparatus of claim 1, wherein the apparatus is operable such that the first digital signal has a first light sensitivity value associated therewith and the second digital signal has a second light sensitivity value associated therewith.

6. The apparatus of claim 1, wherein the apparatus is operable such that the first digital signal and the second digital signal are combined, in response to user input.

7. The apparatus of claim 1, wherein the apparatus is operable such that sliding indicia is displayed and the first digital signal and the second digital signal are combined, in response to the sliding indicia being manipulated by a user.

8. The apparatus of claim 1, wherein the apparatus is operable such that at least one of the first digital signal or the second digital signal associated with the image is further combined with at least a portion of another image.

9. The apparatus of claim 8, wherein the apparatus is operable such that the another image is a second high dynamic range (HDR) image.

10. The apparatus of claim 1, wherein a first digital value specifies the first gain, and a second digital value specifies the second gain.

11. The apparatus of claim 10, wherein at least one of the first digital value and the second digital value is selected based on a mapping from the at least one of the first digital value and the second digital value to an ISO value, and the ISO value is selected by at least one of software executing on the apparatus and a user.

12. The apparatus of claim 1, wherein the first amplified analog signal and the second amplified analog signal each include gain-adjusted analog pixel data representative of a common analog value from the at least one analog pixel value of the pixel array of the image sensor.

13. The apparatus of claim 1, wherein the apparatus is operable for transferring at least one of the first digital signal or the second digital signal over a network.

14. The apparatus of claim 1, wherein the combining occurs remotely.

15. The apparatus of claim 14, wherein the apparatus is operable for receiving at least a portion of the HDR image resulting from the combining.

16. The apparatus of claim 1, wherein the second gain is based, at least in part, on the first gain and the second gain is at least one of a half stop, one stop, or two stops away from the first gain.

17. The apparatus of claim 1, further comprising circuitry for:

generating a third amplified analog signal associated with the image by amplifying the analog signal utilizing a third gain, wherein the third gain is applied to the analog pixel values associated with (i), (ii), or (iii); and

transmitting the third amplified analog signal to the analog-to-digital convert circuit;

converting the third amplified analog signal to a third digital signal utilizing the analog-to-digital converter circuit;

combining at least a portion of the third digital signal and the HDR image.

18. The apparatus of claim 1, wherein at least one of the first amplified analog signal or the second amplified analog signal includes brightness-corrected pixel data based on a specified ISO.

19. A computer program product embodied on a non-transitory computer readable medium, comprising:

code for receiving an analog signal associated with an image of an image sensor, wherein the analog signal includes;

i) at least one analog pixel value of a pixel array of the image sensor;

ii) a line of analog pixel values associated with a line of pixels of the pixel array;

or

iii) a frame of analog pixel values associated with a frame of pixels of the pixel array;

code for generating a first amplified analog signal associated with the image by amplifying the analog signal utilizing a first gain, wherein the first gain is applied to the analog pixel values associated with (i), (ii), or (iii);

code for generating a second amplified analog signal associated with the image by amplifying the analog signal utilizing a second gain, wherein the second gain is applied to the analog pixel values associated with (i), (ii), or (iii);

code for transmitting the first amplified analog signal and the second amplified analog signal to an analog-to-digital converter circuit;

code for converting the first amplified analog signal to a first digital signal utilizing the analog-to-digital converter circuit;

code for converting the second amplified analog signal to a second digital signal utilizing the analog-to-digital converter circuit; and

code for combining the first digital signal and the second digital signal to create a high dynamic range (HDR) image.

20. A method, comprising:

receiving an analog signal associated with an image of an image sensor, wherein the analog signal includes;

i) at least one analog pixel value of a pixel array of the image sensor;

ii) a line of analog pixel values associated with a line of pixels of the pixel array;

or

iii) a frame of analog pixel values associated with a frame of pixels of the pixel array;

amplifying the analog signal utilizing a first gain resulting in a first amplified analog signal associated with the image, wherein the first gain is applied to the analog pixel values associated with (i), (ii), or (iii);

amplifying the analog signal utilizing a second gain resulting in a second amplified analog signal associated with the image, wherein the second gain is applied to the analog pixel values associated with (i), (ii), or (iii);

transmitting the first amplified analog signal and the second amplified analog signal to an analog-to-digital converter circuit;

converting the first amplified analog signal to a first digital signal utilizing the analog-to-digital converter circuit;

converting the second amplified analog signal to a second digital signal utilizing the analog-to-digital converter circuit; and

combining the first digital signal and the second digital signal to create a high dynamic range (HDR) image.