Image sensor apparatus and method for obtaining multiple exposures with zero interframe time

• US 10,652,478 B2
• Filed: 07/23/2019
• Issued: 05/12/2020
• Est. Priority Date: 09/04/2012
• Status: Active Grant

• Current Assignee: Duelight LLC
• Original Assignee: Duelight LLC
• Inventors: Rivard, William, Feder, Adam, Kindle, Brian
• Primary Examiner(s): Jerabek, Kelly L
• Application Number:
  US16/519,244
• Publication Number:
  US 20190349510A1
• Time in Patent Office: 294 Days
• Field of Search: 3482291, 348370-371, 382162, 382167-169, 382284
• CPC Class Codes: G06T 2207/20208 High dynamic range [HDR] image processing
• CPC Class Codes: G06T 2207/20221 Image fusion; Image merging
• CPC Class Codes: G06T 5/50 using two or more images, e.g. averaging or subtraction
• CPC Class Codes: H04N 23/6811 based on the image signal
• CPC Class Codes: H04N 23/72 Combination of two or more compensation controls
• CPC Class Codes: H04N 23/741 by increasing the dynamic range of the image compared to the dynamic range of the electronic image sensors
• CPC Class Codes: H04N 23/76 by influencing the image signals

Abstract

A system, method, and computer program product are provided for obtaining multiple exposures with zero interframe time. In use, an analog signal associated with an image associated with an image of an image sensor is received. Amplified analog signals associated with the image are generated by amplifying the analog signal utilizing gains. The amplified analog signals are transmitted to analog-to-digital converter circuits. The amplified analog signals are converted to digital signals utilizing the analog-to-digital converter circuits. The digital signals are combined to create a high dynamic range (HDR) image.

Claims

1. An apparatus, comprising:

circuitry for;

receiving an analog signal associated with an image of an image sensor;

generating a first amplified analog signal associated with the image by amplifying the analog signal utilizing a first gain, wherein the first gain is applied to analog pixel values;

transmitting the first amplified analog signal to a first analog-to-digital converter circuit;

converting the first amplified analog signal to a first digital signal utilizing the first analog-to-digital converter circuit;

generating a second amplified analog signal associated with the image by amplifying the analog signal utilizing a second gain, wherein the second gain is applied to the analog pixel values;

transmitting the second amplified analog signal to a second analog-to-digital converter circuit;

converting the second amplified analog signal to a second digital signal utilizing the second analog-to-digital converter circuit;

generating a third amplified analog signal associated with the image by amplifying the analog signal utilizing a third gain, wherein the third gain is applied to the analog pixel values;

transmitting the third amplified analog signal to a third analog-to-digital converter circuit;

converting the third amplified analog signal to a third digital signal utilizing the third analog-to-digital converter circuit; and

causing the first digital signal, the second digital signal, and the third digital signal to be combined to create a high dynamic range (HDR) image.

2. The apparatus of claim 1, wherein the apparatus is operable such that the analog signal is amplified utilizing the first gain simultaneously with at least one of the amplification of the analog signal utilizing the second gain or the amplification of the analog signal utilizing the third gain.

3. The apparatus of claim 1, wherein the apparatus is operable such that the analog signal is amplified utilizing the first gain in serial with at least one of the amplification of the analog signal utilizing the second gain or the amplification of the analog signal utilizing the third gain.

4. The apparatus of claim 1, wherein the first amplified analog signal is converted to the first digital signal concurrent with the conversion of at least one of the second amplified analog signal to the second digital signal or the third amplified analog signal to the third digital signal.

5. The apparatus of claim 1, wherein the apparatus is operable such that the first digital signal is associated with a first light sensitivity value, the second digital signal is associated with a second light sensitivity value, and the third digital signal is associated with a third light sensitivity value.

6. The apparatus of claim 1, wherein the apparatus is operable such that the HDR image is created in response to user input.

7. The apparatus of claim 1, wherein the apparatus is operable such that sliding indicia is displayed, and the HDR image is created in response to the sliding indicia being manipulated by a user.

8. The apparatus of claim 1, wherein the apparatus is operable such that at least one of the first digital signal, the second digital signal, or the third digital signal is further combined with at least a portion of another image.

9. The apparatus of claim 8, wherein the apparatus is operable such that the another image is a second high dynamic range (HDR) image.

10. The apparatus of claim 1, wherein a first digital value specifies the first gain, a second digital value specifies the second gain, and a third digital value specifies the third gain.

11. The apparatus of claim 10, wherein at least one of the first digital value, the second digital value, or the third digital value is selected based on a mapping from the at least one of the first digital value, the second digital value, or the third digital value to an ISO value, and the ISO value is selected by at least one of software executing on the apparatus and a user.

12. The apparatus of claim 1, wherein the first amplified analog signal, the second amplified analog signal, and the third amplified analog signal each include gain-adjusted analog pixel data representative of a common analog value from the analog pixel values of a pixel array of the image sensor.

13. The apparatus of claim 1, wherein the apparatus is operable for transferring at least one of the first digital signal, the second digital signal, or the third digital signal over a network.

14. The apparatus of claim 1, wherein the combining occurs remotely.

15. The apparatus of claim 14, wherein the apparatus is operable for receiving at least a portion of the HDR image resulting from the combining.

16. The apparatus of claim 1, wherein the second gain is based, at least in part, on the first gain and the second gain is at least one of a half stop, one stop, or two stops away from the first gain.

17. The apparatus of claim 1, further comprising circuitry for:

generating a fourth amplified analog signal associated with the image by amplifying the analog signal utilizing a fourth gain, wherein the fourth gain is applied to the analog pixel values; and

transmitting the fourth amplified analog signal to a fourth analog-to-digital convert circuit;

converting the fourth amplified analog signal to a fourth digital signal utilizing the fourth analog-to-digital converter circuit;

combining at least a portion of the fourth digital signal and the HDR image.

18. The apparatus of claim 1, wherein the HDR image is used to create a HDR video.

19. A computer program product comprising computer executable instructions stored on a non-transitory computer readable medium that when executed by a processor instruct the processor to:

receive an analog signal associated with an image of an image sensor;

generate a first amplified analog signal associated with the image by amplifying the analog signal utilizing a first gain, wherein the first gain is applied to analog pixel values;

transmit the first amplified analog signal to a first analog-to-digital converter circuit;

convert the first amplified analog signal to a first digital signal utilizing the first analog-to-digital converter circuit;

generate a second amplified analog signal associated with the image by amplifying the analog signal utilizing a second gain, wherein the second gain is applied to the analog pixel values;

transmit the second amplified analog signal to a second analog-to-digital converter circuit;

convert the second amplified analog signal to a second digital signal utilizing the second analog-to-digital converter circuit;

generate a third amplified analog signal associated with the image by amplifying the analog signal utilizing a third gain, wherein the third gain is applied to the analog pixel values;

transmit the third amplified analog signal to a third analog-to-digital converter circuit;

convert the third amplified analog signal to a third digital signal utilizing the third analog-to-digital converter circuit; and

cause the first digital signal, the second digital signal, and the third digital signal to be combined to create a high dynamic range (HDR) image.

20. A method, comprising:

receiving, using a processor, an analog signal associated with an image of an image sensor;

generating, using the processor, a first amplified analog signal associated with the image by amplifying the analog signal utilizing a first gain, wherein the first gain is applied to analog pixel values;

transmitting, using the processor, the first amplified analog signal to a first analog-to-digital converter circuit;

converting, using the processor, the first amplified analog signal to a first digital signal utilizing the first analog-to-digital converter circuit;

generating, using the processor, a second amplified analog signal associated with the image by amplifying the analog signal utilizing a second gain, wherein the second gain is applied to the analog pixel values;

transmitting, using the processor, the second amplified analog signal to a second analog-to-digital converter circuit;

converting, using the processor, the second amplified analog signal to a second digital signal utilizing the second analog-to-digital converter circuit;

generating, using the processor, a third amplified analog signal associated with the image by amplifying the analog signal utilizing a third gain, wherein the third gain is applied to the analog pixel values;

transmitting, using the processor, the third amplified analog signal to a third analog-to-digital converter circuit;

converting, using the processor, the third amplified analog signal to a third digital signal utilizing the third analog-to-digital converter circuit; and

causing, using the processor, the first digital signal, the second digital signal, and the third digital signal to be combined to create a high dynamic range (HDR) image.