Systems and methods for a digital image sensor

• US 10,498,982 B2
• Filed: 12/12/2018
• Issued: 12/03/2019
• Est. Priority Date: 03/15/2013
• Status: Expired due to Fees

• Current Assignee: Duelight LLC
• Original Assignee: Duelight LLC
• Inventors: Feder, Adam Barry, Rivard, William Guie, Kindle, Brian J.
• Primary Examiner(s): Dagnew, Mekonnen D
• Application Number:
  US16/217,848
• Publication Number:
  US 20190124280A1
• Time in Patent Office: 356 Days
• CPC Class Codes: H04N 23/56 provided with illuminating means
• CPC Class Codes: H04N 23/741 by increasing the dynamic range of the image compared to the dynamic range of the electronic image sensors
• CPC Class Codes: H04N 25/583 with different integration times
• CPC Class Codes: H04N 25/75 Circuitry for providing, modifying or processing image signals from the pixel array
• CPC Class Codes: H04N 25/77 Pixel circuitry, e.g. memories, A/D converters, pixel amplifiers, shared circuits or shared components
• CPC Class Codes: H04N 25/771 comprising storage means other than floating diffusion
• CPC Class Codes: H04N 25/772 comprising A/D, V/T, V/F, I/T or I/F converters
• CPC Class Codes: H04N 5/2621 Cameras specially adapted for the electronic generation of special effects during image pickup, e.g. digital cameras, camcorders, video cameras having integrated special effects capability
• CPC Class Codes: H04N 5/2624 for obtaining an image which is composed of whole input images, e.g. splitscreen
• CPC Class Codes: H04N 5/265 Mixing

Abstract

A system, method, and computer program product are provided for generating an image stack. In use, one or more exposure parameters for an image stack are configured. Next, a capture command is received. Further, a pixel array is initialized within an image sensor of the camera module. Moreover, one or more ambient images are sampled within one or more corresponding analog storage planes. Next, if it is determined whether a strobe unit is enabled, where, if it is determined that the strobe unit is enabled, one or more strobe images are sampled within the corresponding analog storage planes.

Claims

1. A camera, comprising:

circuitry configured to;

set one or more exposure parameters for an image stack;

initialize a pixel array within an image sensor of the camera;

commence a sampling of one or more ambient images within at least one corresponding analog storage plane, wherein the sampling of the one or more ambient images occurs within a first duration;

after the first duration commences, commence a sampling of one or more strobe images within the at least one corresponding analog storage plane, using a strobe unit, wherein the sampling of the one or more strobe images occurs within a second duration that ends before the first duration ends.

2. The camera of claim 1, wherein the image stack comprises one ambient image of the one or more ambient images that is stored in a first analog storage plane of the at least one corresponding analog storage plane, and one strobe image of the one or more strobe images that is stored in a second analog storage plane of the at least one corresponding analog storage plane.

3. The camera of claim 1, wherein to set the one or more exposure parameters, the circuitry is configured to at least write one or more registers within the image sensor that specifies exposure time for each of the at least one corresponding analog storage plane, or write one or more registers within the image sensor that specifies exposure sensitivity for each of the at least one corresponding analog storage plane, or write one or more registers within the image sensor that specifies exposure time and exposure sensitivity for each of the at least one corresponding analog storage plane.

4. The camera of claim 1, wherein the camera is implemented within at least one of a digital camera, or a mobile device.

5. The camera of claim 1, wherein to initialize the pixel array, the circuitry is configured to drive voltages on internal nodes of photo-sensitive cells within the at least one corresponding analog storage plane to a reference voltage.

6. The camera of claim 1, wherein the circuitry is configured to directly enable the strobe unit.

7. The camera of claim 1, wherein the circuitry is configured to detect that the strobe unit has been enabled.

8. The camera of claim 1, wherein the camera is configured to store both the one or more ambient images and the one or more strobe images concurrently within the at least one corresponding analog storage plane.

9. The camera of claim 1, wherein the camera is configured to offload at least one of the one or more ambient images prior to sampling the one or more strobe images within the at least one corresponding analog storage plane.

10. The camera of claim 1, wherein the circuitry is further configured to enable simultaneous integration of a photographic scene for at least two corresponding analog storage planes.

11. The camera of claim 10, wherein two or more analog sampling circuits within the at least two corresponding analog storage planes each integrate a respective image during a sampling interval.

12. The camera of claim 1, wherein the circuitry is further configured to:

enable integration to proceed during a first sampling interval for at least two different analog storage planes;

disable integration for at least one analog storage plane of the at least two different analog storage planes; and

enable integration to proceed during a second sampling interval for at least one analog storage plane of the at least two different analog storage planes.

13. The camera of claim 12, wherein the camera is configured to transmit image data corresponding to each of the at least two different analog storage planes to a processing unit.

14. The camera of claim 13, wherein the processing unit is configured to generate the one or more exposure parameters.

15. The camera of claim 1, wherein the sampling of the one or more ambient images includes configuring the circuitry to:

enable integration of a first signal from an associated photodiode on a first analog sampling circuit to generate an ambient sample comprising at least one ambient image of the one or more ambient images; and

disable integration of the first signal within the first analog sampling circuit.

16. The camera of claim 15, wherein the circuitry is further configured to reset the photodiode after disabling integration of the first signal on the first analog sampling circuit.

17. The camera of claim 1, wherein the sampling of the one or more strobe images includes configuring the circuitry to:

enable integration of a first signal from an associated photodiode within a first analog sampling circuit;

disable integration of the first signal on the first analog sampling circuit;

enable integration of a second signal from the associated photodiode on a second analog sampling circuit;

disable integration of the second signal on the second analog sampling circuit; and

enable integration of the first signal on the first analog sampling circuit,

wherein a strobe enable signal is asserted between two different sampling intervals for a same ambient image.

18. The camera of claim 1, wherein the one or more ambient images is blended with the one or more strobe images to form a first synthetic image.

19. A system, comprising:

a camera, configured to sample a photographic scene;

a processing unit in communication with the camera, and configured to;

configure one or more exposure parameters for the image stack;

initialize a pixel array within an image sensor of the camera;

commence a sampling of one or more ambient images within at least one corresponding analog storage plane, wherein the sampling of the one or more ambient images occurs within a first duration;

after the first duration commences, commence a sampling of one or more strobe images within the at least one corresponding analog storage plane, using a strobe unit, wherein the sampling of the one or more strobe images occurs within a second duration that ends before the first duration ends.

20. A method, comprising:

configuring one or more exposure parameters for an image stack;

initializing a pixel array within an image sensor of a camera;

commencing a sampling of one or more ambient images within at least one corresponding analog storage plane, wherein the sampling of the one or more ambient images occurs within a first duration;

after the first duration commences, commencing a sampling of one or more strobe images within the at least one corresponding analog storage plane, using a strobe unit, wherein the sampling of the one or more strobe images occurs within a second duration that ends before the first duration ends.