SYSTEMS AND METHODS FOR ARRAY CAMERA FOCAL PLANE CONTROL

• US 20140132810A1
• Filed: 11/13/2013
• Published: 05/15/2014
• Est. Priority Date: 11/13/2012
• Status: Active Grant

• Current Assignee: FotoNation Limited (Adeia Inc.)
• Original Assignee: Pelican Imaging Corporation
• Inventors: McMahon, Andrew
• Granted Patent: US 9,143,711 B2
• Time in Patent Office: Days
• US Class Current: 348/281
• CPC Class Codes: G06T 2207/10052 Images from lightfield camera
• CPC Class Codes: H04N 2209/049 having three pick-up sensors
• CPC Class Codes: H04N 23/13 with multiple sensors
• CPC Class Codes: H04N 25/41 Extracting pixel data from a plurality of image sensors simultaneously picking up an image, e.g. for increasing the field of view by combining the outputs of a plurality of sensors
• CPC Class Codes: H04N 25/767 Horizontal readout lines, multiplexers or registers

Abstract

Systems and methods for controlling the parameters of groups of focal planes as focal plane groups in an array camera are described. One embodiment includes a plurality of focal planes, and control circuitry configured to control the capture of image data by the pixels within the focal planes. In addition, the control circuitry includes: a plurality of parameter registers, where a given parameter register is associated with one of the focal planes and contains configuration data for the associated focal plane; and a focal plane group register that contains data identifying focal planes that belong to a focal plane group. Furthermore, the control circuitry is configured to control the imaging parameters of the focal planes in the focal plane groups by mapping instructions that address virtual register addresses to the addresses of the parameter registers associated with focal planes within specific focal plane groups.

Claims

1. An imaging sensor configured to capture a plurality of images using a plurality of focal planes, comprising:

a plurality of focal planes, where each focal plane comprises a plurality of rows of pixels that also form a plurality of columns of pixels and each focal plane is contained within a region that does not contain pixels from another focal plane; and

control circuitry configured to control the capture of image data by the pixels within the focal planes, where the control circuitry is configured so that the capture of image data by the pixels in at least two of the focal planes is separately controllable;

wherein the control circuitry comprises a plurality of registers with associated register addresses;

wherein the plurality of registers comprises;

a plurality of parameter registers, where a given parameter register is associated with one of the plurality of focal planes and contains configuration data for the associated focal plane; and

a focal plane group register that contains data identifying focal planes from the plurality of focal planes that belong to a focal plane group;

wherein the control circuitry is further configured to;

receive commands to write data to and read data from register addresses via an interface;

map a virtual register address to the addresses of the parameter registers associated with the focal planes that belong to the focal plane group;

modify the parameter registers associated with the focal planes in the focal plane group in response to receiving a command to write a value to the virtual register address via the interface; and

control imaging parameters of the plurality of focal planes based upon the configuration data in the parameter register associated with each of the plurality of focal planes.

2. The imaging sensor of claim 1, wherein the control circuitry is further configured to modify the data in the focal plane group register to change the focal planes from the plurality of focal planes that are identified as forming a focal plane group in response to receiving a command to write a value to the register address of the focal plane group register via the interface.

3. The imaging sensor of claim 2, wherein the focal plane group register contains a list of the focal planes in the focal plane group.

4. The imaging sensor of claim 1, wherein the focal plane group register is one of a plurality of focal plane group registers and each focal plane group register contains data identifying focal planes from the plurality of focal planes that belong to a specific focal plane group.

5. The imaging sensor of claim 4, wherein the plurality of focal plane group registers is configured so that a given focal plane belongs to a plurality of different focal plane groups.

6. The imaging sensor of claim 4, wherein the control circuitry is configured to prevent the plurality of focal plane group registers from being configured so that a given focal plane belongs to a predetermined set of focal plane groups.

7. The imaging sensor of claim 1, wherein the configuration data in a given parameter register controls integration time of pixels in the focal plane associated with the given parameter register.

8. The imaging sensor of claim 1, wherein the configuration data in a given parameter register controls a gain applied to pixel outputs of pixels in the focal plane associated with the given parameter register.

9. The imaging sensor of claim 1, wherein the configuration data in a given parameter register controls focal plane operational state of the focal plane associated with the given parameter register.

10. The imaging sensor of claim 1, further comprising:

at least one system descriptor register, where the at least one system descriptor register contains system descriptor data describing the imaging sensor; and

wherein the control circuitry is configured to receive instructions to read data from the at least one system descriptor register via the interface.

11. The imaging sensor of claim 10, wherein the system descriptor data includes at least one piece of data selected from a group consisting of information identifying:

a type of imaging sensor;

a version of the imaging sensor,

a communication protocol supported by the imaging sensor;

an imaging sensor hardware manufacturer;

a hardware manufacturer'"'"'s model and version;

the number of the plurality focal planes;

a layout for the plurality of focal planes;

an initial imaging sensor configuration;

default focal plane groups for the plurality of focal planes;

default integration times for default focal plane groups; and

default gains for default focal plane groups.

12. The imaging sensor of claim 1, further comprising at least one color filter applied to the pixels on at least one focal plane.

13. The imaging sensor of claim 12, wherein the at least one color filter applied to the pixels on at least one focal plane forms a Bayer pattern on at least one focal plane.

14. The imaging sensor of claim 13, wherein the at least one color filter applied to the pixels on at least one focal plane are applied so that the pixels of at least one of the plurality of focal planes are configured to capture image data from the same discrete portion of the electromagnetic spectrum.

15. The imaging sensor of claim 1, wherein:

the focal plane group register is one of a plurality of focal plane group registers and each focal plane group register contains data identifying focal planes from the plurality of focal planes that belong to a specific focal plane group;

the control circuitry is further configured to modify the data in a given focal plane group register to change the focal planes that are identified as forming a focal plane group in response to receiving a command to write a value to the register address of the given focal plane group register via the interface; and

the configuration data in a given parameter register controls;

a focal plane operational state of the focal plane associated with the given parameter register;

integration time of pixels in the focal plane associated with the given parameter register; and

a gain applied to pixel outputs of pixels in the focal plane associated with the given parameter register.

16. A method of configuring imaging parameters of a plurality of focal planes on an imaging sensor, where each focal plane comprises a plurality of rows of pixels that also form a plurality of columns of pixels and each focal plane is contained within a region of the imaging sensor that does not contain pixels from another focal plane, the method comprising:

receiving a command to write data to a virtual register address via an interface;

mapping the virtual register address to at least one physical address based upon data identifying focal planes from the plurality of focal planes that belong to a focal plane group stored in a focal plane group register associated with the virtual address using control circuitry;

modifying configuration data stored in parameter registers associated with the focal plane groups in response to the instruction to write data to a virtual register address using the control circuitry; and

controlling imaging parameters of pixels within the plurality of focal planes based upon configuration data stored in the parameter registers associated with each of the plurality of focal planes using the control circuitry.

17. The method of claim 16, further comprising:

receiving a command to write a value to a register address associated with the focal plane group register via the interface; and

modifying the data in the focal plane group register to change the focal planes from the plurality of focal planes that are identified as forming a focal plane group in response to the command using the control circuitry.

18. A method of capturing imaging data using an imaging sensor comprising a plurality of focal planes, where each focal plane comprises a plurality of rows of pixels that also form a plurality of columns of pixels and each focal plane is contained within a region that does not contain pixels from another focal plane, the method comprising:

assigning multiple focal planes from the plurality of focal planes to a focal plane group by outputting a command to an imaging sensor interface to write a value to a register address associated with a focal plane group register on the imaging sensor using a processor configured by array camera software;

controlling imaging parameters for the multiple focal planes assigned to the focal plane group by outputting a command to the imaging sensor interface to write a value to a virtual address using the processor configured by the array camera software; and

receiving imaging data from the imaging sensor via the imaging sensor interface, where the imaging data includes imaging data captured by the multiple focal planes assigned to the focal plane group using imaging parameters determined based upon the command to write a value to the virtual address.

19. The method of claim 18, further comprising:

receiving at least one system descriptor from the imaging sensor via the imaging sensor interface using the processor configured by the array camera application; and

determining the number of focal planes in the plurality of focal planes based upon the at least one system descriptor using the processor configured by the array camera application.

20. The method of claim 19, further comprising determining the layout of the plurality of focal planes based upon the at least one system descriptor using the processor configured by the array camera application.