Thin form factor computational array cameras and modular array cameras

• US 9,774,831 B2
• Filed: 04/22/2016
• Issued: 09/26/2017
• Est. Priority Date: 02/24/2013
• Status: Active Grant

• Current Assignee: FotoNation Limited (Adeia Inc.)
• Original Assignee: Fotonation Cayman Limited
• Inventors: Venkataraman, Kartik, Gallagher, Paul, Lelescu, Dan, McMahon, Andrew Kenneth John, Duparre, Jacques
• Primary Examiner(s): Jerabek, Kelly L
• Application Number:
  US15/136,166
• Publication Number:
  US 20170085845A1
• Time in Patent Office: 522 Days
• Field of Search: 3482181, 348239
• CPC Class Codes: H04N 23/11 for generating image signals from visible and infrared light wavelengths
• CPC Class Codes: H04N 23/13 with multiple sensors
• CPC Class Codes: H04N 23/51 Housings
• CPC Class Codes: H04N 23/60 Control of cameras or camera modules
• CPC Class Codes: H04N 23/90 Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums
• CPC Class Codes: H04N 23/951 by using two or more images to influence resolution, frame rate or aspect ratio
• CPC Class Codes: H04N 25/134 based on three different wavelength filter elements
• CPC Class Codes: H04N 25/48 Increasing resolution by shifting the sensor relative to the scene
• CPC Class Codes: H04N 25/70 SSIS architectures; Circuits associated therewith
• CPC Class Codes: H04N 25/701 Line sensors
• CPC Class Codes: H04N 25/75 Circuitry for providing, modifying or processing image signals from the pixel array

Abstract

Systems and methods in accordance with embodiments of the invention implement one-dimensional array cameras, as well as modular array cameras using sub-array modules. In one embodiment, a 1×N array camera module includes: a 1×N arrangement of focal planes, where N is greater than or equal to 2, each focal plane includes a plurality of rows of pixels that also form a plurality of columns of pixels, and each focal plane not including pixels from another focal plane; and a 1×N arrangement of lens stacks, the arrangement of lens stacks being disposed relative to the arrangement of focal planes so as to form a 1×N arrangement of cameras, each configured to independently capture an image of a scene, where each lens stack has a field of view that is shifted with respect to that of each other lens stack so that each shift includes a sub-pixel shifted view of the scene.

Claims

1. A 1×

N array camera module comprising;

a 1×

N arrangement of focal planes, wherein;

N is greater than or equal to 2;

each focal plane comprises a plurality of rows of pixels that also form a plurality of columns of pixels;

each focal plane does not include pixels from another focal plane; and

the 1×

N arrangement of focal planes includes a first sub-array of focal planes and a second sub-array of focal planes, each of the first and second sub-arrays of focal planes comprising a 1×

X arrangement of focal planes, wherein X is greater than or equal to 1 and the focal planes of the first sub-array of focal planes are independent of the focal planes of the second sub-array of focal planes; and

a 1×

N arrangement of lens stacks, the 1×

N arrangement of lens stacks being disposed relative to the 1×

N arrangement of focal planes so as to form a 1×

N arrangement of cameras, each of which being configured to independently capture an image of a scene, wherein;

each lens stack has a field of view that is shifted with respect to the field-of-views of each other lens stack so that each shift includes a sub-pixel shifted view of the scene; and

the 1×

N arrangement of lens stacks includes a first sub-array of lens stacks and a second sub-array of lens stacks; and

wherein the first sub-array of focal planes and the first sub-array of lens stacks form a first sub-array module, and the second sub-array of focal planes and the second sub-array of lens stacks form a second sub-array module, the first sub-array module comprising image data output circuitry and the second sub-array module comprising image data input circuitry, such that the image data output circuitry is capable of transmitting image data from the first sub-array module to the second sub-array module via the image data input circuitry.

2. The array camera module of claim 1 wherein N is greater than or equal to 3.

3. The array camera module of claim 2, wherein N is 5.

4. The array camera module of claim 3, wherein the 1×

N arrangement of cameras includes a green camera that is configured to image light corresponding with the green band of the visible spectrum.

5. The array camera module of claim 4, wherein the green camera is centrally disposed relative to the 1×

N arrangement of cameras.

6. The array camera of claim 5, wherein the lens stack of the green camera is configured to focus light corresponding with the green band of the visible spectrum onto the corresponding focal plane.

7. The array camera of claim 5, wherein a red camera that is configured to image light corresponding with the red band of the visible spectrum and a blue camera that is configured to image light corresponding with the blue band of the visible spectrum are each disposed on either side of the centrally disposed green camera.

8. The array camera module of claim 2, wherein N is 7.

9. The array camera module of claim 8, wherein the 1×

N arrangement of cameras includes a green camera that is configured to image light corresponding with the green band of the visible spectrum, and that is centrally disposed relative to the 1×

N arrangement of cameras.

10. The array camera module of claim 9, wherein a red camera that is configured to image light corresponding with the red band of the visible spectrum and a blue camera that is configured to image light corresponding with the blue band of the visible spectrum are each disposed on either side of the centrally disposed green camera.

11. The array camera module of claim 2, wherein N is 9.

12. The array camera module of claim 11, wherein the 1×

N arrangement of cameras includes a green camera that is configured to image light corresponding with the green band of the visible spectrum, and that is centrally disposed relative to the 1×

N arrangement of cameras.

13. The array camera module of claim 12, wherein a red camera that is configured to image light corresponding with the red band of the visible spectrum and a blue camera that is configured to image light corresponding with the blue band of the visible spectrum are each disposed on either side of the centrally disposed green camera.

14. The array camera module of claim 1, wherein the 1×

N arrangement of focal planes is embodied within a monolithic structure.

15. The array camera module of claim 14, wherein the 1×

N arrangement of lens stacks is embodied within a monolithic structure.

16. The array camera module of claim 15, wherein the 1×

N arrangement of focal planes and the 1×

N arrangement of lens stacks are each embodied within the same monolithic structure.

17. The array camera module of claim 1, wherein in the first sub-array module:

each focal plane of the 1×

X arrangement of focal planes comprises a plurality of rows of pixels that also form a plurality of columns of pixels;

each focal plane does not include pixels from another focal plane; and

the 1×

X arrangement of lens stacks is disposed relative to the 1×

X arrangement of focal planes so as to form a 1×

X arrangement of cameras, each of which being configured to independently capture an image of a scene, wherein each lens stack has a field of view that is shifted with respect to the field-of-views of each other lens stack so that each shift includes a sub-pixel shifted view of the scene.

18. The array camera of claim 17, wherein the 1×

X arrangement of cameras is embodied within a single monolithic structure.

19. The array camera module of claim 17, wherein N is 9, and X is 3.