Thin Form Factor Computational Array Cameras and Modular Array Cameras

• US 20140240528A1
• Filed: 02/24/2014
• Published: 08/28/2014
• Est. Priority Date: 02/24/2013
• Status: Active Grant

• Current Assignee: FotoNation Limited (Adeia Inc.)
• Original Assignee: Pelican Imaging Corporation
• Inventors: Venkataraman, Kartik, Gallagher, Paul, Lelescu, Dan, McMahon, Andrew, Duparre, Jacques
• Granted Patent: US 9,374,512 B2
• Time in Patent Office: Days
• US Class Current: 348/218.1
• CPC Class Codes: H04N 23/11 for generating image signals from visible and infrared light wavelengths
• CPC Class Codes: H04N 23/13 with multiple sensors
• CPC Class Codes: H04N 23/51 Housings
• CPC Class Codes: H04N 23/60 Control of cameras or camera modules
• CPC Class Codes: H04N 23/90 Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums
• CPC Class Codes: H04N 23/951 by using two or more images to influence resolution, frame rate or aspect ratio
• CPC Class Codes: H04N 25/134 based on three different wavelength filter elements
• CPC Class Codes: H04N 25/48 Increasing resolution by shifting the sensor relative to the scene
• CPC Class Codes: H04N 25/70 SSIS architectures; Circuits associated therewith
• CPC Class Codes: H04N 25/701 Line sensors
• CPC Class Codes: H04N 25/75 Circuitry for providing, modifying or processing image signals from the pixel array

Abstract

Systems and methods in accordance with embodiments of the invention implement one-dimensional array cameras, as well as modular array cameras using sub-array modules. In one embodiment, a 1×N array camera module includes: a 1×N arrangement of focal planes, where N is greater than or equal to 2, each focal plane includes a plurality of rows of pixels that also form a plurality of columns of pixels, and each focal plane not including pixels from another focal plane; and a 1×N arrangement of lens stacks, the arrangement of lens stacks being disposed relative to the arrangement of focal planes so as to form a 1×N arrangement of cameras, each configured to independently capture an image of a scene, where each lens stack has a field of view that is shifted with respect to that of each other lens stack so that each shift includes a sub-pixel shifted view of the scene.

Claims

1. A 1×

N array camera module comprising;

a 1×

N arrangement of focal planes, wherein;

N is greater than or equal to 2;

each focal plane comprises a plurality of rows of pixels that also form a plurality of columns of pixels; and

each focal plane does not include pixels from another focal plane; and

a 1×

N arrangement of lens stacks, the 1×

N arrangement of lens stacks being disposed relative to the 1×

N arrangement of focal planes so as to form a 1×

N arrangement of cameras, each of which being configured to independently capture an image of a scene, wherein;

each lens stack has a field of view that is shifted with respect to the field-of-views of each other lens stack so that each shift includes a sub-pixel shifted view of the scene.

2. The array camera module of claim 1 wherein N is greater than or equal to 3.

3. The array camera module of claim 2, wherein N is 5.

4. The array camera module of claim 3, wherein the 1×

N arrangement of cameras includes a green camera that is configured to image light corresponding with the green band of the visible spectrum.

5. The array camera module of claim 4, wherein the green camera is centrally disposed relative to the 1×

N arrangement of cameras.

6. The array camera of claim 5, wherein the lens stack of the green camera is configured to focus light corresponding with the green band of the visible spectrum onto the corresponding focal plane.

7. The array camera of claim 5, wherein a red camera that is configured to image light corresponding with the red band of the visible spectrum and a blue camera that is configured to image light corresponding with the blue band of the visible spectrum are each disposed on either side of the centrally disposed green camera.

8. The array camera module of claim 2, wherein N is 7.

9. The array camera module of claim 8, wherein the 1×

N arrangement of cameras includes a green camera that is configured to image light corresponding with the green band of the visible spectrum, and that is centrally disposed relative to the 1×

N arrangement of cameras.

10. The array camera module of claim 9, wherein a red camera that is configured to image light corresponding with the red band of the visible spectrum and a blue camera that is configured to image light corresponding with the blue band of the visible spectrum are each disposed on either side of the centrally disposed green camera.

11. The array camera module of claim 2, wherein N is 9.

12. The array camera module of claim 11, wherein the 1×

N arrangement of cameras includes a green camera that is configured to image light corresponding with the green band of the visible spectrum, and that is centrally disposed relative to the 1×

N arrangement of cameras.

13. The array camera module of claim 12, wherein a red camera that is configured to image light corresponding with the red band of the visible spectrum and a blue camera that is configured to image light corresponding with the blue band of the visible spectrum are each disposed on either side of the centrally disposed green camera.

14. The array camera module of claim 1, wherein the 1×

N arrangement of focal planes is embodied within a monolithic structure.

15. The array camera module of claim 14, wherein the 1×

N arrangement of lens stacks is embodied within a monolithic structure.

16. The array camera module of claim 15, wherein the 1×

N arrangement of focal planes and the 1×

N arrangement of lens stacks are each embodied within the same monolithic structure.

17. The array camera module of claim 1, wherein at least one camera is embodied within a single sub-array module, the sub-array module comprising:

a 1×

X arrangement of focal planes, wherein;

X is greater than or equal to 1;

each focal plane comprises a plurality of rows of pixels that also form a plurality of columns of pixels; and

each focal plane does not include pixels from another focal plane; and

a 1×

X arrangement of lens stacks, the 1×

X arrangement of lens stacks being disposed relative to the 1×

X arrangement of focal planes so as to form a 1×

X arrangement of cameras, each of which being configured to independently capture an image of a scene, wherein each lens stack has a field of view that is shifted with respect to the field-of-views of each other lens stack so that each shift includes a sub-pixel shifted view of the scene.

18. The array camera module of claim 17, wherein the sub-array module further comprises interface circuitry that can allow the sub-array module to interface with another sub-array module so that it can at least transmit image data to another sub-array module or receive image data from another sub-array module.

19. The array camera of claim 17, wherein the 1×

X arrangement of cameras is embodied within a single monolithic structure.

20. The array camera module of claim 17, wherein N is 9, and X is 3.

21. The array camera module of claim 19, wherein the 1×

9 arrangement of cameras are embodied within three 1×

3 sub-array modules, each 1×

3 sub-array module comprising;

a 1×

3 arrangement of focal planes, wherein;

each focal plane comprises a plurality of rows of pixels that also form a plurality of columns of pixels; and

each focal plane does not include pixels from another focal plane; and

a 1×

3 arrangement of lens stacks, the 1×

3 arrangement of lens stacks being disposed relative to the 1×

3 arrangement of focal planes so as to form a 1×

3 arrangement of cameras, each of which being configured to independently capture an image of a scene, wherein each lens stack has a field of view that is shifted with respect to the field-of-views of each other lens stack so that each shift includes a sub-pixel shifted view of the scene.

22. The array camera module of claim 21, wherein each sub-array module further comprises interface circuitry that can allow the sub-array module to interface with another sub-array module so that it can at least transmit image data to another sub-array module or receive image data from another sub-array module.

23. The array camera module of claim 17, comprising at least two sub-array modules, wherein each sub-array module comprises:

a 1×

X arrangement of focal planes, wherein;

X is greater than or equal to 1;

each focal plane comprises a plurality of rows of pixels that also form a plurality of columns of pixels; and

each focal plane does not include pixels from another focal plane; and

a 1×

X arrangement of lens stacks, the 1×

X arrangement of lens stacks being disposed relative to the 1×

X arrangement of focal planes so as to form a 1×

X arrangement of cameras, each of which being configured to independently capture an image of a scene, wherein each lens stack has a field of view that is shifted with respect to the field-of-views of each other lens stack so that each shift includes a sub-pixel shifted view of the scene;

wherein each of the at least two sub-array modules are adjoined to the interconnects of a single substrate, and can thereby interface with at least one other sub-array module.

24. The array camera module of claim 23, wherein each of the at least two sub-array modules further comprises interface circuitry that can allow the respective sub-array module to interface with another sub-array module so that it can at least transmit image data to another sub-array module or receive image data from another sub-array module.

25. The array camera module of claim 24, wherein the substrate is optically transparent.

26. The array camera module of claim 25, wherein the substrate is glass.

29. The sub-array module of claim 26, wherein the interface circuitry implements a MIPI CSI 2 interface.

27. A 1×

X sub-array module comprising;

a 1×

X arrangement of focal planes, wherein;

X is greater than or equal to 1;

each focal plane comprises a plurality of rows of pixels that also form a plurality of columns of pixels; and

each focal plane does not include pixels from another focal plane; and

a 1×

X arrangement of lens stacks, the 1×

X arrangement of lens stacks being disposed relative to the 1×

X arrangement of focal planes so as to form a 1×

X arrangement of cameras, each of which being configured to independently capture an image of a scene, wherein each lens stack has a field of view that is shifted with respect to the field-of-views of each other lens stack so that each shift includes a sub-pixel shifted view of the scene.

28. The 1×

X sub-array module of claim 27, further comprising interface circuitry that can allow the sub-array module to interface with another sub-array module so that it can at least transmit image data to another sub-array module or receive image data from another sub-array module.

30. A 1×

N array camera comprising;

a 1×

N arrangement of focal planes, wherein;

N is greater than or equal to 2;

each focal plane comprises a plurality of rows of pixels that also form a plurality of columns of pixels; and

each focal plane does not include pixels from another focal plane; and

a 1×

N arrangement of lens stacks, the 1×

N arrangement of lens stacks being disposed relative to the 1×

N arrangement of focal planes so as to form a 1×

N arrangement of cameras, each of which being configured to independently capture an image of a scene, where each lens stack has a field of view that is shifted with respect to the field-of-views of each other lens stack so that each shift includes a sub-pixel shifted view of the scene; and

a processor that is configured to construct an image of the scene using image data generated by the 1×

N array camera module.