Multi-camera system using folded optics free from parallax and tilt artifacts

• US 9,294,672 B2
• Filed: 12/15/2014
• Issued: 03/22/2016
• Est. Priority Date: 06/20/2014
• Status: Active Grant

• Current Assignee: Qualcomm, Inc.
• Original Assignee: Qualcomm, Inc.
• Inventors: Georgiev, Todor Georgiev, Goma, Sergiu Radu
• Primary Examiner(s): ELAHI, SHAN E
• Application Number:
  US14/571,149
• Publication Number:
  US 20150373262A1
• Time in Patent Office: 463 Days
• Field of Search: 348/36
• US Class Current: 1/1
• CPC Class Codes: G03B 17/00 Details of cameras or camera bodies; Accessories therefor lens hoods or caps G03B11/04
• CPC Class Codes: G03B 17/17 with reflectors arranged in beam forming the photographic image, e.g. for reducing dimensions of camera
• CPC Class Codes: H04N 23/00 Cameras or camera modules comprising electronic image sensors; Control thereof
• CPC Class Codes: H04N 23/45 for generating image signals from two or more image sensors being of different type or operating in different modes, e.g. with a CMOS sensor for moving images in combination with a charge-coupled device [CCD] for still images
• CPC Class Codes: H04N 23/54 Mounting of pick-up tubes, electronic image sensors, deviation or focusing coils
• CPC Class Codes: H04N 23/55 Optical parts specially adapted for electronic image sensors; Mounting thereof
• CPC Class Codes: H04N 23/60 Control of cameras or camera modules
• CPC Class Codes: H04N 23/698 for achieving an enlarged field of view, e.g. panoramic image capture
• CPC Class Codes: H04N 23/811 by dust removal, e.g. from surfaces of the image sensor or processing of the image signal output by the electronic image sensor
• CPC Class Codes: H04N 23/95 Computational photography systems, e.g. light-field imaging systems
• CPC Class Codes: H04N 23/951 by using two or more images to influence resolution, frame rate or aspect ratio
• CPC Class Codes: Y10T 29/49828 Progressively advancing of work assembly station or assembled portion of work

Abstract

Aspects relate to an array camera exhibiting little or no parallax artifacts in captured images. For example, the planes of the central mirror prism of the array camera can intersect at an apex defining the vertical axis of symmetry of the system. The apex can serve as a point of intersection for the optical axes of the sensors in the array. Each sensor in the array “sees” a portion of the image scene using a corresponding facet of the central mirror prism, and accordingly each individual sensor/mirror pair represents only a sub-aperture of the total array camera. The complete array camera has a synthetic aperture generated based on the sum of all individual aperture rays.

Claims

1. An imaging system for forming an image of a target scene by combining into an image a plurality of portions of a target scene, comprising:

a reflecting component including a plurality of primary light reflecting surfaces, the reflecting component comprising an apex at a location of an intersection of each of the plurality of primary light reflecting surfaces; and

a plurality of cameras, each of the plurality of cameras having an optical axis aligned to intersect at the apex of the reflecting component, and each of the plurality of cameras comprising an image sensor that is associated with one of the plurality of primary light reflecting surfaces, the image sensor arranged to receive incoming light from the target scene, that is reflected from the associated one of the primary light reflecting surfaces, and the image sensor further configured to capture an image of a portion of the target scene and provide an output representative of the portion of the target scene,

wherein the reflecting component is disposed between at least two of the plurality of cameras.

2. The system of claim 1, further comprising a virtual optical axis passing through the apex, wherein at least one of the plurality of light reflecting surfaces is positioned such that a plane formed by the at least one of the plurality of primary light reflecting surfaces relative to the virtual optical axis form a first angle, the optical axis of one of the plurality of cameras that receives light from the at least one of the plurality of primary light reflecting surfaces forming a second angle relative to the virtual optical axis, the second angle having a value equal to double a value of the first angle.

3. The system of claim 2, wherein each of the plurality of primary light reflecting surfaces are positioned such that planes formed by each of the plurality of primary light reflecting surfaces form the first angle relative to the virtual optical axis, the optical axis of each of the plurality of cameras forming the second angle relative to the virtual optical axis.

4. The system of claim 2, wherein:

planes formed by a first subset of the plurality of primary light reflecting surfaces form the first angle relative to the virtual optical axis;

the optical axis of a corresponding first subset of the plurality of cameras form the second angle relative to the virtual optical axis;

planes formed by a second subset of the plurality of primary light reflecting surfaces form a third angle relative to the virtual optical axis, the third angle having a value different than the value of the first angle; and

the optical axis of a corresponding second subset of the plurality of cameras form a fourth angle relative to the virtual optical axis, the fourth angle having a value equal to double the value of the third angle.

5. The system of claim 1, wherein each camera of the plurality of cameras comprises a lens assembly and a sensor, and for each camera

the optical axis of the camera intersecting with a center of projection of the lens assembly, and

the optical axis of the camera intersects with the sensor at a location offset from a center of the sensor.

6. The system of claim 1, further comprising a plurality of lens assemblies, wherein each of the plurality of cameras comprises one of the plurality of lens assemblies.

7. The system of claim 6, each of the plurality of lens assemblies having a center of projection, wherein at least two of the plurality of lens assemblies are positioned such that the apex is equidistant from the center of projection of each of the at least two of the plurality of lens assemblies.

8. The system of claim 6, wherein the plurality of lens assemblies are identical to one another, and wherein the plurality of lens assemblies are positioned equidistant from the apex.

9. The system of claim 6, further comprising a substrate, the reflecting component mounted on the substrate or within an aperture of the substrate, wherein each of the plurality of image sensors of the plurality of cameras are positioned on the substrate.

10. The system of claim 9, further comprising a plurality of secondary light reflecting surfaces, each of the plurality of secondary light reflecting surfaces configured to receive incoming light from a corresponding one of the plurality of lens assemblies and redirect the incoming light toward a corresponding one of the plurality of image sensors.

11. The system of claim 10, wherein the plurality of secondary light reflecting surfaces each comprise one of a reflective surface of a refractive prism.

12. The system of claim 9, wherein all the sensors are disposed on one plane on the substrate.

13. The system of claim 6, further comprising a substrate, the reflecting component mounted on the substrate or within an aperture of the substrate, wherein each of the plurality of image sensors of the plurality of cameras are positioned inset into the substrate.

14. The system of claim 13, wherein the substrate is flat.

15. A method of manufacturing a folded optic array camera for forming an image of a target scene by combining into an image a plurality of portions of the target scene, the method comprising:

providing a reflecting component including a plurality of primary light reflecting surfaces, the reflecting component comprising an apex at a location of an intersection of planes formed by each of the plurality of primary light reflecting surfaces; and

arranging a plurality of cameras around the reflecting component such that the reflecting component is disposed between at least two of the plurality of cameras, each of the plurality of cameras having an image sensor that is associated with one of the plurality of light reflecting surfaces, the plurality of cameras each configured to capture an image of a portion of a target scene and provide an output representative of the captured portion of target scene, said arranging comprising, for each camera of the plurality of cameras;

positioning a lens assembly to receive a portion of light representing a target image scene from an associated one of the plurality of primary light reflecting surfaces, the lens assembly having an optical axis,

positioning the lens assembly such that the optical axis is aligned to intersect with the apex, and

positioning the image sensor to receive light from the lens assembly.

16. The method of manufacturing a folded optic array camera of claim 15, further comprising positioning the image sensor such that the optical axis intersects the image sensor at a position offset from a center of the image sensor.

17. The method of manufacturing a folded optic array camera of claim 15, further comprising arranging the plurality of cameras within a housing having an interior height no greater than 4.5 mm.

18. The method of manufacturing a folded optic array camera of claim 15, further comprising positioning the lens assembly of at least two of the plurality of cameras to be equidistant from the apex.

19. The method of manufacturing a folded optic array camera of claim 15, wherein the folded optic array camera comprises a virtual optical axis of a virtual camera, the virtual camera formed by combining a field of view of each of the plurality of cameras.

20. The method of manufacturing a folded optic array camera of claim 19, further comprising positioning one of the plurality of primary light reflecting surfaces at a first angle relative to the virtual optical axis and positioning the lens assembly of a corresponding one of the plurality of cameras at a second angle relative to the virtual optical axis, the second angle having a value that is double a value of the first angle.

21. The method of manufacturing a folded optic array camera of claim 15, further comprising:

providing a substrate;

disposing the reflecting component on the substrate or within an aperture of the substrate; and

for each of the plurality of cameras,

positioning the image sensor on the substrate.

22. The method of manufacturing a folded optic array camera of claim 21, further comprising, for each of the plurality of cameras, providing a secondary light reflecting surface between the lens assembly and the image sensor, the secondary light reflecting surface configured to receive the portion of light representing a target image scene from the lens assembly and redirect the portion of light toward the image sensor.

23. The method of claim 21, wherein all the sensors are mounted on one plane on the substrate.

24. The method of manufacturing a folded optic array camera of claim 15, further comprising electronically coupling each of the plurality of cameras to a processing module configured to assemble data representing the portion of light of each of the plurality of cameras into a complete image of the target image scene.

25. The method of manufacturing a folded optic array camera of claim 15, further comprising:

providing a substrate;

disposing the reflecting component on the substrate or within an aperture of the substrate; and

for each of the plurality of cameras,

positioning the image sensor into the substrate.

26. The method of claim 25, wherein all the sensors are disposed on one plane in the substrate.