Multi-camera system using folded optics free from parallax and tilt artifacts

• US 10,084,958 B2
• Filed: 02/04/2016
• Issued: 09/25/2018
• Est. Priority Date: 06/20/2014
• Status: Active Grant

• Current Assignee: Qualcomm, Inc.
• Original Assignee: Qualcomm, Inc.
• Inventors: Georgiev, Todor Georgiev, Goma, Sergiu Radu
• Primary Examiner(s): Elahi, Shan E
• Application Number:
  US15/015,573
• Publication Number:
  US 20160198087A1
• Time in Patent Office: 964 Days
• Field of Search: 348360
• CPC Class Codes: G03B 17/00 Details of cameras or camera bodies; Accessories therefor lens hoods or caps G03B11/04
• CPC Class Codes: G03B 17/17 with reflectors arranged in beam forming the photographic image, e.g. for reducing dimensions of camera
• CPC Class Codes: H04N 23/00 Cameras or camera modules comprising electronic image sensors; Control thereof
• CPC Class Codes: H04N 23/45 for generating image signals from two or more image sensors being of different type or operating in different modes, e.g. with a CMOS sensor for moving images in combination with a charge-coupled device [CCD] for still images
• CPC Class Codes: H04N 23/54 Mounting of pick-up tubes, electronic image sensors, deviation or focusing coils
• CPC Class Codes: H04N 23/55 Optical parts specially adapted for electronic image sensors; Mounting thereof
• CPC Class Codes: H04N 23/60 Control of cameras or camera modules
• CPC Class Codes: H04N 23/698 for achieving an enlarged field of view, e.g. panoramic image capture
• CPC Class Codes: H04N 23/811 by dust removal, e.g. from surfaces of the image sensor or processing of the image signal output by the electronic image sensor
• CPC Class Codes: H04N 23/951 by using two or more images to influence resolution, frame rate or aspect ratio
• CPC Class Codes: Y10T 29/49828 Progressively advancing of work assembly station or assembled portion of work

Abstract

Aspects relate to an array camera exhibiting little or no parallax artifacts in captured images. For example, the planes of the central prism of the array camera can intersect at an apex defining the vertical axis of symmetry of the system. The apex can serve as a point of intersection for the optical axes of the sensors in the array. Each sensor in the array “sees” a portion of the image scene using a corresponding facet of the central prism, and accordingly each individual sensor/facet pair represents only a sub-aperture of the total array camera. The complete array camera has a synthetic aperture generated based on the sum of all individual aperture rays.

Claims

1. A system configured to form an image of a target scene, comprising:

a refractive prism including a plurality of primary light redirecting surfaces and an apex located at an intersection of each of the plurality of primary light redirecting surfaces; and

a plurality of cameras, each including an optical axis aligned to intersect at the apex of the refractive prism and including an image sensor associated with a respective one of the plurality of primary light redirecting surfaces, the image sensor configured to;

receive incoming light from the target scene that is redirected from the respective one of the primary light redirecting surfaces; and

capture an image of a portion of the target scene, wherein the refractive prism is disposed between at least two of the plurality of cameras.

2. The system of claim 1, further comprising a virtual optical axis passing through the apex, wherein:

at least one of the plurality of primary light redirecting surfaces is positioned such that a plane formed by the at least one of the plurality of primary light redirecting surfaces relative to the virtual optical axis forms a first angle; and

the optical axis of one of the plurality of cameras that receives light from the at least one of the plurality of primary light redirecting surfaces forms a second angle relative to the virtual optical axis, the second angle having a value that is double a value of the first angle.

3. The system of claim 2, wherein planes formed by each of the plurality of primary light redirecting surfaces form the first angle relative to the virtual optical axis.

4. The system of claim 2, wherein:

planes formed by a first subset of the plurality of primary light redirecting surfaces form the first angle relative to the virtual optical axis; and

planes formed by a second subset of the plurality of primary light redirecting surfaces form a third angle relative to the virtual optical axis, the third angle having a value different than the value of the first angle.

5. The system of claim 1, wherein at least one camera of the plurality of cameras comprises a lens assembly and a sensor, wherein:

the optical axis of the at least one camera intersects with a center of projection of the lens assembly, and

the optical axis of the at least one camera intersects with the sensor at a location offset from a center of the sensor.

6. The system of claim 1, wherein each of the plurality of cameras comprises a respective one of a plurality of lens assemblies.

7. The system of claim 6, wherein each of the plurality of lens assemblies includes a center of projection and at least two of the plurality of lens assemblies are positioned such that the apex is equidistant from the center of projection of each of the at least two of the plurality of lens assemblies.

8. The system of claim 6, wherein the plurality of lens assemblies are positioned equidistant from the apex.

9. The system of claim 6, further comprising a substrate upon which the image sensors are positioned.

10. The system of claim 9, wherein each of the image sensors is inset into the substrate.

11. The system of claim 10, wherein the substrate is flat.

12. The system of claim 11, wherein all of the image sensors are disposed on one plane in the substrate.

13. The system of claim 10, further comprising a plurality of secondary light redirecting surfaces.

14. The system of claim 13, wherein each of the plurality of secondary light redirecting surfaces is configured to:

receive at least a first portion of incoming light from a corresponding one of the plurality of lens assemblies; and

redirect at least a second portion the incoming light to a corresponding one of the plurality of image sensors.

15. The system of claim 13, wherein the plurality of secondary light redirecting surfaces comprise surfaces of the refractive prism.

16. A method of manufacturing a folded optic array camera configured to form an image of a target scene, the method comprising:

providing a refractive prism including a plurality of primary light redirecting surfaces and an apex located at an intersection of planes formed by each of the plurality of primary light redirecting surfaces; and

arranging a plurality of cameras around the refractive prism such that the refractive prism is disposed between at least two of the plurality of cameras, each of the plurality of cameras including an image sensor associated with a respective one of the plurality of light redirecting surfaces and configured to capture an image of a portion of the target scene, wherein the arranging comprises, for each camera of the plurality of cameras;

positioning a lens assembly having an optical axis to receive a portion of light representing the target scene from a respective one of the plurality of primary light redirecting surfaces;

positioning the lens assembly such that the optical axis is aligned to intersect with the apex, and

positioning the image sensor to receive light from the lens assembly.

17. The method of claim 16, further comprising:

positioning the image sensor such that the optical axis intersects the image sensor at a position offset from a center of the image sensor.

18. The method of claim 16, further comprising:

arranging the plurality of cameras within a housing having an interior height no greater than 4.5 mm.

19. The method of claim 16, further comprising:

positioning lens assemblies of at least two of the plurality of cameras to be equidistant from the apex.

20. The method of claim 16, wherein the folded optic array camera comprises a virtual optical axis of a virtual camera, the virtual camera formed by combining a field of view of each of the plurality of cameras.

21. The method of claim 20, further comprising:

positioning one of the plurality of primary light redirecting surfaces at a first angle relative to the virtual optical axis; and

positioning the lens assembly of a corresponding one of the plurality of cameras at a second angle relative to the virtual optical axis, the second angle having a value that is double a value of the first angle.

22. The method of claim 16, further comprising:

providing a substrate;

disposing the refractive prism on the substrate or within an aperture of the substrate; and

for each of the plurality of cameras, providing an image sensor positioned to receive light from the lens assembly, and positioning the image sensor on the substrate.

23. The method of claim 22, further comprising, for each of the plurality of cameras:

providing a secondary light redirecting surface between the lens assembly and the image sensor, the secondary light redirecting surface configured to receive the portion of light representing the target scene from the lens assembly and to redirect the portion of light toward the image sensor.

24. The method of claim 16, further comprising:

electrically coupling each of the plurality of cameras to a processor configured to assemble data representing the portion of light of each of the plurality of cameras into a complete image of the target scene.

25. The method of claim 16, further comprising:

providing a substrate;

disposing the refractive prism on the substrate or within an aperture of the substrate; and

for each of the plurality of cameras;

providing one or more image sensors positioned to receive light from the lens assembly; and

positioning the one or more image sensors into the substrate.

26. The method of claim 25, wherein the substrate is flat.

27. The method of claim 25, wherein more than one of the one or more image sensors are mounted on one plane on the substrate.