Pattern projection and imaging using lens arrays

• US 9,167,138 B2
• Filed: 12/06/2011
• Issued: 10/20/2015
• Est. Priority Date: 12/06/2010
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Shpunt, Alexander, Pesach, Benny
• Primary Examiner(s): Velez, Roberto
• Assistant Examiner(s): LE, TUAN H
• Application Number:
  US13/311,589
• Publication Number:
  US 20120140094A1
• Time in Patent Office: 1,414 Days
• Field of Search: 348/222.1
• US Class Current: 1/1
• CPC Class Codes: G03B 21/14 Details
• CPC Class Codes: G06T 7/50 Depth or shape recovery
• CPC Class Codes: G06V 2201/12 Acquisition of 3D measurements of objects
• CPC Class Codes: H04N 13/271 wherein the generated image signals comprise depth maps or disparity maps
• CPC Class Codes: H04N 23/60 Control of cameras or camera modules
• CPC Class Codes: H04N 23/698 for achieving an enlarged field of view, e.g. panoramic image capture
• CPC Class Codes: H04N 25/41 Extracting pixel data from a plurality of image sensors simultaneously picking up an image, e.g. for increasing the field of view by combining the outputs of a plurality of sensors
• CPC Class Codes: H04N 5/262 Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects

Abstract

A method for projection includes generating a pattern of illumination, and positioning an array of lenses so as to project different, respective parts of the pattern onto a scene.

Claims

1. Imaging apparatus, comprising:

an image sensor, comprising an array of detector elements;

objective optics, which are configured to focus optical radiation and are positioned so as to form multiple, respective optical images of different areas of a scene such that all of the optical images focused by each objective optics are cast on the entire area of the array;

means for optically encoding the optical images with different, respective coding patterns; and

a processor, which is configured to process an output signal from the detector elements by matched filtering of the coding patterns in order to reconstruct electronic images of the different areas of the scene.

2. The apparatus according to claim 1, wherein the means for optically encoding comprise multiple coded apertures, which are configured and positioned to optically modulate the respective optical images formed of the different areas of the scene.

3. The apparatus according to claim 2, wherein the objective optics comprise multiple lenses, which are configured to form the respective optical images, and wherein each of the coded apertures is associated with an optical aperture of a respective one of the lenses.

4. The apparatus according to claim 1, wherein the means for optically encoding comprise a projection module, which is configured to project the respective coding patterns onto the different areas of the scene.

5. The apparatus according to claim 4, wherein the processor is configured to process the reconstructed electronic images so as to generate a depth map of the scene responsively to the coding patterns appearing in the optical images of the different areas of the scene.

6. The apparatus according to claim 1, wherein the coding patterns are mutually orthogonal.

7. The apparatus according to claim 1, wherein the processor is configured to reconstruct the electronic images of the different areas of the scene by applying to the output signal respective deconvolution kernels, based on the respective coding patterns.

8. The apparatus according to claim 1, and comprising a projection module, which is configured to project an optical pattern onto the scene, wherein the processor is configured to process the electronic images so as to generate a depth map of the scene responsively to the optical pattern appearing in the electronic images of the different areas of the scene.

9. The apparatus according to claim 8, wherein the processor is configured to select a sector of the depth map, to instruct the projection module to project the optical pattern only in the selected sector, and to process the output signal so as to generate a further depth map of the selected sector with enhanced resolution.

10. The apparatus according to claim 1, wherein the processor is configured to stitch together the electronic images of the different areas of the scene in order to provide a combined image with a wide field of view relative to the electronic images of the different areas.

11. A method for imaging, comprising:

focusing optical radiation so as to form multiple, respective optical images of different areas of a scene such that all of the optical images focused by each objective optics are cast on the entire area of an array of detector elements;

optically encoding the optical images with different, respective coding patterns; and

processing an output signal from the detector elements by matched filtering of the coding patterns in order to reconstruct electronic images of the different areas of the scene.

12. The method according to claim 11, wherein optically encoding the optical images comprise applying multiple coded apertures to optically modulate the respective optical images formed of the different areas of the scene.

13. The method according to claim 12, wherein focusing the optical radiation comprises forming the optical images using multiple, respective lenses, and wherein each of the coded apertures is associated with an optical aperture of a respective one of the lenses.

14. The method according to claim 11, wherein optically encoding the optical images comprises projecting the respective coding patterns onto the different areas of the scene.

15. The method according to claim 14, and comprising processing the reconstructed electronic images so as to generate a depth map of the scene responsively to the pattern appearing in the optical images of the respective portions of the scene.

16. The method according to claim 11, wherein the coding patterns are mutually orthogonal.

17. The method according to claim 11, wherein processing the output signal comprises applying to the output signal multiple, respective deconvolution kernels, based on the respective coding patterns.

18. The method according to claim 11, and comprising projecting an optical pattern onto the scene, and processing the electronic images so as to generate a depth map of the scene responsively to the optical pattern appearing in the electronic images of the different areas of the scene.

19. The method according to claim 18, and comprising, after generating the depth map, selecting a sector of the depth map, projecting the optical pattern only in the selected sector, and processing the output signal so as to generate a further depth map of the selected sector with enhanced resolution.