Pattern projection and imaging using lens arrays

• US 20120140094A1
• Filed: 12/06/2011
• Published: 06/07/2012
• Est. Priority Date: 12/06/2010
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: PrimeSense Ltd (Apple Inc.)
• Inventors: Shpunt, Alexander, Pesach, Benny
• Granted Patent: US 9,167,138 B2
• Time in Patent Office: Days
• US Class Current: 348/239
• CPC Class Codes: G03B 21/14 Details
• CPC Class Codes: G06T 7/50 Depth or shape recovery
• CPC Class Codes: G06V 2201/12 Acquisition of 3D measurements of objects
• CPC Class Codes: H04N 13/271 wherein the generated image signals comprise depth maps or disparity maps
• CPC Class Codes: H04N 23/60 Control of cameras or camera modules
• CPC Class Codes: H04N 23/698 for achieving an enlarged field of view, e.g. panoramic image capture
• CPC Class Codes: H04N 25/41 Extracting pixel data from a plurality of image sensors simultaneously picking up an image, e.g. for increasing the field of view by combining the outputs of a plurality of sensors
• CPC Class Codes: H04N 25/707 Pixels for event detection
• CPC Class Codes: H04N 5/262 Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects

Abstract

A method for projection includes generating a pattern of illumination, and positioning an array of lenses so as to project different, respective parts of the pattern onto a scene.

Claims

1. Imaging apparatus, comprising:

an image sensor, comprising an array of detector elements;

objective optics, which are configured to focus optical radiation and are positioned so as to form multiple, respective optical images of different areas of a scene onto a common area of the array;

means for optically encoding the optical images with different, respective coding patterns; and

a processor, which is configured to process an output signal from the sensor element by matched filtering of the coding patterns in order to reconstruct electronic images of the different areas of the scene.

2. The apparatus according to claim 1, wherein the means for optically encoding comprise multiple coded apertures, which are configured and positioned to optically modulate the respective optical images formed of the different areas of the scene.

3. The apparatus according to claim 2, wherein the objective optics comprise multiple lenses, which are configured to form the respective optical images, and wherein each of the coded apertures is associated with an optical aperture of a respective one of the lenses.

4. The apparatus according to claim 1, wherein the means for optically encoding comprise a projection module, which is configured to project the respective coding patterns onto the different areas of the scene.

5. The apparatus according to claim 4, wherein the processor is configured to process the reconstructed electronic images so as to generate a depth map of the scene responsively to the pattern appearing in the optical images of the respective portions of the scene.

6. The apparatus according to claim 1, wherein the coding patterns are mutually orthogonal.

7. The apparatus according to claim 1, wherein the processor is configured to reconstruct the electronic images of the different areas of the scene by applying to the output signal respective deconvolution kernels, based on the respective coding patterns.

8. The apparatus according to claim 1, and comprising a projection module, which is configured to project an optical pattern onto the scene, wherein the processor is configured to process the electronic images so as to generate a depth map of the scene responsively to the pattern appearing in the optical images of the respective portions of the scene.

9. The apparatus according to claim 8, wherein the processor is configured to select a sector of the depth map, to instruct the projection module to project the optical pattern only in the selected sector, and to process the output signal so as to generate a further depth map of the selected sector with enhanced resolution.

10. Projection apparatus, comprising:

an illumination source, which is configured to generate a pattern of illumination; and

an array of lenses, positioned so as to project different, respective parts of the pattern onto a scene.

11. The apparatus according to claim 10, wherein the illumination source comprises a light source and a condenser, which are configured to generate a beam of light, and a transparency, which is interposed in the beam.

12. The apparatus according to claim 10, wherein the pattern comprises light and dark spots.

13. The apparatus according to claim 10, wherein the lenses are configured to project the respective parts of the pattern onto different, respective areas of the scene.

14. The apparatus according to claim 10, wherein the lenses are configured to project the respective parts of the pattern onto a common area of the scene.

15. The apparatus according to claim 10, and comprising an imaging module, which is configured to generate electronic images of the pattern on the scene, and a processor, which is configured to process the electronic images so as to generate a depth map of the scene responsively to the pattern appearing in the images.

16. A method for imaging, comprising:

focusing optical radiation so as to form multiple, respective optical images of different areas of a scene on a common area of an array of detector elements;

optically encoding the optical images with different, respective coding patterns; and

processing an output signal from the sensor element by matched filtering of the coding patterns in order to reconstruct electronic images of the different areas of the scene.

17. The method according to claim 16, wherein optically encoding the optical images comprise applying multiple coded apertures to optically modulate the respective optical images formed of the different areas of the scene.

18. The method according to claim 17, wherein focusing the optical radiation comprises forming the optical images using multiple, respective lenses, and wherein each of the coded apertures is associated with an optical aperture of a respective one of the lenses.

19. The method according to claim 16, wherein optically encoding the optical images comprises projecting the respective coding patterns onto the different areas of the scene.

20. The method according to claim 19, and comprising processing the reconstructed electronic images so as to generate a depth map of the scene responsively to the pattern appearing in the optical images of the respective portions of the scene.

21. The method according to claim 16, wherein the coding patterns are mutually orthogonal.

22. The method according to claim 16, wherein processing the output signal comprises applying to the output signal multiple, respective deconvolution kernels, based on the respective coding patterns.

23. The method according to claim 16, and comprising projecting an optical pattern onto the scene, and processing the electronic images so as to generate a depth map of the scene responsively to the optical pattern appearing in the optical images of the respective portions of the scene.

24. The method according to claim 23, and comprising, after generating the depth map, selecting a sector of the depth map, projecting the optical pattern only in the selected sector, and processing the output signal so as to generate a further depth map of the selected sector with enhanced resolution.

25. A method for projection, comprising:

generating a pattern of illumination; and

positioning an array of lenses so as to project different, respective parts of the pattern onto a scene.

26. The method according to claim 25, wherein generating the pattern comprises transmitting a beam of light through a transparency, which is configured to impose the pattern on the beam.

27. The method according to claim 25, wherein the pattern comprises light and dark spots.

28. The method according to claim 25, wherein the lenses are configured to project the respective parts of the pattern onto different, respective areas of the scene.

29. The method according to claim 25, wherein the lenses are configured to project the respective parts of the pattern onto a common area of the scene.

30. The method according to claim 25, and comprising generating electronic images of the pattern on the scene, and processing the electronic images so as to generate a depth map of the scene responsively to the pattern appearing in the images.