Non-Uniform Spatial Resource Allocation for Depth Mapping

• US 20110211044A1
• Filed: 02/28/2011
• Published: 09/01/2011
• Est. Priority Date: 03/01/2010
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: PrimeSense Ltd (Apple Inc.)
• Inventors: Shpunt, Alexander, Mor, Zafrir
• Granted Patent: US 8,982,182 B2
• Time in Patent Office: Days
• US Class Current: 348/46
• CPC Class Codes: G06F 3/005 Input arrangements through a video camera
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06T 2207/10016 Video; Image sequence
• CPC Class Codes: G06T 2207/30196 Human being; Person
• CPC Class Codes: G06T 7/521 from laser ranging, e.g. using interferometry; from the projection of structured light
• CPC Class Codes: H04N 13/254 in combination with electromagnetic radiation sources for illuminating objects
• CPC Class Codes: H04N 13/271 wherein the generated image signals comprise depth maps or disparity maps

Abstract

A method for depth mapping includes providing depth mapping resources including an illumination module, which is configured to project patterned optical radiation into a volume of interest containing the object, and an image capture module, which is configured to capture an image of the pattern reflected from the object. A depth map of the object is generated using the resources while applying at least one of the resources non-uniformly over the volume of interest.

Claims

1. A method for depth mapping, comprising:

providing depth mapping resources comprising;

an illumination module, which is configured to project patterned optical radiation into a volume of interest containing an object; and

an image capture module, which is configured to capture an image of the pattern reflected from the object; and

generating a depth map of the object using the resources while applying at least one of the resources non-uniformly over the volume of interest.

2. The method according to claim 1, wherein the volume of interest has a depth that varies with angle relative to the illumination and image capture modules, and wherein applying the at least one of the resources non-uniformly comprises varying an application of the at least one of the resources responsively to the varying depth as a function of the angle.

3. The method according to claim 2, wherein the volume of interest has a pentagonal profile, with a vertex at the image capture module.

4. The method according to claim 2, wherein varying the application of the at least one of the resources non-uniformly comprises angularly modulating an intensity distribution of the patterned optical radiation projected by the illumination module.

5. The method according to claim 2, wherein varying the application of the at least one of the resources non-uniformly comprises optically distorting the image captured by the image capture module.

6. The method according to claim 1, wherein the illumination module is configured to project a spatial pattern of the optical radiation onto the object, and wherein generating the depth map comprises deriving depth coordinates of the object based on transverse shifts of the spatial pattern in the image.

7. The method according to claim 1, wherein the illumination module generates the patterned optical radiation with a given pattern distortion, and wherein the image capture module comprises objective optics configured to form an image of the pattern on an image sensor while applying an optical distortion to the image that compensates at least partially for the pattern distortion.

8. The method according to claim 7, wherein the objective optics comprise an F-theta lens.

9. The method according to claim 7, wherein the illumination module comprises a diffractive optical element (DOE) and a radiation emitter configured to transilluminate the DOE so as to generate the patterned optical radiation.

10. Apparatus for depth mapping, comprising:

depth mapping resources comprising;

an illumination module, which is configured to project patterned optical radiation into a volume of interest containing an object; and

an image capture module, which is configured to capture an image of the pattern reflected from the object,

wherein at least one of the resources is applied non-uniformly over the volume of interest; and

a processor, which is configured to process the image in order to generate a depth map of the object.

11. The apparatus according to claim 10, wherein the volume of interest has a depth that varies with angle relative to the illumination and image capture modules, and wherein the at least one of the resources is applied non-uniformly responsively to the varying depth as a function of the angle.

12. The apparatus according to claim 11, wherein the volume of interest has a pentagonal profile, with a vertex at the image capture module.

13. The apparatus according to claim 11, wherein an intensity distribution of the patterned optical radiation projected by the illumination module is angularly modulated.

14. The apparatus according to claim 11, wherein the image capture module comprises optics configured to optically distort the image captured by the image capture module.

15. The apparatus according to claim 10, wherein the illumination module is configured to project a spatial pattern of the optical radiation onto the object, and wherein the processor is configured to derive depth coordinates of the object based on transverse shifts of the spatial pattern in the image.

16. The apparatus according to claim 10, wherein the illumination module generates the patterned optical radiation with a given pattern distortion, and wherein the image capture module comprises objective optics configured to form an image of the pattern on an image sensor while applying an optical distortion to the image that compensates at least partially for the pattern distortion.

17. The apparatus according to claim 16, wherein the objective optics comprise an F-theta lens.

18. The apparatus according to claim 16, wherein the illumination module comprises a diffractive optical element (DOE) and a radiation emitter configured to transilluminate the DOE so as to generate the patterned optical radiation.

19. Apparatus for depth mapping, comprising:

an illumination module, which is configured to project patterned optical radiation, with a given pattern distortion, into a volume of interest containing an object; and

an image capture module, which comprises an image sensor and objective optics configured to form an image of the pattern on an image sensor while applying an optical distortion to the image that compensates at least partially for the pattern distortion; and

a processor, which is configured to process the image in order to generate a depth map of the object.

20. The apparatus according to claim 19, wherein the objective optics comprise an F-theta lens.

21. The apparatus according to claim 19, wherein the illumination module comprises a diffractive optical element (DOE) and a radiation emitter configured to transilluminate the DOE so as to generate the patterned optical radiation.