DEPTH MAPPING USING MULTI-BEAM ILLUMINATION

• US 20100020078A1
• Filed: 01/21/2008
• Published: 01/28/2010
• Est. Priority Date: 01/21/2007
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: PrimeSense Ltd (Apple Inc.)
• Inventors: Shpunt, Alexander
• Granted Patent: US 8,350,847 B2
• Time in Patent Office: Days
• US Class Current: 345/420
• CPC Class Codes: G01B 11/25 by projecting a pattern, e.g. one or more lines, moiré fringes on the object G01B11/255 takes precedence ; image analysis for depth or shape recovery G06T7/50
• CPC Class Codes: G06T 7/521 from laser ranging, e.g. using interferometry; from the projection of structured light
• CPC Class Codes: G06V 10/145 Illumination specially adapted for pattern recognition, e.g. using gratings
• CPC Class Codes: G06V 2201/12 Acquisition of 3D measurements of objects

Abstract

A method for mapping an object (28) includes illuminating the object with at least two beams (37, 38) of radiation having different beam characteristics. At least one image of the object is captured under illumination with each of the at least two beams. The at least one image is processed to detect local differences in an intensity of the illumination cast on the object by the at least two beams, and the local differences are analyzed in order to generate a three-dimensional (3D) map of the object.

Claims

1. A method for mapping an object, comprising:

illuminating the object with at least two beams of radiation having different beam characteristics;

capturing at least one image of the object under illumination with each of the at least two beams;

processing the at least one image to detect local differences in an intensity of the illumination cast on the object by the at least two beams; and

analyzing the local differences in order to generate a three-dimensional (3D) map of the object.

2. The method according to claim 1, wherein the at least two beams have different respective divergence characteristics.

3. The method according to claim 1, wherein the at least two beams have different geometrical shapes.

4. The method according to claim 1, wherein the at least two beams have different wavelengths.

5. The method according to claim 1, wherein the at least two beams are configured so as to project different patterns on the object.

6. The method according to claim 1, wherein illuminating the object comprises generating the at least two beams using light originating from a single source.

7. The method according to claim 1, wherein illuminating the object comprises generating the at least two beams using light originating from different sources in different respective positions.

8. The method according to claim 7, wherein the different respective positions of the different sources are located at equal respective distances from a plane of the object.

9. The method according to claim 1, wherein capturing the at least one image comprises capturing a single image under the illumination of the at least two beams.

10. The method according to claim 1, wherein the at least two beams comprise first and second beams, and wherein capturing the at least one image comprises capturing first and second images under illumination of the object by the first and second beams, respectively.

11. The method according to claim 1, wherein the at least two beams comprise first and second beams having known, respective intensity distributions I₁(x, y, z) and I₂(x, y, z), and wherein capturing the image comprises detecting first and second intensity patterns on the object D₁(x, y, z) and D₂(x, y, z) using an image capture device, wherein z is a distance from the image capture device to each point (x,y) on the object, and wherein analyzing the local differences comprises inverting an equation of a form

$\frac{I_1}{}$

( x , y , z ) I 2 

( x , y , z ) = D 1 

( x , y , z ) D 2 

( x , y , z )

in order to generate the 3D map of z as a function of (x,y).

12. The method according to claim 1, wherein analyzing the local differences comprises processing the local differences in the intensity of the illumination cast on the object by the at least two beams in order to generate the 3D map while canceling ambiguity due to ambient light reflected from the object.

13. The method according to claim 12, wherein the at least two beams comprise three beams, and wherein canceling the ambiguity comprises using the at least one image captured under the illumination with each of the three beams to cancel the ambiguity.

14. The method according to claim 1, wherein capturing the at least one image comprises capturing a succession of images while the object is moving, and wherein analyzing the local differences comprises mapping a 3D movement of the object.

15. The method according to claim 14, wherein the object is a part of a human body, and wherein the 3D movement comprises a gesture made by the part of the human body, and wherein mapping the 3D movement comprises providing an input to a computer application responsively to the gesture.

16. Apparatus for mapping an object, comprising:

an illumination assembly, which is configured to illuminate the object with at least two beams of radiation having different beam characteristics;

an image capture assembly, which is configured to capture at least one image of the object under illumination with each of the at least two beams; and

an image processor, which is configured to process the at least one image to detect local differences in an intensity of the illumination cast on the object by the at least two beams, and to analyze the local differences in order to generate a three-dimensional (3D) map of the object.

17. The apparatus according to claim 16, wherein the at least two beams have different respective divergence characteristics.

18. The apparatus according to claim 16, wherein the at least two beams have different geometrical shapes.

19. The apparatus according to claim 16, wherein the at least two beams have different wavelengths.

20. The apparatus according to claim 16, wherein the at least two beams are configured so as to project different patterns on the object.

21. The apparatus according to claim 16, wherein the illumination assembly comprises a single light source for generating the at least two beams.

22. The apparatus according to claim 16, wherein the illumination assembly comprises at least two different light sources in different, respective positions for respectively generating the at least two beams.

23. The apparatus according to claim 22, wherein the different respective positions of the different sources are located at equal respective distances from a plane of the object.

24. The method according to claim 16, wherein the image capture assembly is configured to capture a single image under the illumination of the at least two beams, and wherein the image processor is configured to process the single image in order to generate the 3D map.

25. The method according to claim 16, wherein the at least two beams comprise first and second beams, and wherein the image capture assembly is configured to capture first and second images under illumination of the object by the first and second beams, respectively, and wherein the image processor is configured to generate the 3D map by processing the first and second images.

26. The method according to claim 16, wherein the at least two beams comprise first and second beams having known, respective intensity distributions I₁(x, y, z) and I₂(x, y, z), and wherein the image capture device is configured to detect first and second intensity patterns on the object D₁(x, y, z) and D₂(x, y, z), wherein z is a distance from the image capture device to each point (x,y) on the object, and wherein the image processor is configured to invert an equation of a form

$\frac{I_1}{}$

( x , y , z ) I 2 

( x , y , z ) = D 1 

( x , y , z ) D 2 

( x , y , z )

in order to generate the 3D map of z as a function of (x,y).

27. The method according to claim 16, wherein the image processor is configured to analyze the local differences in the intensity of the illumination cast on the object by the at least two beams in order to generate the 3D map while canceling ambiguities due to ambient light reflected from the object.

28. The apparatus according to claim 27, wherein the at least two beams comprise three beams, and wherein the image processor is configured to use the at least one image captured under the illumination with each of the three beams to cancel the ambiguity.

29. The method according to claim 16, wherein the image processor is configured to process a succession of images captured while the object is moving so as to map a 3D movement of the object.

30. The apparatus according to claim 29, wherein the object is a part of a human body, and wherein the 3D movement comprises a gesture made by the part of the human body, and wherein the image processor is coupled to provide an input to a computer application responsively to the gesture.