Optical modules that reduce speckle contrast and diffraction artifacts

• US 10,024,968 B2
• Filed: 08/04/2016
• Issued: 07/17/2018
• Est. Priority Date: 09/23/2013
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: Hudman, Joshua, DePue, Marshall
• Primary Examiner(s): HUANG, FRANK F
• Application Number:
  US15/228,982
• Publication Number:
  US 20160341829A1
• Time in Patent Office: 712 Days
• CPC Class Codes: G01S 17/89 for mapping or imaging
• CPC Class Codes: G01S 7/481 Constructional features, e.g. arrangements of optical elements
• CPC Class Codes: G01S 7/4815 using multiple transmitters
• CPC Class Codes: G02B 19/0057 in the form of a laser diode array, e.g. laser diode bar semiconductor laser arrays with beam combining arrangement H01S5/4012
• CPC Class Codes: G02B 27/0961 Lens arrays lens arrays per se G02B3/0006
• CPC Class Codes: G02B 27/48 Laser speckle optics
• CPC Class Codes: G02B 3/0056 arranged along two different directions in a plane, e.g. honeycomb arrangement of lenses G02B3/0043 takes precedence; miniaturised objectives for electronic devices employing wafer level optics G02B13/0085
• CPC Class Codes: H04N 13/128 Adjusting depth or disparity
• CPC Class Codes: H04N 13/207 using a single 2D image sensor
• CPC Class Codes: H04N 13/229 using lenticular lenses, e.g. arrangements of cylindrical lenses
• CPC Class Codes: H04N 2013/0081 Depth or disparity estimation from stereoscopic image signals
• CPC Class Codes: H04N 23/55 Optical parts specially adapted for electronic image sensors; Mounting thereof
• CPC Class Codes: H04N 23/56 provided with illuminating means
• CPC Class Codes: H04N 5/33 Transforming infrared radiation cameras or camera modules for generating image signals from infrared radiation H04N23/20; circuitry of SSIS for transforming infrared radiation into image signals H04N25/20

Abstract

An optical module, for use in a depth camera, includes a plurality of laser emitting elements, each of which emits a corresponding laser beam, and a micro-lens array (MLA) that includes a plurality of lenslets. Laser beams emitted by adjacent laser emitting elements at least partially overlap one another prior to being incident on the MLA For each lenslet of at least a majority of the lenslets of the MLA, the lenslet is at least partially filled by light corresponding to laser beams emitted by at least two of the laser emitting elements. The inclusion of the plurality of laser emitting elements is used to reduce speckle contrast. The overlap of the laser beams, and the at least partially filling of the lenslets of the MLA with light corresponding to laser beams emitted by multiple laser emitting elements, is used to reduce diffraction artifacts.

Claims

1. A depth camera system for use in obtaining a depth image of a capture area, comprising:

an optical module configured to output infrared (IR) light that illuminates the capture area;

an image pixel detector array configured to detect a portion of the IR light, output by the optical module, that has reflected off one or more objects within the capture area and is incident on the image pixel detector array; and

a processor configured to produce the depth image based on the portion of the IR light detected by the image pixel detector;

wherein the optical module includes

a plurality of laser emitting elements each of which is operable to emit a corresponding IR laser beam; and

a micro-lens array including a two-dimensional array of substantially identical lenslets provided along two axes on a common surface of the micro-lens array;

wherein adjacent ones of the laser emitting elements are configured to emit IR laser beams that at least partially overlap one another prior to being incident on the micro-lens array;

wherein a number of lenslets, in the two-dimensional array of lenslets provided on the common surface of the micro-lens array, is greater than a number of laser emitting elements;

wherein a center-to-center distance between any two of the laser emitting elements that are adjacent to one another is less than 100 μ

m; and

wherein a center-to-center distance between any two of the laser emitting elements that are not adjacent to one another is less than 1 mm.

2. The depth camera system of claim 1, wherein for each lenslet of at least a majority of the lenslets in the two-dimensional array of lenslets provided on the common surface of the micro-lens array, the lenslet is configured to be at least partially filled by IR light corresponding to IR laser beams emitted by more than one of the plurality of laser emitting elements.

3. The depth camera system of claim 2, wherein:

the inclusion of the plurality of laser emitting elements in the optical module reduces speckle contrast in the IR light that is output by the optical module and illuminates the capture area; and

the overlap of the IR laser beams emitted by adjacent ones of the laser emitting elements, and the at least partially filling of the lenslets of the micro-lens array with IR light corresponding to IR laser beams emitted by more than one of the laser emitting elements, reduces diffraction pattern artifacts in the IR light that is output by the optical module and illuminates the capture area.

4. The depth camera system of claim 1, wherein:

the two-dimensional array of lenslets provided on the common surface of the micro-lens array of the optical module comprises at least a 7×

7 array of lenslets provided on the common surface of the micro-lens array; and

for each lenslet of at least a majority of the lenslets, in the at least 7×

7 array of lenslets provided on the common surface of the micro-lens array, the lenslet is configured to be at least partially filled by IR light corresponding to IR laser beams emitted by more than one of the laser emitting elements.

5. The depth camera system of claim 1, wherein for each lenslet of at least a majority of the lenslets in the two-dimensional array of lenslets provided on the common surface of the micro-lens array, the lenslet is configured to be completely filled by IR light corresponding to IR laser beams emitted by more than one of the laser emitting elements.

6. The depth camera system of claim 1, wherein the plurality of laser emitting elements comprise five or more edge emitting lasers fabricated on a same semiconductor substrate.

7. The depth camera system of claim 1, wherein the plurality of laser emitting elements comprise five or more edge emitting lasers or vertical-cavity surface-emitting lasers (VCSELs).

8. The depth camera of claim 1, wherein the plurality of laser emitting elements comprise five or more parallel laser stripes fabricated on a same semiconductor substrate.

9. The depth camera system of claim 1, wherein IR light exiting the micro-lens array comprises the IR light output by the optical module that illuminates the capture area.

10. A method for use by a depth camera, the method comprising:

outputting infrared (IR) light from an optical module of the depth camera to thereby illuminate a capture area with the IR light, wherein a portion of the IR light that has reflected off one or more objects within the capture area is detected by an image pixel detector array;

wherein the outputting IR light from the optical module includes emitting a plurality of separate IR laser beams from a plurality of laser emitting elements towards a micro-lens array that includes a two-dimensional array of substantially identical lenslets provided along two axes on a common surface of the micro-lens array such that

adjacent IR laser beams at least partially overlap one another prior to being incident on the micro-lens array, and

for each lenslet of at least a majority of the lenslets in the two-dimensional array of lenslets provided on the common surface of the micro-lens array, the lenslet is at least partially filled by IR light corresponding to more than one of the IR laser beams;

wherein a number of the lenslets is greater than a number of laser emitting elements;

wherein a center-to-center distance between any two of the laser emitting elements that are adjacent to one another is less than 100 μ

m; and

wherein a center-to-center distance between any two of the laser emitting elements that are not adjacent to one another is less than 1 mm.

11. The method of claim 10, wherein:

a center-to-center distance between any two laser emitting elements that are adjacent to one another in the optical module is less than 100 μ

m; and

a center-to-center distance between any two of the laser emitting elements that are not adjacent to one another in the optical module is less than 1 mm.

12. The method of claim 10, wherein:

the two-dimensional array of lenslets comprises at least a 7×

7 array of lenslets provided on the common surface of the micro-lens array; and

for each lenslet of the at least the majority of the lenslets, in the at least 7×

7 array of lenslets provided on the common surface of the micro-lens array, the lenslet is at least partially filled by IR light corresponding to more than one of the IR laser beams.

13. The method of claim 10, further comprising:

detecting a portion of the IR light that has reflected off one or more objects within the capture area;

producing a depth image based on the detected portion of the IR light; and

updating an application based on the depth image.

14. The method of claim 10, wherein the emitting the plurality of separate IR laser beams towards the micro-lens array that includes the plurality of lenslets is performed such that each of the IR laser beams at least partially overlaps each of the other IR laser beams of the plurality of separate IR laser beams, prior to the plurality of IR laser beams being incident on the micro-lens array.

15. The method of claim 10, wherein the emitting the plurality of separate IR laser beams towards the micro-lens array that includes the plurality of lenslets is performed such that each lenslet of the micro-lens array, is at least partially filled by each IR laser beam of the plurality of IR laser beams.

16. The method of claim 10, wherein the emitting the plurality of separate IR laser beams towards the micro-lens array that includes the two-dimensional array of lenslets provided on the common surface of the micro-lens array is performed such that each lenslet of the at least a majority of the two-dimensional array of lenslets provided on the common surface of the micro-lens array, is completely filled by more than one of the plurality of IR laser beams.

17. An optical module for use with a depth camera system for use in obtaining a depth image of a capture area, the optical module comprising:

a plurality of laser emitting elements each of which is configured to emit a corresponding infrared (IR) laser beam, wherein a portion of IR light corresponding to the IR laser beams reflects off one or more objects within the capture area and is detected by an image pixel detector array; and

a micro-lens array including a two-dimensional array of substantially identical lenslets provided along two axes on a common surface of the micro-lens array;

wherein IR laser beams emitted by adjacent ones of the laser emitting elements at least partially overlap one another prior to being incident on the micro-lens array;

wherein for each lenslet of at least a majority of the lenslets in the two-dimensional array of substantially identical lenslets provided on the common surface of the micro-lens array, the lenslet is configured to be at least partially filled by IR light corresponding to IR laser beams emitted by more than one of the laser emitting elements;

wherein a number of lenslets, in the two-dimensional array of substantially identical lenslets provided on the common surface of the micro-lens array, is greater than a number of laser emitting elements;

wherein a center-to-center distance between any two of the laser emitting elements that are adjacent to one another is less than 100 μ

m; and

wherein a center-to-center distance between any two of the laser emitting elements that are not adjacent to one another is less than 1 mm.

18. The optical module of claim 17, wherein:

a center-to-center distance between any two of the laser emitting elements that are adjacent to one another is less than 100 μ

m; and

a center-to-center distance between any two of the laser emitting elements that are not adjacent to one another is less than 1 mm.

19. The optical module of claim 17, wherein:

the two-dimensional array of substantially identical lenslets provided on the common surface of the micro-lens array of the optical module comprises at least a 7×

7 array of substantially identical lenslets provided on the common surface of the micro-lens array; and

for each lenslet of at least a majority of the lenslets, in the at least 7×

7 array of substantially identical lenslets provided on the common surface of the micro-lens array, the lenslet is configured to be at least partially filled by IR light corresponding to IR laser beams emitted by more than one of the laser emitting elements.

20. The optical module of claim 17, wherein the plurality of laser emitting elements comprise five or more edge emitting lasers or vertical-cavity surface-emitting lasers (VCSELs).