Using micro mirrors to improve the field of view of a 3D depth map

• US 10,495,735 B2
• Filed: 02/14/2017
• Issued: 12/03/2019
• Est. Priority Date: 02/14/2017
• Status: Active Grant

• Current Assignee: Sony Corporation (Sony Group Corp.), Sony Interactive Entertainment Inc. (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: Shintani, Peter, Gonzalez Hernandez, Jose Omar, Clay, William, Espinosa, Pablo Antonio, Ansfield, Fred, Mohapatra, Bibhudendu, Resch, Keith, Usami, Morio
• Primary Examiner(s): Ratcliffe, Luke D
• Application Number:
  US15/432,674
• Publication Number:
  US 20180231641A1
• Time in Patent Office: 1,022 Days
• CPC Class Codes: G01S 17/08 for measuring distance only indirect measurement G01S17/46; active triangulation systems G01S17/48
• CPC Class Codes: G01S 17/10 using transmission of interrupted, pulse-modulated waves determination of distance by phase measurements G01S17/32
• CPC Class Codes: G01S 17/89 for mapping or imaging
• CPC Class Codes: G01S 7/4816 of receivers alone
• CPC Class Codes: G01S 7/4817 relating to scanning
• CPC Class Codes: G02B 26/0833 the reflecting element being a micromechanical device, e.g. a MEMS mirror, DMD G02B26/0825 takes precedence; micromechanical devices in general B81B

Abstract

A micro mirror assembly widens the field of view (FOV) of a 3D depth map sensor, alleviating the limitation of limited laser illumination power and limitations on the resolution of the available imaging device.

Claims

1. A device comprising:

at least one computer medium that is not a transitory signal and that comprises instructions executable by at least one processor to;

activate a laser on a first mobile apparatus to emit light;

move a micro mirror assembly to a first configuration to reflect the light onto a first area of an object distanced from the device and disposed on a surface on which the device is also disposed, the object comprising a second mobile apparatus and comprising a laser emitter configured to illuminate the first mobile apparatus to generate at least one image thereof;

receive, from at least one detector, a signal representing a reflection of the light from the first area;

determine a distance to the first area based at least in part on a time of receipt of the signal representing the reflection of the light from the first area;

move the micro mirror assembly to a second configuration to reflect the light onto a second area of the object;

receive from the detector a signal representing a reflection of the light from the second area;

determine a distance to the second area based at least in part on a time of receipt of the signal representing the reflection of the light from the second area; and

generate a three dimensional (3D) depth map of the object at least in part using the distances to the first and second areas.

2. The device of claim 1, comprising the at least one processor.

3. The device of claim 1, wherein the micro mirror assembly includes a laser bar code scanner-like mechanism to widen a field of view (FOV) of the detector.

4. The device of claim 1, wherein the instructions are executable to determine the distance to the first area at least in part by determining a time of flight (TOF) between a time of light transmission and a time of reflection reception.

5. The device of claim 1, wherein the micro mirror assembly includes a Digital Light Processing (DLP) array-like mechanism.

6. The device of claim 1, wherein the detector has a field of view (FOV) and the instructions are executable to move the micro mirror assembly to shift the FOV of the detector by one-half line height of the FOV of the detector.

7. The device of claim 6, wherein the instructions are executable to use a lateral shift of the detector to double a horizontal resolution of the detector.

8. A method comprising:

illuminating an object on a surface using a laser on a first device on the surface and spaced from the object;

moving a micro mirror assembly to deflect the light from a first area of the object to a second area of the object;

receiving by at least a first detector reflections from the object of light deflected by the micro mirror assembly;

based at least in part of time of receipt of the reflections, generating an image of the object; and

vibrate/oscillate the micro mirror assembly to shift a field of view (FOV) of the first detector by one-half line height.

9. The method of claim 8, wherein the image includes a three dimensional (3D) depth map.

10. The method of claim 8, wherein the micro mirror assembly includes a laser bar code scanner-like mechanism.

11. The method of claim 8, comprising determining a time of flight (TOF) between a time of light transmission and a time of reflection reception.

12. The method of claim 8, wherein the micro mirror assembly includes a Digital Light Processing (DLP) array-like mechanism.

13. The method of claim 12, comprising moving the micro mirror assembly to shift a field of view (FOV) of a detector of the reflections by one-half line height of the FOV of the detector.

14. The method of claim 13, comprising using a lateral shift of the detector to double a horizontal resolution of the detector.

15. An assembly comprising:

plural devices;

each of the plural devices comprising at least one laser range finder configured to output signals useful for generating images of other of the plural devices on a surface, wherein at least a first one of the plural devices is within a field of view (FOV) of the laser range finder of at least a second one of the plural devices, and at least one micro mirror assembly for reflecting light from the laser range finder onto an object to be mapped, and at least one light detector for receiving reflections of the light from the laser finder deflected by micro mirror assembly and reflected by the object; and

at least one processor configured with instructions for generating a 3D depth map of the object based on one or more aspects of the reflections of the light.

16. The assembly of claim 15, wherein the laser range finder comprises at least one laser and the instructions are executable to:

activate the laser to emit light;

move the micro mirror assembly to a first configuration to reflect the light onto a first area of the object;

receive, from the detector, a signal representing a reflection of the light from the first area;

determine a distance to the first area based at least in part on a time of receipt of the signal representing the reflection of the light from the first area;

move the micro mirror assembly to a second configuration to reflect the light onto a second area;

receive from the detector a signal representing a reflection of the light from the second area;

determine a distance to the second area based at least in part on a time of receipt of the signal representing the reflection of the light from the second area; and

generate the 3D depth map at least in part using the distances to the first and second areas.

17. The assembly of claim 16, wherein the micro mirror assembly includes a laser bar code scanner-like mechanism.

18. The assembly of claim 16, wherein the micro mirror assembly includes a Digital Light Processing (DLP) array-like mechanism.

19. The assembly of claim 16, wherein the detector has a field of view (FOV) and the instructions are executable to move the micro mirror assembly to shift the FOV of the detector by one-half line height of the FOV of the detector.

20. The assembly of claim 19, wherein the instructions are executable to use a lateral shift of the detector to double a horizontal resolution of the detector.