DEPTH MEASUREMENT USING MULTIPLE PULSED STRUCTURED LIGHT PROJECTORS

• US 20190072771A1
• Filed: 09/05/2017
• Published: 03/07/2019
• Est. Priority Date: 09/05/2017
• Status: Abandoned Application

• Current Assignee: META Platforms Technologies LLC (Meta Platforms, Inc. (f/k/a Facebook, Inc.))
• Original Assignee: Facebook Technologies, LLC (Meta Platforms, Inc. (f/k/a Facebook, Inc.))
• Inventors: Hall, Michael
• Application Number:
  US15/695,851
• Publication Number:
  US 20190072771A1
• Time in Patent Office: Days
• CPC Class Codes: G01B 11/22 for measuring depth
• CPC Class Codes: G01B 11/2513 with several lines being projected in more than one direction, e.g. grids, patterns
• CPC Class Codes: G01B 5/0014 due to temperature on machine tools B23Q11/0003
• CPC Class Codes: G02B 2027/0127 comprising devices increasing the depth of field
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 27/0172 characterised by optical features
• CPC Class Codes: G02B 27/0176 characterised by mechanical features
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06T 7/507 from shading G06T7/586 takes precedence
• CPC Class Codes: H04N 13/25 using two or more image sensors with different characteristics other than in their location or field of view, e.g. having different resolutions or colour pickup characteristics; using image signals from one sensor to control the characteristics of another sensor
• CPC Class Codes: H04N 23/60 Control of cameras or camera modules

Abstract

A depth measurement assembly (DMA) includes a pulsed illuminator assembly, a depth camera assembly, and a controller. The pulsed illuminator assembly has a structured light projector that projects pulses of structured light at a pulse rate into a local area. The depth camera assembly captures images data of an object in the local area illuminated with the pulses of structured light. An exposure interval of the depth camera assembly is pulsed and synchronized to the pulses projected by the pulsed illuminator assembly. The controller controls the pulsed illuminator assembly and the depth camera assembly so that they are synchronized. The controller also determine depth and/or tracking information of the object based on the captured image data. In some embodiments, the pulsed illuminator assembly have a plurality of structured light projectors that projects pulses of structured light at different times.

Claims

1. A depth measurement assembly (DMA) comprising:

a pulsed illuminator assembly comprising at least two structured light projectors, wherein each of the structured light projectors are configured to project pulses of structured light at a pulse rate into a local area at different times in accordance with depth instructions;

a depth camera assembly configured to capture image data of a portion of the local area illuminated with the pulses of structured light in accordance with depth instructions and, wherein an exposure interval of the depth camera is pulsed and synchronized to the projected pulses;

a controller configured to;

generate the depth instructions;

provide the depth instructions to the depth camera and the structure light source, and

determine depth information of an object in the local area based in part on the image data.

2. The DMA of claim 1, wherein the structured light projectors illuminate at least two objects in the local area, the depth camera captures image data for each of the objects, and the controller determines depth information for each of the objects.

5. The DMA of claim 1, wherein the depth camera comprises a detector configured to collect pulses of structured light reflected from the object in synchronization with pulse emission of the structured light projector.

6. The DMA of claim 5, wherein the detector comprises a plurality of photodiodes, each photodiodes comprising at least two storage regions.

7. The DMA of claim 5, wherein for each pulse of structured light, the detector is configured to take one or more exposures during an exposure duration same as or longer than duration of the pulse.

8. The DMA of claim 7, wherein the detector comprises a tunable filter that is inactive during each exposure duration and active outside exposure durations of the detector.

9. The DMA of claim 7, wherein the exposure duration is 20% longer than the duration of the pulse.

10. The DMA of claim 1, wherein each structured light projector includes a pulsed illuminator, a diffractive optical element, and a projection assembly.

11. The DMA of claim 7, wherein the pulses of structured light projected by each structured light projector are formed by interference of two or more beams of pulsed light.

12. The DMA of claim 1, wherein the structured light projectors alternatively projects pulses of structured light.

13. The DMA of claim 1, wherein the pulses emitted by the pulsed illuminator assembly have a frequency in a range from 100 kHz to 200 MHz.

14. The DMA of claim 1, wherein the pulses emitted by the pulsed illuminator assembly have a pulse duration in a range from 100 ps to 100 ns.

15. The DMA of claim 1, wherein the controller is configured to determine the depth information based on phase-shifted patterns of the portions of the reflected structured light distorted by shapes of the objects in the local area.

16. The DMA of claim 1, wherein the controller is configured to determine the depth information using a ratio of charge between storage regions associated with each photodiode of the depth camera assembly.

17. The DMA of claim 1, wherein the controller is further configured to use triangulation calculation to obtain a depth map of the local area.

18. The DMA of claim 1, wherein the depth instructions comprise one or more pulse parameters for the structured light projector.

19. The DMA of claim 17, wherein the one or more pulse parameters include pulse rate, pulse length, pulse wavelength, pulse amplitude, some other parameter that controls how the pulses of structured light are projected by the pulsed illuminator assembly, or some combination thereof

20. The DMA of claim 1, wherein the depth instructions comprise an exposure rate and an exposure duration.

21. The DMA of claim 19, wherein the exposure rate equals the pulse rate of the pulsed illuminator assembly.

3. The DMA of claim 3, wherein the captured image data comprises separate image data for each structured light projector.

4. The DMA of claim 3, wherein the captured image data comprises combined image data for all the structured light projectors.