Methods and systems for laser based real-time structured light depth extraction
First Claim
1. A laser-based real-time structured light depth extraction system comprising:
- (a) a laser light source for producing a collimated beam of laser light;
(b) a pattern generator being optically coupled to the laser light source for generating a plurality of different structured light patterns, each structured light pattern including a plurality of pixels, wherein each pattern interacts with the collimated beam of laser light to simultaneously project the plurality of pixels onto an object of interest;
(c) a detector being optically coupled to the object and synchronized with the pattern generator for receiving patterns reflected from the object and for generating signals based on the reflected patterns; and
(d) a real-time structured light depth extraction engine/controller coupled to the detector and the pattern generator for controlling the projection and detection of the patterns and for calculating, in real-time, depth values for regions of the object based on the signals received from the detector.
1 Assignment
0 Petitions
Accused Products
Abstract
Laser-based methods and systems for real-time structured light depth extraction are disclosed. A laser light source (100) produces a collimated beam of laser light. A pattern generator (102) generates structured light patterns including a plurality of pixels. The beam of laser light emanating from the laser light source (100) interacts with the patterns to project the patterns onto the object of (118). The patterns are reflected from the object of interest (118) and detected using a high-speed, low-resolution detector (106). A broadband light source (111) illuminates the object with broadband/light, and a separate high-resolution, low-speed detector (108) detects broadband light reflected from the object (118). A real-time structured light depth extraction engine/controller (110) based on the transmitted and reflected patterns and the reflected broadband light.
162 Citations
61 Claims
-
1. A laser-based real-time structured light depth extraction system comprising:
-
(a) a laser light source for producing a collimated beam of laser light;
(b) a pattern generator being optically coupled to the laser light source for generating a plurality of different structured light patterns, each structured light pattern including a plurality of pixels, wherein each pattern interacts with the collimated beam of laser light to simultaneously project the plurality of pixels onto an object of interest;
(c) a detector being optically coupled to the object and synchronized with the pattern generator for receiving patterns reflected from the object and for generating signals based on the reflected patterns; and
(d) a real-time structured light depth extraction engine/controller coupled to the detector and the pattern generator for controlling the projection and detection of the patterns and for calculating, in real-time, depth values for regions of the object based on the signals received from the detector. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21)
-
-
22. A real-time structured light depth extraction system comprising:
-
(a) a self-illuminating display for generating a plurality of different structured light patterns, each structured light pattern including a plurality of pixels, and for simultaneously projecting the plurality of pixels onto an object of interest;
(b) a detector being optically coupled to the self-illuminating display for receiving patterns reflected from the object and for generating signals based on the reflected patterns; and
(c) a real-time structured light depth extraction engine/controller coupled to the detector and the self-illuminating display for controlling the projection and detection of the patterns and for calculating, in real-time, depth values for regions of the object based on the signals received from the detector. - View Dependent Claims (23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36)
-
-
37. A system for real-time structured light depth extraction in an endoscopic surgical environment:
-
(a) a laser light source for producing a collimated beam of laser light;
(b) a pattern generator optically coupled to the laser light source for presenting a plurality of different structured light patterns, each structured light pattern including a plurality of pixels, when each pattern interacts with the collimated beam of laser light to simultaneously project the plurality of pixels onto an object of interest;
(c) beam expansion optics being optically coupled to the laser light source and the pattern generator for expanding the collimated beam of laser light to illuminate an area of the pattern generator corresponding to the patterns;
(d) an endoscope optically coupled to the pattern generator for communicating the patterns into a patient'"'"'s body to illuminate an object and for receiving patterns reflected from the object;
(e) beam compression optics being optically coupled to the pattern generator and the detector for reducing a beam width of the projected patterns to a size that fits within an aperture of the endoscope;
(f) a structured light depth extraction camera optically coupled to the object via the endoscope and synchronized with the pattern generator for detecting the reflected patterns and generating signals based on the reflected patterns;
(g) a broadband light source optically coupled to the object via the endoscope for broadband illumination of the object;
(h) a color camera optically coupled to the object via the endoscope for receiving broadband light reflected from the object and for generating signals based on the reflected broadband light; and
(i) a real-time structured light depth extraction engine/controller coupled to the cameras and the pattern generator for controlling the projection and detection of patterns and for calculating, in real-time, depth and color values for regions of the object based on the signals received from the cameras.
-
-
38. A method for laser-based real-time structured light depth extraction comprising:
-
(a) projecting a beam of laser light from a laser onto a pattern generator;
(b) generating patterns on the pattern generator, each pattern including a plurality of pixels;
(c) altering the beam of laser light using the patterns such that the patterns are projected onto object of interest;
(d) detecting patterns reflected from the object of interest; and
(e) calculating depth information relating to the object of interest in real-time based on the reflected patterns. - View Dependent Claims (39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54)
-
-
55. A method for real-time structured light depth extraction comprising:
-
(a) projecting patterns from a self-illuminating display onto an object of interest;
(b) detecting patterns reflected from the object of interest; and
(c) calculating depth information relating to the object of interest in real-time based on the reflected patterns. - View Dependent Claims (56, 57, 59, 60, 61)
-
-
58. The method of claim 58 wherein detecting reflected patterns includes detecting the reflected patterns using a high-speed, low-resolution camera.
Specification