Methods and systems for laser based real-time structured light depth extraction
First Claim
1. A laser-based real-time structured light depth extraction system comprising:
- (a) a laser light source for producing a collimated beam of laser light;
(b) a pattern generator being optically coupled to the laser light source for generating a plurality of different structured light patterns, each structured light pattern including a plurality of pixels, wherein each pattern interacts with the collimated beam of laser light to simultaneously project the plurality of pixels onto an object of interest;
(c) a detector being optically coupled to the object and synchronized with the pattern generator for receiving patterns reflected from the object and for generating signals based on the reflected patterns; and
(d) a real-time structured light depth extraction engine/controller coupled to the detector and the pattern generator for controlling the projection and detection of the patterns, for calculating, in real-time, depth values for regions of the object based on the signals received from the detector, and for generating and displaying the image of the object based on the calculated depth values, wherein the projection, the calculating, and the generation are repeated continually to update display of the image in real time,wherein the three dimensional image of the object comprises a synthetic image and wherein the real time structured light depth extraction engine/controller combines the synthetic image with a real image of a scene and displays the combined image.
1 Assignment
0 Petitions
Accused Products
Abstract
Laser-based methods and systems for real-time structured light depth extraction are disclosed. A laser light source (100) produces a collimated beam of laser light. A pattern generator (102) generates structured light patterns including a plurality of pixels. The beam of laser light emanating from the laser light source (100) interacts with the patterns to project the patterns onto the object of interest (118). The patterns are reflected from the object of interest (118) and detected using a high-speed, low-resolution detector (106). A broadband light source (111) illuminates the object with broadband/light, and a separate high-resolution, low-speed detector (108) detects broadband light reflected from the object (118). A real-time structured light depth extraction engine/controller (110) based on the transmitted and reflected patterns and the reflected broadband light.
164 Citations
64 Claims
-
1. A laser-based real-time structured light depth extraction system comprising:
-
(a) a laser light source for producing a collimated beam of laser light; (b) a pattern generator being optically coupled to the laser light source for generating a plurality of different structured light patterns, each structured light pattern including a plurality of pixels, wherein each pattern interacts with the collimated beam of laser light to simultaneously project the plurality of pixels onto an object of interest; (c) a detector being optically coupled to the object and synchronized with the pattern generator for receiving patterns reflected from the object and for generating signals based on the reflected patterns; and (d) a real-time structured light depth extraction engine/controller coupled to the detector and the pattern generator for controlling the projection and detection of the patterns, for calculating, in real-time, depth values for regions of the object based on the signals received from the detector, and for generating and displaying the image of the object based on the calculated depth values, wherein the projection, the calculating, and the generation are repeated continually to update display of the image in real time, wherein the three dimensional image of the object comprises a synthetic image and wherein the real time structured light depth extraction engine/controller combines the synthetic image with a real image of a scene and displays the combined image. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22)
-
-
23. A real-time structured light depth extraction system comprising:
-
(a) a self-illuminating display for generating a plurality of different structured light patterns, each structured light pattern including a plurality of pixels, and for simultaneously projecting the plurality of pixels onto an object of interest; (b) a detector being optically coupled to the self-illuminating display for receiving patterns reflected from the object and for generating signals based on the reflected patterns; and (c) a real-time structured light depth extraction engine/controller coupled to the detector and the self-illuminating display for controlling the projection and detection of the patterns and for calculating, in real-time, depth values for regions of the object based on the signals received from the detector. - View Dependent Claims (24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37)
-
-
38. A system for real-time structured light depth extraction in an endoscopic surgical environment:
-
(a) a laser light source for producing a collimated beam of laser light; (b) a pattern generator optically coupled to the laser light source for presenting a plurality of different structured light patterns, each structured light pattern including a plurality of pixels, when each pattern interacts with the collimated beam of laser light to simultaneously project the plurality of pixels onto an object of interest; (c) beam expansion optics being optically coupled to the laser light source and the pattern generator for expanding the collimated beam of laser light to illuminate an area of the pattern generator corresponding to the patterns; (d) an endoscope optically coupled to the pattern generator for communicating the patterns into a patient'"'"'s body to illuminate an object and for receiving patterns reflected from the object; (e) beam compression optics being optically coupled to the pattern generator and the detector for reducing a beam width of the projected patterns to a size that fits within an aperture of the endoscope; (f) a structured light depth extraction camera optically coupled to the object via the endoscope and synchronized with the pattern generator for detecting the reflected patterns and generating signals based on the reflected patterns; (g) a broadband light source optically coupled to the object via the endoscope for broadband illumination of the object; (h) a color camera optically coupled to the object via the endoscope for receiving broadband light reflected from the object and for generating signals based on the reflected broadband light; and (i) a real-time structured light depth extraction engine/controller coupled to the cameras and the pattern generator for controlling the projection and detection of patterns for calculating, in real-time, depth and color values for regions of the object based on the signals received from the cameras, and for generating and displaying the image of the object based on the calculated depth values, wherein the projecting of the plurality of pixels onto the object, the calculating of the depth and color values, and the generation of the image of the object are repeated continually to update display of the image in real time, wherein the three dimensional image of the object comprises a synthetic image and wherein the real time structured light depth extraction engine/controller combines the synthetic image with a real image of a scene and displays the combined image. - View Dependent Claims (39)
-
-
40. A method for laser-based real-time structured light depth extraction comprising:
-
(a) projecting a beam of laser light from a laser onto a pattern generator; (b) generating patterns on the pattern generator, each pattern including a plurality of pixels; (c) altering the beam of laser light using the patterns such that the patterns are projected onto object of interest; (d) detecting patterns reflected from the object of interest; (e) calculating depth information relating to the object of interest in real-time based on the reflected patterns; (f) generating and displaying three-dimensional image of the object based on the calculated depth information; and (g) wherein steps (a)-(f) are continually repeated to update display of the three-dimensional image of the object in real time, wherein the three dimensional image of the object comprises a synthetic image and wherein the method further comprises combining the synthetic image with a real image of a scene and displaying the combined image. - View Dependent Claims (41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57)
-
-
58. A method for real-time structured light depth extraction comprising:
-
(a) projecting patterns from a self-illuminating display onto an object of interest; (b) detecting patterns reflected from the object of interest; (c) calculating depth information relating to the object of interest in real-time based on the reflected patterns; and (d) generating a three-dimensional image of the object based on the calculated depth information. - View Dependent Claims (59, 60, 61, 62, 63, 64)
-
Specification