Methods and systems for real-time structured light depth extraction and endoscope using real-time structured light depth extraction
First Claim
Patent Images
1. A real-time structured light depth extraction system for producing real-time images in an endoscopic surgical environment comprising:
- (a) a projector for projecting structured light patterns onto an object inside of a patient'"'"'s body, each structured light pattern including a plurality of pixels being simultaneously projected onto the object;
(b) at least one endoscope optically coupled to the projector for communicating the structured light patterns from the projector to a first region inside of the patient'"'"'s body and for communicating reflected structured light patterns from the first region to a second region outside of the patient'"'"'s body;
(c) a camera optically coupled to the endoscope for sampling the reflected light patterns and outputting digital signals indicative of the reflected light patterns; and
(d) an image processor/controller coupled to the camera to receive the digital signals and extract depth information of the object in real time.
1 Assignment
0 Petitions
Accused Products
Abstract
A real-time structured light depth extraction system includes a projector for projecting structured light patterns onto an object of interest. A camera positioned off-axis from the projector samples light reflected from the object synchronously with the projection of structured light patterns and outputs digital signals indicative of the reflected light. An image processor/controller receives the digital signals from the camera and processes the digital signals to extract depth information of the object in real time.
-
Citations
15 Claims
-
1. A real-time structured light depth extraction system for producing real-time images in an endoscopic surgical environment comprising:
-
(a) a projector for projecting structured light patterns onto an object inside of a patient'"'"'s body, each structured light pattern including a plurality of pixels being simultaneously projected onto the object;
(b) at least one endoscope optically coupled to the projector for communicating the structured light patterns from the projector to a first region inside of the patient'"'"'s body and for communicating reflected structured light patterns from the first region to a second region outside of the patient'"'"'s body;
(c) a camera optically coupled to the endoscope for sampling the reflected light patterns and outputting digital signals indicative of the reflected light patterns; and
(d) an image processor/controller coupled to the camera to receive the digital signals and extract depth information of the object in real time. - View Dependent Claims (2, 3)
-
-
4. A real-time structured light depth extraction system for producing real-time images in an endoscopic surgical environment comprising:
-
(a) a projector for projecting structured light patterns onto an object inside of a patient'"'"'s body;
(b) at least one endoscope optically coupled to the projector for communicating the structured light patterns from the projector to a first region inside of the patient'"'"'s body and for communicating reflected structured light patterns from the first region to a second region outside of the patient'"'"'s body;
(c) a camera optically coupled to the endoscope for sampling the reflected light patterns and outputting digital signals indicative of the reflected light patterns; and
(d) an image processor/controller coupled to the camera to receive the digital signals and extract depth information of the object in real time, wherein the endoscope comprises a first endoscope for communicating the structured light patterns from the projector to the first region and a second endoscope for communicating the reflected light patterns from the first region to the camera. - View Dependent Claims (5)
-
-
6. An augmented reality visualization system for endoscopic surgery comprising:
-
(a) at least one endoscope for viewing objects inside of a patient'"'"'s body;
(b) a real-time structured light depth extraction system coupled to the endoscope for projecting structured light patterns into the patient'"'"'s body, receiving light reflected from the objects, determining depth information relating to the objects in real time, and producing three-dimensional images of the objects;
(c) a graphics generator for generating synthetic images;
(d) an image merger for merging the three-dimensional images and the synthetic images to produce merged images having correct occlusion relationships; and
(e) a display for displaying the merged images to a viewer. - View Dependent Claims (7, 8, 9, 10, 11, 12, 13, 14, 15)
(a) a projector optically coupled to the endoscope for projecting, from a first position, structured light patterns into the patient'"'"'s body;
(b) a camera optically coupled to the endoscope for receiving, from a second position, light reflected from the objects inside of the patient'"'"'s body synchronously with projection of the structured light patterns; and
(c) a depth extractor for calculating depth information relating to the objects inside of the patient'"'"'s body based on the structured light patterns, the light received by the camera, and the first and second positions.
-
-
12. The augmented reality visualization system of claim 6 wherein the endoscope comprises a single endoscope having a shared optical path for transmitting structured light patterns into the patient'"'"'s body and receiving light reflected from the objects inside of the patient'"'"'s body.
-
13. The augmented reality visualization system of claim 11 wherein the single endoscope comprises a single laparoscope.
-
14. The augmented reality visualization system of claim 6 wherein the endoscope comprises a first endoscope for communicating structured light patterns into the patient'"'"'s body and a second endoscope for receiving light reflected from the objects inside of the patient'"'"'s body.
-
15. The augmented reality visualization system of claim 14 wherein the first and second endoscopes comprise first and second laparoscopes.
Specification