DEPTH RECONSTRUCTION USING PLURAL DEPTH CAPTURE UNITS
First Claim
1. A computer readable storage medium for storing computer readable instructions, the computer readable instructions providing a depth construction module executed by one or more processing devices, the computer readable instructions performing a method comprising:
- receiving at least a first depth image from a first depth capture unit and a second depth image from a second depth capture unit,the first depth image and the second depth image being generated, respectively, by the first depth capture unit and the second depth capture unit, in response to;
projecting, using a first projector, a first projected pattern onto an object;
projecting, using a second projector, a second projected pattern onto the object;
capturing, using a first camera, a first captured image of the object;
capturing, using a second camera, a second captured image of the object;
providing the first depth image based on the first projected pattern and the first captured image; and
providing the second depth image based on the second projected pattern and the second captured image;
identifying at least one deficient portion in at least one of the first depth image and the second depth image;
generating depth information for said at least one deficient portion using a multi-view reconstruction technique; and
merging the depth information for said at least one deficient portion with at least the first depth image and the second depth image to produce a depth scene that provides a depth map of the object.
2 Assignments
0 Petitions
Accused Products
Abstract
A depth construction module is described that receives depth images provided by two or more depth capture units. Each depth capture unit generates its depth image using a structured light technique, that is, by projecting a pattern onto an object and receiving a captured image in response thereto. The depth construction module then identifies at least one deficient portion in at least one depth image that has been received, which may be attributed to overlapping projected patterns that impinge the object. The depth construction module then uses a multi-view reconstruction technique, such as a plane sweeping technique, to supply depth information for the deficient portion. In another mode, a multi-view reconstruction technique can be used to produce an entire depth scene based on captured images received from the depth capture units, that is, without first identifying deficient portions in the depth images.
71 Citations
20 Claims
-
1. A computer readable storage medium for storing computer readable instructions, the computer readable instructions providing a depth construction module executed by one or more processing devices, the computer readable instructions performing a method comprising:
-
receiving at least a first depth image from a first depth capture unit and a second depth image from a second depth capture unit, the first depth image and the second depth image being generated, respectively, by the first depth capture unit and the second depth capture unit, in response to; projecting, using a first projector, a first projected pattern onto an object; projecting, using a second projector, a second projected pattern onto the object; capturing, using a first camera, a first captured image of the object; capturing, using a second camera, a second captured image of the object; providing the first depth image based on the first projected pattern and the first captured image; and providing the second depth image based on the second projected pattern and the second captured image; identifying at least one deficient portion in at least one of the first depth image and the second depth image; generating depth information for said at least one deficient portion using a multi-view reconstruction technique; and merging the depth information for said at least one deficient portion with at least the first depth image and the second depth image to produce a depth scene that provides a depth map of the object. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10)
-
-
11. A depth construction module, implemented using physical and tangible computing functionality, comprising:
-
a deficient portion generation module for; receiving plural depth images from plural depth capture units, each depth capture unit using a structured light technique to generate a respective depth image; and identifying at least one deficient portion in at least one depth image that has been received; and a depth information generation module for generating depth information using a multi-view reconstruction technique by jointly taking into consideration plural captured images provided by the plural depth capture units. - View Dependent Claims (12)
-
-
13. A method, implemented by tangible and physical computing functionality, for generating a depth scene, comprising:
-
receiving at least a first captured image from a first camera and a second captured image from a second camera, the first captured image and the second captured image being generated in response to projection of a first projected pattern by a first projector onto an object, and projection of a second projected pattern by a second projector onto the object; and generating a depth scene, that provides a depth map of the object, based on at least the first captured image and the second captured image, said generating leveraging a constraint relationship that affects at least the first captured image, the second captured image, the first projected pattern, and the second projected pattern. - View Dependent Claims (14, 15, 16, 17, 18, 19, 20)
-
Specification