Method and system for 3D reconstruction of multiple views with altering search path and occlusion modeling
First Claim
1. A method of reconstructing 3D image information from a plurality of 2D images of a scene, the method comprising the steps of:
- receiving a plurality of image features corresponded between different 2D views of a scene, the corresponded image features deviating between different views as a result of camera relative motion;
determining image features of the received plurality of image features that are occluded views;
determining image features of the received plurality of image features that are confident seeds associated with 3D depth information; and
propagating 3D depth information from the confident seeds to neighboring image features, while avoiding image features that have been determined to be occluded views.
1 Assignment
0 Petitions
Accused Products
Abstract
An image processing system and method reconstructs 3D image information corresponding to a scene from a plurality of 2D images of the scene. The method receives a plurality of image features corresponded between different 2D views of the scene, the corresponded image features deviating between different views as a result of camera relative motion. The method determines image features of the received plurality of image features that are occluded views, determines image features of the received plurality of image features that are confident seeds associated with 3D depth information, and propagates 3D depth information from the confident seeds to neighboring image features, while avoiding image features that have been determined to be occluded views. The 3D image information can be rendered and displayed such as for a virtual walkthrough of the scene.
131 Citations
35 Claims
-
1. A method of reconstructing 3D image information from a plurality of 2D images of a scene, the method comprising the steps of:
-
receiving a plurality of image features corresponded between different 2D views of a scene, the corresponded image features deviating between different views as a result of camera relative motion;
determining image features of the received plurality of image features that are occluded views;
determining image features of the received plurality of image features that are confident seeds associated with 3D depth information; and
propagating 3D depth information from the confident seeds to neighboring image features, while avoiding image features that have been determined to be occluded views. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13)
-
-
14. An image processing system comprising:
-
a memory;
a controller/processor electrically coupled to the memory;
a 3D image reconstructor, electrically coupled to the controller/processor and to the memory, for;
receiving a plurality of image features corresponded between different 2D views of a scene, the corresponded image features deviating between different views as a result of camera relative motion;
determining image features of the received plurality of image features that are occluded views;
determining image features of the received plurality of image features that are confident seeds associated with 3D depth information; and
propagating 3D depth information from the confident seeds to neighboring image features, while avoiding image features that have been determined to be occluded views. - View Dependent Claims (15, 16, 17)
-
-
18. A computer readable medium including computer instructions for a 3D image reconstruction computer system, the computer instructions comprising instructions for:
-
receiving a plurality of image features corresponded between different 2D views of a scene, the corresponded image features deviating between different views as a result of camera relative motion;
determining image features of the received plurality of image features that are occluded views;
determining image features of the received plurality of image features that are confident seeds associated with 3D depth information; and
propagating 3D depth information from the confident seeds to neighboring image features, while avoiding image features that have been determined to be occluded views. - View Dependent Claims (19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30)
-
-
31. An electrical device comprising:
-
a data memory;
a program memory including computer instructions for 3D image reconstruction; and
a controller/processor, electrically coupled to the first interface, the data memory and the program memory, for storing image information corresponding to a plurality of image features corresponded between different 2D views of a scene, the corresponded image features deviating between different views as a result of camera relative motion;
determining image features of the stored plurality of image features that are occluded views;
determining image features of the stored plurality of image features that are confident seeds associated with 3D depth information; and
propagating 3D depth information from the confident seeds to neighboring image features, while avoiding image features that have been determined to be occluded views. - View Dependent Claims (32, 33, 34, 35)
-
Specification