SYSTEM AND METHOD FOR 3D OBJECT RECOGNITION
First Claim
1. A method for constructing a 3D model for 3D object recognition comprising the following steps:
- (a) providing the interior parameters of the camera;
(b) providing a geometric representation of a 3D object;
(c) providing a range of poses in which the 3D object may appear with respect to the camera;
(d) creating virtual views of the 3D object by sampling the range of poses for different image resolutions;
(e) representing all views by a tree structure where views that correspond to the same image resolution reside at the same hierarchy level in the tree; and
(f) for each view creating a 2D model that can be used to find the 2D view in an image by using an appropriate 2D matching approach.
1 Assignment
0 Petitions
Accused Products
Abstract
The present invention provides a system and method for recognizing a 3D object in a single camera image and for determining the 3D pose of the object with respect to the camera coordinate system. In one typical application, the 3D pose is used to make a robot pick up the object. A view-based approach is presented that does not show the drawbacks of previous methods because it is robust to image noise, object occlusions, clutter, and contrast changes. Furthermore, the 3D pose is determined with a high accuracy. Finally, the presented method allows the recognition of the 3D object as well as the determination of its 3D pose in a very short computation time, making it also suitable for real-time applications. These improvements are achieved by the methods disclosed herein.
-
Citations
45 Claims
-
1. A method for constructing a 3D model for 3D object recognition comprising the following steps:
-
(a) providing the interior parameters of the camera; (b) providing a geometric representation of a 3D object; (c) providing a range of poses in which the 3D object may appear with respect to the camera; (d) creating virtual views of the 3D object by sampling the range of poses for different image resolutions; (e) representing all views by a tree structure where views that correspond to the same image resolution reside at the same hierarchy level in the tree; and (f) for each view creating a 2D model that can be used to find the 2D view in an image by using an appropriate 2D matching approach. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28)
-
-
29. A method for recognizing a 3D object and for determining its 3D pose from one image of the object comprising the following steps:
-
(a) providing a 3D model of the 3D object; (b) providing an electronic search image of the 3D object; (c) creating a representation of the search image containing different resolutions of the search image; (d) matching the 2D models that do not have a parent view in a hierarchical tree structure to the image of the respective level of an image pyramid; (e) verifying and refining the 2D matches of a top pyramid level by tracking them down to a lowest pyramid; (f) determining the initial 3D object pose from the 2D matching pose and the respective 3D view pose; and (g) refining the initial 3D object poses. - View Dependent Claims (30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45)
-
Specification