Object posture estimation/correction system using weight information
First Claim
1. An object pose estimating and matching system comprising:
- reference three-dimensional object model storage means for storing, in advance, reference three-dimensional object models of objects;
reference three-dimensional weighting coefficient storage means for storing, in advance, reference three-dimensional weighting coefficients corresponding to said reference three-dimensional object models;
pose candidate determining means for determining pose candidates for an object;
comparative image generating means for generating comparative images close to an input image depending on said pose candidates, based on said reference three-dimensional object models;
weighting coefficient converting means for converting said reference three-dimensional weighting coefficients into two-dimensional weighting coefficients depending on said pose candidates, using said reference three-dimensional object models; and
weighted matching and pose selecting means for calculating weighted distance values or similarity degrees between said input image and said comparative images, using said two-dimensional weighting coefficients, and selecting one of the comparative images whose distance value up to said object is the smallest or whose similarity degree with respect to said object is the greatest, thereby to estimate and match the pose of said object.
1 Assignment
0 Petitions
Accused Products
Abstract
An object pose estimating and matching system is disclosed for estimating and matching the pose of an object highly accurately by establishing suitable weighting coefficients, against images of an object that has been captured under different conditions of pose, illumination. Pose candidate determining unit determines pose candidates for an object. Comparative image generating unit generates comparative images close to an input image depending on the pose candidates, based on the reference three-dimensional object models. Weighting coefficient converting unit determines a coordinate correspondence between the standard three-dimensional weighting coefficients and the reference three-dimensional object models, using the standard three-dimensional basic points and the reference three-dimensional basic points, and converts the standard three-dimensional weighting coefficients into two-dimensional weighting coefficients depending on the pose candidates. Weighted matching and pose selecting unit calculates weighted distance values or similarity degrees between said input image and the comparative images, using the two-dimensional weighting coefficients, and selects one of the comparative images whose distance value up to the object is the smallest or whose similarity degree with respect to the object is the greatest, thereby to estimate and match the pose of the object.
-
Citations
38 Claims
-
1. An object pose estimating and matching system comprising:
-
reference three-dimensional object model storage means for storing, in advance, reference three-dimensional object models of objects;
reference three-dimensional weighting coefficient storage means for storing, in advance, reference three-dimensional weighting coefficients corresponding to said reference three-dimensional object models;
pose candidate determining means for determining pose candidates for an object;
comparative image generating means for generating comparative images close to an input image depending on said pose candidates, based on said reference three-dimensional object models;
weighting coefficient converting means for converting said reference three-dimensional weighting coefficients into two-dimensional weighting coefficients depending on said pose candidates, using said reference three-dimensional object models; and
weighted matching and pose selecting means for calculating weighted distance values or similarity degrees between said input image and said comparative images, using said two-dimensional weighting coefficients, and selecting one of the comparative images whose distance value up to said object is the smallest or whose similarity degree with respect to said object is the greatest, thereby to estimate and match the pose of said object. - View Dependent Claims (5, 17)
-
-
2. An object pose estimating and matching system comprising:
-
reference three-dimensional object model storage means for storing, in advance, reference three-dimensional object models of objects;
standard three-dimensional weighting coefficient storage means for storing, in advance, standard three-dimensional weighting coefficients;
reference three-dimensional basic point storage means for storing, in advance, reference three-dimensional basic points corresponding to said reference three-dimensional object models;
standard three-dimensional basic point storage means for storing, in advance, standard three-dimensional basic points corresponding to standard three-dimensional object models;
pose candidate determining means for determining pose candidates for an object;
comparative image generating means for generating comparative images close to an input image depending on said pose candidates, based on said reference three-dimensional object models;
weighting coefficient converting means for determining a coordinate correspondence between said standard three-dimensional weighting coefficients and said reference three-dimensional object models, using said standard three-dimensional basic points and said reference three-dimensional basic points, and converting said standard three-dimensional weighting coefficients into two-dimensional weighting coefficients depending on said pose candidates; and
weighted matching and pose selecting means for calculating weighted distance values or similarity degrees between said input image and said comparative images, using said two-dimensional weighting coefficients, and selecting one of the comparative images whose distance value up to said object is the smallest or whose similarity degree with respect to said object is the greatest, thereby to estimate and match the pose of said object. - View Dependent Claims (7)
-
-
3. An object pose estimating and matching system comprising:
-
reference three-dimensional object model storage means for storing, in advance, reference three-dimensional object models of objects;
variation-specific reference three-dimensional weighting coefficient storage means for storing, in advance, reference three-dimensional weighting coefficients corresponding to said reference three-dimensional object models and image variations;
pose candidate determining means for determining pose candidates for an object;
variation estimating means for determining a correspondence between an area of a three-dimensional object model and an input image, using said pose candidates and said reference three-dimensional object models, and estimating a variation based on image information of a given area of said input image;
comparative image generating means for generating comparative images close to said input image depending on said pose candidates, based on said reference three-dimensional object models;
weighting coefficient converting means for converting said reference three-dimensional weighting coefficients corresponding to the estimated variation into two-dimensional weighting coefficients depending on said pose candidates, using said reference three-dimensional object models; and
weighted matching and pose selecting means for calculating weighted distance values or similarity degrees between said input image and said comparative images, using said two-dimensional weighting coefficients, and selecting one of the comparative images whose distance value up to said object is the smallest or whose similarity degree with respect to said object is the greatest, thereby to estimate and match the pose of said object. - View Dependent Claims (6, 15, 16)
-
-
4. An object pose estimating and matching system comprising:
-
reference three-dimensional object model storage means for storing, in advance, reference three-dimensional object models of objects;
variation-specific standard three-dimensional weighting coefficient storage means for storing, in advance, standard three-dimensional weighting coefficients corresponding to image variations;
reference three-dimensional basic point storage means for storing, in advance, reference three-dimensional basic points corresponding to said reference three-dimensional object models;
standard three-dimensional basic point storage means for storing, in advance, standard three-dimensional basic points corresponding to standard three-dimensional object models;
pose candidate determining means for determining pose candidates for an object;
variation estimating means for determining a correspondence between an area of a three-dimensional object model and an input image, using said pose candidates and said reference three-dimensional object models, and estimating a variation based on image information of a given area of said input image;
comparative image generating means for generating comparative images close to said input image depending on said pose candidates, based on said reference three-dimensional object models;
weighting coefficient converting means for determining a coordinate correspondence between said standard three-dimensional weighting coefficients corresponding to the estimated variation and said reference three-dimensional object models, using said standard three-dimensional basic points and said reference three-dimensional basic points, and converting said standard three-dimensional weighting coefficients into two-dimensional weighting coefficients depending on said pose candidates; and
weighted matching and pose selecting means for calculating weighted distance values or similarity degrees between said input image and said comparative images, using said two-dimensional weighting coefficients, and selecting one of the comparative images whose distance value up to said object is the smallest or whose similarity degree with respect to said object is the greatest, thereby to estimate and match the pose of said object.
-
-
8. An object pose estimating and matching system comprising:
-
pose-specific reference image storage means for storing, in advance, pose-specific reference images of an object;
pose-specific reference weighting coefficient storage means for storing, in advance, pose-specific reference weighting coefficients corresponding to said reference images;
normalizing means for normalizing an input image to generate a normalized image; and
weighted matching and pose selecting means for calculating weighted distance values or similarity degrees between said normalized image and said reference images, using said pose-specific weighting coefficients, and selecting one of the reference images whose distance value up to said object is the smallest or whose similarity degree with respect to said object is the greatest, thereby to estimate and match the pose of said object. - View Dependent Claims (12)
-
-
9. An object pose estimating and matching system comprising:
-
pose-specific reference image storage means for storing, in advance, pose-specific reference images of an object;
pose-specific standard weighting coefficient storage means for storing, in advance, pose-specific standard weighting coefficients;
normalizing means for normalizing an input image to generate a normalized image; and
weighted matching and pose selecting means for calculating weighted distance values or similarity degrees between said normalized image and said reference images, using said pose-specific weighting coefficients, and selecting one of the reference images whose distance value up to said object is the smallest or whose similarity degree with respect to said object is the greatest, thereby to estimate and match the pose of said object. - View Dependent Claims (14)
-
-
10. An object pose estimating and matching system comprising:
-
pose-specific reference image storage means for storing, in advance, pose-specific reference images of an object;
pose- and variation-specific reference weighting coefficient storage means for storing, in advance, pose- and variation-specific reference weighting coefficients corresponding to said reference images and image variations;
standard three-dimensional object model storage means for storing, in advance, standard three-dimensional object models;
normalizing means for normalizing an input image to generate a normalized image;
variation estimating means for determining a correspondence between an area of a three-dimensional object model and the normalized image, using pose information of said reference images and said standard three-dimensional object models, and estimating a variation based on image information of a given area of said normalized image; and
weighted matching and pose selecting means for calculating weighted distance values or similarity degrees between said normalized image and said reference images, using the pose information of said reference images and said pose- and variation-specific weighting coefficients corresponding to the estimated variation, and selecting one of the reference images whose distance value up to said object is the smallest or whose similarity degree with respect to said object is the greatest, thereby to estimate and match the pose of said object. - View Dependent Claims (13)
-
-
11. An object pose estimating and matching system comprising:
-
pose-specific reference image storage means for storing, in advance, pose-specific reference images of an object;
pose- and variation-specific standard weighting coefficient storage means for storing, in advance, pose- and variation-specific standard weighting coefficients corresponding to image variations;
standard three-dimensional object model storage means for storing, in advance, standard three-dimensional object models;
normalizing means for normalizing an input image to generate a normalized image;
variation estimating means for determining a correspondence between an area of a three-dimensional object model and the normalized image, using pose information of said reference images and said standard three-dimensional object models, and estimating a variation based on image information of a given area of said normalized image; and
weighted matching and pose selecting means for calculating weighted distance values or similarity degrees between said normalized image and said reference images, using the pose information of said reference images and said pose- and variation-specific weighting coefficients corresponding to the estimated variation, and selecting one of the reference images whose distance value up to said object is the smallest or whose similarity degree with respect to said object is the greatest, thereby to estimate and match the pose of said object.
-
-
18. An object pose estimating and matching program for enabling a computer to perform a process comprising the steps of:
-
storing, in advance, reference three-dimensional object models of objects;
storing, in advance, reference three-dimensional weighting coefficients corresponding to said reference three-dimensional object models;
determining pose candidates for an object;
generating comparative images close to an input image depending on said pose candidates, based on said reference three-dimensional object models;
converting said reference three-dimensional weighting coefficients into two-dimensional weighting coefficients depending on said pose candidates, using said reference three-dimensional object models; and
calculating weighted distance values or similarity degrees between said input image and said comparative images, using said two-dimensional weighting coefficients, and selecting one of the comparative images whose distance value up to said object is the smallest or whose similarity degree with respect to said object is the greatest, thereby to estimate and match the pose of said object.
-
-
19. An object pose estimating and matching program for enabling a computer to perform a process comprising the steps of:
-
storing, in advance, reference three-dimensional object models of objects;
storing, in advance, standard three-dimensional weighting coefficients;
storing, in advance, reference three-dimensional basic points corresponding to said reference three-dimensional object models;
storing, in advance, standard three-dimensional basic points corresponding to standard three-dimensional object models;
determining pose candidates for an object;
generating comparative images close to an input image depending on said pose candidates, based on said reference three-dimensional object models;
determining a coordinate correspondence between said standard three-dimensional weighting coefficients and said reference three-dimensional object models, using said standard three-dimensional basic points and said reference three-dimensional basic points, and converting said standard three-dimensional weighting coefficients into two-dimensional weighting coefficients depending on said pose candidates; and
calculating weighted distance values or similarity degrees between said input image and said comparative images, using said two-dimensional weighting coefficients, and selecting one of the comparative images whose distance value up to said object is the smallest or whose similarity degree with respect to said object is the greatest, thereby to estimate and match the pose of said object.
-
-
20. An object pose estimating and matching program for enabling a computer to perform a process comprising the steps of:
-
storing, in advance, reference three-dimensional object models of objects;
storing, in advance, reference three-dimensional weighting coefficients corresponding to said reference three-dimensional object models and image variations;
determining pose candidates for an object;
determining a correspondence between an area of a three-dimensional object model and an input image, using said pose candidates and said reference three-dimensional object models, and estimating a variation based on image information of a given area of said input image;
generating comparative images close to said input image depending on said pose candidates, based on said reference three-dimensional object models;
converting said reference three-dimensional weighting coefficients corresponding to the estimated variation into two-dimensional weighting coefficients depending on said pose candidates, using said reference three-dimensional object models; and
calculating weighted distance values or similarity degrees between said input image and said comparative images, using said two-dimensional weighting coefficients, and selecting one of the comparative images whose distance value up to said object is the smallest or whose similarity degree with respect to said object is the greatest, thereby to estimate and match the pose of said object.
-
-
21. An object pose estimating and matching program for enabling a computer to perform a process comprising the steps of:
-
storing, in advance, reference three-dimensional object models of objects;
storing, in advance, standard three-dimensional weighting coefficients corresponding to image variations;
storing, in advance, reference three-dimensional basic points corresponding to said reference three-dimensional object models;
storing, in advance, standard three-dimensional basic points corresponding to standard three-dimensional object models;
determining pose candidates for an object;
determining a correspondence between an area of a three-dimensional object model and an input image, using said pose candidates and said reference three-dimensional object models, and estimating a variation based on image information of a given area of said input image;
generating comparative images close to said input image depending on said pose candidates, based on said reference three-dimensional object models;
determining a coordinate correspondence between said standard three-dimensional weighting coefficients corresponding to the estimated variation and said reference three-dimensional object models, using said standard three-dimensional basic points and said reference three-dimensional basic points, and converting said standard three-dimensional weighting coefficients into two-dimensional weighting coefficients depending on said pose candidates; and
calculating weighted distance values or similarity degrees between said input image and said comparative images, using said two-dimensional weighting coefficients, and selecting one of the comparative images whose distance value up to said object is the smallest or whose similarity degree with respect to said object is the greatest, thereby to estimate and match the pose of said object.
-
-
22. (canceled)
-
23. (canceled)
-
24. (canceled)
-
25. (canceled)
-
26. (canceled)
-
27. (canceled)
-
28. (canceled)
-
29. (canceled)
-
30. (canceled)
-
31. (canceled)
-
32. (canceled)
-
33. (canceled)
-
34. (canceled)
-
35. A method of object pose estimating and matching comprising the steps of:
-
storing, in advance, reference three-dimensional object models of objects;
storing, in advance, reference three-dimensional weighting coefficients corresponding to said reference three-dimensional object models;
determining pose candidates for an object;
generating comparative images close to an input image depending on said pose candidates, based on said reference three-dimensional object models;
converting said reference three dimensional weighting coefficients into two-dimensional weighting coefficients depending on said pose candidates, using said reference three-dimensional object models; and
calculating weighted distance values or similarity degrees between said input image and said comparative images, using said two-dimensional weighting coefficients, and selecting one of the comparative images whose distance value up to said object is the smallest or whose similarity degree with respect to said object is the greatest, thereby to match and estimate the pose of said object.
-
-
36. A method of object pose estimating and matching comprising the steps of:
-
storing, in advance, reference three-dimensional object models of objects;
storing, in advance, standard three-dimensional weighting coefficients;
storing, in advance, reference three-dimensional basic points corresponding to said reference three-dimensional object models;
storing, in advance, standard three-dimensional basic points corresponding to standard three-dimensional object models;
determining pose candidates for an object;
generating comparative images close to an input image depending on said pose candidates, based on said reference three-dimensional object models;
determining a coordinate correspondence between said standard three-dimensional weighting coefficients and said reference three-dimensional object models, using said standard three-dimensional basic points and said reference three-dimensional basic points, and converting said standard three-dimensional weighting coefficients into two-dimensional weighting coefficients depending on said pose candidates; and
calculating weighted distance values or similarity degrees between said input image and said comparative images, using said two-dimensional weighting coefficients, and selecting one of the comparative images whose distance value up to said object is the smallest or whose similarity degree with respect to said object is the greatest, thereby to estimate and match the pose of said object.
-
-
37. A method of object pose estimating and matching comprising the steps of:
-
storing, in advance, reference three-dimensional object models of objects;
storing, in advance, reference three-dimensional weighting coefficients corresponding to said reference three-dimensional object models and image variations;
determining pose candidates for an object;
determining a correspondence between an area of a three-dimensional object model and an input image, using said pose candidates and said reference three-dimensional object models, and estimating a variation based on image information of a given area of said input image;
generating comparative images close to said input image depending on said pose candidates, based on said reference three-dimensional object models;
converting said reference three-dimensional weighting coefficients corresponding to the estimated variation into two-dimensional weighting coefficients depending on said pose candidates, using said reference three-dimensional object models; and
calculating weighted distance values or similarity degrees between said input image and said comparative images, using said two-dimensional weighting coefficients, and selecting one of the comparative images whose distance value up to said object is the smallest or whose similarity degree with respect to said object is the greatest, thereby to estimate and match the pose of said object.
-
-
38. A method of object pose estimating and matching comprising the steps of:
-
storing, in advance, reference three-dimensional object models of objects;
storing, in advance, standard three-dimensional weighting coefficients corresponding to image variations;
storing, in advance, reference three-dimensional basic points corresponding to said reference three-dimensional object models;
storing, in advance, standard three-dimensional basic points corresponding to standard three-dimensional object models;
determining pose candidates for an object;
determining a correspondence between an area of a three-dimensional object model and an input image, using said pose candidates and said reference three-dimensional object models, and estimating a variation based on image information of a given area of said input image;
generating comparative images close to said input image depending on said pose candidates, based on said reference three-dimensional object models;
determining a coordinate correspondence between said standard three-dimensional weighting coefficients corresponding to the estimated variation and said reference three-dimensional object models, using said standard three-dimensional basic points and said reference three-dimensional basic points, and converting said standard three-dimensional weighting coefficients into two-dimensional weighting coefficients depending on said pose candidates; and
calculating weighted distance values or similarity degrees between said input image and said comparative images, using said two-dimensional weighting coefficients, and selecting one of the comparative images whose distance value up to said object is the smallest or whose similarity degree with respect to said object is the greatest, thereby to estimate and match the pose of said object.
-
Specification