Pose estimation method and apparatus
First Claim
1. A pose estimation method by using a plurality of pose candidates, comprising the steps of:
- a) formulating 3D model data indicating a three-dimensional shape of an object and reflectivity or color at every point of said object;
b) creating, for each of said pose candidates, an image space representing brightness values of a plurality of two-dimensional images of said object which is placed in the same position and orientation as said each pose candidate, wherein said brightness values would be obtained if said object is illuminated under varying lighting conditions;
c) detecting, for each of said pose candidates, an image candidate within said image space by using said 3D model data and determining a distance from the image candidate to an input image; and
d) selecting one of the pose candidates which corresponds to the image candidate whose distance to an input image is smallest.
1 Assignment
0 Petitions
Accused Products
Abstract
A three-dimensional image data is formulated and saved in a memory for indicating a three-dimensional shape of an object and reflectivity or color at every point of the object. For each of multiple pose candidates, an image space is created for representing brightness values of a set of two-dimensional images of the object which is placed in the same position and orientation as the each pose candidate. The brightness values are those which would be obtained if the object is illuminated under varying lighting conditions. For each pose candidate, an image candidate is detected within the image space using the 3D model data and a distance from the image candidate to an input image is determined. Corresponding to the image candidate whose distance is smallest, one of the pose candidates is selected. The image space is preferably created from each of a set of pose variants of each pose candidate.
-
Citations
66 Claims
-
1. A pose estimation method by using a plurality of pose candidates, comprising the steps of:
-
a) formulating 3D model data indicating a three-dimensional shape of an object and reflectivity or color at every point of said object;
b) creating, for each of said pose candidates, an image space representing brightness values of a plurality of two-dimensional images of said object which is placed in the same position and orientation as said each pose candidate, wherein said brightness values would be obtained if said object is illuminated under varying lighting conditions;
c) detecting, for each of said pose candidates, an image candidate within said image space by using said 3D model data and determining a distance from the image candidate to an input image; and
d) selecting one of the pose candidates which corresponds to the image candidate whose distance to an input image is smallest. - View Dependent Claims (2, 3, 4, 5, 6, 7)
-
-
8. A pose estimation method by using a plurality of pose candidates stored in a memory, comprising the steps of:
-
a) formulating 3D model data indicating a three-dimensional shape of an object and reflectivity or color at every point of said object;
b) successively reading one of said pose candidates from said memory;
c) creating a plurality of pose variants from said one pose candidate such that each of the pose variants is displaced in position and orientation by a predetermined amount from said one pose candidate;
d) creating, for each of said pose variants, an image space representing brightness values of a plurality of two-dimensional images of said object placed in the same position and orientation as said each pose variant, wherein said brightness values would be obtained if said object is illuminated under varying lighting conditions;
e) detecting, for each said pose variant, an image candidate within said image space by using said 3D model data and determining a distance from the image candidate to an input image;
f) repeating steps (b) to (e) to produce a plurality of said image candidates for each of said pose candidates;
g) selecting one of the pose candidates corresponding to the image candidate whose distance to said input image is smallest;
h) comparing the pose candidate selected by step (g) with a previously selected pose candidate; and
i) replacing the previously selected pose candidate with the pose candidate currently selected by step (g) if the currently selected pose candidate is better than the previously selected pose candidate, and repeating steps (b) to (g) until the previously selected pose candidate is better than the currently selected pose candidate. - View Dependent Claims (9, 10, 11)
-
-
12. A pose estimation method comprising the steps of:
-
a) formulating 3D model data indicating a three-dimensional shape of an object and reflectivity or color at every point of said object;
b) extracting feature points from said object and extracting feature points from an input image;
c) creating a plurality of pose candidates from the extracted feature points of said object and the extracted feature points of said input image and storing the pose candidates in a memory;
d) creating, for each of said pose candidates, an image space representing brightness values of a plurality of two-dimensional images of an object placed in the same position and orientation as said each pose candidate, wherein said brightness values would be obtained if said image object is illuminated under varying lighting conditions;
e) detecting, for each of said pose candidates, an image candidate within said image space by using said 3D model data and determining a distance from the image candidate to said input image; and
f) selecting one of the pose candidates corresponding to the image candidate whose distance to said input image is smallest. - View Dependent Claims (13, 14, 15, 16, 17, 18)
-
-
19. A pose estimation method comprising the steps of:
-
a) formulating 3D model data indicating a three-dimensional shape of an object and reflectivity or color at every point of said object;
b) extracting feature points from said object and extracting feature points from an input image;
c) estimating a possible error of the extracted feature points of said input image;
d) creating a plurality of pose candidates from the extracted feature points of said object and the extracted feature points of said input image and storing the pose candidates in a memory;
e) successively reading one of said pose candidates from said memory;
f) creating a plurality of pose variants from said one pose candidate such that each of the pose variants is displaced in position and orientation by a predetermined amount from said one pose candidate over a range determined by said possible error estimated by step (c);
g) creating, for each of said pose variants, an image space representing brightness values of a plurality of two-dimensional images of said object placed in the same position and orientation as said each pose variant, wherein said brightness values would be obtained if said image object is illuminated under varying lighting conditions;
h) detecting, for each said pose variant an image candidate within said image space by using said 3D model data and determining a distance from the image candidate to said input image;
i) repeating steps (e) to (h) to produce a plurality of said image candidates for each of said pose candidates; and
j) selecting one of the pose candidates corresponding to the image candidate whose distance to said input image is smallest. - View Dependent Claims (20, 21, 22)
-
-
23. A pose estimation apparatus comprising:
-
a memory for storing a plurality of pose candidates;
a three-dimensional model creating mechanism for formulating 3D model data indicating a three-dimensional shape of an object and reflectivity or color at every point of said object;
an image space creating mechanism for successively retrieving a pose candidate from said memory and creating an image space representing brightness values of a plurality of two-dimensional images of said object placed in the same position and orientation as the retrieved pose candidate, wherein said brightness values would be obtained if said image object is illuminated under varying lighting conditions;
an image candidate detecting mechanism for detecting an image candidate within said image space by using said 3D model data and determining a distance from the image candidate to an input image; and
a selecting mechanism for selecting one of the pose candidates which corresponds to the image candidate whose distance to said input image is smallest. - View Dependent Claims (24, 25, 26, 27, 28, 29)
-
-
30. A pose estimation apparatus comprising:
-
a first memory for storing a plurality of pose candidates;
a 3D model data formulating mechanism for formulating 3D model data for indicating a three-dimensional shape of an object and reflectivity or color at every point of said object;
a pose variants creating mechanism for successively reading a pose candidate from said first memory and creating a plurality of pose variants of the retrieved pose candidate such that each of the pose variants is displaced in position and orientation by a predetermined amount from the retrieved pose candidate, and storing the pose variants in a second memory;
an image space creating mechanism for successively reading a pose variant from said second memory and creating an image space representing brightness values of a plurality of two-dimensional images of said object placed in the same position and orientation as the retrieved pose variant, wherein said brightness values would be obtained if said object is illuminated under varying lighting conditions;
an image candidate detecting and selecting mechanism for successively detecting, in correspondence to the retrieved pose variant, an image candidate within said image space by using said 3D model data, determining a distance from the image candidate to an input image, and selecting one of the pose candidates corresponding to the image candidate whose distance to said input image is smallest; and
a pose candidate comparing and replacing mechanism for comparing the selected pose candidate with a previously selected pose candidate, and replacing the previously selected pose candidate with the currently selected pose candidate if the currently selected pose candidate is better than the previously selected pose candidate until the previously selected pose candidate is better than the currently selected pose candidate. - View Dependent Claims (31, 32, 33)
-
-
34. A pose estimation apparatus comprising:
-
a three-dimensional model creating mechanism for formulating 3D model data indicating a three-dimensional shape of an object and reflectivity or color at every point of said object;
a feature extracting mechanism for extracting feature points from said object and extracting feature points from an input image;
a pose candidate creating mechanism for creating a plurality of pose candidates from the extracted feature points of said object and the extracted feature points of said input image and storing the pose candidates in a memory;
a image space creating mechanism for creating, for each of said pose candidates, an image space representing brightness values of a plurality of two-dimensional images of said object placed in the same position and orientation as said each pose candidate, wherein said brightness values would be obtained if said object is illuminated under varying lighting conditions;
an image candidate detecting mechanism for detecting, for each of said pose candidates, an image candidate within said image space by using said 3D model data and determining a distance from the image candidate to said input image; and
an image candidate selecting mechanism for selecting one of the pose candidates which corresponds to the image candidate whose distance to said input image is smallest. - View Dependent Claims (35, 36, 37, 38, 39, 40)
-
-
41. A pose estimation apparatus comprising:
-
a memory;
a 3D model data formulating mechanism for formulating 3D model data indicating a three-dimensional shape of an object and reflectivity or color at every point of said object;
a feature points extracting and estimating mechanism for extracting feature points from said object and extracting feature points from an input image and estimating a possible error of the extracted feature points of said input image;
a pose candidate creating mechanism for creating a plurality of pose candidates from the extracted feature points of said object and the extracted feature points of said input image and storing the pose candidates in said memory;
a pose variants creating mechanism for successively retrieving a pose candidate from said memory and creating a plurality of pose variants from the retrieved pose candidate such that each of the pose variants is displaced in position and orientation by a predetermined amount from the retrieved pose candidate over a range determined by the estimated possible error;
an image space creating mechanism for creating, for each of said pose variants, an image space representing brightness values of a plurality of two-dimensional images of said object placed in the same position and orientation as said each pose variant, wherein said brightness values would be obtained if said image object is illuminated under varying lighting conditions; and
an image candidate detecting and selecting mechanism for detecting, for each said pose variant, an image candidate within said image space by using said 3D model data, determining a distance from the image candidate to said input image and selecting one of the pose candidates corresponding to the image candidate whose distance to said input image is smallest. - View Dependent Claims (42, 43, 44)
-
-
45. A computer-readable storage medium containing a computer-executable program which comprises the steps of:
-
a) formulating 3D model data indicating a three-dimensional shape of an object and reflectivity or color at every point of said object;
b) creating, for each of said pose candidates, a image space representing brightness values of a two-dimensional image object of same position and orientation as said each pose candidate, which brightness values would be obtained if said image object is illuminated under varying lighting conditions;
c) detecting, for each of said pose candidates, an image candidate within said image space by using said 3D model data and determining a distance from said image candidate to an input image; and
d) selecting one of the pose candidates which corresponds to the image candidate whose distance to said input image is smallest. - View Dependent Claims (46, 47, 48, 49, 50, 51)
-
-
52. A computer-readable storage medium containing a computer-executable program which comprises the steps of:
-
a) formulating 3D model data indicating a three-dimensional shape of an object and reflectivity or color at every point of said object;
b) successively reading one of said pose candidates from said memory;
c) creating a plurality of pose variants from said one pose candidate such that each of the pose variants is displaced in position and orientation by a predetermined amount from said one pose candidate;
d) creating, for each of said pose variants, an image space representing brightness values of a plurality of two-dimensional images of said object placed in the same position and orientation as said each pose variant, wherein said brightness values would be obtained if said object is illuminated under varying lighting conditions;
e) detecting, for each said pose variant, an image candidate within said image space by using said 3D model data and determining a distance from the image candidate to an input image;
f) repeating steps (b) to (e) to produce a plurality of said image candidates for each of said pose candidates;
g) selecting one of the pose candidates corresponding to the image candidate whose distance to said input image is smallest;
h) comparing the pose candidate selected by step (g) with a previously selected pose candidate; and
i) replacing the previously selected pose candidate with the pose candidate currently selected by step (g) if the currently selected pose candidate is better than the previously selected pose candidate, and repeating steps (b) to (g) until the previously selected pose candidate is better than the currently selected pose candidate. - View Dependent Claims (53, 54, 55)
-
-
56. A computer-readable storage medium containing a computer-executable program which comprises the steps of:
-
a) formulating 3D model data indicating a three-dimensional shape of an object and reflectivity or color at every point of said object;
b) extracting feature points from said object and extracting feature points from an input image;
c) creating a plurality of pose candidates from the extracted feature points of said object and the extracted feature points of said input image and storing the pose candidates in a memory;
d) creating, for each of said pose candidates, an image space representing brightness values of a plurality of two-dimensional images of said object placed in the same position and orientation as said each pose candidate, wherein said brightness values would be obtained if said image object is illuminated under varying lighting conditions;
e) detecting, for each of said pose candidates, an image candidate within said image space by using said 3D model data and determining a distance from the image candidate to said input image; and
f) selecting one of the pose candidates which corresponds to the image candidate whose distance to said input image is smallest. - View Dependent Claims (57, 58, 59, 60, 61, 62)
-
-
63. A computer-readable storage medium containing a computer-executable program which comprises the steps of:
-
a) formulating 3D model data indicating a three-dimensional shape of an object and reflectivity or color at every point of said object;
b) extracting feature points from said object and extracting feature points from an input image;
c) estimating a possible error of the extracted feature points of said input image;
d) creating a plurality of pose candidates from the extracted feature points of said object and the extracted feature points of said input image and storing the pose candidates in a memory;
e) successively reading one of said pose candidates from said memory;
f) creating a plurality of pose variants from said one pose candidate such that each of the pose variants is displaced in position and orientation by a predetermined amount from said one pose candidate over a range determined by said possible error estimated by step (c);
g) creating, for each of said pose variants, an image space representing brightness values of a plurality of two-dimensional images of said object placed in the same position and orientation as said each pose variant, wherein said brightness values would be obtained if said image object is illuminated under varying lighting conditions;
h) detecting, for each said pose variant, an image candidate within said image space by using said 3D model data and determining a distance from the image candidate to said input image;
i) repeating steps (e) to (h) to produce a plurality of said image candidates for each of said pose candidates; and
j) selecting one of the pose candidates corresponding to the image candidate whose distance to said input image is smallest. - View Dependent Claims (64, 65, 66)
-
Specification