POSITION AND ORIENTATION MEASUREMENT METHOD AND POSITION AND ORIENTATION MEASUREMENT APPARATUS

• US 20080122869A1
• Filed: 11/26/2007
• Published: 05/29/2008
• Est. Priority Date: 11/28/2006
• Status: Active Grant

• Current Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Original Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Inventors: Satoh, Kiyohide, Kotake, Daisuke, Aratani, Shinichi
• Granted Patent: US 8,355,531 B2
• Time in Patent Office: Days
• US Class Current: 345/633
• CPC Class Codes: G01C 11/04 Interpretation of pictures
• CPC Class Codes: G06T 2207/10016 Video; Image sequence
• CPC Class Codes: G06T 2207/30208 Marker matrix
• CPC Class Codes: G06T 2207/30244 Camera pose
• CPC Class Codes: G06T 7/246 using feature-based methods, e.g. the tracking of corners or segments
• CPC Class Codes: G06T 7/73 using feature-based methods

Abstract

Indices allocated or set on an object are detected from sensed images of frames, which are time-serially sensed by an image sensing device. In association with each index detected from the sensed image of the frame of interest, a detection condition from frames before the frame of interest is acquired. According to the acquired detection condition of the index, the reliability of this index is calculated. The position and orientation of the object or the image sensing device are calculated using at least information associated with the image coordinates of the detected indices and the reliabilities of the indices.

Claims

1. A position and orientation measurement method, comprising:

an input step of inputting sensed images of respective frames time-serially sensed by an image sensing device;

a detection step of detecting indices allocated or set on an object from each of the sensed images;

an acquisition step of acquiring, in association with each of the indices detected in the sensed image of a frame of interest, a detection condition from frames before the frame of interest;

a reliability calculation step of calculating a reliability of the index according to the detection condition of that index acquired in the acquisition step; and

a position and orientation calculation step of calculating a position and orientation of the object or the image sensing device using at least information associated with image coordinates of the respective indices detected in the detection step and the reliabilities of the indices calculated in the reliability calculation step.

2. The method according to claim 1, wherein, in the acquisition step, as the detection condition, continuity of detection of the index in the sensed images of the respective frames in the past frames is acquired, and

wherein in the reliability calculation step, the reliability of each index is calculated based on the continuity of detection of the index.

3. The method according to claim 1, wherein in the acquisition step, as the detection condition, the number of times of detection of the index in the sensed images of the respective frames is acquired, and

wherein in the reliability calculation step, the reliability of each index is calculated based on the number of times of detection.

5. A program for making a computer execute a position and orientation measurement method according to claim 1.

6. A computer-readable storage medium for storing a program according to claim 5.

4. A position and orientation measurement apparatus, comprising:

an input unit adapted to input sensed images of respective frames time-serially sensed by an image sensing device;

a detection unit adapted to detect indices allocated or set on an object from each of the sensed images;

an acquisition unit adapted to acquire, in association with each of the indices detected in the sensed image of a frame of interest, a detection condition from frames before the frame of interest;

a reliability calculation unit adapted to calculate a reliability of the index according to the detection condition of that index acquired by said acquisition unit; and

a position and orientation calculation unit adapted to calculate a position and orientation of the object or the image sensing device using at least information associated with image coordinates of the respective indices detected by said detection unit and the reliabilities of the indices calculated by said reliability calculation unit.