Method and apparatus for measuring position and orientation

• US 20060227211A1
• Filed: 04/05/2006
• Published: 10/12/2006
• Est. Priority Date: 04/06/2005
• Status: Active Grant

• Current Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Original Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Inventors: Satoh, Kiyohide, Kotake, Daisuke
• Granted Patent: US 7,782,361 B2
• Time in Patent Office: Days
• US Class Current: 348/141
• CPC Class Codes: G01C 11/00 Photogrammetry or videogrammetry, e.g. stereogrammetry; Photographic surveying
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G06T 2207/30204 Marker
• CPC Class Codes: G06T 2207/30244 Camera pose
• CPC Class Codes: G06T 7/73 using feature-based methods

Abstract

A position and an orientation of an image capturing device or an object to which an inclination sensor is mounted are obtained without performing iterative calculation. A position and orientation measuring method includes the steps of: inputting a measured inclination value of an inclination sensor mounted to one of an object and an image capturing device; inputting a captured image from the image capturing device; detecting an index on the object from the captured image; and calculating a position and an orientation of one of the object and the image capturing device to which the inclination sensor is mounted on the basis of the measured inclination value, an image coordinate of the detected index, and already-known positional information on the detected index without performing iterative calculation.

Claims

1. A position and orientation measuring method, comprising the steps of:

inputting a measured inclination value of an inclination sensor mounted to at least one of an object and an image capturing device;

inputting a captured image from the image capturing device;

detecting an index on the object from the captured image; and

calculating a position and an orientation of one of the object and the image capturing device to which the inclination sensor is mounted on the basis of the measured inclination value, an image coordinate of the detected index, and known positional information on the detected index without performing an iterative calculation of correction values of position and orientation.

2. The position and orientation measuring method according to claim 1, wherein the calculating step prepares a plurality of position and orientation calculating procedures, and the method includes selecting an appropriate position and orientation calculating procedure from the plurality of position and orientation calculating procedures according to the detected index.

3. The position and orientation measuring method according to claim 1, wherein the calculating step calculates the position and the orientation on the basis of at least three detected indices.

4. The position and orientation measuring method according to claim 1, wherein the calculating step calculates the position and orientation under constraint condition where the detected indices are on the same plane perpendicular to a predetermined axis.

5. The position and orientation measuring method according to claim 1, wherein the calculating step solves simultaneous equations obtained by establishing a linear equation for each of the detected indices.

6. The position and orientation measuring method according to claim 1, further comprising the step of optimizing the position and the orientation on the basis of an image coordinate of the detected index and the known positional information on the detected index while the calculated position and the calculated orientation are set as initial values.

7. The position and orientation measuring method according to claim 6, wherein the step of optimizing the position and the orientation includes the step of using iterative calculation.

17. A computer-readable medium having stored thereon a program which, when loaded into a computer and executed performs a position and orientation measuring method according to claim 1.

8. A position and orientation measuring method, comprising the steps of:

inputting a first measured inclination value of a first inclination sensor mounted to an object;

inputting a second measured inclination value of a second inclination sensor mounted to an image capturing device;

inputting a captured image from the image capturing device;

detecting an index on the object from the captured image; and

calculating relative position and relative orientation of the object and the image capturing device on the basis of the first measured inclination value, the second measured inclination value, an image coordinate of the detected index, and known positional information on the detected index without performing an iterative calculation of correction values of position and orientation.

9. The position and orientation measuring method according to claim 8, wherein the calculating step prepares a plurality of position and orientation calculating procedures and the method includes selecting an appropriate position and orientation calculating procedure from the plurality of position and orientation calculating procedures according to the detected index.

10. The position and orientation measuring method according to claim 8, wherein the calculating step calculates the relative position and the relative orientation on the basis of at least three detected indices.

11. The position and orientation measuring method according to claim 8, wherein the calculating step calculates the position and orientation under constraint condition where the detected indices are on the same plane perpendicular to a predetermined axis.

12. The position and orientation measuring method according to claim 8, wherein the calculating step solves simultaneous equations obtained by establishing a linear equation for each of the detected indices.

13. The position and orientation measuring method according to claim 8, further comprising the step of optimizing the relative position and the relative orientation on the basis of an image coordinate of the detected index and the known positional information on the detected index while the calculated relative position and the calculated relative orientation are set as initial values.

14. The position and orientation measuring method according to claim 13, wherein the optimizing step uses iterative calculation.

18. A computer-readable medium having stored thereon a program which, when loaded into a computer and executed performs a position and orientation measuring method according to claim 8.

15. A position and orientation measuring apparatus, comprising:

an image capturing device;

an inclination sensor mounted to at least one of an object and the image capturing device;

an inclination value input unit adapted to input a measured inclination value of the inclination sensor;

an image inputting unit adapted to input a captured image from the image capturing device;

an index detecting unit adapted to detect an index on the object from the captured image; and

a position and orientation calculator adapted to calculate a position and an orientation of one of the object and the image capturing device to which the inclination sensor is mounted on the basis of the measured inclination value, an image coordinate of the detected index, and known positional information on the detected index without performing iterative calculation of correction values of position and orientation.

16. A position and orientation measuring apparatus, comprising:

a first measured inclination value input unit adapted to input a first measured inclination value of a first inclination sensor mounted to an object;

a second measured inclination value input unit adapted to input a second measured inclination value of a second inclination sensor mounted to an image capturing device;

an image inputting unit adapted to input a captured image from the image capturing device;

an index detecting unit adapted to detect an index on the object from the captured image; and

a position and orientation calculator adapted to calculate relative position and relative orientation of the object and the image capturing device on the basis of the first measured inclination value, the second measured inclination value, an image coordinate of the detected index, and known positional information on the detected index without performing iterative calculation of correction values of position and orientation.