Orientation calculation apparatus, storage medium having orientation calculation program stored therein, game apparatus, and storage medium having game program stored therein

• US 8,405,611 B2
• Filed: 05/27/2009
• Issued: 03/26/2013
• Est. Priority Date: 06/30/2008
• Status: Active Grant

• Current Assignee: Nintendo Company Limited
• Original Assignee: Nintendo Company Limited
• Inventors: Sato, Kenta, Ohta, Keizo
• Primary Examiner(s): CERULLO, LILIANA P
• Application Number:
  US12/472,628
• Publication Number:
  US 20090322679A1
• Time in Patent Office: 1,399 Days
• Field of Search: 345156-184, 702150-154, 463 30- 38, 3482081-20814
• US Class Current: 345/158
• CPC Class Codes: A63F 13/211 using inertial sensors, e.g. accelerometers or gyroscopes
• CPC Class Codes: A63F 13/213 comprising photodetecting means, e.g. cameras, photodiodes or infrared cells A63F13/219, A63F13/655 take precedence
• CPC Class Codes: A63F 13/428 involving motion or position input signals, e.g. signals representing the rotation of an input controller or a player's arm motions sensed by accelerometers or gyroscopes
• CPC Class Codes: A63F 13/98 Accessories, i.e. detachable arrangements optional for the use of the video game device, e.g. grip supports of game controllers
• CPC Class Codes: A63F 2300/1006 having additional degrees of freedom
• CPC Class Codes: A63F 2300/105 using inertial sensors, e.g. accelerometers, gyroscopes
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors

Abstract

An orientation calculation apparatus obtains data from an input device including at least a gyroscope and an acceleration sensor, and calculates an orientation of the input device in a three-dimensional space. Orientation calculation means calculates the orientation of the input device in accordance with an angular rate detected by the gyroscope. Acceleration vector calculation means calculates an acceleration vector representing an acceleration of the input device in accordance with acceleration data from the acceleration sensor. Correction means corrects the orientation of the input device such that a direction of the acceleration vector in the space approaches a vertically downward direction in the space. Also, the correction means corrects the orientation of the input device such that a directional change before and after the correction is minimized regarding a predetermined axis representing the orientation of the input device.

Claims

1. An orientation calculation apparatus for obtaining data from an input device including at least an angular rate sensor and an acceleration sensor, and calculating a three dimensional orientation of the input device in a three-dimensional space, the apparatus comprising:

a processor;

a memory coupled to said processor, said memory storing instructions that, when executed by said processor, control said processor to;

calculate data of the three-dimensional orientation of the input device in accordance with an angular rate detected by the angular rate sensor;

calculate a three-dimensional acceleration vector providing orientation information for the input device in accordance with acceleration data from the acceleration sensor;

calculate an acceleration projection vector projected onto a plane perpendicular to a predetermined axis, wherein the predetermined axis corresponds to a direction in which the input device is oriented as detected by the angular rate sensor;

calculate a projection gravity vector which corresponds to the projection of a vertically downward direction onto the plane; and

correct the data of the three-dimensional orientation of the input device such that a direction of the three-dimensional acceleration vector in the three-dimensional space approaches the vertically downward direction in the three-dimensional space, wherein,

the data of the three-dimensional orientation of the input device is corrected so as to at least rotate the three-dimensional orientation of the input device about the predetermined axis in such a direction that a direction of the acceleration projection vector approaches a direction of the projected gravity vector.

2. The orientation calculation apparatus according to claim 1, wherein the orientation of the input device is corrected through a conversion comprising a first conversion for performing a rotation about the predetermined axis such that a direction of the acceleration projection vector approaches a direction of the projection gravity vector, and a second conversion for performing a rotation after the first conversion such that the direction of the acceleration vector approaches the vertically downward direction.

3. The orientation calculation apparatus according to claim 1, wherein the orientation of the input device is corrected such that the direction of the acceleration vector coincides with the vertically downward direction.

4. The orientation calculation apparatus according to claim 1, wherein an amount of correction for the orientation of the input device is controlled such that the closer a magnitude of the acceleration vector is to a magnitude of a gravitational acceleration, the more closely the direction of the acceleration vector approaches the vertically downward direction in the space.

5. The orientation calculation apparatus according to claim 1, wherein the orientation of the input device is corrected only when a difference between a magnitude of the acceleration vector and a magnitude of a gravitational acceleration is smaller than a predetermined reference value.

6. The orientation calculation apparatus according to claim 1, wherein,

the input device further includes an image pickup unit, and

the processor is further configured to correct the orientation of the input device in accordance with an image of a predetermined subject taken by the image pickup unit.

7. The orientation calculation apparatus according to claim 6, wherein the orientation of the input device is corrected by applying a rotation about the predetermined axis.

8. A game apparatus for performing a game process using, as the orientation of the input device, an orientation obtained through correction by the orientation calculation apparatus according to claim 1.

9. A non-transitory computer-readable storage medium having stored therein an orientation calculation program to be executed by a computer of an orientation calculation apparatus for obtaining data from an input device including at least an angular rate sensor and an acceleration sensor, and calculating a three-dimensional orientation of the input device in a three-dimensional space, the program causing the computer to execute:

calculating data of the three-dimensional orientation of the input device in accordance with an angular rate detected by the angular rate sensor;

calculating a three-dimensional acceleration vector providing orientation information for the input device in accordance with acceleration data from the acceleration sensor;

calculating an acceleration projection vector projected onto a plane perpendicular to a predetermined axis, wherein the predetermined axis corresponds to a direction in which the input device is oriented as detected by the angular rate sensor;

calculating a projection gravity vector which corresponds to the projection of a vertically downward direction onto the plane; and

correcting the data of the three-dimensional orientation of the input device such that a direction of the three-dimensional acceleration vector in the three-dimensional space approaches the vertically downward direction in the three-dimensional space, wherein,

the orientation of the input device is corrected so as to at least rotate the three-dimensional orientation of the input device about the predetermined axis in such a direction that a direction of the acceleration projection vector approaches a direction of the projected gravity vector.

10. The non-transitory storage medium according to claim 9, wherein the orientation of the input device is corrected through a conversion comprising a first conversion for performing a rotation about the predetermined axis such that a direction of the acceleration projection vector approaches a direction of the projection gravity vector, and a second conversion for performing a rotation after the first conversion such that the direction of the acceleration vector approaches the vertically downward direction.

11. The non-transitory storage medium according to claim 9, wherein the orientation of the input device is corrected such that the direction of the acceleration vector coincides with the vertically downward direction.

12. The non-transitory storage medium according to claim 9, wherein the an amount of correction for the orientation of the input device is controlled such that the closer a magnitude of the acceleration vector is to a magnitude of a gravitational acceleration, the more closely the direction of the acceleration vector approaches the vertically downward direction in the space.

13. The non-transitory storage medium according to claim 9, wherein the orientation of the input device is corrected only when a difference between a magnitude of the acceleration vector and a magnitude of a gravitational acceleration is smaller than a predetermined reference value.

14. The non-transitory storage medium according to claim 9, wherein,

the input device further includes an image pickup device, and

the orientation calculation program further causes the computer to execute further correcting the orientation of the input device in accordance with an image of a predetermined subject taken by the image pickup device.

15. The non-transitory storage medium according to claim 14, wherein the orientation of the input device is corrected by applying a rotation about the predetermined axis.

16. A non-transitory storage medium having stored therein a game program for performing a game process using, as the orientation of the input device, an orientation obtained through correction by the orientation calculation program according to claim 9.

17. A method for obtaining data from an input device including at least an angular rate sensor and an acceleration sensor, and calculating a three-dimensional orientation of the input device in a three-dimensional space, the method comprising:

calculating data of the three-dimensional orientation of the input device in accordance with an angular rate detected by the angular rate sensor;

calculating a three-dimensional acceleration vector providing orientation information for the input device in accordance with acceleration data from the acceleration sensor;

calculating an acceleration projection vector projected onto a plane perpendicular

to a predetermined axis, wherein the predetermined axis corresponds to a direction

in which the input device is oriented as detected by the angular rate sensor;

calculating a projection gravity vector which corresponds to the projection of a vertically downward direction onto the plane; and

correcting the data of the three-dimensional orientation of the input device such that a direction of the three-dimensional acceleration vector in the three-dimensional space approaches the vertically downward direction in the three-dimensional space, wherein,

the orientation of the input device is corrected so as to at least rotate the three-dimensional orientation of the input device about the predetermined axis in such a direction that a direction of the acceleration projection vector approaches a direction of the projected gravity vector.