ORIENTATION CALCULATION APPARATUS, STORAGE MEDIUM HAVING ORIENTATION CALCULATION PROGRAM STORED THEREIN, GAME APPARATUS, AND STORAGE MEDIUM HAVING GAME PROGRAM STORED THEREIN

• US 20090326846A1
• Filed: 04/20/2009
• Published: 12/31/2009
• Est. Priority Date: 06/30/2008
• Status: Active Grant

• Current Assignee: Nintendo Company Limited
• Original Assignee: Nintendo Company Limited
• Inventors: OHTA, Keizo
• Granted Patent: US 7,711,505 B2
• Time in Patent Office: Days
• US Class Current: 702/85
• CPC Class Codes: A63F 13/211 using inertial sensors, e.g. accelerometers or gyroscopes
• CPC Class Codes: A63F 13/213 comprising photodetecting means, e.g. cameras, photodiodes or infrared cells A63F13/219, A63F13/655 take precedence
• CPC Class Codes: A63F 13/428 involving motion or position input signals, e.g. signals representing the rotation of an input controller or a player's arm motions sensed by accelerometers or gyroscopes
• CPC Class Codes: A63F 13/98 Accessories, i.e. detachable arrangements optional for the use of the video game device, e.g. grip supports of game controllers
• CPC Class Codes: A63F 2300/1006 having additional degrees of freedom
• CPC Class Codes: A63F 2300/105 using inertial sensors, e.g. accelerometers, gyroscopes
• CPC Class Codes: A63F 2300/1087 comprising photodetecting means, e.g. a camera

Abstract

An orientation calculation apparatus obtains data from an input device comprising at least a gyro sensor, an acceleration sensor, and an image pickup means, so as to calculate an orientation of the input device. Firstly, the orientation calculation apparatus calculates an orientation of the input device in accordance with an angular rate detected by the gyro sensor. Secondly, the orientation is corrected in accordance with acceleration data detected by the acceleration sensor. Further, the orientation is corrected in accordance with an image of a predetermined subject to be taken by the image pickup means.

Claims

1. An orientation calculation apparatus for obtaining data from an input device comprising at least a gyro sensor, an acceleration sensor, and an image pickup device, so as to calculate an orientation of the input device, the orientation calculation apparatus comprising:

orientation calculator for calculating a first orientation of the input device in accordance with an angular rate detected by the gyro sensor;

first correction programmed logic circuitry for correcting the first orientation such that the closer a magnitude of an acceleration which is represented by acceleration data detected by the acceleration sensor is to a magnitude of a gravitational acceleration, the more closely the first orientation approaches a second orientation, the second orientation being an orientation, of the input device, in which a direction of the acceleration which is represented by the acceleration data detected by the acceleration sensor is a vertically downward direction, and

second correction programmed logic circuitry for correcting the first orientation so as to approach a third orientation at a predetermined rate, the third orientation being an orientation, of the input device, which is calculated from a direction and/or a position of a predetermined subject in an image taken by the image pickup device,

the first correction programmed logic circuitry correcting the first orientation only when a difference between the magnitude of the acceleration and the magnitude of the gravitational acceleration is smaller than a predetermined reference value, and

the second correction programmed logic circuitry calculating, among the third orientation, an orientation, associated with a roll direction, relative to an imaging direction of the image pickup device, based on the direction of the predetermined subject in the image taken by the image pickup device, and calculating, among the third orientation, an orientation, associated with a pitch direction and/or a yaw direction, relative to the imaging direction of the image pickup device, based on the position of the predetermined subject in the image taken by the image pickup device.

2. The orientation calculation apparatus according to claim 1, wherein the second correction programmed logic circuitry determines, based on the first orientation, whether or not the image pickup device is facing toward a direction in which the image pickup device is allowed to take the image of the predetermined subject, and corrects the first orientation only when the image pickup device is facing toward the direction in which the image pickup device is allowed to take the image of the predetermined subject.

3. The orientation calculation apparatus according to claim 1, wherein the second correction programmed logic circuitry corrects the first orientation having been corrected by the first correction programmed logic circuitry.

4. A game apparatus for performing a game process by using, as the orientation of the input device, the first orientation corrected by the orientation calculation apparatus according to claim 1.

5. A computer-readable storage medium having stored therein an orientation calculation program executed by a computer of an orientation calculation apparatus for obtaining data from an input device comprising at least a gyro sensor, an acceleration sensor, and an image pickup device, so as to calculate an orientation of the input device, the computer being caused to function as:

orientation calculator for calculating a first orientation of the input device in accordance with an angular rate detected by the gyro sensor;

first correction programmed logic circuitry for correcting the first orientation such that the closer a magnitude of an acceleration which is represented by acceleration data detected by the acceleration sensor is to a magnitude of a gravitational acceleration, the more closely the first orientation approaches a second orientation, the second orientation being an orientation, of the input device, in which a direction of the acceleration which is represented by the acceleration data detected by the acceleration sensor is a vertically downward direction,

second correction programmed logic circuitry for correcting the first orientation so as to approach a third orientation at a predetermined rate, the third orientation being an orientation, of the input device, which is calculated from a direction and/or a position of a predetermined subject in an image taken by the image pickup device,

the first correction programmed logic circuitry correcting the first orientation only when a difference between the magnitude of the acceleration and the magnitude of the gravitational acceleration is smaller than a predetermined reference value, and

the second correction programmed logic circuitry calculating, among the third orientation, an orientation, associated with a roll direction, relative to an imaging direction of the image pickup device, based on the direction of the predetermined subject in the image taken by the image pickup device, and calculating, among the third orientation, an orientation, associated with a pitch direction and/or a yaw direction, relative to the imaging direction of the image pickup device, based on the position of the predetermined subject in the image taken by the image pickup device.

6. The storage medium according to claim 5, wherein the second correction programmed logic circuitry determines, based on the first orientation, whether or not the image pickup device is facing toward a direction in which the image pickup device is allowed to take the image of the predetermined subject, and corrects the first orientation only when the image pickup device is facing toward the direction in which the image pickup device is allowed to take the image of the predetermined subject.

7. The storage medium according to claim 5, wherein the second correction programmed logic circuitry corrects the first orientation having been corrected by the first correction programmed logic circuitry

8. A computer-readable storage medium having stored therein a game program for performing a game process by using, as the orientation of the input device, the first orientation corrected by the orientation calculation program according to claim 5.