Storage medium storing video game program for calculating a distance between a game controller and a reference

• US 9,561,441 B2
• Filed: 05/08/2006
• Issued: 02/07/2017
• Est. Priority Date: 09/14/2005
• Status: Active Grant

• Current Assignee: Nintendo Company Limited
• Original Assignee: Nintendo Company Limited
• Inventors: Dohta, Takuhiro
• Primary Examiner(s): GALKA, LAWRENCE STEFAN
• Application Number:
  US11/429,249
• Publication Number:
  US 20070060384A1
• Time in Patent Office: 3,928 Days
• Field of Search: 463 36- 39, 463/43, 463/31, 463/32, 463/34, 345/419, 345/156, 345/161
• US Class Current: 1/1
• CPC Class Codes: A63F 13/211 using inertial sensors, e.g. accelerometers or gyroscopes
• CPC Class Codes: A63F 13/213 comprising photodetecting means, e.g. cameras, photodiodes or infrared cells A63F13/219, A63F13/655 take precedence
• CPC Class Codes: A63F 13/22 Setup operations, e.g. calibration, key configuration or button assignment
• CPC Class Codes: A63F 13/235 using a wireless connection, e.g. infrared or piconet
• CPC Class Codes: A63F 13/42 by mapping the input signals into game commands, e.g. mapping the displacement of a stylus on a touch screen to the steering angle of a virtual vehicle
• CPC Class Codes: A63F 13/426 involving on-screen location information, e.g. screen coordinates of an area at which the player is aiming with a light gun
• CPC Class Codes: A63F 2300/1006 having additional degrees of freedom
• CPC Class Codes: A63F 2300/1018 Calibration; Key and button assignment
• CPC Class Codes: A63F 2300/1031 using a wireless connection, e.g. Bluetooth, infrared connections
• CPC Class Codes: A63F 2300/105 using inertial sensors, e.g. accelerometers, gyroscopes
• CPC Class Codes: A63F 2300/1087 comprising photodetecting means, e.g. a camera
• CPC Class Codes: A63F 2300/6045 for mapping control signals received from the input arrangement into game commands
• CPC Class Codes: G06F 3/0325 using a plurality of light emitters or reflectors or a plurality of detectors forming a reference frame from which to derive the orientation of the object, e.g. by triangulation or on the basis of reference deformation in the picked up image

Abstract

A game process is performed by obtaining control data from a game controller. Distance data associated with the distance between the game controller and a predetermined measured reference provided in a real space is calculated by using the control data obtained from the game controller. Then, a predetermined game process is performed on a virtual game world through an operation based on the value of the distance data. Then, the virtual game world after the game process is displayed on a display device.

Claims

1. A method for performing a process using a controller and a video display device including a processor, the method comprising:

providing a reference structure having a known and constant spatial dimension;

obtaining control data including at least one of image data captured by an image sensor in the controller of the known and constant spatial dimension of the reference structure and data determined by an analysis of the image data;

calculating a first distance representative of a real space distance between the controller and the reference structure;

defining an effective range as between a first distance from the reference structure to a second distance from the reference structure, wherein the effective range is defined to include the calculated first distance between the controller and the reference structure;

calculating an effective range position representing a position of the controller within the effective range using the defined effective range and a calculated second distance representative of a real space distance between the controller and the reference structure;

performing a process in the virtual world through an operation using data representative of the effective range position data, and

displaying the virtual world after performing the process.

2. The method of claim 1 further comprising:

determining the effective range position data to be a maximum value when the first distance equals the first value, and

determining the effective range position data to be a minimum value when the first distance equals the second value.

3. The method of claim 1 wherein the first distance is calculated based on an interval between two points in the image data wherein the two points correspond to points on the measured reference structure separated by the known physical dimension.

4. A storage medium storing a video game program to be executed by a computer of a video game device for performing a game process by obtaining control data from a game controller, wherein the storage medium is a non-transitory storage medium and the video game program instructs the computer to perform:

a distance data calculation including calculating distance data associated with a distance between the game controller and a constant measured reference structure provided in a real space, by using the control data obtained from the game controller, wherein the measured reference structure has a constant measured spatial dimension and the control data includes information of a view from the perspective of the game controller of the constant measured spatial dimension;

defining an effective range which includes the calculated distance and is based on a first distance value greater than the calculated distance and a second distance value shorter than the calculated distance;

calculating effective range position data representing at least one position of the game controller in the effective range based on a calculation of a second distance between the game controller and the constant measured reference structure, wherein the calculation of the second distance occurs after the definition of the effective range;

a game process including performing a game process on a virtual game world through an operation based on the effective range position data; and

a display process including displaying, on a display device, the virtual game world after the game process.

5. The storage medium storing a video game program according to claim 4, wherein:

the game controller includes an image-capturing section for capturing an image of an imaging target;

the control data includes a captured image of the measured reference structure, which image is captured by the image-capturing section or a result of performing an operation on the captured image; and

the distance data calculation includes a calculation of the distance data by using the captured image or the result of performing an operation on the captured image included in the control data.

6. The storage medium storing a video game program according to claim 5, wherein the calculation of the distance data includes calculating the distance data based on an interval between at least two points that are indicated by the imaging target in the captured image.

7. The storage medium storing a video game program according to claim 5, wherein:

the video game program instructs the computer to further determine a pointed position as a position in a display area of the display device based on a position of the imaging target in the captured image; and

the game process further includes performing a game process on the virtual game world based on the pointed position.

8. The storage medium storing a video game program according to claim 4, wherein the calculation of the effective range position data includes calculating the effective range position data so that the effective range position data takes a maximum value when the value of the distance data is equal to the first distance value and a minimum value when the value of the distance data is equal to the second distance value.

9. The storage medium storing a video game program according to claim 4, wherein the game process includes:

obtaining a depth direction position in a three-dimensional virtual game space corresponding to the effective range position data;

performing a game process including an operation using the depth direction position, and

wherein the display process step includes displaying, in a display area of the display device, a three-dimensional virtual game space that has undergone a game process in the game process step.

10. The storage medium storing a video game program according to claim 4, wherein the game controller is portable.

11. The storage medium storing a video game program according to claim 4, wherein the game controller is movable relative to the constant measured reference structure during the game process.

12. A storage medium storing a video game program to be executed by a computer of a video game device for performing a game process by obtaining control data from a game controller, wherein the storage medium is a non-transitory storage medium and the video game program instructs the computer to perform:

calculating distance data associated with a distance between the game controller and a constant measured reference structure provided in a real space, by using the control data obtained from the game controller;

performing a game process on a virtual game world through an operation based on a value of the calculated distance data;

displaying, on a display device, the virtual game world after the game process;

defining an effective range as a range from a first value to a second value; and

calculating effective range position data representing a position of the value of the distance data in the effective range,

wherein the game process step performs a game process on the virtual game world through an operation based on the calculated effective range position data;

wherein the video game program instructs the computer to further perform a first effective range update which, when the value of the distance data is outside the effective range, updates the first value and the second value so that one of the first value and the second value that is closer to the value of the distance data becomes equal to the value of the distance data.

13. A storage medium storing a video game program to be executed by a computer of a video game device for performing a game process by obtaining control data from a game controller, wherein the storage medium is a non-transitory storage medium and the video game program instructs the computer to perform:

calculating distance data associated with a distance between the game controller and a constant measured reference structure provided in a real space, by using the control data obtained from the game controller;

performing a game process on a virtual game world through an operation based on a value of the distance data;

displaying the virtual game world after the game process;

defining an effective range as a range from a first value to a second value; and

calculating effective range position data representing a position of the value of the distance data in the effective range,

wherein the game process performing a process on the virtual game world through an operation based on the effective range position data;

wherein the video game program instructs the computer to further perform a second effective range update which, when the value of the distance data is outside the effective range, updates the first value and the second value so that one of the first value and the second value that is closer to the value of the distance data approaches the value of the distance data at a predetermined rate.

14. A storage medium storing a video game program to be executed by a computer of a video game device for performing a game process by obtaining control data from a game controller, wherein the storage medium is a non-transitory storage medium and the video game program instructs the computer to perform:

calculating distance data associated with a distance between the game controller and a constant measured reference structure provided in a real space, using the control data obtained from the game controller;

performing a game process on a virtual game world through an operation based on a value of the distance data;

displaying the virtual game world after the game process;

defining an effective range as a range from a first value to a second value; and

calculating effective range position data representing a position of the value of the distance data in the effective range,

wherein the game process performs a process on the virtual game world through an operation based on the calculated effective range position data, wherein;

the defining of the effective range includes defining a play range having a constant length at a front end of the effective range and a rear end thereof; and

the video game program instructs the computer to further perform an effective range update which, when the distance data takes a value outside a combined range including the effective range and the play ranges, updates the first value and the second value so that one of the first value and the second value that is closer to the value of the distance data becomes equal to the value of the distance data.

15. The storage medium storing a video game program according to claim 14, wherein the position data calculation step calculates the effective range position data so that:

the effective range position data takes a maximum value when the value of the distance data is equal to the first value or exceeds the effective range in a direction of the first value; and

the effective range position data takes a minimum value when the value of the distance data is equal to the second value or exceeds the effective range in a direction of the second value.

16. A storage medium storing a video game program to be executed by a computer of a video game device for performing a game process by obtaining control data from a game controller, wherein the storage medium is a non-transitory storage medium and the video game program instructs the computer to perform:

calculating distance data associated with a distance between the game controller and a constant measured reference structure provided in a real space, by using the control data obtained from the game controller;

performing a game process on a virtual game world through an operation based on a value of the distance data; and

displaying the virtual game world after the game process wherein;

a first value, a second value smaller than the first value, a third value larger than the first value, and a fourth value smaller than the second value are defined;

the video game program instructs the computer to further perform;

defining an upper limit value variable from the first value to the third value and a lower limit value variable from the second value to the fourth value, and defining an effective range as a range the from the variable upper limit value to the variable lower limit value;

when the value of the distance data is within the variable range of the upper limit value/lower limit value, updating the upper limit value/lower limit value so that the upper limit value/lower limit value approaches the value of the distance data at a predetermined rate and updating the lower limit value/upper limit value so that the lower limit value/upper limit value approaches the second value/first value at a predetermined rate;

when the value of the distance data is within a range between the first value and the second value, updating the upper limit value/lower limit value so that the upper limit value/lower limit value approaches the first value/second value at a predetermined rate;

when the value of the distance data is larger than the third value, moving the first value, the second value, the third value, the fourth value and the lower limit value so that the third value approaches the value of the distance data at a predetermined rate and updating the upper limit value to the new third value;

when the value of the distance data is smaller than the fourth value, moving the first value, the second value, the third value, the fourth value and the upper limit value so that the fourth value approaches the value of the distance data at a predetermined rate and updating the lower limit value to the new fourth value; and

a position data calculation step including calculating effective range position data representing a position of the value of the distance data in the effective range,

wherein the game process step performs a game process on the virtual game world through an operation based on the value of the effective range position data calculated in the position data calculation step.

17. The storage medium storing a video game program according to claim 16, wherein the position data calculation step calculates the effective range position data so that:

the effective range position data takes a maximum value when the value of the distance data is equal to the first value or is below the effective range in a direction of the first value; and

the effective range position data takes a minimum value when the value of the distance data is equal to the second value or exceeds the effective range in a direction of the second value.

18. The storage medium storing a video game program according to claim 16, wherein the game process includes:

obtaining a depth direction position in a three-dimensional virtual game space corresponding to the effective range position data; and

performing a game process including an operation using the depth direction position,

and wherein the display process step includes displaying, in a display area of the display device, a three-dimensional virtual game space that has undergone a game process in the game process step.

19. A method for performing a game process using a game controller and a video game device including a processor, the method comprising:

providing a reference structure having a known and constant spatial dimension;

obtaining control data including at least one of image data captured by an image sensor in the game controller of the known and constant spatial dimension of the reference structure and data determined by an analysis of the image data;

calculating a distance representative of a real space distance between the game controller and the reference structure;

defining an effective range as a range from a first distance to a second distance;

identifying which of the first distance and the second distance is further away from the calculated distance, and

redefining the effective range as a range from the calculated distance and the identified first or second distance;

performing a game process in the virtual game world through an operation using data representative of calculated distance relative to the effective range, and

displaying the virtual game world after performing the game process.

20. A method for performing a game process using a game controller and a video game device including a processor, the method comprising:

providing a reference structure having a known and constant spatial dimension;

obtaining control data including at least one of image data captured by an image sensor in the game controller of the known and constant spatial dimension of the reference structure and data determined by an analysis of the image data;

calculating a distance representative of a real space distance between the game controller and the reference structure;

defining an effective range as a range from a first value to a second value;

if the calculated distance is beyond the effective range, moving at least one of the first value or the second value towards the calculated distance at a predetermined rate;

performing a game process in the virtual game world through an operation using data representative of calculated distance relative to the effective range, and

displaying the virtual game world after performing the game process.

21. The method of claim 20 wherein the moved first value or second value is the value nearest the calculated distance prior to the move.

22. A method for performing a game process using a game controller and a video game device including a processor, the method comprising:

providing a reference structure having a known and constant spatial dimension;

obtaining control data including at least one of image data captured by an image sensor in the game controller of the known and constant spatial dimension of the reference structure and data determined by an analysis of the image data;

calculating a calculated distance representative of a real space distance between the game controller and the reference structure;

defining an effective range as a range from a first value to a second value;

calculating effective range position data representing a position of the calculated distance with respect to the effective range;

defining a play range having a constant length, and

if the calculated distance is beyond the effective range by a distance greater than the play range, substituting the one of the first value and the second value closest to the calculated data;

performing a game process in the virtual game world through an operation using data representative of calculated distance relative to the effective range, and

displaying the virtual game world after performing the game process.

23. A game apparatus comprising:

a reference structure having thereon a known and constant spatial dimension;

a game controller having an image capture device, which captures an image of the reference structure;

a computer accessing a program stored on a non-transitory memory, the computer executes the program to cause the game apparatus to;

obtain control data from the game controller wherein the control data includes the image of the reference structure or data determined by an analysis of the image;

calculate a first distance representative of an actual physical distance between the game controller at a first instance and the reference structure;

define an effective distance range wherein the first distance between the game controller and the reference structure is within the effective range;

after defining the effective distance range, calculate effective range position data at successive times, wherein each successive effective range position data represents a position of the controller with respect to the effective distance range;

perform a game process on a virtual game world generated by the computer wherein the game process uses the effective range position data, and

display on a display device an image of the virtual game world after the game process is performed.

24. The game apparatus as in claim 23 wherein the reference structure is mountable proximate to the display device.

25. A system comprising:

a display device

a reference structure having thereon a known and constant spatial reference dimension, and the reference structure device mounted proximate to the display device;

a controller having an image capture device, which captures an image of the reference structure;

a console having a computer accessing a program stored on a non-transitory memory in the console, the computer executes the program to cause the console to;

obtain control data from the controller wherein the control data includes at least one of the image of the known and constant spatial reference dimension of the reference structure and data determined by an analysis of the image;

calculate in real time a calculated distance representative of an actual physical distance between the controller and the reference structure based on the control data;

set a range of distances which includes the calculated distance;

in response to the calculated distance being beyond the set range of distances, reset the range of distances to include the calculated distance;

determine a process position representing the calculated distance relative to the range of distances;

perform a process on a virtual world generated by the computer wherein the process uses the process position, and

display on the display device an image of the virtual world after the process is performed.