Storage medium having input processing program stored thereon and input processing device

• US 8,907,896 B2
• Filed: 08/08/2013
• Issued: 12/09/2014
• Est. Priority Date: 10/19/2004
• Status: Active Grant

• Current Assignee: Nintendo Company Limited
• Original Assignee: Nintendo Company Limited
• Inventors: Konno, Hideki, Ajioka, Yoshitaka, Ebisawa, Yasushi, Mizuki, Kiyoshi
• Primary Examiner(s): Zhou, Hong
• Application Number:
  US13/962,551
• Publication Number:
  US 20140043266A1
• Time in Patent Office: 488 Days
• Field of Search: 345156-184, 345/419, 345/427, 463 30- 34, 715/757, 715/782, 715/836, 715848-852
• US Class Current: 345/157
• CPC Class Codes: A63F 2300/1075 using a touch screen
• CPC Class Codes: A63F 2300/301 using an additional display connected to the game console, e.g. on the controller
• CPC Class Codes: G06F 3/0416 Control or interface arrangements specially adapted for digitisers
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures

Abstract

An input processing device including a display screen and a pointing device for inputting corresponding 2-dimensional coordinates on the display screen. A 3-dimensional space is displayed on the display screen and the 2-dimensional coordinates inputted from the pointing device are detected. Next, shift amounts, per unit of time, of the detected 2-dimensional coordinates are calculated based on a predetermined calculation start condition. And the calculated shift amounts are converted to 3-dimensional coordinate shift amounts in the 3-dimensional space.

Claims

1. A non-transitory computer-readable storage medium having stored thereon an input processing program to be executed by a computer in an input processing device including a display screen and a pointing device for inputting corresponding 2-dimensional coordinates on the display screen, wherein

the computer is operable to execute:

a display control step for displaying a virtual 3-dimensional space on the display screen;

a 2-dimensional coordinate detection step for detecting the 2-dimensional coordinates inputted from the pointing device;

a 2-dimensional coordinate shift amount calculation step for calculating a first shift amount, per unit of time, in a first axis direction, of the 2-dimensional coordinates detected in the 2-dimensional coordinate detection step, and a second shift amount of the 2-dimensional coordinates, per unit of time, in a second axis direction; and

a 3-dimensional coordinate shift amount conversion step for calculating a shift amount of a first axis in 3-dimensional coordinates in the virtual 3-dimensional space by using at least one of the first shift amount and the second shift amount, calculating a shift amount of a second axis in the 3-dimensional coordinates by using at least one of the first shift amount and the second shift amount, and calculating a shift amount of a third axis in the 3-dimensional coordinates by using at least one of the first shift amount and the second shift amount, thereby converting the first shift amount and the second shift amount into 3-dimensional coordinate shift amounts in the virtual 3-dimensional space to provide initial values, and thereafter, repeatedly calculating 3-dimensional coordinate shift amounts from the initial values.

2. The non-transitory computer-readable storage medium having stored thereon the input processing program according to claim 1, wherein

the computer is further operable to execute an input status determination step for determining an input status from the pointing device, and

in the 2-dimensional coordinate shift amount calculation step, based on the calculation start condition that calculation starts when a status where an input from the pointing device is continuously being conducted is changed to a status where there is no input is determined in the input status determination step, the first shift amount and the second shift amount, per unit of time, of the 2-dimensional coordinates detected immediately before the status of no input in the 2-dimensional coordinate detection step are calculated.

3. The non-transitory computer-readable storage medium having stored thereon the input processing program according to claim 2, wherein

in the display control step, a predetermined virtual projection plane is set in the virtual 3-dimensional space and when in the input status determination step, an input from the pointing device is determined as being continuously conducted, a predetermined object is displayed at a position where the 2-dimensional coordinates detected in the 2-dimesional coordinate detection step are projected on the virtual projection plane, and

when the conversion of the first and second shift amounts into the 3-dimensional coordinate shift amounts has been conducted in the 3-dimensional coordinate shift amount conversion step, the object is lifted off the virtual projection plane, moved in the virtual 3-dimensional space, based on the 3-dimensional coordinate shift amounts, and displayed therein.

4. The non-transitory computer-readable storage medium having stored thereon the input processing program according to claim 3, wherein

in the display control step, when in the input status determination step, an input from the pointing device is determined as being continuously conducted, a display angle of the object to be projected on the virtual projection plane is controlled based on the 2-dimensional coordinates detected in the 2-dimensional coordinate detection step.

5. The non-transitory computer-readable storage medium having stored thereon the input processing program according to claim 3, wherein

the computer is further operable to execute a motion trajectory calculation step for calculating a motion trajectory, per unit of time, in the virtual 3-dimensional space by setting the 3-dimensional coordinate shift amounts obtained in the 3-dimensional coordinate shift amount conversion step, as an initial motion vector of the object in the virtual 3-dimensional space, and

in the display control step, based on the motion trajectory calculated in the motion trajectory calculation step, the object is lifted off the virtual projection plane, moved in the virtual 3-dimensional space, and displayed therein.

6. The non-transitory computer-readable storage medium having stored thereon the input processing program according to claim 5, wherein

in the display control step, when in the input status determination step, an input from the pointing device is determined as being continuously conducted, a display angle of the object to be projected on the virtual projection plane is controlled based on the 2-dimensional coordinates detected in the 2-dimensional coordinate detection step, and

in the motion trajectory calculation step, an initial normal vector of the object is set according to the display angle, and a motion trajectory, per unit of time, in the virtual 3-dimensional space is calculated based on the motion vector and the normal vector.

7. The non-transitory computer-readable storage medium having stored thereon the input processing program according to claim 1, wherein

in the 3-dimensional coordinate shift amount conversion step, based on the first shift amount and the second shift amount of the 2-dimensional coordinates, which are calculated in the 2-dimensional coordinate shift amount calculation step, a shift amount of a third axis perpendicular to the first and second axes of the 2-dimensional coordinates is calculated, and thereby the first shift amount and the second shift amount are converted into the 3-dimensional coordinate shift amounts.

8. The non-transitory computer-readable storage medium having stored thereon the input processing program according to claim 7, wherein in the 3-dimensional coordinate shift amount conversion step, when the first shift amount and the second shift amount calculated in the 2-dimensional coordinate shift amount calculation step are vx and vy, respectively, and predetermined constants are a, b, c, d, e, and f, a shift amount Vx of the first axis, a shift amount Vy of the second axis, and a shift amount Vz of the third axis, which are represented as the 3-dimensional coordinate shift amounts, are calculated using the following equation:

9. The non-transitory computer-readable storage medium having stored thereon the input processing program according to claim 8, wherein the constants a, b, c, d, e, and f respectively vary according to each kind of the objects.

10. An input processing device comprising:

a display screen;

a pointing device for inputting corresponding 2-dimensional coordinates on the display screen;

a display controller for displaying a virtual 3-dimensional space on the display screen;

a 2-dimensional coordinate detector for detecting the 2-dimensional coordinates inputted from the pointing device;

a 2-dimensional coordinate detector for calculating a first shift amount, per unit of time, in a first axis direction, of the 2-dimensional coordinates detected by the 2-dimensional coordinate detector, and a second shift amount of the 2-dimensional coordinates, per unit of time, in a second axis direction; and

a 3-dimensional coordinate shift amount converter for calculating a shift amount of a first axis in 3-dimensional coordinates in the virtual 3-dimensional space by using at least one of the first shift amount and the second shift amount, calculating a shift amount of a second axis in the 3-dimensional coordinates by using at least one of the first shift amount and the second shift amount, and calculating a shift amount of a third axis in the 3-dimensional coordinates by using at least one of the first shift amount and the second shift amount, thereby converting the first shift amount and the second shift amount into 3-dimensional coordinate shift amounts in the virtual 3-dimensional space to provide initial values, and thereafter, repeatedly calculating 3-dimensional coordinate shift amounts from the initial values.

11. The input processing device according to claim 10, wherein the pointing device is a touch panel covering the display screen.

12. An information processing system comprising:

a display screen;

a pointing device configured to generate input data representative of positions of the pointing device and timing of the positions;

a controller system configured to communicate with the display screen and the pointing device, the controller system including a non-transient memory storing instructions which cause the controller system to;

receive the input data from the pointing device display;

determine two-dimensional coordinates from the input data;

generate images of a virtual three-dimensional space to be presented on the display screen, wherein positions in the virtual three-dimensional space are determined based on a first axis, a second axis and a third axis, and each of the axes are orthogonal;

calculate a first shift amount along a first direction using the input data and corresponding to a shift in the positions of the pointing device along the first direction and during a unit of time;

calculate a second shift amount along a second direction using the input data and corresponding to a shift in the positions of the pointing device along the a second direction during the unit of time, wherein the second direction is different than the first direction;

calculate a three-dimensional shift amount including shift values corresponding to each of the first, second and third axes using as variable inputs to the calculation consist solely of the first and second shift amounts, and

shift a virtual objection in the virtual three-space based on the three-dimensional shift amount.

13. The information processing system of claim 12 wherein the instructions further cause the controller system to:

successively calculate the first and second shift amounts, and calculate the three-dimensional shift amount based on each successive calculations of the first and second shift amounts.