INPUT SYSTEM, INFORMATION PROCESSING DEVICE, STORAGE MEDIUM STORING INFORMATION PROCESSING PROGRAM, AND THREE-DIMENSIONAL POSITION CALCULATION METHOD

• US 20120258796A1
• Filed: 01/19/2012
• Published: 10/11/2012
• Est. Priority Date: 04/07/2011
• Status: Active Grant

• Current Assignee: Nintendo Company Limited
• Original Assignee: Nintendo Company Limited
• Inventors: Ohta, Keizo, Musa, Kazuhiro
• Granted Patent: US 8,845,426 B2
• Time in Patent Office: Days
• US Class Current: 463/32
• CPC Class Codes: A63F 13/211 using inertial sensors, e.g. accelerometers or gyroscopes
• CPC Class Codes: A63F 13/2145 the surface being also a display device, e.g. touch screens
• CPC Class Codes: A63F 13/26 having at least one additional display device, e.g. on the game controller or outside a game booth
• CPC Class Codes: A63F 13/428 involving motion or position input signals, e.g. signals representing the rotation of an input controller or a player's arm motions sensed by accelerometers or gyroscopes
• CPC Class Codes: A63F 13/5252 using two or more virtual cameras concurrently or sequentially, e.g. automatically switching between fixed virtual cameras when a character changes room or displaying a rear-mirror view in a car-driving game
• CPC Class Codes: A63F 13/5255 according to dedicated instructions from a player, e.g. using a secondary joystick to rotate the camera around a player's character
• CPC Class Codes: A63F 13/92 Video game devices specially adapted to be hand-held while playing
• CPC Class Codes: A63F 2300/105 using inertial sensors, e.g. accelerometers, gyroscopes
• CPC Class Codes: A63F 2300/1075 using a touch screen
• CPC Class Codes: A63F 2300/204 the platform being a handheld device
• CPC Class Codes: A63F 2300/6045 for mapping control signals received from the input arrangement into game commands
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06T 19/00 Manipulating 3D models or images for computer graphics
• CPC Class Codes: G06T 2219/2024 Style variation

Abstract

An example input processing system includes a controller device and an information processing device. The controller device transmits data representing an input position on a predetermined input surface and a detection result of an inertia sensor unit to the information processing device. The information processing device calculates an attitude of the controller device based on the detection result of the inertia sensor unit, and sets a predetermined surface in a virtual space so that an attitude of the predetermined surface changes in accordance with the attitude of the controller device. A first image representing an area in the virtual space including a position of the surface is displayed on a predetermined display device. The information processing device calculates, as a position in the virtual space, a position on the surface determined by the input position.

Claims

1. An input system comprising a controller device and an information processing device for calculating a position in a three-dimensional virtual space based on an operation performed on the controller device, wherein:

the controller device comprises;

a position detection unit for detecting an input position on a predetermined input surface;

an inertia sensor unit; and

an operation data transmission unit for transmitting, to the information processing device, operation data including data representing detection results of the position detection unit and the inertia sensor unit; and

the information processing device comprises;

an attitude calculation unit for calculating an attitude of the controller device based on the detection result of the inertia sensor unit;

a surface setting unit for setting a predetermined surface in the virtual space so that an attitude of the predetermined surface changes in accordance with the attitude of the controller device;

a first image generation unit for generating a first image which represents an area in the virtual space including a position of the surface;

a first image outputting unit for outputting the first image to a predetermined display device; and

a position calculation unit for calculating, as the position in the virtual space, the position of the surface determined by the input position.

2. The input system according to claim 1, wherein the first image generation unit generates a predetermined image at a position on the first image corresponding to the position calculated by the position calculation unit.

3. The input system according to claim 2, wherein the first image generation unit generates, as the predetermined image, an image representing a path extending through a series of positions which are determined in the virtual space by a series of input positions on the input surface.

4. The input system according to claim 1, wherein the information processing device further comprises an object setting unit for arranging a predetermined object at the position calculated by the position calculation unit.

5. The input system according to claim 4, wherein the object setting unit moves the predetermined object based on an operation performed on the controller device.

6. The input system according to claim 5, wherein the object setting unit moves the predetermined object based on the attitude of the controller device if a predetermined condition is satisfied for the operation performed on the controller device, and does not move the predetermined object based on the attitude of the controller device if the predetermined condition is not satisfied.

7. The input system according to claim 1, wherein:

the controller device further comprises a display unit;

the position detection unit is a touch panel provided on a display screen of the display unit;

the information processing device further comprises;

a second image generation unit for generating a second image which represents an area in the virtual space including a position of the surface; and

a second image transmitting unit for transmitting the second image to the controller device; and

the position calculation unit calculates, as the position in the virtual space, a position corresponding to the input position on the display screen.

8. The input system according to claim 7, wherein the second image generation unit generates, as the second image, an image representing an area in the virtual space in which the surface is set.

9. The input system according to claim 8, wherein:

the first image generation unit generates the first image using a first virtual camera whose viewing direction is set independently of the attitude of the surface; and

the second image generation unit generates the second image using a second virtual camera whose viewing direction is set to be generally perpendicular to the surface.

10. The input system according to claim 1, wherein the surface setting unit controls the attitude of the surface so that the attitude of the surface corresponds to the attitude of the controller device.

11. The input system according to claim 1, wherein the surface setting unit controls the attitude of the surface so that the attitude of the surface corresponds to the attitude of the controller device, and controls a position of the surface in accordance with the attitude of the controller device.

12. The input system according to claim 11, wherein the surface setting unit controls the surface so that the surface moves in an arc about a predetermined position in the virtual space in accordance with the attitude of the controller device.

13. The input system according to claim 1, wherein the surface setting unit moves the surface based on a direction input operation performed on the controller device.

14. The input system according to claim 1, wherein the information processing device further comprises a game process unit for performing a predetermined game process using, as an input, the position calculated by the position calculation unit.

15. An information processing system for calculating a position in a three-dimensional virtual space based on an operation performed on an operation unit, the information processing system comprising:

a position detection unit for detecting an input position on a predetermined input surface provided on the operation unit;

a sensor unit for detecting a physical quantity used for calculating an attitude of the operation unit;

an operation data obtaining unit for obtaining operation data including data representing detection results of the position detection unit and the sensor unit;

an attitude calculation unit for calculating an attitude of the controller device based on the physical quantity;

a surface setting unit for setting a predetermined surface in the virtual space based on the attitude;

a first image generation unit for generating a first image which represents an area in the virtual space including a position of the surface;

a first image outputting unit for outputting the first image to a predetermined display device; and

a position calculation unit for calculating, as the position in the virtual space, a position on the surface determined by the input position.

16. An information processing device for calculating a position in a three-dimensional virtual space based on an operation performed on a controller device, the information processing device comprising:

an operation data obtaining unit for obtaining operation data including data representing detection results of a touch panel and an inertia sensor of the controller device;

an attitude calculation unit for calculating an attitude of the controller device based on the detection result of the inertia sensor;

a surface setting unit for setting a predetermined surface in the virtual space so that an attitude of the predetermined surface changes in accordance with the attitude of the controller device;

a position calculation unit for calculating, as the position in the virtual space, a position on the surface determined by an input position on the touch panel;

an object setting unit for arranging a predetermined object at the position calculated by the position calculation unit;

a first image generation unit for generating a first image representing an area in the virtual space including a position of the surface;

a first image outputting unit for outputting the first image to a predetermined display device;

a second image generation unit for generating, as a second image to be displayed on a display screen on which the touch panel is provided, an image representing an area in the virtual space in which the surface is set; and

a second image transmitting unit for transmitting the second image to the controller device.

17. A computer-readable non-transitory storage medium storing an information processing program to be executed by a computer of an information processing device for calculating a position in a three-dimensional virtual space based on an operation performed on a controller device, the information processing program causing the computer to execute:

obtaining operation data including data representing detection results of a touch panel and an inertia sensor of the controller device;

calculating an attitude of the controller device based on the detection result of the inertia sensor;

setting a predetermined surface in the virtual space so that an attitude of the predetermined surface changes in accordance with the attitude of the controller device;

calculating, as the position in the virtual space, a position on the surface determined by an input position on the touch panel;

arranging a predetermined object at the position calculated by the position calculation unit;

generating, as a first image to be displayed on a predetermined display device, a first image representing an area in the virtual space including a position of the surface; and

generating, as a second image to be displayed on a display screen on which the touch panel is provided, an image representing an area in the virtual space in which the surface is set.

18. A three-dimensional position calculation method to be carried out in an input system including a controller device and an information processing device for calculating a position in a three-dimensional virtual space based on an operation performed on the controller device, the three-dimensional position calculation method comprising:

calculating an attitude of the controller device based on a detection result of an inertia sensor of the controller device;

setting a predetermined surface in the virtual space so that an attitude of the predetermined surface changes in accordance with the attitude of the controller device;

generating a first image representing an area in the virtual space including a position of the surface;

outputting the first image to a predetermined display device; and

calculating, as the position in the virtual space, a position on the surface determined by an input position on a predetermined input surface of the controller device.

19. The three-dimensional position calculation method according to claim 18, wherein the information processing device generates a predetermined image at a position on the first image corresponding to the calculated position on the surface.

20. The three-dimensional position calculation method according to claim 19, wherein the information processing device generates, as the predetermined image, an image representing a path extending through a series of positions which are determined in the virtual space by a series of input positions on the input surface.

21. The three-dimensional position calculation method according to claim 18, further comprising arranging a predetermined object at the calculated position on the surface.

22. The three-dimensional position calculation method according to claim 21, wherein the information processing device moves the predetermined object based on an operation performed on the controller device.

23. The three-dimensional position calculation method according to claim 22, wherein the information processing device moves the predetermined object based on the attitude of the controller device if a predetermined condition is satisfied for the operation performed on the controller device, and does not move the predetermined object based on the attitude of the controller device if the predetermined condition is not satisfied.

24. The three-dimensional position calculation method according to claim 18, wherein:

the controller device includes a display unit, and a touch panel provided on a display screen of the display unit, the method further comprising;

generating a second image representing an area in the virtual space including a position of the surface; and

transmitting the second image to the controller device; and

the information processing device calculates, as the position in the virtual space, a position corresponding to the input position on the display screen.

25. The three-dimensional position calculation method according to claim 24, wherein the information processing device generates, as the second image, an image representing an area in the virtual space in which the surface is set.

26. The three-dimensional position calculation method according to claim 25, wherein:

the information processing device generates a first image using a first virtual camera whose viewing direction is set independently of an attitude of the surface; and

the information processing device generates the second image using a second virtual camera whose viewing direction is set to be generally perpendicular to the surface.

27. The three-dimensional position calculation method according to claim 18, wherein the information processing device controls an attitude of the surface so that the attitude of the surface corresponds to the attitude of the controller device.

28. The three-dimensional position calculation method according to claim 18, wherein the information processing device controls an attitude of the surface so that the attitude of the surface corresponds to the attitude of the controller device, and controls a position of the surface in accordance with the attitude of the controller device.

29. The three-dimensional position calculation method according to claim 28, wherein the information processing device controls the surface so that the surface moves in an arc about a predetermined position in the virtual space in accordance with the attitude of the controller device.

30. The three-dimensional position calculation method according to claim 18, wherein the information processing device moves the surface based on a direction input operation performed on the controller device.

31. The three-dimensional position calculation method according to claim 18, further comprising performing a predetermined game process using the calculated position on the surface as an input.

32. A three-dimensional position calculation method to be carried out in an information processing system for calculating a position in a three-dimensional virtual space based on an operation performed on an operation unit, the three-dimensional position calculation method comprising:

obtaining operation data including data representing an input position on a predetermined input surface provided on the operation unit, and data representing a physical quantity used for calculating an attitude of the operation unit;

calculating the attitude of the controller unit based on the physical quantity;

setting a predetermined surface in the virtual space based on the attitude;

generating a first image representing an area in the virtual space including a position of the surface;

outputting the first image to a predetermined display device; and

calculating, as the position in the virtual space, a position on the surface determined by the input position.