INPUT SYSTEM, INFORMATION PROCESSING APPARATUS, INFORMATION PROCESSING PROGRAM, AND SPECIFIED POSITION CALCULATION METHOD

• US 20120119992A1
• Filed: 10/07/2011
• Published: 05/17/2012
• Est. Priority Date: 11/17/2010
• Status: Abandoned Application

• Current Assignee: Nintendo Company Limited
• Original Assignee: Nintendo Company Limited
• Inventors: NISHIDA, Kenichi, Yamashita, Yoshikazu, Shimamura, Takayuki
• Application Number:
  US13/268,176
• Publication Number:
  US 20120119992A1
• Time in Patent Office: Days
• US Class Current: 345/158
• CPC Class Codes: A63F 13/219 for aiming at specific areas on the display, e.g. light-guns
• CPC Class Codes: A63F 13/26 having at least one additional display device, e.g. on the game controller or outside a game booth
• CPC Class Codes: G06F 3/0325 using a plurality of light emitters or reflectors or a plurality of detectors forming a reference frame from which to derive the orientation of the object, e.g. by triangulation or on the basis of reference deformation in the picked up image
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/038 Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
• CPC Class Codes: G06F 3/1423 controlling a plurality of local displays, e.g. CRT and flat panel display
• CPC Class Codes: H04N 21/42222 Additional components integrated in the remote control device, e.g. timer, speaker, sensors for detecting position, direction or movement of the remote control, microphone or battery charging device

Abstract

An example input system calculates a specified position on a screen of a display device, the position being specified by an operating device. The input system includes an attitude calculation section, an identification section, and a specified position calculation section. The attitude calculation section calculates an attitude of the operating device. The identification section identifies one of a plurality of display devices toward which the operating device is directed, based on the attitude of the operating device. The specified position calculation section calculates a specified position in accordance with the attitude of the operating device as a position on a screen of the display device identified by the identification section.

Claims

1. An input system for calculating a specified position on a screen of a display device, the position being specified by an operating device, the system comprising:

an attitude calculation section for calculating an attitude of the operating device;

an identification section for identifying one of a plurality of display devices toward which the operating device is directed, based on the attitude of the operating device; and

a first specified position calculation section for calculating a specified position in accordance with the attitude of the operating device as a position on a screen of the display device identified by the identification section.

2. The input system according to claim 1, wherein,

the operating device includes an inertial sensor, and

the attitude calculation section calculates the attitude of the operating device based on an output from the inertial sensor.

3. The input system according to claim 1, further comprising a reference attitude storage section for storing a reference attitude for each display device, the reference attitude representing an attitude of the operating device being directed toward the display device, wherein,

the identification section identifies the display device toward which the operating device is directed, based on the attitude calculated by the attitude calculation section and the reference attitudes.

4. The input system according to claim 3, further comprising a reference setting section for, when the operating device is in a predetermined state, setting the attitude of the operating device in the reference attitude storage section as the reference attitude.

5. The input system according to claim 4, wherein,

the operating device includes an image pickup section,

the input system further comprises marker sections each being provided for a corresponding one of the display devices, and

when the image pickup section has picked up an image of one of the marker sections, the reference setting section sets the attitude of the operating device as a reference attitude for the display device corresponding to that marker section.

6. The input system according to claim 5, further comprising:

a second specified position calculation section for calculating the specified position based on a position of the marker section in the image picked up by the image pickup section; and

a predetermined image display control section for displaying a predetermined image at the specified position calculated by the second specified position calculation section, wherein,

the reference setting section sets as the reference attitude the attitude of the operating device calculated by the attitude calculation section when the predetermined image is displayed.

7. The input system according to claim 4, wherein,

the operating device includes an operating section operable by a user, and

the reference setting section sets as the reference attitude the attitude of the operating device when a predetermined operation is performed on the operating section.

8. The input system according to claim 6, wherein, when the specified position calculated by the second specified position calculation section lies within a predetermined area on the screen of the display device, the reference setting section sets the attitude of the operating device as the reference attitude for the display device.

9. The input system according to claim 5, wherein,

the marker sections include light-emitting members, and

the input system further comprises a lighting control section for only lighting up the marker section corresponding to a first one of the display devices when the reference setting section sets the reference attitude for the first display device, or only lighting up the marker section corresponding to a second one of the display devices when the reference setting section sets the reference attitude for the second display device.

10. The input system according to claim 5, wherein the attitude calculation section calculates the attitude of the operating device based on the position of the marker section in the image picked up by the image pickup section.

11. The input system according to claim 5, further comprising:

an information processing apparatus;

one of the display devices that is transportable; and

one of the marker sections that is capable of emitting infrared light and corresponds to the other predetermined display device provided independently of the transportable display device, wherein,

the information processing apparatus includes;

a first image generation section for sequentially generating first images based on a predetermined information process;

a second image generation section for sequentially generating second images based on a predetermined information process;

an image compression section for generating compressed image data by sequentially compressing the second images;

a data transmission section for sequentially transmitting the compressed image data to the transportable display device in a wireless manner; and

an image output section for sequentially outputting the first images to the predetermined display device, and

the transportable display device includes;

an infrared emission section capable of emitting infrared light and functioning as the marker section for the transportable display device;

an image reception section for sequentially receiving the compressed image data from the information processing apparatus;

an image decompression section for sequentially decompressing the compressed image data to obtain the second images; and

a display section for sequentially displaying the second images obtained by decompression.

12. The input system according to claim 3, wherein the first specified position calculation section calculates the specified position in accordance with an amount and a direction of change in a current attitude with respect to the reference attitude for the display device toward which the operating device is directed.

13. The input system according to claim 1, further comprising a direction image display control section for displaying a direction image at least on the display device unidentified by the identification section, wherein the direction image represents a direction in which the operating device is oriented.

14. A game system comprising:

an input system of claim 1; and

a game process section for performing a game process using a specified position calculated by the first specified position calculation section as an input.

15. The game system according to claim 14, further comprising:

a reference attitude storage section for storing a reference attitude for each display device, the reference attitude representing an attitude of the operating device being directed toward the display device; and

a reference setting section for, when the operating device is in a predetermined state, setting the attitude of the operating device in the reference attitude storage section as the reference attitude, wherein,

the identification section identifies the display device toward which the operating device is directed, based on the attitude calculated by the attitude calculation section and the reference attitudes, and

the game process section performs the game process differently in accordance with a difference between the reference attitudes.

16. The game system according to claim 14, wherein the game process section includes:

a first game image display control section for causing a predetermined one of the display devices to display an image of a game space;

a selection section for, upon a user'"'"'s predetermined instruction, selecting a game object displayed at the specified position calculated by the first specified position calculation section;

an object movement section for moving the selected game object simultaneously with movement of the specified position; and

a second game image display control section for, when the identification section identifies another display device with the game object being kept selected, displaying the game object at a specified position on a screen of that display device.

17. A specified position calculation method to be performed by at least one information processing apparatus included in an input system for calculating a specified position on a screen of a display device, the position being specified by an operating device, the method comprising:

an attitude calculation step for calculating an attitude of the operating device;

an identification step for identifying one of a plurality of display devices toward which the operating device is directed, based on the attitude of the operating device; and

a first specified position calculation step for calculating a specified position in accordance with the attitude of the operating device as a position on a screen of the display device identified in the identification step.

18. The specified position calculation method according to claim 17, wherein,

the operating device includes an inertial sensor, and

in the attitude calculation step, the attitude of the operating device is calculated based on an output from the inertial sensor.

19. The specified position calculation method according to claim 17, wherein,

storage means accessible by the at least one information processing apparatus has a reference attitude stored therein for each display device, the reference attitude representing an attitude of the operating device being directed toward the display device, and

in the identification step, the at least one information processing apparatus identifies the display device toward which the operating device is directed, based on the attitude calculated in the attitude calculation step and the reference attitudes.

20. The specified position calculation method according to claim 19, further comprising a reference setting step for, when the operating device is in a predetermined state, setting the attitude of the operating device in the storage means as the reference attitude.

21. The specified position calculation method according to claim 20, wherein,

the operating device includes an image pickup section,

the input system further includes marker sections each being provided for a corresponding one of the display devices, and

when the image pickup section has picked up an image of one of the marker sections, the at least one information processing apparatus sets the attitude of the operating device as a reference attitude for the display device corresponding to the marker section in the reference setting step.

22. The specified position calculation method according to claim 21, further comprising:

a second specified position calculation step for calculating the specified position based on a position of the marker section in the image picked up by the image pickup section; and

a predetermined image display control step for displaying a predetermined image at the specified position calculated in the second specified position calculation step, wherein,

in the reference setting step, the at least one information processing apparatus sets as the reference attitude the attitude of the operating device calculated in the attitude calculation step when the predetermined image is displayed.

23. The specified position calculation method according to claim 20, wherein,

the operating device includes an operating section operable by a user, and

in the reference setting step, the at least one information processing apparatus sets as the reference attitude the attitude of the operating device when a predetermined operation is performed on the operating section.

24. The specified position calculation method according to claim 22, wherein, when the specified position calculated in the second specified position calculation step lies within a predetermined area on the screen of the display device, the at least one information processing apparatus sets the attitude of the operating device as the reference attitude for the display device in the reference setting step.

25. The specified position calculation method according to claim 21, wherein,

the marker sections include light-emitting members, and

the method further comprises a lighting control step for only lighting up the marker section corresponding to a first one of the display devices when the reference attitude for the first display device is set in the reference setting step, or only lighting up the marker section corresponding to a second one of the display devices when the reference attitude for the second display device is set in the reference setting step.

26. The specified position calculation method according to claim 21, wherein in the attitude calculation step, the at least one information processing apparatus calculates the attitude of the operating device to be set as the reference attitude, based on an output from the inertial sensor included in the operating device, and in the first specified position calculation step, the at least one information processing apparatus calculates the attitude of the operating device to be used for calculating the specified position, based on an output from the inertial sensor and a position of the marker section in the image picked up by the image pickup section.

27. The specified position calculation method according to claim 17, wherein in the first specified position calculation step, the at least one information processing apparatus calculates the specified position in accordance with an amount and a direction of change in a current attitude with respect to the reference attitude for the display device toward which the operating device is directed.

28. The specified position calculation method according to claim 17, further comprising a direction image display control step for displaying a direction image on any display device other than the display device identified in the identification step, wherein the direction image represents a direction in which the operating device is oriented.

29. A game process method to be performed by at least one game apparatus, comprising:

a step for calculating a specified position by a specified position calculation method of claim 17, and

a game process step for performing a game process using the calculated specified position as an input.

30. The game process method according to claim 29, further comprising a reference setting step for, when the operating device is in a predetermined state, setting the attitude of the operating device as a reference attitude representing an attitude of the operating device being directed toward the display device, wherein,

in the identification step, the at least one information processing apparatus compares the attitude calculated in the attitude calculation step with the reference attitudes, thereby identifying the display device being directed toward the operating device, and

in the game process step, the at least one information processing apparatus performs the game process differently in accordance with a difference between the reference attitudes.

31. The game process method according to claim 29, wherein the game process step includes:

a first display control step for causing a predetermined one of the display devices to display an image of a game space;

a selection step for, upon a user'"'"'s predetermined instruction, selecting a game object displayed at the specified position calculated in the first specified position calculation step;

an object movement step for moving the selected game object simultaneously with movement of the specified position; and

a second game image display control step for, when another display device is identified in the identification step with the game object being kept selected, displaying the game object at a specified position on a screen of that display device.

32. An information processing apparatus for calculating a specified position on a screen of a display device, the position being specified by an operating device, the apparatus comprising:

an attitude calculation section for calculating an attitude of the operating device;

an identification section for identifying one of a plurality of display devices toward which the operating device is directed, based on the attitude of the operating device; and

a first specified position calculation section for calculating a specified position in accordance with the attitude of the operating device as a position on a screen of the display device identified by the identification section.

33. The information processing apparatus according to claim 32, wherein,

the operating device includes an inertial sensor, and

the attitude calculation section calculates the attitude of the operating device based on an output from the inertial sensor.

34. The information processing apparatus according to claim 32, further comprising:

a reference attitude storage section for storing a reference attitude for each display device, the reference attitude representing an attitude of the operating device being directed toward the display device; and

a reference setting section for, when the operating device is in a predetermined state, setting the attitude of the operating device in the reference attitude storage section as the reference attitude, wherein, the identification section identifies the display device toward which the operating device is directed, based on the attitude calculated by the attitude calculation section and the reference attitudes.

35. The information processing apparatus according to claim 34, wherein,

the operating device includes an image pickup section, and

when the image pickup section has picked up an image of one of a plurality of marker sections each being provided for a corresponding one of the display devices, the reference setting section sets the attitude of the operating device as a reference attitude for the display device corresponding to the marker section.

36. The information processing apparatus according to claim 35, further comprising:

a second specified position calculation section for calculating the specified position based on a position of the marker section in the image picked up by the image pickup section; and

a predetermined image display control section for displaying a predetermined image at the specified position calculated by the second specified position calculation section, wherein,

the reference setting section sets as the reference attitude the attitude of the operating device calculated by the attitude calculation section when the predetermined image is displayed.

37. A computer-readable storage medium having stored therein a information processing program to be performed by a computer of an information processing apparatus for calculating a specified position on a screen of a display device, the position being specified by an operating device, the medium causing the computer to function as:

attitude calculation means for calculating an attitude of the operating device;

identification means for identifying one of a plurality of display devices toward which the operating device is directed, based on the attitude of the operating device; and

first specified position calculation means for calculating a specified position in accordance with the attitude of the operating device as a position on a screen of the display device identified by the identification means.

38. The storage medium according to claim 37, wherein,

the operating device includes an inertial sensor, and

the attitude calculation means calculates the attitude of the operating device based on an output from the inertial sensor.

39. The storage medium according to claim 37, wherein,

the information processing program further causes the computer to function as reference setting means for causing storage means accessible by the information processing apparatus to store an attitude of the operating device in a predetermined state as a reference attitude representing an attitude of the operating device being directed toward the display device, and

the identification means identifies the display device toward which the operating device is directed, based on the attitude calculated by the attitude calculation means and the reference attitudes.

40. The storage medium according to claim 39, wherein,

the operating device includes an image pickup section, and

when the image pickup section has picked up an image of one of a plurality of marker sections each being provided for a corresponding one of the display devices, the reference setting means sets the attitude of the operating device as a reference attitude for the display device corresponding to the marker section.

41. The storage medium according to claim 40, wherein,

the information processing program further causes the computer to function as:

second specified position calculation means for calculating the specified position based on a position of the marker section in the image picked up by the image pickup means; and

predetermined image display control means for displaying a predetermined image at the specified position calculated by the second specified position calculation means, wherein,

the reference setting means sets as the reference attitude the attitude of the operating device calculated by the attitude calculation means when the predetermined image is displayed.