Information processing apparatus and computer-readable recording medium recording information processing program

• US 8,502,773 B2
• Filed: 01/13/2009
• Issued: 08/06/2013
• Est. Priority Date: 10/16/2008
• Status: Active Grant

• Current Assignee: Nintendo Company Limited
• Original Assignee: Nintendo Company Limited
• Inventors: Nishida, Kenichi, Sakaguchi, Tsubasa
• Primary Examiner(s): SIMPSON, LIXI CHOW
• Application Number:
  US12/352,696
• Publication Number:
  US 20100097309A1
• Time in Patent Office: 1,666 Days
• Field of Search: None
• US Class Current: 345/157
• CPC Class Codes: A63F 13/219 for aiming at specific areas on the display, e.g. light-guns
• CPC Class Codes: A63F 13/426 involving on-screen location information, e.g. screen coordinates of an area at which the player is aiming with a light gun
• CPC Class Codes: A63F 13/533 for prompting the player, e.g. by displaying a game menu
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G08C 2201/32 Remote control based on movements, attitude of remote control device

Abstract

Motion information is obtained which is information about a motion applied to an input device housing itself including a pointing device of a plurality of input mean. Next, based on the motion information, a movement amount of the input device housing is calculated. Thereafter, it is determined whether or not the movement amount satisfies predetermined conditions. When the predetermined conditions are satisfied, a position is designated based on an output from the pointing device.

Claims

1. A non-transitory computer-readable recording medium recording an information processing program executable by a computer of an information processing apparatus for designating a position on a screen based on outputs of a plurality of input devices including at least one pointing device, the program causing the computer to execute functionality comprising:

designating the position on the screen to correspond to a position of an on-screen object that is selected using a key selection operation of at least one of the plurality of input devices;

obtaining motion information that is information about a motion applied to a first input device housing itself including the pointing device;

calculating a movement amount of the first input device housing based on the motion information;

accumulating the calculated movement amounts;

determining whether or not the cumulative value of the accumulated calculated movement amounts exceeds a predetermined threshold; and

designating a new position on the screen, to correspond to a current pointing direction of the pointing device configured to be positioned outside of an area of the selected on-screen object, at a time when the cumulative value exceeds the predetermined threshold.

2. The non-transitory computer-readable recording medium according to claim 1, wherein

the first input device housing further includes a non-pointing device that is an input device that is not a pointing device, of the plurality of input devices, and

the information processing program causes the computer to further execute:

determining whether or not an input to the non-pointing device has occurred when position designation is being performed; and

designating a position based on an output from the non-pointing device when an input to the non-pointing device has occurred.

3. The non-transitory computer-readable recording medium according to claim 1, wherein

a non-pointing device that is an input device that is not a pointing device, of the plurality of input devices, is included in a second input device housing, and

the information processing program causes the computer to further execute:

determining whether or not an input to the non-pointing device has occurred when position designation is being performed; and

performing position designation based on an output from the non-pointing device when an input to the non-pointing device has occurred.

4. The non-transitory computer-readable recording medium according to claim 1, wherein

the information processing program causes the computer to further execute:

switching a position designation mode between a first position designation mode in which position designation is performed and a second position designation mode in which position designation is performed based on an output from a non-pointing device that is an input device that is not a pointing device, and

switching the position designation mode to the first position designation mode if the movement amount exceeds a predetermined threshold when the position designation mode is the second position designation mode, and switching the position designation mode to the second position designation mode if an input to the non-pointing device has occurred when the position designation mode is the first position designation mode.

5. The non-transitory computer-readable recording medium according to claim 4, wherein

the information processing program causes the computer to further execute:

measuring a period of time during which it is determined that there is not an input to the non-pointing device when the position designation mode is the second position designation mode, and

switching the position designation mode to the first position designation mode when the measured period of time exceeds a predetermined value.

6. The non-transitory computer-readable recording medium according to claim 1, wherein

the first input device housing includes a motion sensor for detecting a motion applied to the first input device housing itself, and

data output from the motion sensor as the motion information is obtained.

7. The non-transitory computer-readable recording medium according to claim 1, wherein

data indicating a position designated by the pointing device, as the motion information, is repeatedly obtained, and

the movement amount based on a change amount of the designated positions of the pointing device is calculated.

8. The non-transitory computer-readable recording medium according to claim 1, wherein

the movement amounts are accumulated for a predetermined period of time until a current time.

9. The non-transitory computer-readable recording medium according to claim 1, wherein

the information processing program causes the computer to further execute:

resetting the cumulative value when an input has occurred with respect to an input device other than the pointing device.

10. The non-transitory computer-readable recording medium according to claim 1, wherein

the information processing program causes the computer to further execute:

calculating a change amount of the calculated movement amounts, and

determining whether or not the calculated change amount exceeds a predetermined threshold.

11. The non-transitory computer-readable recording medium according to claim 10, wherein

the information processing program causes the computer to further execute:

accumulating the calculated change amounts, and

determining whether or not the cumulative change amount of the accumulated calculated change amounts exceeds a predetermined threshold.

12. The non-transitory computer-readable recording medium according to claim 11, wherein

the change amounts are accumulated for a predetermined period of time until a current time.

13. The non-transitory computer-readable recording medium according to claim 11, wherein

the information processing program causes the computer to further execute:

resetting the cumulative change amount when an input has occurred with respect to an input device other than the pointing device.

14. The non-transitory computer-readable recording medium according to claim 1, wherein

the first input device housing includes an image capturing device for capturing an image of at least one object whose image is to be captured and which is located in a vicinity of a display device,

captured image data output from the first input device housing is obtained, and

a position is designated based on an object whose image is to be captured is shown in a captured image indicated by the captured image data.

15. A non-transitory computer-readable recording medium recording an information processing program executable by a computer of an information processing apparatus for selecting one of a plurality of objects displayed on a screen, the program causing the computer to execute functionality comprising:

obtaining motion information that is information about a motion applied to a predetermined input device housing itself used for an operation of selecting the objects;

calculating a movement amount of the input device itself based on the motion information;

accumulating the calculated movement amounts;

switching a selection mode based on the motion information, between a pointing selection mode and a key selection mode, the pointing selection mode being a selection mode in which a new position on the screen is configured to be designated, and any of the objects displayed on the screen are configured to be selected by designating a position where the object is displayed, and the key selection mode being a selection mode in which setting of a focused state indicating a selected state is changed among the objects displayed on the screen in a predetermined order, depending on a predetermined key input; and

switching the selection mode to the pointing selection mode from the key selection mode at a time when the cumulative value of the accumulated calculated movement amounts exceeds a predetermined threshold and designating the position on the screen to a current pointing direction of the predetermined input device configured to be positioned outside of an area of a selected on-screen object.

16. The non-transitory computer-readable recording medium according to claim 15, wherein

the information processing program causes the computer to further execute:

determining whether or not the predetermined key input has been performed when the selection mode is the pointing selection mode;

calculating a movement amount of the input device itself based on the motion information when the selection mode is the key selection mode; and

switching the selection mode to the key selection mode when the key input has been performed, and switching the selection mode to the pointing selection mode when the calculated movement amount exceeds a predetermined threshold.

17. The non-transitory computer-readable recording medium according to claim 15, wherein

the input device housing includes a motion sensor for detecting a motion applied to the input device housing itself, and

data output from the motion sensor as the motion information is obtained.

18. The non-transitory computer-readable recording medium according to claim 15, wherein

the movement amounts are accumulated for a predetermined period of time until a current time.

19. The non-transitory computer-readable recording medium according to claim 15, wherein

the information processing program causes the computer to further execute:

resetting the cumulative value when the predetermined key input has been performed.

20. The non-transitory computer-readable recording medium according to claim 15, wherein

the information processing program causes the computer to further execute:

calculating a change amount of the calculated movement amounts, and

switching the selection mode to the pointing selection mode when the calculated change amount exceeds a predetermined threshold.

21. The non-transitory computer-readable recording medium according to claim 20, wherein

the information processing program causes the computer to further execute:

accumulating the calculated change amounts, and

switching the selection mode to the pointing selection mode when the cumulative change amount of the accumulated calculated change amounts exceeds a predetermined threshold.

22. The non-transitory computer-readable recording medium according to claim 21, wherein

the change amounts are accumulated for a predetermined period of time until a current time.

23. The non-transitory computer-readable recording medium according to claim 21, wherein

the information processing program causes the computer to further execute:

resetting the cumulative change amount when an input has occurred with respect to an input device other than the pointing device.

24. The non-transitory computer-readable recording medium according to claim 16, wherein

the information processing program causes the computer to further execute:

measuring a period of time during which it is determined that the key input is not being performed when the selection mode is the key selection mode, and

switching the selection mode to the pointing selection mode when the measured period of time exceeds a predetermined value.

25. An information processing apparatus for designating a position on a screen based on outputs of a plurality of input devices including at least one pointing device, comprising:

a first position designating unit for designating the position on the screen to correspond to a position of an on-screen object that is selected using a key selection operation of at least one of the plurality of input devices;

a motion information obtaining unit for obtaining motion information that is information about a motion applied to a first input device housing itself including the pointing device;

a movement amount calculating unit for calculating a movement amount of the first input device housing based on the motion information;

an accumulation unit for accumulating the movement amounts calculated by the movements amount calculating unit;

a threshold determining unit for determining whether or not the cumulative value of the accumulation unit exceeds a predetermined threshold; and

a second position designating unit for designating a new position on the screen, to correspond to a current pointing direction of the pointing device configured to be positioned outside of an area of the selected on-screen object, at a time when the threshold determining unit determines that the cumulative value of the accumulation unit exceeds the predetermined threshold.

26. An information processing apparatus for selecting one of a plurality of objects displayed on a screen, comprising:

a motion information obtaining unit for obtaining motion information that is information about a motion applied to a predetermined input device housing itself used for an operation of selecting the objects;

a movement amount calculating unit for calculating a movement amount of the input device based on the obtained motion information;

an accumulation unit for accumulating the movement amounts calculated by the movements amount calculating unit;

a selection mode switching unit for switching a selection mode based on the motion information, between a pointing selection mode and a key selection mode, the pointing selection mode being a selection mode in which a new position on the screen is configured to be designated, and any of the objects displayed on the screen are configured to be selected by designating a position where the object is displayed, and the key selection mode being a selection mode in which setting of a focused state indicating a selected state is changed among the objects displayed on the screen in a predetermined order, depending on a predetermined key input,

wherein the selection mode switching unit switches the selection mode to the pointing selection mode at a time when the cumulative value of the accumulation unit exceeds a predetermined threshold and designates the position on the screen to a current pointing direction of the predetermined input device configured to be positioned outside of an area of a selected on-screen object.

27. A method for designating a position on a screen of an information processing apparatus having one or more processors based on outputs of a plurality of input devices including at least one pointing device, the method comprising:

designating the position on the screen to correspond to a position of an on-screen object that is selected using a key selection operation of at least one of the plurality of input devices;

obtaining motion information that is information about a motion applied to a first input device housing itself including the pointing device;

calculating, via the one or more processors, a movement amount of the first input device housing based on the motion information;

accumulating the calculated movement amounts;

determining whether or not the cumulative value of the accumulated calculated movement amounts exceeds a predetermined threshold; and

designating a new position on the screen, to correspond to a current pointing direction of the pointing device configured to be positioned outside of an area of the selected on-screen object, at a time when the cumulative value exceeds the predetermined threshold.

28. A method for selecting one of a plurality of objects displayed on a screen of an information processing apparatus having one or more processors, the method comprising:

obtaining motion information that is information about a motion applied to a predetermined input device housing itself used for an operation of selecting the objects;

calculating, via the one or more processors, a movement amount of the input device itself based on the motion information;

accumulating the calculated movement amounts;

switching a selection mode based on the motion information, between a pointing selection mode and a key selection mode, the pointing selection mode being a selection mode in which a new position on the screen is configured to be designated, and any of the objects displayed on the screen are configured to be selected by designating a position where the object is displayed, and the key selection mode being a selection mode in which setting of a focused state indicating a selected state is changed among the objects displayed on the screen in a predetermined order, depending on a predetermined key input; and

switching the selection mode to the pointing selection mode from the key selection mode at a time when the cumulative value of the accumulated calculated movement amounts exceeds a predetermined threshold and designating the position on the screen to correspond to a current pointing direction of the predetermined input device configured to be positioned outside of an area of a selected on-screen object.

29. An information processing system, comprising:

a display device having at least one screen;

a plurality of input devices including at least one pointing device; and

an information processing apparatus having one or more processors and configured to designate a position on a screen based on outputs of a plurality of input devices, the information processing apparatus comprising;

a first position designating unit for designating the position on the screen to correspond to a position of an on-screen object that is selected using a key selection operation of at least one of the plurality of input devices;

a motion information obtaining unit for obtaining motion information that is information about a motion applied to a first input device housing itself including the pointing device;

a movement amount calculating unit for calculating a movement amount of the first input device housing based on the motion information;

an accumulation unit for accumulating the movement amounts calculated by the movements amount calculating unit;

a threshold determining unit for determining whether or not the cumulative value of the accumulation unit exceeds a predetermined threshold; and

a second position designating unit for designating a new position on the screen, to correspond to a current pointing direction of the pointing device configured to be positioned outside of an area of the selected on-screen object, at a time when the threshold determining unit determines that the cumulative value of the accumulation unit exceeds the predetermined threshold.

30. An information processing system, comprising:

a display device having at least one screen;

a predetermined input device having a predetermined input device housing; and

an information processing apparatus having one or more processors and configured to select one of a plurality of objects displayed on the screen, the information processing apparatus comprising;

a motion information obtaining unit for obtaining motion information that is information about a motion applied to a predetermined input device housing itself used for an operation of selecting the objects;

a movement amount calculating unit for calculating a movement amount of the input device based on the obtained motion information;

an accumulation unit for accumulating the movement amounts calculated by the movements amount calculating unit;

a selection mode switching unit for switching a selection mode based on the motion information, between a pointing selection mode and a key selection mode, the pointing selection mode being a selection mode in which a new position on the screen is configured to be designated, and any of the objects displayed on the screen are configured to be selected by designating a position where the object is displayed, and the key selection mode being a selection mode in which setting of a focused state indicating a selected state is changed among the objects displayed on the screen in a predetermined order, depending on a predetermined key input,

wherein the selection mode switching unit switches the selection mode to the pointing selection mode at a time when the cumulative value of the accumulation unit exceeds a predetermined threshold and designating the position on the screen to a current pointing direction of the predetermined input device configured to be positioned outside of an area of a selected on-screen object.