Input method and apparatus

• US 10,004,981 B2
• Filed: 12/04/2017
• Issued: 06/26/2018
• Est. Priority Date: 10/05/2005
• Status: Active Grant

• Current Assignee: Nintendo Company Limited
• Original Assignee: Nintendo Company Limited
• Inventors: Champagne, Robert, Yamashiro, Shigeki, Miyamoto, Shigeru, Comair, Claude
• Primary Examiner(s): Ahmed, Masud
• Application Number:
  US15/830,912
• Publication Number:
  US 20180085664A1
• Time in Patent Office: 204 Days
• Field of Search: None
• CPC Class Codes: A63F 13/00 Video games, i.e. games using an electronically generated display having two or more dimensions gaming systems which provide a financial reward G07F17/32
• CPC Class Codes: A63F 13/10 Control of the course of the game, e.g. start, progess, end
• CPC Class Codes: A63F 13/2145 the surface being also a display device, e.g. touch screens
• CPC Class Codes: A63F 13/245 specially adapted to a particular type of game, e.g. steering wheels
• CPC Class Codes: A63F 13/285 Generating tactile feedback signals via the game input device, e.g. force feedback
• CPC Class Codes: A63F 13/42 by mapping the input signals into game commands, e.g. mapping the displacement of a stylus on a touch screen to the steering angle of a virtual vehicle
• CPC Class Codes: A63F 13/45 Controlling the progress of the video game
• CPC Class Codes: A63F 13/803 Driving vehicles or craft, e.g. cars, airplanes, ships, robots or tanks
• CPC Class Codes: A63F 13/98 Accessories, i.e. detachable arrangements optional for the use of the video game device, e.g. grip supports of game controllers
• CPC Class Codes: A63F 2300/204 the platform being a handheld device
• CPC Class Codes: A63F 2300/301 using an additional display connected to the game console, e.g. on the controller
• CPC Class Codes: A63F 2300/6045 for mapping control signals received from the input arrangement into game commands
• CPC Class Codes: A63F 2300/8017 Driving on land or water; Flying
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 30/20 Design optimisation, verification or simulation optimisation, verification or simulation of circuit designs G06F30/30
• CPC Class Codes: G09B 9/04 for teaching control of land vehicles

Abstract

A vehicle simulation such as for example a driving game can be provided by displaying an image of a steering wheel on a touch sensitive screen. Touch inputs are used to control the rotational orientation of displayed steering wheel. The rotational orientation of the displayed steering wheel is used to apply course correction effects to a simulated vehicle. Selective application of driver assist and different scaling of touch inputs may be provided.

Claims

1. A handheld device comprising:

a housing shaped and dimensioned for being held by a hand;

a touch sensitive screen disposed on the housing;

a graphics processor operatively connected to the touch sensitive screen, the graphics processor generating display of a virtual object on the touch sensitive screen; and

a processor operatively connected to the touch sensitive screen and to the graphics processor, the processor being responsive to input sensed by the touch sensitive screen to detect movements along a multiplicity of paths on the screen, the processor defining vectors in response to said detected touch movements and causing the orientation of the displayed virtual object to change in response to the defined vectors.

2. The handheld device of claim 1 wherein the housing is shaped and dimensioned such that when the hand grasps the housing, a thumb of the hand can reach and touch at least a portion of the touch sensitive screen, and the processor and the graphics processor are disposed in the housing.

3. The handheld device of claim 1 wherein the virtual object comprises a virtual steering wheel.

4. The handheld device of claim 1 wherein the processor changes orientation of the virtual object by smaller amounts in response to the processor detecting touch movements along paths on the screen that are disposed further from a user.

5. The handheld device of claim 1 wherein the processor measures an angle α

between starting and ending vectors of touch movement along a path on the screen, and uses the angle α

to determine an amount to change the orientation of the virtual object.

6. The handheld device of claim 1 wherein the processor selects proportionality between amount of detected touch movement and amount of change of orientation of the virtual object depending on distance of the detected touch movement relative to a reference.

7. The handheld device of claim 1 wherein the processor calculates an angle between successive vectors to determine direction and amount to change the orientation of the virtual object.

8. The handheld device of claim 1 wherein the processor controls the graphics processor to provide at least one of translating and scaling the virtual object.

9. The handheld device of claim 1 wherein the touch sensitive screen is sensitive to touch by a stylus or by a digit of a human hand.

10. The handheld device of claim 1 wherein the displayed virtual object changes orientation by rotating about an axis that is perpendicular to the screen.

11. In a handheld device of the type comprising a housing shaped and dimensioned for being held by at least one hand, a screen disposed on the housing, and a graphics processor operatively connected to the screen, the graphics processor generating display of a virtual object on the screen, a processor operatively connected to the graphics processor, and a non-transitory memory operatively connected to the processor, the non-transitory memory storing information comprising instructions that when executed by the processor control the processor to:

(a) detect input movements along a multiplicity of paths on the screen,

(b) define vectors in response to said detected input movements on the screen, and

(c) cause the orientation of the displayed virtual object to change in response to the defined vectors.

12. The handheld device of claim 11 wherein the housing is shaped and dimensioned such that when the hand grasps the housing, a thumb of the hand can reach and touch at least a portion of the screen, and the processor and the graphics processor are disposed in the housing.

13. The handheld device of claim 11 wherein the virtual object comprises a virtual steering wheel.

14. The handheld device of claim 11 wherein the instructions control the processor to change orientation of the virtual object by smaller amounts in response to the processor detecting input movements along paths on the screen further from a user.

15. The handheld device of claim 11 wherein the instructions control the processor to measure an angle α

between starting and ending vectors of movement along a path on the screen, and to use the angle α

to determine an amount to change the orientation of the virtual object.

16. The handheld device of claim 11 wherein the instructions control the processor to select proportionality between amount of movement on the screen and amount of change of orientation of the virtual object depending on distance of the input movement on the screen relative to a reference.

17. The handheld device of claim 16 wherein the reference comprises a position on the screen such as a part of the displayed virtual object.

18. The handheld device of claim 11 wherein the instructions control the processor to calculate an angle between successively-defined vectors to determine direction and amount to change the orientation of the virtual object.

19. The handheld device of claim 11 wherein the instructions control the graphics processor to provide at least one of translating and scaling the virtual object.

20. The handheld device of claim 11 wherein the screen is sensitive to touch by a stylus or a digit of a human hand.

21. The handheld device of claim 11 wherein the displayed virtual object changes orientation by rotating about an axis that is perpendicular to the screen.

22. A method of operating a handheld device of the type comprising a housing shaped and dimensioned for being held by at least one hand, a screen disposed on the housing, and a processing arrangement including a processor and a graphics processor operatively connected to the screen, the graphics processor generating display of a virtual object on the screen, the method comprising performing with the processing arrangement:

detecting input movements along a multiplicity of paths on the screen,

defining vectors in response to said detected input movements on the screen, and

causing the orientation of the displayed virtual object to change in response to the defined vectors.

23. The method of claim 22 wherein the virtual object comprises a virtual steering wheel.

24. The method of claim 22 further including changing orientation of the virtual object by smaller amounts in response to the processor detecting input movements along paths on the screen further from a user.

25. The method of claim 22 further including measuring an angle α

between starting and ending vectors of movement along a path on the screen, and using the angle α

to determine an amount to change the orientation of the virtual object.

26. The method of claim 22 further including selecting proportionality between amount of movement on the screen and amount of change of orientation of the virtual object depending on distance of the input movement on the screen relative to a reference position on the screen.

27. The method of claim 22 further including calculating an angle between successively-defined vectors, and specifying direction and amount to change the orientation of the virtual object in response to the calculated angle.

28. The method of claim 22 further including providing visual feedback comprising at least one of translating and scaling the virtual object.

29. The method of claim 22 wherein the screen is sensitive to touch by a stylus or by a digit of a human hand.

30. The method of claim 22 further including changing orientation of the displayed virtual object by rotating the displayed virtual object about an axis that is perpendicular to the screen.