TOUCH SCREEN WITH VIRTUAL JOYSTICK AND METHODS FOR USE THEREWITH

• US 20110285636A1
• Filed: 05/20/2010
• Published: 11/24/2011
• Est. Priority Date: 05/20/2010
• Status: Active Grant

• Current Assignee: Brian G. Howard, Jeremy R. Howa, John W. Howard
• Original Assignee: Brian G. Howard, Jeremy R. Howa, John W. Howard
• Inventors: Howa, Jeremy R., Howard, Brian G., Howard, John W.
• Granted Patent: US 9,262,073 B2
• Time in Patent Office: Days
• US Class Current: 345/173
• CPC Class Codes: A63F 13/2145 the surface being also a display device, e.g. touch screens
• CPC Class Codes: A63F 13/42 by mapping the input signals into game commands, e.g. mapping the displacement of a stylus on a touch screen to the steering angle of a virtual vehicle
• CPC Class Codes: A63F 13/426 involving on-screen location information, e.g. screen coordinates of an area at which the player is aiming with a light gun
• CPC Class Codes: G06F 3/0416 Control or interface arrangements specially adapted for digitisers
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus

Abstract

Joystick display data is generated for display on a touch screen of an electronic device. The joystick display data creates a visual representation of a virtual joystick when displayed on the touch screen. Touch data from the touch screen is processed to determine when the touch data indicates user interaction with the virtual joystick. When the touch data indicates user interaction with the virtual joystick, the joystick display data is adjusted to reflect the user interaction with the virtual joystick, based on the touch data, and joystick data is generated based on the user interaction with the virtual joystick. The display of at least one other element on the touch screen can be adjusted based on the joystick data.

Claims

1. A method for use in conjunction with a handheld device that includes a touch screen, the method comprising:

generating joystick display data for display on the touch screen, wherein the joystick display data creates a visual representation of a virtual joystick when displayed on the touch screen, wherein the visual representation of the virtual joystick includes a boundary and an actuator that moves within the boundary;

processing touch data from the touch screen to determine when the touch data indicates user interaction with the virtual joystick, by;

determining the touch data indicates user interaction with the virtual joystick when the touch data corresponds to a touch of the touch screen inside the boundary; and

determining the touch data indicates user interaction with the virtual joystick when the touch data corresponds to dragging the touch from inside the boundary to outside the boundary;

when the touch data indicates user interaction with the virtual joystick;

adjusting the joystick display data to reflect the user interaction with the virtual joystick, based on the touch data by modifying a position of the actuator to correspond to a position of the touch of the touch screen; and

generating joystick data based on the user interaction with the virtual joystick;

wherein the display of at least one other element on the touch screen is adjusted based on the joystick data.

2. The method of claim 1 wherein generating the joystick data based on the user interaction with the virtual joystick includes:

generating orientation data;

comparing the orientation data to a range of orientations about at least one advantageous orientation;

generating the joystick data to indicate the advantageous orientation when the orientation data compares favorably to the range of orientations about the at least one advantageous orientation.

3. The method of claim 2 wherein the at least one advantageous orientation includes a plurality of advantageous orientations.

4. The method of claim 2 further comprising:

generating the joystick data to indicate the orientation data when the orientation data compares unfavorably to the range of orientations about the at least one advantageous orientation.

5. The method of claim 1 further comprising:

displaying visual orientation feedback on the touch screen, based on the joystick data, wherein the visual orientation feedback is separate from the visual representation of the virtual joystick.

6. The method of claim 1 further comprising:

generating instruction data for display on the touch screen, wherein the instruction data generates a display of a visual prompt on the touch screen that instructs the user on use of the virtual joystick.

7. The method of claim 6 further comprising:

terminating the display of the visual prompt when the touch data indicates user interaction with the virtual joystick.

8. The method of claim 1 wherein generating joystick display data for display on the touch screen includes modifying a position of the virtual joystick on the touch screen in response to a user selection of the position of the virtual joystick.

9. The method of claim 1 further comprising:

processing the touch data to determine a bias corresponding to the user interaction with the virtual joystick;

wherein generating the joystick data based on the user interaction with the virtual joystick includes bias compensation.

10. The method of claim 1 wherein the virtual joystick includes at least one adjunct button that is selectable in response to user interaction;

wherein processing the touch data further includes determining when the at least one adjunct button is selected; and

wherein generating the joystick data includes generating button selection data when the at least one adjunct button is selected.

11. A method for use in conjunction with an electronic device that includes a touch screen, the method comprising:

generating joystick display data for display on the touch screen, wherein the joystick display data creates a visual representation of a virtual joystick when displayed on the touch screen;

processing touch data from the touch screen to determine when the touch data indicates user interaction with the virtual joystick, and when the touch data indicates user interaction with the virtual joystick;

adjusting the joystick display data to reflect the user interaction with the virtual joystick, based on the touch data; and

generating joystick data based on the user interaction with the virtual joystick;

wherein the display of at least one other element on the touch screen is adjusted based on the joystick data.

12. The method of claim 11 wherein the visual representation of the virtual joystick includes a boundary and wherein processing touch data from the touch screen to determine when the touch data indicates user interaction with the virtual joystick includes determining when the touch data corresponds to a touch of the touch screen inside the boundary.

13. The method of claim 11 wherein processing touch data from the touch screen to determine when the touch data indicates user interaction with the virtual joystick includes determining when the touch data corresponds to a touch of the touch screen inside the boundary and further corresponds to dragging the touch outside the boundary.

14. The method of claim 11 wherein the visual representation of the virtual joystick includes an actuator and wherein adjusting the joystick display data to reflect the user interaction with the virtual joystick includes modifying a position of the actuator to correspond to a position of a touch of the touch screen.

15. The method of claim 11 wherein generating the joystick data based on the user interaction with the virtual joystick includes:

generating orientation data;

comparing the orientation data to a range of orientations about at least one advantageous orientation;

generating the joystick data to indicate the advantageous orientation when the orientation data compares favorably to the range of orientations about the at least one advantageous orientation.

16. The method of claim 15 wherein the at least one advantageous orientation includes a plurality of advantageous orientations.

17. The method of claim 15 further comprising:

generating the joystick data to indicate the orientation data when the orientation data compares unfavorably to the range of orientations about the at least one advantageous orientation.

18. The method of claim 11 further comprising:

displaying visual orientation feedback on the touch screen, based on the joystick data, wherein the visual orientation feedback is separate from the visual representation of the virtual joystick.

19. The method of claim 11 further comprising:

generating instruction data for display on the touch screen, wherein the instruction data generates a display of a visual prompt on the touch screen that instructs the user on use of the virtual joystick.

20. The method of claim 19 further comprising:

terminating the display of the visual prompt when the touch data indicates user interaction with the virtual joystick.

21. The method of claim 11 wherein generating joystick display data for display on the touch screen includes modifying a position of the virtual joystick on the touch screen in response to a user selection of the position of the virtual joystick.

22. The method of claim 11 further comprising:

processing the touch data to determine a bias corresponding to the user interaction with the virtual joystick;

wherein generating the joystick data based on the user interaction with the virtual joystick includes bias compensation.

23. The method of claim 22 wherein the processing the touch data to determine the bias includes determining a difference between at least two touch positions indicated by the touch data.

24. The method of claim 11 wherein the virtual joystick includes at least one adjunct button that selectable in response to user interaction;

wherein processing the touch data further includes determining when the at least one adjunct button is selected; and

wherein generating the joystick data includes generating button selection data when the at least one adjunct button is selected.

25. The method of claim 11 wherein the joystick display data creates a visual representation of a plurality of virtual joysticks.

26. The method of claim 11 wherein the joystick data indicates one of n discrete directions, where n is an integer.

27. The method of claim 11 wherein adjusting the display of the at least one other element includes moving a background.

28. The method of claim 11 further comprising:

adjusting the joystick display data, in response to user interaction with the touch screen, to reposition the virtual joystick to a new location on the touch screen.