Virtual controller for touch display

• US 9,411,509 B2
• Filed: 12/29/2010
• Issued: 08/09/2016
• Est. Priority Date: 12/29/2010
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: Berkes, Otto, Matthews, Joseph H. III, Geiger, Avi
• Primary Examiner(s): Tung, David
• Application Number:
  US12/981,139
• Publication Number:
  US 20120169610A1
• Time in Patent Office: 2,050 Days
• Field of Search: 345173-178
• US Class Current: 1/1
• CPC Class Codes: A63F 13/2145 the surface being also a display device, e.g. touch screens
• CPC Class Codes: A63F 13/218 using pressure sensors, e.g. generating a signal proportional to the pressure applied by the player
• CPC Class Codes: A63F 13/25 Output arrangements for video game devices
• CPC Class Codes: A63F 2300/1075 using a touch screen
• CPC Class Codes: A63F 2300/204 the platform being a handheld device
• CPC Class Codes: A63F 2300/6045 for mapping control signals received from the input arrangement into game commands
• CPC Class Codes: A63F 2300/609 for unlocking hidden game elements, e.g. features, items, levels
• CPC Class Codes: G06F 2203/04104 Multi-touch detection in digitiser, i.e. details about the simultaneous detection of a plurality of touching locations, e.g. multiple fingers or pen and finger
• CPC Class Codes: G06F 2203/04105 Pressure sensors for measuring the pressure or force exerted on the touch surface without providing the touch position
• CPC Class Codes: G06F 2203/04808 Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen
• CPC Class Codes: G06F 3/01 Input arrangements or combined input and output arrangements for interaction between user and computer G06F3/16 takes precedence
• CPC Class Codes: G06F 3/03547 Touch pads, in which fingers can move on a surface
• CPC Class Codes: G06F 3/0412 Digitisers structurally integrated in a display
• CPC Class Codes: G06F 3/0414 using force sensing means to determine a position
• CPC Class Codes: G06F 3/04166 Details of scanning methods, e.g. sampling time, grouping of sub areas or time sharing with display driving Synchronisation with the driving of the display or the backlighting unit to avoid interferences generated internally G06F3/04184
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus

Abstract

Systems and methods are provided for use with a computing device having a touch sensitive display including a touch sensor configured to detect touches of a digit of a user. The method may include detecting an initial digit down position on the display via the touch sensor, and establishing a neutral position for a virtual controller at the digit down position. The method may further include detecting a subsequent movement of the digit relative to the initial digit down position, and determining a controller input parameter based on the subsequent movement of the digit relative to the initial digit down position. The method may further include generating a controller input message indicating the determined controller input parameter.

Claims

1. An input method for use with a computing device having a touch sensitive display including a touch sensor configured to detect touches of a digit of a user, the method comprising:

during game play of a program executed on a processor of the computing device;

establishing a neutral position for a virtual controller at a detected initial digit down position on the touch sensitive display, the virtual controller being a virtual joystick controller;

detecting a digit up event subsequent to establishing the neutral position;

detecting a subsequent digit down position;

detecting creep between the subsequent digit down position and the initial digit down position at which the neutral position was established; and

repositioning the neutral position for the virtual controller at the subsequent digit down position upon detecting the creep;

determining that a border of the display impedes a portion of an actuable area of the virtual controller following repositioning;

partially displaying a control icon in the actuable area of the virtual controller; and

inhibiting display and actuability of portions of the virtual controller obstructed by the border of the display.

2. The input method of claim 1, wherein the digit up event is a lack of contact of the digit and the display for a predetermined threshold period of time.

3. The input method of claim 1, wherein the digit is a thumb.

4. The input method of claim 1, further comprising determining a controller input parameter based on subsequent movement of the digit relative to the subsequent digit down position, wherein determining the controller input parameter includes determining a direction, velocity, and/or relative magnitude of the subsequent movement of the digit relative to the subsequent digit down position.

5. The input method of claim 4, wherein establishing the neutral position, detecting the digit up event, detecting the subsequent digit down position, detecting creep, repositioning the neutral position for the virtual controller, determining that a border of the display impedes a portion of an actuable area, partially displaying a control icon, and inhibiting display and actuability of portions of the virtual controller are performed by an application programming interface executed on the computing device, the method further comprising:

outputting the controller input message from the application programming interface to a program executed on the computing device.

6. The input method of claim 4, further comprising:

detecting pressure of the digit against the touch sensitive display during detection of the subsequent digit down position and wherein generating the controller input message includes an indication of the detected pressure.

7. The input method of claim 6, wherein detecting pressure includes determining pressure from changes in an area of the touch associated with the digit over time or determining pressure from a pressure sensor coupled to the touch sensitive display.

8. The input method of claim 1, wherein the virtual controller includes an ancillary control zone that is configured as a virtual button or a directional pad.

9. A computing device, comprising:

a touch sensitive display including a touch sensor configured to detect touches of a digit of a user;

a virtual controller input module executed by a processor of the computing device, the virtual controller input module being configured to, during game play of a program executed on the processor of the computing device;

establish a neutral position for a virtual controller at a detected initial digit down position on the touch sensitive display, the virtual controller being a virtual joystick controller;

detect a digit up event subsequent to establishing the neutral position;

detect a subsequent digit down position;

detect creep between the subsequent digit down position and the initial digit down position at which the neutral position was established; and

reposition the neutral position for the virtual controller at the subsequent digit down position upon detecting the creep;

determine that a border of the display impedes a portion of an actuable area of the virtual controller following repositioning;

partially display a control icon in the actuable area of the virtual controller; and

inhibit display and actuability of portions of the virtual controller obstructed by the border of the display.

10. The computing device of claim 9, wherein the digit is a thumb.

11. The computing device of claim 9, wherein the virtual controller input module is configured to display a control icon anchored at the neutral position, the control icon providing a visual indication to the user of a positioning of the control.

12. The computing device of claim 9, wherein the computing device is configured as a mobile telephone or tablet computer.

13. The computing device of claim 9, wherein the digit up event is a lack of contact of the digit and the display for a predetermined threshold period of time.

14. The computing device of claim 9, wherein the virtual controller input module is configured to determine a controller input parameter based on subsequent movement of the digit relative to the subsequent digit down position, wherein determining the controller input parameter includes determining a direction, velocity, and/or relative magnitude of the subsequent movement of the digit relative to the subsequent digit down position.

15. The computing device of claim 9, wherein the virtual controller input module is further configured to:

detect pressure of the digit against the touch sensitive display during detection of the subsequent digit down position; and

generate a controller input message that includes an indication of the detected pressure.

16. The computing device of claim 15, wherein the virtual controller input module is further configured to detect the pressure of the digit by determining pressure from changes in an area of the touch associated with the digit over time or determining pressure from a pressure sensor coupled to the touch sensitive display.

17. The computing device of claim 9, wherein the virtual controller includes an ancillary control zone that is configured as a virtual button or a directional pad.