Virtual input devices created by touch input

• US 9,141,284 B2
• Filed: 05/28/2009
• Issued: 09/22/2015
• Est. Priority Date: 05/28/2009
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: Sands, Ian M., Snavely, John A., Burtner, Edwin Russ, Russ, V. Kevin
• Primary Examiner(s): Elahi, Towfiq
• Application Number:
  US12/474,205
• Publication Number:
  US 20100302155A1
• Time in Patent Office: 2,308 Days
• US Class Current: 1/1
• CPC Class Codes: G06F 2203/04808 Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen
• CPC Class Codes: G06F 3/042 by opto-electronic means
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus

Abstract

An input device is created on a touch screen in response to a user'"'"'s placement of their hand. When a user places their hand on the touch screen, an input device sized for their hand is dynamically created. Alternatively, some other input device may be created. For example, when the user places two hands on the device a split keyboard input device may be dynamically created on the touch screen that is split between the user'"'"'s hand locations. Once the input device is determined, the user may enter input through the created device on the input screen. The input devices may be configured for each individual user such that the display of the input device changes based on physical characteristics that are associated with the user.

Claims

1. A method for creating a virtual input device on a touch input device, comprising:

determining when a portion of a hand is detected by the touch input device;

when the portion of the hand is detected by the touch input device;

determining a size of the portion of the hand;

dynamically creating and sizing the virtual input device based on the determined size of the portion of the hand, wherein an inner area of the virtual input device is sized to contain the portion of the hand;

displaying a graphical representation of the virtual input device on the touch input device, wherein displaying the graphical representation comprises;

displaying a circular graphic and an associated cursor on the touch input device that moves in response to a movement of the portion of the hand;

displaying one or more buttons on an outer boundary of the circular graphic;

defining a central area of the circular graphic defined by the one or more buttons on the outer boundary of the circle, wherein the central area is operable to accept multi-finger touch operations that use the associated cursor as a focal point including one or more of;

panning, zooming, and rotating;

receiving user input from the virtual input device through an interaction between the portion of the hand and the circular graphic of the virtual input device.

2. The method of claim 1, wherein movement of the virtual input device on the touch input device moves a cursor on a display screen.

3. The method of claim 1, wherein displaying the one or more buttons comprises determining a size of each of the at least one finger of the hand and a location of a palm;

and sizing each of the one or more buttons based on the determined size and location.

4. The method of claim 1, wherein the virtual input device is a virtual mouse ring that includes a virtual mouse button that is disposed beneath each detected finger of the hand;

wherein each virtual mouse button is associated with an action.

5. The method of claim 1, further comprising determining a size of each detected finger and creating a virtual mouse button that is sized according to the determined size of each detected finger.

6. The method of claim 1, wherein the virtual input device is a split keyboard when two hands are detected by the touch input device, wherein keys of the keyboard are divided between a display disposed beneath each hand.

7. The method of claim 1, wherein when a virtual button is selected displaying a list of menu items in place of the display of the virtual button.

8. The method of claim 1, further comprising determining when the hand becomes undetected and when the hand becomes undetected removing the virtual input device from the touch input device.

15. The method of claim 1, further comprising:

determining when a portion of a second hand is detected by the touch input device;

in response to detecting the portion of the second hand, creating a second virtual input device;

determining a size of the portion of the second hand that is placed on the touch input device;

dynamically sizing the second virtual input device based on the determined size of the portion of the second hand;

displaying a graphical representation of the second virtual input device that includes a display of a second circular graphic beneath the portion of the second hand;

determining when a two-handed operation has been received in response to receiving user input from the first virtual input device and receiving user input from the second virtual input device;

determining when the second hand becomes undetected and when the second hand becomes undetected, halting display of the second virtual input device on the touch input device.

9. A computer-readable storage device having computer-executable instructions for creating a virtual input device in response to a touch input, comprising:

determining when a portion of a hand is detected by a touch input device;

when the portion of the hand is detected by the touch input device;

automatically determining a size of the portion of the hand;

dynamically creating and sizing the virtual input device based on the determined size of the portion of the hand;

wherein an inner area of the virtual input device is sized to completely contain the portion of the hand detected by the touch input device;

displaying a graphical representation of the virtual input device, the graphical representation of the virtual input device, comprising;

a display of a circular graphic beneath the portion of the hand that is detected by the touch input device, wherein the circular graphic is operable to respond to a movement of the portion of the hand to remain beneath the portion of the hand as the portion of the hand moves and wherein a cursor associated with the circular graphic moves in correspondence with the circular graphic, the circular graphic including one or more buttons on an outer boundary of the circular graphic and defining a central area of the circular graphic defined by the one or more buttons on the outer boundary of the circle, wherein the central area is operable to accept multi-finger touch operations that use the cursor as a focal point including one or more of;

panning, zooming, and rotating;

receiving user input from the virtual input device through an interaction between the portion of the hand and the virtual input device; and

removing the virtual input device when the hand becomes undetected by the touch input device.

10. The computer-readable storage device of claim 9, wherein creating the virtual input device comprises determining a type of virtual input device based on a context of an application.

11. The computer-readable storage device of claim 9, wherein the virtual input device is a virtual mouse ring that includes at least two virtual mouse buttons that are disposed beneath each detected finger of the hand.

12. The computer-readable storage device of claim 9, wherein the virtual input device is a virtual ring that consists of a single input ring wherein an inside of the ring is used for multi-finger touch operations.

13. The computer-readable storage device of claim 9, wherein the virtual input device is a portion of a keyboard.

14. The computer-readable storage device of claim 11, wherein when a virtual mouse button is selected by tapping one of the fingers on the virtual mouse button, displaying a list of menu items in place of the display of the virtual mouse button.

16. A system for creating a virtual input device on a touch screen, comprising:

the touch screen;

a processor and a computer-readable medium;

an operating environment stored on the computer-readable medium and executed by the processor; and

a touch manager operating under control of the operating environment and operable to;

detect a portion of a hand by the touch screen;

in response to detecting the portion of the hand, create the virtual input device on the touch screen, the virtual input device having;

an outer boundary operable to receive a movement input, the outer boundary having a button operable to receive a tap input, wherein the movement input comprises a detection of the hand moving on the touch screen and wherein the tap input comprises a detection of the hand being picked up and subsequently pressed on the button of the outer boundary; and

a central portion defined by the outer boundary, the central portion comprising an area operable to receive multi-finger touch input associated with an action to perform one or more of;

panning, zooming or rotating;

in response to receiving the movement input at the outer boundary, move the virtual input device on the touch screen in correspondence with the movement input;

in response to receiving the tap input at the button of the outer boundary, invoke a function within the operating environment;

in response to receiving the multi-finger touch input at the central portion, invoke a multi-finger touch operation within the operating environment.

17. The system of claim 16, wherein the multi-finger touch input includes at least two fingers of the hand being detected within the central portion by the touch screen, wherein each of the detected fingers is detected as having a motion in opposition to the other detected finger'"'"'s motion, such that combining the opposing motions results in no movement of the virtual input device.

18. The system of claim 16, wherein the outer boundary includes a second button, the second button being disposed of beneath at least two fingers of the hand being detected by the touch screen.

19. The system of claim 16, wherein the touch manger is further operable to:

in response to losing detection of the hand, delete the virtual input device from the touch screen.