Multi-touch interface gestures for keyboard and/or mouse inputs

• US 9,465,457 B2
• Filed: 08/30/2010
• Issued: 10/11/2016
• Est. Priority Date: 08/30/2010
• Status: Active Grant

• Current Assignee: Omnissa, LLC
• Original Assignee: VMware, Inc. (Broadcom, Inc.)
• Inventors: Hua, Xueliang, Casares, Juan, Zhang, Li-Zhu, Thompson, Robert Lee, Zhang, Zheng, Shao, Wenlong
• Primary Examiner(s): PITARO, RYAN F
• Application Number:
  US12/871,639
• Publication Number:
  US 20120054671A1
• Time in Patent Office: 2,234 Days
• US Class Current: 1/1
• CPC Class Codes: G06F 2203/0383 Remote input, i.e. interface arrangements in which the signals generated by a pointing device are transmitted to a PC at a remote location, e.g. to a PC in a LAN
• CPC Class Codes: G06F 2203/04805 Virtual magnifying lens, i.e. window or frame movable on top of displayed information to enlarge it for better reading or selection
• CPC Class Codes: G06F 2203/04808 Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen
• CPC Class Codes: G06F 3/038 Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text

Abstract

A computing device includes a touch screen displaying a graphical user interface (GUI) and a processing unit programmed to recognize gestures made on the touch screen and execute, in response thereto, a process associated with the gestures. The gestures include at least one of: a tap that causes an animation to be overlaid on the GUI at a location of the tap and, if a cursor is overlaid on the GUI, also causes the cursor to be moved to the location of the tap, a press-and-hold that causes a cursor overlaid on the GUI to be moved to a location of the press-and-hold, a press-and-hold in combination with a tap that causes a mouse right-click command to be executed, a press-and-hold that exceeds a predetermined amount of time in combination with a drag that causes a resizing of the GUI, a simultaneous three-tap that causes a keyboard to be launched and overlaid on the GUI to not obscure the portion of the GUI on top of which the simultaneous three-tap gesture was made, and a two-finger sweep that causes content within the GUI to be scrolled.

Claims

1. A computing device comprising:

a touch screen displaying a graphical user interface (GUI); and

a processing unit programmed to recognize gestures made on the touch screen and execute, in response thereto, a process associated with the gestures,

wherein the gestures include;

a press-and-hold that exceeds a predetermined amount of time,

an elimination of the press-and-hold, and

an establishment of a grab within a resize handle of a window of the GUI and a drag that causes a resizing of the window,

wherein the press-and-hold causes a first portion of animation to be displayed and, after the predetermined amount of time, a loupe and a second portion of animation to be displayed, and

wherein the elimination of the press-and-hold while the loupe is displayed over the resize handle causes a resize tool to replace the loupe.

2. The device of claim 1, wherein the first portion of animation is a pulse animation.

3. The device of claim 1, wherein the touch screen further displays a virtual touch pad for controlling a cursor that is overlaid on the GUI.

4. A client computing device interacting with a server for a remoting session, comprising:

a touch screen displaying an image of a user interface generated by the server; and

a processing unit programmed to recognize gestures made on the touch screen and execute, in response thereto, a process associated with the gestures that is executed locally on the client and not at the server,

wherein the gestures include;

a press-and-hold that exceeds a predetermined amount of time,

an elimination of the press-and-hold, and

an establishment of a grab within a resize handle of a window of the GUI and a drag that causes a resizing of the window,

wherein the press-and-hold causes a first portion of animation to be displayed and, after the predetermined amount of time, a loupe and a second portion of animation to be displayed, and

wherein the elimination of the press-and-hold while the loupe is displayed over the resize handle causes a resize tool to replace the loupe.

5. The device of claim 4, wherein the gestures are made within boundaries of the image.

6. The device of claim 4, wherein the animation is a pulse animation.

7. A method for recognizing a gesture on a touch screen, comprising:

displaying an image of a graphical user interface (GUI) on the touch screen;

recognizing, with a processing unit, a gesture made on the touch screen; and

executing a process associated with the recognized gesture,

wherein the gestures include;

a press-and-hold that exceeds a predetermined amount of time,

an elimination of the press-and-hold, and

an establishment of a grab within a resize handle of a window of the GUI and a drag that causes a resizing of the window,

wherein the press-and-hold causes a first portion of animation to be displayed and, after the predetermined amount of time, a loupe and a second portion of animation to be displayed, and

wherein the elimination of the press-and-hold while the loupe is displayed over the resize handle causes a resize tool to replace the loupe.

8. The method of claim 7, wherein the animation is a pulse animation.

9. The method of claim 7, wherein the touch screen further displays a virtual touch pad for controlling a cursor that is overlaid on the GUI.