Multi-touch-movement gestures for tablet computing devices

• US 8,902,181 B2
• Filed: 02/07/2012
• Issued: 12/02/2014
• Est. Priority Date: 02/07/2012
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Hinckley, Kenneth P., Pahud, Michel, Buxton, William A. S.
• Primary Examiner(s): GIESY, ADAM
• Application Number:
  US13/367,377
• Publication Number:
  US 20130201113A1
• Time in Patent Office: 1,029 Days
• Field of Search: None
• US Class Current: 345/173
• CPC Class Codes: G06F 15/0291 for reading, e.g. e-books constructional details of portable computers G06F1/1613
• CPC Class Codes: G06F 2200/1637 Sensing arrangement for detection of housing movement or orientation, e.g. for controlling scrolling or cursor movement on the display of an handheld computer
• CPC Class Codes: G06F 2203/0381 Multimodal input, i.e. interface arrangements enabling the user to issue commands by simultaneous use of input devices of different nature, e.g. voice plus gesture on digitizer
• CPC Class Codes: G06F 2203/04808 Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0485 Scrolling or panning
• CPC Class Codes: G06F 3/0487 using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text

Abstract

Functionality is described herein for detecting and responding to gestures performed by a user using a computing device, such as, but not limited to, a tablet computing device. In one implementation, the functionality operates by receiving touch input information in response to the user touching the computing device, and movement input information in response to the user moving the computing device. The functionality then determines whether the input information indicates that a user has performed or is performing a multi-touch-movement (MTM) gesture. The functionality can then perform any behavior in response to determining that the user has performed an MTM gesture, such as by modifying a view or invoking a function, etc.

Claims

1. A method, performed by a tablet computing device, for detecting gestures, comprising:

receiving touch input information from at least one touch input mechanism, in response to a user touching the computing device;

receiving movement input information from at least one movement input mechanism, in response to movement of the computing device;

determining whether the touch input information and the movement input information indicate that the user has performed or is performing a multi-touch-movement gesture,

where the multi-touch-movement gesture entails;

establishing two or more contacts with a surface of the computing device by a user who grasps the computing device with two hands during use; and

moving the computing device to establish a prescribed posture;

after determining that the user has performed a multi-touch-movement gesture, evaluating data from one or more sensors of the tablet computing device to determine whether a predefined telltale noise signature representing a predefined pattern of behavior has occurred; and

cancelling implementation of the multi-touch-movement gesture when the predefined telltale noise signature has occurred.

2. The method of claim 1, wherein said two or more contacts correspond to two hand contacts placed at two respective points along a peripheral region of the surface of the computing device.

3. The method of claim 2, wherein the two hand contacts are placed on or near two corners of the computing device.

4. The method of claim 2, wherein the peripheral region includes two opposing edges have respective lengths, and wherein the two hand contacts are placed on or near points that are midway along the respective lengths of the two edges.

5. The method of claim 1, wherein said two or more contacts include at least a first contact placed on a first surface of the computing device, and a second contact placed on a second surface of the computing device, the first surface and the second surface having normals pointed in generally opposite directions.

6. The method of claim 2, further comprising moving the computing device to establish a prescribed path that corresponds to a tilting movement whereby the computing device is rotated about an axis that runs generally through the two hand contacts.

7. The method of claim 2, further comprising moving the computing device to establish a prescribed path that corresponds to a flipping movement whereby the computing device is rotated about an axis that runs generally along an edge of the computing device.

8. The method of claim 2, further comprising moving the computing device to establish a prescribed path that corresponds to a pivoting movement whereby the computing device is rotated in a plane that is generally parallel to the surface of the computing device.

9. The method of claim 2, wherein the two hand contacts correspond to a first hand contact and a second hand contact, and further comprising moving the computing device to establish a prescribed path that corresponds to a twisting movement whereby the first hand contact is moved towards a reference point and the second hand contact is moved away from the reference point.

10. The method of claim 1, wherein the multi-touch-movement gesture is defined, at least in part, based on a manner in which the computing device is moved over a prescribed path, as characterized by one or more of:

a speed of the computing device;

an acceleration of the computing device; and

a deceleration of the computing device.

11. The method of claim 1, wherein the prescribed posture defines a prescribed tilt of a display surface of the computing device.

12. The method of claim 1, wherein the computing device includes at least a first second section and a second section,

wherein said two or more contacts correspond to two hand contacts, a first hand contact placed on a surface of the first section, and a second hand contact placed on a surface of the second section,

wherein said moving involves moving the first section with respect to the second section.

13. The method of claim 1, further comprising invoking a view in response to determining that the user has performed or is performing a multi-touch-movement gesture, where the view shows individual items in a layered collection of items.

14. The method of claim 1, further comprising invoking an interaction experience in response to determining that the user has performed or is performing a multi-touch-movement gesture, where the interaction experience facilitates interaction with the computing device for a condition that is assumed to affect the user in a current state.

15. The method of claim 1, further comprising invoking a toolbar selection in response to determining that the user has performed or is performing a multi-touch-movement gesture.

16. The method of claim 1, further comprising invoking an interface page in response to determining that the user has performed or is performing a multi-touch-movement gesture.

17. The method of claim 1, further comprising invoking an application or an operating system function in response to determining that the user has performed or is performing a multi-touch-movement gesture.

18. A computer readable storage device for storing computer readable instructions, the computer readable instructions providing an interpretation and behavior selection module (IBSM) when the instructions are executed by one or more processing devices, the computer readable instructions comprising:

logic configured to receive touch input information from at least one touch input mechanism of a tablet computing device, in response to a user touching the computing device;

logic configured to receive movement input information from at least one movement input mechanism, in response to movement of the computing device;

logic configured to determine whether the touch input information and the movement input information indicate that the user has made or is making a multi-touch-movement gesture by;

determining that the user has applied at least two hand contacts at two respective points along a peripheral region of a display surface of the computing device, using two hands that are also used to grasp the computing device; and

determining that the user has rotated the computing device in a prescribed manner while touching the display surface with said at least two hand contacts;

after determining that the user has performed a multi-touch-movement gesture, evaluating data from one or more sensors of the tablet computing device to determine whether a predefined telltale noise signature representing a predefined pattern of behavior has occurred; and

logic configured perform an action in response to determining that the user has performed a multi-touch-movement gesture unless the predefined telltale noise signature has occurred.

19. A booklet computing device, comprising:

at least a first section and a second section;

a hinged coupling mechanism for movably coupling the first section to the second section, each section comprising a separate display device;

at least one touch input mechanism configured to receive touch input information in response to a user touching the first section or the second section, or both the first section and the second section;

at least one movement input mechanism configured to receive movement input information in response to movement of the booklet computing device, including;

movement applied to both the first section and the second section; and

movement of the first section relative to the second section; and

a gesture matching module configured to;

receive the touch input information from said at least one touch input mechanism, and the movement input information from said at least one movement input mechanism;

determine whether the touch input information and the movement input information indicate that a user has performed or is performing a multi-touch-movement gesture,

where the multi-touch-movement gesture entails;

establishing two or more contacts with the booklet computing device, using two hands that are also used to grasp the booklet computing device; and

moving the sections of the booklet computing device relative to each other;

a noise cancelling mechanism that, after determining that the user has performed a multi-touch-movement gesture, evaluates data from one or more sensors of the booklet computing device to determine whether a predefined telltale noise signature representing a predefined pattern of behavior has occurred; and

wherein the noise cancelling mechanism cancels implementation of the multi-touch-movement gesture when the predefined telltale noise signature has occurred.

20. The booklet computing device of claim 19, wherein the gesture matching module is configured to detect different multi-touch-movement gestures for different static poses that are maintained for a prescribed period of time that achieve different respective angular separations between the first section and the second section.