RECOGNIZING MULTIPLE INPUT POINT GESTURES

• US 20110260986A1
• Filed: 10/18/2010
• Published: 10/27/2011
• Est. Priority Date: 01/05/2007
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Vale, Peter, Duncan, Weiss, John Guido Atkins
• Granted Patent: US 8,294,685 B2
• Time in Patent Office: Days
• US Class Current: 345/173
• CPC Class Codes: G06F 2203/04104 Multi-touch detection in digitiser, i.e. details about the simultaneous detection of a plurality of touching locations, e.g. multiple fingers or pen and finger
• CPC Class Codes: G06F 3/041 Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text

Abstract

The present invention extends to methods, systems, and computer program products for recognizing multiple input point gestures. A recognition module receives an ordered set of points indicating that contacts have been detected in a specified order at multiple different locations on a multi-touch input surface. The recognition module determines the position of subsequently detected locations (e.g., third detected location) relative to (e.g., to the left of right of) line segments connecting previously detected locations (e.g., connecting first and second detected locations). The gesture module also detects whether line segments connecting subsequently detected locations (e.g., connecting third and fourth detected locations) intersect line segments connecting previously detected locations (e.g., connecting first and second detected locations). The gesture module recognizes an input gesture based on the relative positions and whether or not line segments intersect. The gesture module then identifies a corresponding input operation (e.g., cut, paste, etc.) to be performed.

Claims

1. At a computer system including a processor and system memory, a method for recognizing a multiple input point gesture, the method comprising:

an act of receiving a sequenced order of point locations, the sequenced order of point locations indicating contact at a first location on an input surface, followed by simultaneous contact at the first location and a second location on the input surface, followed by simultaneous contact at the first location, the second location, and a third location on the input surface;

an act of calculating a line segment between the first location and the second location;

an act of determining that the third location is on a specified side of the line segment; and

an act of the processor recognizing an input gesture represented by the sequenced order of point locations based at least on the determination that the third location is on the specified side of the line segment.

2. The method as recited in claim 1, wherein of receiving a sequenced order of point locations comprises an act of receiving a sequenced order of point locations indicating that simultaneous contact at the first location, the second location, and the third location was followed by simultaneous contact at the first location, the second location, the third location, and a fourth location on the input surface;

and further comprising;

an act of calculating a second line segment between the second location and the third location; and

an act of an act of calculating a third line segment between the third location and the fourth location.

3. The method as recited in claim 2, further comprising:

an act of determining that the fourth location is on the specified side of the second line segment.

4. The method as recited in claim 3, further comprising:

an act of detecting that the third line segment intersects with the first line segment.

5. The method as recited in claim 4, wherein the act of recognizing an input gesture represented by the sequenced order of point locations comprises an act of recognizing an input gesture corresponding to detected contact at four or more locations on the input surface based at least on the determination that the fourth location is on the specified side of the second line segment and that the third line segment intersects with the first line segment.

6. The method as recited in claim 3, further comprising:

an act of detecting that the third line segment does not intersect with the first line segment.

7. The method as recited in claim 6, wherein the act of recognizing an input gesture represented by the sequenced order of point locations comprises an act of recognizing an input gesture corresponding to detected contact at four or more locations on the input surface based at least on the determination that the fourth location is on the specified side of the second line segment and that the third line segment does not intersect with the first line segment.

8. The method as recited in claim 2, further comprising:

an act of determining that the fourth location is not on the specified side of the second line segment.

9. The method as recited in claim 8, wherein the act of recognizing an input gesture represented by sequenced order of point locations comprises an act of recognizing an input gesture corresponding to detected contact at four or more locations on the input surface based at least on the determination that the fourth location is not on the specified side of the second line segment.

10. The method as recited in claim 1, wherein the act of recognizing an input gesture represented by the sequenced order of point locations comprises an act of recognizing a corresponding input gesture corresponding to detected contact at five locations on the input surface.

11. The method as recited in claim 1, wherein the act of recognizing an input gesture represented by the sequenced order of point locations comprises an act of recognizing an input gesture corresponding to detected contact at three or more locations on the input surface based on the order of the detected contact at the three or more locations.

12. The method as recited in claim 1, further comprising an act of looking up the meaning of the input gesture in a table of known input gestures.

13. A computer program product for use at a computer system including an input surface, the computer program product for implementing a method for recognizing a multiple input point gesture on the input surface, the computer program product comprising one or more computer storage media having stored thereon computer-executable instructions that, when executed at a processor, cause the computer system to perform the method, including the following:

receive a sequenced order of point locations, the sequenced order of point locations indicating contact at a first location on the input surface, followed by simultaneous contact at the first location and a second location on the input surface, followed by simultaneous contact at the first location, the second location, and a third location on the input surface;

calculate a line segment between the first location and the second location;

determine that the third location is on a specified side of the line segment; and

recognize an input gesture represented by the sequenced order of point locations based at least on the determination that the third location is on the specified side of the line segment.

14. The computer program product as recited in claim 13, wherein computer-executable instructions that, when executed, cause the computer system to receive a sequenced order of point locations comprise computer-executable instructions that, when executed at a processor, cause the computer system to receive a sequenced order of point locations indicating that simultaneous contact at the first location, the second location, and the third location was followed by simultaneous contact at the first location, the second location, the third location, and a fourth location on the input surface.

15. The computer program product as recited in claim 14, wherein computer-executable instructions that, when executed, cause the computer system to recognize an input gesture represented by the sequenced order of point locations comprise computer-executable instructions that, when executed, cause the computer system to recognize an input gesture based in part on the fourth location.

16. The computer program product as recited in claim 14, wherein computer-executable instructions that, when executed, cause the computer system to receive a sequenced order of point locations indicating that simultaneous contact at the first location, the second location, and the third location was followed by simultaneous contact at the first location, the second location, the third location, and a fourth location on the input surface comprise computer-executable instructions that, when executed, cause the computer system to receive a sequenced order of point locations indicating that simultaneous contact at the first location, the second location, the third location, and the fourth location was followed by simultaneous contact at the first location, the second location, the third location, the fourth location, and a fifth location on the input surface.

17. The computer program product as recited in claim 13, wherein computer-executable instructions that, when executed, cause the computer system to recognize an input gesture represented by the sequenced order of point locations comprise computer-executable instructions that, when executed, cause the computer system to recognize an input gesture corresponding to detected contact at four or more locations on the input surface.

18. The computer program product as recited in claim 13, wherein computer-executable instructions that, when executed, cause the computer system to recognize an input gesture corresponding to detected contact at four or more locations on the input surface comprise computer-executable instructions that, when executed, cause the computer system to recognize an input gesture corresponding to detected contact at five locations on the input surface.

19. The computer program product as recited in claim 13, further comprising computer-executable instructions that, when executed, cause the computer system to look up the meaning of the recognized input gesture in a table of known input gestures.

20. A computer system, the computer system comprising:

one or more processors;

system memory;

an input surface; and

one or more computer storage media having stored thereon computer-executable instructions representing a gesture recognition module, the gesture recognition module configured to;

receive a sequenced order of point locations, the sequenced order of point locations indicating contact at a first location on the input surface, followed by simultaneous contact at the first location and a second location on the input surface, followed by simultaneous contact at the first location, the second location, and a third location on the input surface;

calculate a line segment between the first location and the second location;

determine that the third location is on a specified side of the line segment; and

recognize an input gesture represented by the sequenced order of point locations based at least on the determination that the third location is on the specified side of the line segment.