Gesture recognition system for a touch-sensing surface

• US 8,830,181 B1
• Filed: 06/01/2009
• Issued: 09/09/2014
• Est. Priority Date: 06/01/2008
• Status: Active Grant

• Current Assignee: Parade Technologies, Ltd.
• Original Assignee: Cypress Semiconductor Corporation (Infineon Technologies AG)
• Inventors: Clark, Paul, Park, Tony, Rowe, Gabe, Grivna, Edward, Prendergast, Patrick, Seguine, Ryan
• Primary Examiner(s): Liang, Regina
• Application Number:
  US12/476,240
• Time in Patent Office: 1,926 Days
• Field of Search: 345156-179, 715/863
• US Class Current: 345/173
• CPC Class Codes: G06F 2203/04808 Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text

Abstract

An apparatus and method for identifying gestures performed on a touch-sensing surface. In one embodiment, a gesture recognition unit processes an input signal to determine input metrics associated with contacts at the touch-sensing surface. The gesture recognition unit identifies a gesture based on comparing at least one of the input metrics with a threshold value associated with the gesture.

Claims

1. A method, comprising:

processing an input signal using a segmentation scheme to determine a path of a contact, wherein the input signal indicates a location of the contact at a touch sensor;

determining a first direction vector between a first location of the contact and a second location of the contact;

selecting from a first plurality of segments a first segment associated with the first direction vector in response to determining that the direction of the first direction vector is within a range of directions associated with the first segment, wherein an area surrounding the first location is divided into the first plurality of segments, and wherein each of the first plurality of segments represents a range of directions around the first location of the contact;

determining a second direction vector between a second location of the contact and a third location of the contact;

selecting, from a second plurality of segments, a second segment associated with the second direction vector in response to determining that the direction of the second direction vector is within a range of directions associated with the second segment, wherein an area surrounding the second location is divided into the second plurality of segments, and wherein each of the second plurality of segments represents a range of directions around the second location of the contact; and

identifying a gesture based on the path of the contact, wherein the path of the contact is represented by at least the first segment and the second segment.

2. The method of claim 1, further comprising comparing an active distance with a movement distance of the contact to determine whether the contact is in motion, wherein the movement distance is a distance between a first location of the contact and a second location of the contact.

3. The method of claim 1, wherein the path of the contact includes a sequence of segments.

4. The method of claim 1, wherein identifying the gesture based on the path of the contact comprises comparing a sequence of segments associated with the path to a sequence of segments associated with the gesture.

5. The method of claim 1, further comprising identifying a rotation gesture in response to determining that the path of the contact approximates an arc.

6. The method of claim 1, further comprising identifying a grab gesture in response to detecting that each of a plurality of contacts is moving towards a convergence point, wherein the input signal indicates a location of each of the plurality of contacts at the touch sensor.

7. The method of claim 1, further comprising identifying a sweep gesture in response to detecting simultaneous motion of each of a plurality of contacts, wherein the simultaneous motion of each of the plurality of contacts is substantially towards a location of a stationary contact, wherein the input signal indicates a location of each of the plurality of contacts at the touch sensor.

8. The method of claim 1, further comprising identifying a strum gesture in response to detecting simultaneous motion of each of a plurality of contacts, wherein the simultaneous motion is substantially in one direction, wherein each of the plurality of contacts is located within a threshold distance of each of the other contacts of the plurality of contacts, and wherein the input signal indicates a location of each of the plurality of contacts at the touch sensor.

9. The method of claim 1, further comprising executing a set of instructions in response to detecting a gesture, wherein the set of instructions is selected based on a location associated with the gesture.

10. An apparatus, comprising:

an input configured to receive an input signal from a touch sensor, wherein the input signal indicates a location of a contact at the touch sensor;

a gesture recognition unit coupled with the input, wherein the gesture recognition unit is configured to;

apply a segmentation scheme to determine a path of the contact by dividing an area surrounding a first location of the contact into a first plurality of segments each representing a range of directions around the first location of the contact,

determine a first direction vector between the first location of the contact and a second location of the contact,

select from the first plurality of segments a first segment associated with the first direction vector by determining whether the first direction vector is within a range of directions defining the first segment,

apply the segmentation scheme by dividing an area surrounding the second location of the contact into a second plurality of segments each representing a range of directions around the second location of the contact,

determine a second direction vector between the second location of the contact and a third location of the contact,

select from the second plurality of segments a second segment associated with the second direction vector by determining whether the second direction vector is within a range of directions defining the second segment, and

identify a gesture based on the path of the contact, wherein the path of the contact is represented by at least the first segment and the second segment.

11. The apparatus of claim 10, wherein the gesture recognition unit is configured to identify the gesture based on the path of the contact by comparing a sequence of segments associated with the path to a sequence of segments associated with the gesture.

12. A method, comprising:

determining, from an input signal, an amount of temporal overlap between a duration of a first contact and a duration of a second contact during which the first contact and the second contact are simultaneously present, wherein the input signal indicates a location of the first contact at a touch sensor and a location of the second contact at the touch sensor; and

identifying a gesture based on comparing the temporal overlap with a threshold overlap value.

13. The method of claim 12, further comprising identifying a cascade gesture in response to detecting a threshold separation time between the start times of the plurality of contacts.

14. The method of claim 12, further comprising identifying a motion and tap gesture in response to detecting that a duration of the first contact temporally overlaps a duration of the second contact while the first contact is in motion.

15. The method of claim 12, further comprising detecting the first contact at a first location alternating with the second contact at a second location.

16. The method of claim 15, further comprising identifying a drumming gesture in response to detecting that the duration of the first contact is temporally non-overlapping with the duration of the second contact.

17. The method of claim 15, further comprising identifying a walking gesture in response to detecting that the duration of the first contact is temporally overlapping with the second contact.

18. The method of claim 12, further comprising executing a set of instructions in response to identifying the gesture, wherein the set of instructions is selected based on a location associated with at least one of the first contact and the second contact.