Asynchronous and synchronous gesture recognition

• US 7,614,019 B2
• Filed: 11/15/2004
• Issued: 11/03/2009
• Est. Priority Date: 09/13/2004
• Status: Expired due to Fees

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Jarrett, Robert J., Pettiross, Jeffrey W., Keely, Leroy B., Lerner, Matthew Rubin, Duncan, Rick, Viji, Sriram, Rimas Ribikauskas, Emily K.
• Primary Examiner(s): Bashore; William L
• Assistant Examiner(s): Alvesteffer; Stephen
• Application Number:
  US10/986,997
• Publication Number:
  US 20060055685A1
• Time in Patent Office: 1,814 Days
• Field of Search: 715/863
• US Class Current: 715/863
• CPC Class Codes: G06F 2203/04807 Pen manipulated menu
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text

Abstract

A system and method for determining whether a flick gesture has occurred is described. A flick gesture is a simple gesture that may be easily detected and is characterized by minimal interference with other applications or gestures.

Claims

1. A system for processing information comprising:

a memory;

a storage; and

a processor coupled to the memory exchanging information with the storage, the processor hosting a component, the component being a framework for processing, in real-time, plug-in objects and providing, in real-time, at least one of an event for display on a window input rectangle, wherein the component includes one or more interfaces for receiving plug-ins;

wherein the plug-ins are grouped into a collection comprising at least one of synchronous plug-ins or asynchronous plug-ins, wherein the group of synchronous plug-ins and the group of asynchronous plug-ins are associated with the one or more interfaces that are executed independent of each other, wherein an order of operation of the plug-ins'"'"' is changeable to affect a data return output of each collection, wherein the one or more interfaces include;

a synchronous interface to which a first gesture recognizer object is attached, including a dynamic renderer for quickly processing input, the first gesture recognizer object processing information received by the component synchronously with the receipt of the information by the component; and

an asynchronous interface to which a second gesture recognizer object is attached, an asynchronous thread for processing information from the component on an asynchronous basis, the second gesture recognizer object processing information received by the component asynchronously with the receipt of the information by the component, wherein the first gesture recognizer object recognizes flick gestures and wherein a gesture not recognized as a flick gesture by the first gesture recognizer object is recognized and processed by the second gesture recognizer object as another gesture.

2. The system according to claim 1, wherein the information processed by the second gesture recognizer object is the same information processed by the first gesture recognizer object.

3. The system according to claim 1, wherein the information processed by the second gesture recognizer object is different from the information processed by the first gesture recognizer object, where the first gesture recognizer object modified the information to be later processed by the second gesture recognizer object.

4. The system according to claim 1, wherein the first gesture recognizer object is in a first collection of objects attached to the synchronous interface and the second gesture recognizer object is in a second collection of objects attached to the asynchronous interface.

5. The system according to claim 1, further comprising:

a dynamic renderer attached to the synchronous interface, the dynamic renderer for dynamically rendering ink strokes received by the component.

6. The system according to claim 1, further comprising:

a synchronous plug-in attached to the synchronous interface of the component.

7. The system according to claim 1, further comprising:

an asynchronous plug-in attached to the asynchronous interface of the component.

8. A method for recognizing gestures using a component that has a first gesture recognizer associated with a synchronous interface and a second gesture recognizer associated with an asynchronous interface, the method comprising the steps of:

receiving at the first gesture recognizer ink information via the synchronous interface of the component;

receiving at the second gesture recognizer, input including ink information, via the asynchronous interface of the component;

determining that the ink information includes a flick gesture, the determining being made first by the first gesture recognizer via the synchronous interface;

determining the ink information as another gesture, wherein the second gesture recognizer determines the another gesture via the asynchronous interface;

responsive to determining that the ink information includes a flick gesture, processing the flick gesture in real-time, wherein the flick gesture is processed by a synchronous thread prior to being processed by an asynchronous thread; and

displaying an event associated with the type of flick gesture on a window input rectangle.

9. The method according to claim 8, further comprising:

receiving the ink information at a second gesture recognizer;

determining that the ink includes another gesture; and

processing the another gesture.

10. The method according to claim 8, further comprising the step of:

deleting the ink if the ink is recognized to include a flick gesture.

11. The method according to claim 8, further comprising the steps of:

receiving the ink information at a plug-in attached to the synchronous interface of the component; and

processing the ink information at the plug-in.

12. A system for recognizing gestures using a component that has a first gesture recognizer associated with a synchronous interface and a second gesture recognizer associated with an asynchronous interface, the system comprising:

means for inputting ink information, the inputting means having a sensing system, wherein the sensing system includes a camera, accelerometers, magnetometers, gyroscopes and a transceiver for transmitting information from the sensing system to the component;

means for receiving at a first gesture recognizer ink information via a synchronous interface of a component;

means for receiving at the second gesture recognizer, an input including ink information, via the asynchronous interface of the component;

means for determining if the ink information includes a flick gesture via the synchronous interface, wherein the means for determining if the ink information includes a flick gesture processes the flick gesture in real-time, wherein the flick gesture is processed on a synchronous thread prior to being processed via the asynchronous interface on an asynchronous thread;

means for determining ink information as another gesture via the asynchronous interface of the component; and

means for displaying an event associated with the type of flick gesture on a window input rectangle.

13. The system according to claim 12, further comprising:

means for receiving the ink information at a second gesture recognizer; and

means for determining if the ink includes another gesture.

14. The system according to claim 12, further comprising:

means for deleting the ink if the ink is recognized to include a flick gesture.

15. The system according to claim 12, further comprising:

means for receiving the ink information at a plug-in attached to the synchronous interface of the component; and

means for processing the ink information at the plug-in.

16. A computer-readable medium having a computer-implemented program stored thereon, the program for recognizing gestures using a component that has a first gesture recognizer associated with a synchronous interface and a second gesture recognizer associated with an asynchronous interface, the program comprising:

receiving at a first gesture recognizer ink information via a synchronous interface of a component;

determining that the ink information includes a flick gesture, the determining being made first by the first gesture recognizer via the synchronous interface;

determining the ink information as another gesture, wherein the second gesture recognizer determines the another gesture via the asynchronous interface; and

responsive to determining that the ink information includes a flick gesture, processing the flick gesture in real-time, wherein the flick gesture is processed by a synchronous thread prior to being processed by an asynchronous thread.

17. The computer-readable medium according to claim 16, the program further comprising the steps of:

receiving the ink information at a second gesture recognizer;

determining that the ink includes another gesture; and

processing the another gesture.

18. The computer-readable medium according to claim 16, the program further comprising the step of:

deleting the ink if the ink is recognized to include a flick gesture.

19. The computer-readable medium according to claim 16, the program further comprising the steps of:

receiving the ink information at a plug-in attached to the synchronous interface of the component; and

processing the ink information at the plug-in.