Event Registration and Dispatch System and Method for Multi-Point Controls

• US 20120146932A1
• Filed: 02/17/2012
• Published: 06/14/2012
• Est. Priority Date: 04/29/2008
• Status: Abandoned Application

• Current Assignee: Perceptive Pixel Incorporated (Microsoft Corporation)
• Original Assignee: Perceptive Pixel Incorporated (Microsoft Corporation)
• Inventors: Davidson, Philip L.
• Application Number:
  US13/399,551
• Publication Number:
  US 20120146932A1
• Time in Patent Office: Days
• US Class Current: 345/173
• CPC Class Codes: G06F 2203/04104 Multi-touch detection in digitiser, i.e. details about the simultaneous detection of a plurality of touching locations, e.g. multiple fingers or pen and finger
• CPC Class Codes: G06F 2203/04808 Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen
• CPC Class Codes: G06F 3/03545 Pens or stylus
• CPC Class Codes: G06F 3/038 Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
• CPC Class Codes: G06F 3/041 Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
• CPC Class Codes: G06F 3/04166 Details of scanning methods, e.g. sampling time, grouping of sub areas or time sharing with display driving Synchronisation with the driving of the display or the backlighting unit to avoid interferences generated internally G06F3/04184
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 9/451 Execution arrangements for user interfaces

Abstract

Dynamic registration of event handlers in a computer application or operating system recognizes multiple synchronous input streams by identifying each new stroke in a frame representing a single moment in time and mapping in a registration process each identified new stroke to a listening process that is associated with the user interface element to which the new input stream is to be applied. In the same frame, released strokes are unmapped and then each active listening process is called to carry out a respective control operation. When called, the strokes have the correct data for the given frame. The process is repeated for subsequent frames. By carrying out various processes in a sequence of frames, the concept of concurrency is preserved, which is particularly beneficial to multi-touch and multi-user systems.

Claims

1. A method of handling input streams in a multi-point input device capable of having multiple synchronous input streams, comprising the steps of:

maintaining a set of one or more user interface elements that respond to contact of the multi-point input device, each of the user interface elements having an associated tangible and at least one associated listener, each listener representing a respective control operation; and

processing, for each given frame of a plurality of frames each representing a single moment in time, one or more input streams representing contacts of the multi-point input device by;

identifying each new stroke in the given frame, a new stroke representing a new contact of the multi-point input device;

registering each identified new stroke to the listener of at least one of the user interface elements in the maintained set based on a relationship between a position of contact of the identified new stroke and the tangible of one or more of the user interface elements;

notifying, for each listener to which a new stroke has been registered in the given frame, the respective listener of the existence of the respective new stroke, each notified listener representing an active listener;

identifying each released stroke in the given frame, a released stroke representing an end of a contact of the multi-point input device;

notifying, for each identified released stroke in the given frame, the respective listener of the discontinuation of the released stroke, each active listener becoming an inactive listener conditioned on being notified of released strokes such that the listener is no longer listening to any strokes; and

dispatching, in the given frame, each of the active listeners to implement the respective control operation based on an updated state or states of one or more non-released strokes of which the respective listener is notified, the updated state of a non-released stroke corresponding to a current position of contact of the multi-point input device.

2. The method of claim 1, wherein registering comprises registering an identified new stroke to a listener to which a non-released stroke is already registered;

and dispatching comprises implementing the respective control operation corresponding to said listener to which a plurality of non-released strokes are registered based on the updated states of said plurality of non-released strokes.

3. The method of claim 1, wherein registering comprises registering an identified new stroke to a plurality of listeners.

4. The method of claim 1, wherein registering comprises ascertaining at least one of the user interface elements to which the identified new stroke is applicable;

and registering the identified new stroke to the listener of the ascertained user interface element.

5. The method of claim 4, wherein the user interface elements in the set have a hierarchical structure;

and the step of ascertaining at least one of the user interface elements to which the identified new stroke is applicable employs the hierarchical structure by assessing user interface elements higher in the hierarchical structure before assessing user interface elements lower in the hierarchical structure.

6. The method of claim 1,

wherein a first stroke represents a contact of the multi-point input device by a first person, and

wherein identifying each new stroke includes identifying a second stroke in the given frame that represents a new contact of the multi-point input device by a second person, and

wherein the first stroke is a non-released stroke in the given frame.

7. The method of claim 1,

further comprising, for each released stroke, clearing the registration of listeners previously registered to the respective released stroke, and

wherein each active listener becoming an inactive listener comprises each active listener becoming an inactive listener conditioned on being no longer registered for any strokes.

8. The method of claim 1, further comprising not dispatching, in the given frame, each of the inactive listeners to implement the respective control operation.