Event Registration and Dispatch System and Method for Multi-Point Controls

• US 20120146934A1
• Filed: 02/17/2012
• Published: 06/14/2012
• Est. Priority Date: 04/29/2008
• Status: Abandoned Application

• Current Assignee: Perceptive Pixel Incorporated (Microsoft Corporation)
• Original Assignee: Perceptive Pixel Incorporated (Microsoft Corporation)
• Inventors: Davidson, Philip L.
• Application Number:
  US13/399,694
• Publication Number:
  US 20120146934A1
• Time in Patent Office: Days
• US Class Current: 345/173
• CPC Class Codes: G06F 2203/04104 Multi-touch detection in digitiser, i.e. details about the simultaneous detection of a plurality of touching locations, e.g. multiple fingers or pen and finger
• CPC Class Codes: G06F 2203/04808 Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen
• CPC Class Codes: G06F 3/03545 Pens or stylus
• CPC Class Codes: G06F 3/038 Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
• CPC Class Codes: G06F 3/041 Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
• CPC Class Codes: G06F 3/04166 Details of scanning methods, e.g. sampling time, grouping of sub areas or time sharing with display driving Synchronisation with the driving of the display or the backlighting unit to avoid interferences generated internally G06F3/04184
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 9/451 Execution arrangements for user interfaces

Abstract

Dynamic registration of event handlers in a computer application or operating system recognizes multiple synchronous input streams by identifying each new stroke in a frame representing a single moment in time and mapping in a registration process each identified new stroke to a listening process that is associated with the user interface element to which the new input stream is to be applied. In the same frame, released strokes are unmapped and then each active listening process is called to carry out a respective control operation. When called, the strokes have the correct data for the given frame. The process is repeated for subsequent frames. By carrying out various processes in a sequence of frames, the concept of concurrency is preserved, which is particularly beneficial to multi-touch and multi-user systems.

Claims

1. A multi-point input system, comprising:

a multi-point input device having an input surface and adapted to sense simultaneous contacts of the input surface and providing as an output data streams representing strokes on the input surface over a period of time; and

a controller configured to maintain-a set of one or more user interface elements that respond to contact of the input surface and that have an associated tangible and at least one associated listener representing a respective control operation, receive the data streams from the multi-point input device, carry out a set of processes during a given frame representing a single moment in time, and repeat the set of processes for each of a successive plurality of frames over said period of time, the set of processes including;

identifying each new stroke in the given frame, a new stroke representing a new contact of the input surface;

registering each identified new stroke to the listener of at least one of the user interface elements in the maintained set based on a relationship between a position of contact of the identified new stroke and the tangible of one or more of the user interface elements;

notifying, for each listener to which a new stroke has been registered in the given frame, the respective listener of the existence of the respective new stroke, each notified listener representing an active listener;

identifying each released stroke in the given frame, a released stroke representing an end of a contact of the input surface;

notifying, for each identified released stroke in the given frame, the respective listener of the discontinuation of the released stroke, each active listener becoming an inactive listener conditioned on being notified of released strokes such that the listener is no longer listening to any strokes; and

dispatching, in the given frame, each of the active listeners to implement the respective control operation based on an updated state or states of one or more non-released strokes of which the respective listener is notified, the updated state of a non-released stroke corresponding to a current position of contact of the input surface.

2. The system of claim 1,

wherein the controller being configured to carry out the registering process comprises the controller being configured to register an identified new stroke to a listener to which a non-released stroke is already registered;

and

wherein the controller being configured to carry out the dispatching process comprises the controller being configured to implement the respective control operation corresponding to said listener to which a plurality of non-released strokes are registered based on the updated states of said plurality of non-released strokes.

3. The system of claim 1, wherein the controller being configured to carry out the registering process comprises the controller being configured to register an identified new stroke to a plurality of listeners.

4. The system of claim 1, wherein the controller being configured to carry out the registering process comprises the controller being configured to ascertain at least one of the user interface elements to which the identified new stroke is applicable, and register the identified new stroke to the listener of the ascertained user interface element.

5. The system of claim 4, wherein the user interface elements in the set have a hierarchical structure;

and the controller is configured to ascertain at least one of the user interface elements to which the identified new stroke is applicable using the hierarchical structure by assessing user interface elements higher in the hierarchical structure before assessing user interface elements lower in the hierarchical structure.

6. The system of claim 1,

wherein a first stroke represents a contact of the input surface by a first person, and

wherein the controller being configured to carry out the identifying each new stroke process comprises the controller being configured to identify a second stroke in the given frame that represents a new contact of the input surface by a second person, and

wherein the first stroke is a non-released stroke in the given frame.