Event Registration and Dispatch System and Method for Multi-Point Controls

• US 20120146933A1
• Filed: 02/17/2012
• Published: 06/14/2012
• Est. Priority Date: 04/29/2008
• Status: Abandoned Application

• Current Assignee: Perceptive Pixel Incorporated (Microsoft Corporation)
• Original Assignee: Perceptive Pixel Incorporated (Microsoft Corporation)
• Inventors: Davidson, Philip L.
• Application Number:
  US13/399,609
• Publication Number:
  US 20120146933A1
• Time in Patent Office: Days
• US Class Current: 345/173
• CPC Class Codes: G06F 2203/04104 Multi-touch detection in digitiser, i.e. details about the simultaneous detection of a plurality of touching locations, e.g. multiple fingers or pen and finger
• CPC Class Codes: G06F 2203/04808 Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen
• CPC Class Codes: G06F 3/03545 Pens or stylus
• CPC Class Codes: G06F 3/038 Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
• CPC Class Codes: G06F 3/041 Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
• CPC Class Codes: G06F 3/04166 Details of scanning methods, e.g. sampling time, grouping of sub areas or time sharing with display driving Synchronisation with the driving of the display or the backlighting unit to avoid interferences generated internally G06F3/04184
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 9/451 Execution arrangements for user interfaces

Abstract

Dynamic registration of event handlers in a computer application or operating system recognizes multiple synchronous input streams by identifying each new stroke in a frame representing a single moment in time and mapping in a registration process each identified new stroke to a listening process that is associated with the user interface element to which the new input stream is to be applied. In the same frame, released strokes are unmapped and then each active listening process is called to carry out a respective control operation. When called, the strokes have the correct data for the given frame. The process is repeated for subsequent frames. By carrying out various processes in a sequence of frames, the concept of concurrency is preserved, which is particularly beneficial to multi-touch and multi-user systems.

Claims

1. A multi-point input system, comprising:

a multi-point input device having an input surface and adapted to sense simultaneous contacts of the input surface and providing as an output data streams representing strokes on the input surface over a period of time; and

a controller configured to receive the data streams from the multi-point input device, carry out a set of processes during a given frame representing a single moment in time, and repeat the set of processes for each of a successive plurality of frames over said period of time, the set of processes including;

identifying each new stroke in a given frame and mapping each identified new stroke to one or more listening processes;

identifying each released stroke in the given frame and unmapping each identified released stroke from the respective listening process to which the stroke previously was mapped; and

implementing in the given frame each listening process to which at least one stroke is mapped, each implemented listening process being carried out based on a current state of each stroke mapped to the respective listening process.

2. The system of claim 1,

wherein each listening process is associated with a user interface element that includes an associated tangible, and

wherein the controller being configured to carry out a set of processes that includes mapping each identified new stroke includes the controller being configured to determine whether to map the new stroke to the respective listening process based on the associated tangible.

3. The system of claim 2, wherein the controller being configured to carry out the mapping process comprises the controller being configured to map each identified new stroke based on a positional relationship between a point of contact on the input surface of the identified new stroke and the tangible of each user interface element.

4. The system of claim 1, wherein the controller being configured to carry out the implementing process comprises the controller being configured to implement each listening process to which at least one stroke is mapped based on a current position of contact of each stroke mapped to the respective listening process.

5. The system of claim 1,

wherein the controller being configured to carry out the mapping process comprises the controller being configured to map an identified new stroke to a listening process to which another stroke already is mapped, and

wherein the controller being configured to carry out the implementing process comprises the controller being configured to implement the listening process to which a plurality of strokes are mapped based on current states of said plurality of strokes mapped to the respective listening process.

6. The system of claim 1, wherein the controller being configured to carry out the mapping process comprises the controller being configured to map an identified new stroke to a plurality of listening processes.

7. The system of claim 1, wherein the controller being configured to carry out the mapping process comprises the controller being configured to ascertain at least one of a plurality of user interface elements to which an identified new stroke is applicable, and map the identified new stroke to a listener process associated with the ascertained user interface element.

8. The system of claim 7, wherein the user interface elements have a hierarchical structure;

and the controller is configured to employ the hierarchical structure by assessing user interface elements higher in the hierarchical structure before assessing user interface elements lower in the hierarchical structure.

9. The system of claim 1, wherein the multi-point input device is adapted to sense simultaneous contacts by different users on the input surface.

10. The system of claim 1,

wherein the multi-point input device includes a display surface distinct from the input surface;

and

wherein the controller is configured to control the multi-point input device to display on the display surface at least one user interface element, and implement at least one listening process that modifies an appearance of the user interface element displayed on the display surface.

11. The system of claim 1,

wherein the input surface is adapted to operate as a display surface for the multi-point input device;

and

wherein the controller is configured to control the multi-point input device to display on the display surface at least one user interface element, and implement at least one listening process that modifies an appearance of the user interface element displayed on the display surface.