Input Classification for Multi-Touch Systems

• US 20140104191A1
• Filed: 10/17/2012
• Published: 04/17/2014
• Est. Priority Date: 10/17/2012
• Status: Abandoned Application

• Current Assignee: Perceptive Pixel Incorporated (Microsoft Corporation)
• Original Assignee: Perceptive Pixel Incorporated (Microsoft Corporation)
• Inventors: Davidson, Philip L., Han, Jefferson Y.
• Application Number:
  US13/654,372
• Publication Number:
  US 20140104191A1
• Time in Patent Office: Days
• US Class Current: 345/173
• CPC Class Codes: G06F 2203/04104 Multi-touch detection in digitiser, i.e. details about the simultaneous detection of a plurality of touching locations, e.g. multiple fingers or pen and finger
• CPC Class Codes: G06F 2203/04106 Multi-sensing digitiser, i.e. digitiser using at least two different sensing technologies simultaneously or alternatively, e.g. for detecting pen and finger, for saving power or for improving position detection
• CPC Class Codes: G06F 2203/04109 FTIR in optical digitiser, i.e. touch detection by frustrating the total internal reflection within an optical waveguide due to changes of optical properties or deformation at the touch location
• CPC Class Codes: G06F 2203/04808 Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen
• CPC Class Codes: G06F 3/03545 Pens or stylus
• CPC Class Codes: G06F 3/041 Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
• CPC Class Codes: G06F 3/04162 for exchanging data with external devices, e.g. smart pens, via the digitiser sensing hardware
• CPC Class Codes: G06F 3/041661 using detection at multiple resolutions, e.g. coarse and fine scanning; using detection within a limited area, e.g. object tracking window
• CPC Class Codes: G06F 3/04186 Touch location disambiguation
• CPC Class Codes: G06F 3/042 by opto-electronic means
• CPC Class Codes: G06F 3/0441 using active external devices, e.g. active pens, for receiving changes in electrical potential transmitted by the digitiser, e.g. tablet driving signals
• CPC Class Codes: G06F 3/0442 using active external devices, e.g. active pens, for transmitting changes in electrical potential to be received by the digitiser
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text

Abstract

Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for input classification for multi-touch systems. In one aspect, a method includes receiving first and second contact data describing a first and second series of contacts with a touch sensitive display, the first and second series of contacts occurring over a time range. The method includes classifying the first series of contacts as being a series of touch inputs provided by a user'"'"'s body part, and classifying the second series of contacts as being a series of stylus inputs provided by a stylus. The method includes comparing motion represented by the series of touch inputs with motion represented by the series of stylus inputs, and determining that the motion represented by the series of touch inputs correlates with the motion represented by the series of stylus inputs. The method includes classifying the series of touch inputs.

Claims

1. A computer implemented method, comprising:

receiving first contact data describing a first series of contacts with a touch sensitive display;

receiving second contact data describing a second series of contacts with the touch sensitive display, the second series of contacts occurring over a time range during which the first series of contacts occurred;

classifying the first series of contacts as being a series of touch inputs provided by a user'"'"'s body part;

classifying the second series of contacts as being a series of stylus inputs provided by a stylus;

comparing motion represented by the series of touch inputs with motion represented by the series of stylus inputs;

based on comparing the motion represented by the series of touch inputs with the motion represented by the series of stylus inputs, determining that the motion represented by the series of touch inputs correlates with the motion represented by the series of stylus inputs; and

based on the determination that the motion represented by the series of touch inputs correlates with the motion represented by the series of stylus inputs, classifying the series of touch inputs as guide input incidental to the series of stylus inputs.

2. The method of claim 1, further comprising ignoring the series of touch inputs based on the classification of the series of touch inputs as guide input incidental to the series of stylus inputs.

3. The method of claim 2, wherein ignoring the series of touch inputs based on the classification of the series of touch inputs as guide input incidental to the series of stylus inputs comprises maintaining a state of an object on the touch sensitive display that is contacted by at least one of the series of touch inputs without regard for the series of touch inputs.

4. The method of claim 1, further comprising:

determining that the series of touch inputs and the series of stylus inputs contact an object on the touch sensitive display;

based on the determination that the series of stylus inputs contact the object on the touch sensitive display, altering the object based on the series of stylus inputs, the alteration of the object being different from movement of the object; and

based on the classification of the series of touch inputs as guide input incidental to the series of stylus inputs;

overriding the determination that the series of touch inputs contact the object on the touch sensitive display; and

maintaining the object at a stationary location without movement based on overriding the determination that the series of touch inputs contact the object on the touch sensitive display.

5. The method of claim 1:

wherein comparing motion represented by the series of touch inputs with motion represented by the series of stylus inputs comprises;

determining a first path of the series of touch inputs over the time range;

determining a second path of the series of stylus inputs over the time range; and

comparing the first path of the series of touch inputs with the second path of the series of stylus inputs;

wherein determining that the motion represented by the series of touch inputs correlates with the motion represented by the series of stylus inputs comprises determining that the first path of the series of touch inputs correlates with the second path of the series of stylus inputs.

6. The method of claim 5:

wherein comparing the first path of the series of touch inputs with the second path of the series of stylus inputs comprises comparing a distance between the first path of the series of touch inputs with the second path of the series of stylus inputs over the time range; and

wherein determining that the first path of the series of touch inputs correlates with the second path of the series of stylus inputs comprises determining that the distance between the first path of the series of touch inputs and the second path of the series of stylus inputs remains substantially similar over the time range.

7. The method of claim 5, wherein determining the first path of the series of touch inputs over the time range comprises interpolating a first path that fits the series of touch inputs.

8. The method of claim 1, further comprising determining that the series of touch inputs are separated from the series of stylus inputs by less than a threshold distance,

wherein comparing motion represented by the series of touch inputs with motion represented by the series of stylus inputs, determining that the motion represented by the series of touch inputs correlates with the motion represented by the series of stylus inputs, and classifying the series of touch inputs as guide input incidental to the series of stylus inputs are conditioned on the determination that the series of touch inputs are separated from the series of stylus inputs by less than the threshold distance.

9. The method of claim 1, further comprising:

receiving third contact data describing a third contact with the touch sensitive display, the third contact occurring after the time range and being different from the series of stylus inputs and the series of touch inputs;

classifying the third contact as a touch point provided by a user'"'"'s body part;

comparing a location of the third contact with the motion represented by the series of touch inputs;

based on comparing the location of the third contact with the motion represented by the series of touch inputs, determining that the third contact follows the motion represented by the series of touch input; and

based on the determination that the third contact follows the motion represented by the series of touch input, classifying the third contact as guide input incidental to the series of stylus inputs.

10. The method of claim 1, further comprising:

receiving third contact data describing a third contact with the touch sensitive display, the third contact occurring during the time range;

classifying the third contact as a touch point provided by a user'"'"'s body part;

determining that a location of the third contact does not correlate with motion represented by the series of touch inputs or motion represented by the series of stylus inputs;

maintaining the classification of the third contact as a touch point provided by a user'"'"'s body part based on the determination that the location of the third contact does not correlate with motion represented by the series of touch inputs or motion represented by the series of stylus inputs; and

responding to the third contact as user input while ignoring the series of touch inputs based on the classification of the series of touch inputs as guide input incidental to the series of stylus inputs.

11. A system comprising:

one or more computers and one or more storage devices storing instructions that are operable, when executed by the one or more computers, to cause the one or more computers to perform operations comprising;

receiving first contact data describing a first series of contacts with a touch sensitive display;

receiving second contact data describing a second series of contacts with the touch sensitive display, the second series of contacts occurring over a time range during which the first series of contacts occurred;

classifying the first series of contacts as being a series of touch inputs provided by a user'"'"'s body part;

classifying the second series of contacts as being a series of stylus inputs provided by a stylus;

comparing motion represented by the series of touch inputs with motion represented by the series of stylus inputs;

based on comparing the motion represented by the series of touch inputs with the motion represented by the series of stylus inputs, determining that the motion represented by the series of touch inputs correlates with the motion represented by the series of stylus inputs; and

based on the determination that the motion represented by the series of touch inputs correlates with the motion represented by the series of stylus inputs, classifying the series of touch inputs as guide input incidental to the series of stylus inputs.

12. The system of claim 11, further comprising ignoring the series of touch inputs based on the classification of the series of touch inputs as guide input incidental to the series of stylus inputs.

13. The system of claim 12, wherein ignoring the series of touch inputs based on the classification of the series of touch inputs as guide input incidental to the series of stylus inputs comprises maintaining a state of an object on the touch sensitive display that is contacted by at least one of the series of touch inputs without regard for the series of touch inputs.

14. The system of claim 11, further comprising:

determining that the series of touch inputs and the series of stylus inputs contact an object on the touch sensitive display;

based on the determination that the series of stylus inputs contact the object on the touch sensitive display, altering the object based on the series of stylus inputs, the alteration of the object being different from movement of the object; and

based on the classification of the series of touch inputs as guide input incidental to the series of stylus inputs;

overriding the determination that the series of touch inputs contact the object on the touch sensitive display; and

maintaining the object at a stationary location without movement based on overriding the determination that the series of touch inputs contact the object on the touch sensitive display.

15. The system of claim 11:

wherein comparing motion represented by the series of touch inputs with motion represented by the series of stylus inputs comprises;

determining a first path of the series of touch inputs over the time range;

determining a second path of the series of stylus inputs over the time range; and

comparing the first path of the series of touch inputs with the second path of the series of stylus inputs;

wherein determining that the motion represented by the series of touch inputs correlates with the motion represented by the series of stylus inputs comprises determining that the first path of the series of touch inputs correlates with the second path of the series of stylus inputs.

16. The system of claim 15:

wherein comparing the first path of the series of touch inputs with the second path of the series of stylus inputs comprises comparing a distance between the first path of the series of touch inputs with the second path of the series of stylus inputs over the time range; and

wherein determining that the first path of the series of touch inputs correlates with the second path of the series of stylus inputs comprises determining that the distance between the first path of the series of touch inputs and the second path of the series of stylus inputs remains substantially similar over the time range.

17. The system of claim 15, wherein determining the first path of the series of touch inputs over the time range comprises interpolating a first path that fits the series of touch inputs.

18. The system of claim 11, further comprising determining that the series of touch inputs are separated from the series of stylus inputs by less than a threshold distance,

wherein comparing motion represented by the series of touch inputs with motion represented by the series of stylus inputs, determining that the motion represented by the series of touch inputs correlates with the motion represented by the series of stylus inputs, and classifying the series of touch inputs as guide input incidental to the series of stylus inputs are conditioned on the determination that the series of touch inputs are separated from the series of stylus inputs by less than the threshold distance.

19. The system of claim 11, further comprising:

receiving third contact data describing a third contact with the touch sensitive display, the third contact occurring after the time range and being different from the series of stylus inputs and the series of touch inputs;

classifying the third contact as a touch point provided by a user'"'"'s body part;

comparing a location of the third contact with the motion represented by the series of touch inputs;

based on comparing the location of the third contact with the motion represented by the series of touch inputs, determining that the third contact follows the motion represented by the series of touch input; and

based on the determination that the third contact follows the motion represented by the series of touch input, classifying the third contact as guide input incidental to the series of stylus inputs.

20. The system of claim 11, further comprising:

receiving third contact data describing a third contact with the touch sensitive display, the third contact occurring during the time range;

classifying the third contact as a touch point provided by a user'"'"'s body part;

determining that a location of the third contact does not correlate with motion represented by the series of touch inputs or motion represented by the series of stylus inputs;

maintaining the classification of the third contact as a touch point provided by a user'"'"'s body part based on the determination that the location of the third contact does not correlate with motion represented by the series of touch inputs or motion represented by the series of stylus inputs; and

responding to the third contact as user input while ignoring the series of touch inputs based on the classification of the series of touch inputs as guide input incidental to the series of stylus inputs.