Classification of touch input as being unintended or intended

• US 9,886,186 B2
• Filed: 07/26/2016
• Issued: 02/06/2018
• Est. Priority Date: 09/12/2014
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: Durojaiye, Olumuyiwa M, Abzarian, David
• Primary Examiner(s): Merkoulova, Olga
• Application Number:
  US15/220,295
• Publication Number:
  US 20160334961A1
• Time in Patent Office: 560 Days
• CPC Class Codes: G06F 2203/04101 2.5D-digitiser, i.e. digitiser detecting the X/Y position of the input means, finger or stylus, also when it does not touch, but is proximate to the digitiser's interaction surface and also measures the distance of the input means within a short range in the Z direction, possibly with a separate measurement setup
• CPC Class Codes: G06F 2203/04104 Multi-touch detection in digitiser, i.e. details about the simultaneous detection of a plurality of touching locations, e.g. multiple fingers or pen and finger
• CPC Class Codes: G06F 2203/04808 Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen
• CPC Class Codes: G06F 3/03545 Pens or stylus
• CPC Class Codes: G06F 3/041 Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
• CPC Class Codes: G06F 3/0418 for error correction or compensation, e.g. based on parallax, calibration or alignment
• CPC Class Codes: G06F 3/04186 Touch location disambiguation
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures

Abstract

The techniques described herein implement a classification process to evaluate information associated with a tool input (e.g., from an input tool such as a pen or a stylus) and a user touch input (e.g., from a finger or a palm of a hand) to determine whether the user touch input is an intended or an unintended touch input. The information evaluated may be associated with an arrival of the tool input relative to an arrival of the user touch input. The information evaluated may also be associated with a movement of the tool input relative to a movement of the user touch input. In various implementations, the techniques may calculate an evaluation score and compare the evaluation score to a confidence classification threshold. If a confident classification cannot be achieved, the techniques further the classification process as more information associated with the inputs is received.

Claims

1. A system comprising:

a touch surface configured to receive a plurality of inputs;

one or more processors communicatively coupled to the touch surface; and

memory storing instructions that, when executed by the one or more processors, cause the system to;

implement a first classifier to evaluate information associated with a first input and a second input to determine whether the second input is an intended touch input or an unintended touch input, wherein the first classifier evaluates the information to determine an inter-arrival distance between a first position at which the first input arrives at the touch surface and a second position at which the second input arrives at the touch surface; and

in response to the first classifier being unable to determine whether the second input is the intended touch input or the unintended touch input, implement at least one subsequent classifier to evaluate additional information to determine whether the second input is the intended touch input or the unintended touch input, wherein the additional information evaluated is associated with a movement of the first input relative to a movement of the second input.

2. The system of claim 1, wherein:

the first input comprises touch input based on contact from a finger of a user; and

the second input is based on contact from another finger or a palm of a hand of the user.

3. The system of claim 1, wherein the first classifier evaluates the information to determine an inter-arrival time between a first time when the first input arrives at the touch surface and a second time when the second input arrives at the touch surface.

4. The system of claim 3, wherein:

if the inter-arrival time is less than an inter-arrival time threshold, then at least part of the evaluation of the first classifier indicates that the second input is the unintended touch input; and

if the inter-arrival time is greater than or equal to the inter-arrival time threshold, then at least part of the evaluation of the first classifier indicates that the second input is the intended touch input.

5. The system of claim 1, wherein:

if the inter-arrival distance is less than an inter-arrival distance threshold, then at least part of the evaluation of the first classifier indicates that the second input is the unintended touch input; and

if the inter-arrival distance is greater than or equal to the inter-arrival distance threshold, then at least part of the evaluation of the first classifier indicates that the second input is the intended touch input.

6. The system of claim 1, wherein the at least one subsequent classifier evaluates the additional information to determine a difference between a direction of movement of the first input and a direction of movement of the second input.

7. The system of claim 6, wherein:

if the difference is less than a direction difference threshold, then at least part of the evaluation of the at least one subsequent classifier indicates that the second input is the unintended touch input; and

if the difference is greater than or equal to the direction difference threshold, then at least part of the evaluation of the at least one subsequent classifier indicates that the second input is the intended touch input.

8. The system of claim 1, wherein the at least one subsequent classifier evaluates the additional information to determine a difference between a velocity of movement of the first input and a velocity of movement of the second input.

9. The system of claim 8, wherein:

if the difference is less than a velocity difference threshold, then at least part of the evaluation of the at least one subsequent classifier indicates that the second input is the unintended touch input; and

if the difference is greater than or equal to the velocity difference threshold, then at least part of the evaluation of the at least one subsequent classifier indicates that the second input is the intended touch input.

10. A method comprising:

determining that a first input is being simultaneously received at a touch surface along with a second input;

determining that the second input is associated with user touch; and

determining an inter-arrival distance between a first position at which the first input arrives at the touch surface and a second position at which the second input arrives at the touch surface;

evaluating, by one or more processors, the inter-arrival distance to classify the second input as an intended touch input or an unintended touch input.

11. The method of claim 10, further comprising:

calculating an evaluation score based at least in part on the evaluation of the inter-arrival distance;

comparing the evaluation score to at least one confidence threshold;

if, based on the comparing, the evaluation score satisfies the at least one confidence threshold, classifying the second input as the intended touch input or the unintended touch input; and

if, based on the comparing, the evaluation score fails to satisfy the at least one confidence threshold, evaluating at least one factor associated with a movement of the first input relative to a movement of the second input.

12. The method of claim 10, further comprising:

determining an inter-arrival interval between a first time when the first input arrives at the touch surface and a second time when the second input arrives at the touch surface; and

evaluating the inter-arrival interval to classify the second input as the intended touch input or the unintended touch input.

13. The method of claim 10, further comprising:

determining a difference between a direction of movement of the first input and a direction of movement of the second input; and

evaluating the difference to classify the second input as the intended touch input or the unintended touch input.

14. The method of claim 10, determining:

a difference between a velocity of movement of the first input and a velocity of movement of the second input; and

evaluating the difference to classify the second input as the intended touch input or the unintended touch input.

15. The method of claim 10, further comprising:

determining a difference between a first number of inputs in a first section of the touch surface and a second number of inputs in a second section of the touch surface; and

evaluating the difference to classify the second input as the intended touch input or the unintended touch input.

16. The method of claim 10, wherein the first input comprises touch input.

17. A system comprising:

one or more processors communicatively coupled to the touch surface; and

memory storing instructions that, when executed by the one or more processors, cause the system to;

implement a first classifier to evaluate one or more first classifier factors associated with a first input and a second input, the one or more first classifier factors to classify the second input as being either an intended touch input or an unintended touch input, wherein an individual first classifier factor has a corresponding weight to calculate an evaluation score and one first classifier factor is associated with a first arrival position of the first input relative to a second arrival position of the second input;

determine, based at least in part on the evaluation score, that the first classifier is unable to confidently classify the second input as being either the intended touch input or the unintended touch input; and

implement a subsequent classifier to evaluate one or more second classifier factors associated with the first input and the second input, wherein the one or more second classifier factors includes at least one first classifier factor with a corresponding weight adjusted to decrease an evaluation score influence during the implementation of the subsequent classifier.

18. The system of claim 17, wherein:

another first classifier factor is based at least in part on an arrival of the first input relative to an arrival of the second input;

a second classifier factor is based at least in part on movement of the first input relative to movement of the second input.

19. The system of claim 17, wherein the corresponding weights are set based at least in part on learned user input information.

20. The system of claim 17, wherein the first input comprises touch input.