Adaptive stylus position interpolation

• US 10,455,115 B2
• Filed: 05/19/2017
• Issued: 10/22/2019
• Est. Priority Date: 05/19/2017
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: Zyskind, Amir, Westhues, Jonathan, Geller, Ilan, Haran, On
• Primary Examiner(s): Edun, Muhammad N
• Application Number:
  US15/599,918
• Publication Number:
  US 20180338065A1
• Time in Patent Office: 886 Days
• CPC Class Codes: G06F 3/03545 Pens or stylus
• CPC Class Codes: G06F 3/0441 using active external devices, e.g. active pens, for receiving changes in electrical potential transmitted by the digitiser, e.g. tablet driving signals
• CPC Class Codes: G06F 3/0442 using active external devices, e.g. active pens, for transmitting changes in electrical potential to be received by the digitiser
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06T 3/10 Selection of transformation methods according to the characteristics of the input images
• CPC Class Codes: G06V 30/1423 the instrument generating sequences of position coordinates corresponding to handwriting preprocessing or recognising digital ink G06V30/32
• CPC Class Codes: G06V 30/347 Sampling; Contour coding; Stroke extraction
• CPC Class Codes: H04N 1/3935 with modification of image resolution, i.e. determining the values of picture elements at new relative positions

Abstract

The presently disclosed technology uses predefined handwriting characteristics to create and/or refine a stylus position interpolation function over time to provide more accurate and adaptive renderings of the user'"'"'s handwriting on a touch screen. As the presently disclosed technology is performed on a specific device and uses data collected from one or more specific users, it adapts the stylus position interpolation function for any device-specific or user-specific variations. Further, as the stylus position interpolation function adapts iteratively over time, it may not converge and continues to adapt as the device ages, the user'"'"'s habits change, or identify of the user changes, and environmental conditions of the device change.

Claims

1. A method for interpolating position with reference to a touch screen comprising:

evaluating a position function to render a user'"'"'s stroke on the touch screen;

detecting one or more anomalies in the rendered stroke;

adapting the position function to change one or more coefficients of the position function and smooth the one or more detected anomalies; and

evaluating the adapted position function to render a subsequent stroke on the touch screen, wherein the detecting, adapting, and evaluating operations are performed in real-time.

2. The method of claim 1 wherein the rendered stroke and the subsequent stroke are that of a stylus.

3. The method of claim 1 wherein the rendered stroke and the subsequent stroke are that of the user'"'"'s finger.

4. The method of claim 1 wherein the one or more anomalies are regularly repeating discontinuities in the user'"'"'s stroke.

5. The method of claim 1 further comprising:

detecting one or more anomalies in the rendered subsequent stroke;

further adapting the position function to smooth the one or more detected anomalies in the rendered subsequent stroke; and

evaluating the further adapted position function to render another subsequent stroke on the touch screen.

6. The method of claim 1 wherein the detecting, adapting, and evaluating operations are performed iteratively.

7. The method of claim 1 further comprising:

comparing the adapted position function to one or more interpolation limits prior to evaluating the adapted position function.

8. The method of claim 1 further comprising:

detecting a region of the touch screen where the user'"'"'s stroke is rendered; and

selecting from a database the position function corresponding to the detected region of the touch screen.

9. The method of claim 1 further comprising:

identifying an application the user is actively using when the user'"'"'s stroke is rendered, wherein the adapting the position function is based on the identified application.

10. A computing system comprising:

a touch screen;

a stylus; and

a stylus position interpolation module configured to;

evaluate a stylus position function to render a user'"'"'s stroke of the stylus on the touch screen;

detect one or more anomalies in the rendered stroke of the stylus;

adapt the stylus position function to change one or more coefficients of the position function and smooth the one or more detected anomalies; and

evaluate the adapted stylus position function to render a subsequent stroke of the stylus on the touch screen, wherein the detecting, adapting, and evaluating operations are performed in real-time.

11. The computing system of claim 10 wherein the one or more anomalies are regularly repeating discontinuities in the user'"'"'s stroke of the stylus.

12. The computing system of claim 10 wherein the stylus position interpolation module is further configured to:

detect one or more anomalies in the rendered subsequent stroke of the stylus;

further adapt the stylus position function to smooth the one or more detected anomalies in the rendered subsequent stroke of the stylus; and

evaluate the further adapted stylus position function to render another subsequent stroke of the stylus on the touch screen.

13. The computing system of claim 10 wherein the detecting, adapting, and evaluating operations are performed iteratively.

14. The computing system of claim 10 wherein the stylus position interpolation module is further configured to:

compare the adapted stylus function to one or more interpolation limits prior to evaluating the adapted stylus position function.

15. The computing system of claim 10 wherein the stylus position interpolation module is further configured to:

detect a region of the touch screen where the user'"'"'s stroke of the stylus is rendered; and

select from a database the stylus position function corresponding to the detected region of the touch screen.

16. The computing system of claim 10 wherein the stylus position interpolation module is further configured to:

identify an application the user is actively using when the user'"'"'s stroke is rendered, wherein the adapting the stylus position function is based on the identified application.

17. One or more tangible processor-readable storage media embodied with instructions for executing on one or more processors and circuits of a device a process comprising:

evaluating a stylus position function to render a user'"'"'s stroke of a stylus on a touch screen;

detecting one or more anomalies in the rendered stroke of the stylus;

adapting the stylus position function to change one or more coefficients of the position function and smooth the one or more detected anomalies; and

evaluating the adapted stylus position function to render a subsequent stroke of the stylus on the touch screen, wherein the detecting, adapting, and evaluating operations are performed in real-time.

18. The one or more tangible processor-readable storage media of claim 17, wherein the process further comprises:

detecting one or more anomalies in the rendered subsequent stroke of the stylus;

further adapting the stylus position function to smooth the one or more detected anomalies in the rendered subsequent stroke of the stylus; and

evaluating the further adapted stylus position function to render another subsequent stroke of the stylus on the touch screen.