PREDICTIVE COMPENSATION FOR A LATENCY OF AN INPUT DEVICE

• US 20130181908A1
• Filed: 01/13/2012
• Published: 07/18/2013
• Est. Priority Date: 01/13/2012
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Santiago, Pravin K., Kaneko, Masahiko, Leti, Nikola, Olsen, Thomas W., Li, Ruoyang
• Granted Patent: US 10,452,188 B2
• Time in Patent Office: Days
• US Class Current: 345/173
• CPC Class Codes: G06F 3/0416 Control or interface arrangements specially adapted for digitisers
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures

Abstract

A computer configured to selectively use prediction to compensate for a latency of an input device. The input device may be a touch screen. Processing of touch inputs may lead to a latency between the user performing a touch input and the touch screen display responding to the touch input. A touch screen component predicts a subsequent position of a touch contact point based on the sensed positions of the touch contact point. The component may be a software component that provides a predictive output that can be selectively used based on a characteristic of a touch input. The component may be generic such that it may be applied on multiple types of computers equipped with different types of touch sensing hardware configured with any suitable settings. The component'"'"'s output may be used to control the touch screen display.

Claims

1. A method of predictively compensating for a latency associated with a touch screen of a computer, the method comprising:

predicting a plurality of predicted positions of a touch, based at least in part on a plurality of sensed positions of the touch, the plurality of sensed positions sensed by the touch screen;

selecting the plurality of predicted positions or the plurality of sensed positions based on a characteristic of the touch; and

controlling a display of the computer based on the selected plurality of positions.

2. The method of claim 1, wherein the selecting is performed by at least one of a touch processing component associated with the touch screen or an application.

3. The method of claim 1, wherein selecting the plurality of predicted positions or the plurality of sensed positions based on the characteristic of the touch comprises selecting based on at least one of a number of contact points of the touch, a duration of the touch, a location of the touch, a movement of the touch, or a command associated with the touch.

4. The method of claim 1, wherein selecting the plurality of predicted positions or the plurality of sensed positions based on the characteristic of the touch comprises selecting the plurality of predicted positions when the touch is associated with a pan command.

5. The method of claim 1, wherein predicting the plurality of predicted positions comprises:

calculating a plurality of prediction parameters, and

calculating, based at least in part on the plurality of prediction parameters, a predicted position of the touch at a time subsequent to a plurality of times associated with the plurality of sensed positions.

6. The method of claim 5, wherein calculating the plurality of prediction parameters comprises calculating at least one of a plurality of trajectory parameters associated with the plurality of sensed positions, a smoothing parameter, a limit on the predicted position of the touch, and a plurality of parameters associated with an adaptive filter.

7. The method of claim 5, wherein calculating the predicted position of the touch comprises:

calculating a plurality of predicted changes in position of the touch;

smoothing the plurality of predicted changes in position of the touch; and

calculating a candidate predicted position of the touch by combining the plurality of predicted changes in position of the touch with a base position of the touch.

8. The method of claim 7, wherein the candidate predicted position of the touch is the predicted position of the touch.

9. The method of claim 7, wherein:

calculating the predicted position of the touch further comprises selecting, as the predicted position of the touch, one of the candidate predicted position of the touch and a prior predicted position of the touch,

the prior predicted position of the touch is associated with a time prior to the time associated with the candidate predicted position, and

the selecting of the predicted position of the touch is based on a direction of movement associated with the plurality of sensed positions and on a direction of movement between the prior predicted position and the candidate predicted position.

10. An apparatus for predictively compensating for a latency associated with a touch screen of a computer, the computer including a touch sensing unit, a display, and a controller of the display, the touch sensing unit configured to sense a touch of the touch screen and to provide a plurality of sensed positions of the touch, the display controller configured to control the display based on a selected plurality of positions, the apparatus comprising:

a processing unit; and

a memory storing instructions which, when executed by the processing unit, cause the apparatus to perform a method of;

predicting, by a touch processing component, a plurality of predicted positions of the touch, based at least in part on the plurality of sensed positions received from the touch sensing unit,

making a selection, by the touch processing component, between the plurality of predicted positions or the plurality of sensed positions 208 based on a characteristic of the touch, and

controlling the display based on the selected plurality of positions received by the display controller.

11. The apparatus of claim 10, further comprising providing, by the touch processing component, the plurality of predicted positions, the plurality of sensed positions, and an indication of the selection, to a software component.

12. The apparatus of claim 11, further comprising the software component selecting the plurality of predicted positions or the plurality of sensed positions as the selected plurality of positions.

13. The method of claim 10, wherein predicting the plurality of predicted positions comprises:

calculating a plurality of prediction parameters based on at least one of a characteristic of the touch sensing unit or a characteristic of the touch, and

calculating, based at least in part on the plurality of prediction parameters, a predicted position of the touch at a time subsequent to a plurality of times associated with the plurality of sensed positions.

14. The method of claim 13, wherein calculating the plurality of prediction parameters comprises calculating at least one of a velocity of the touch, an acceleration of the touch, a maximum acceleration of the touch, or a smoothing parameter, based on the plurality of sensed positions and on a latency associated with the touch sensing unit.

15. The method of claim 13, wherein calculating the plurality of prediction parameters comprises calculating a limit on the predicted position of the touch based on the plurality of sensed positions, a latency associated with the touch sensing unit, and a sample time associated with the touch sensing unit.

16. The method of claim 13, wherein calculating the plurality of prediction parameters comprises calculating a plurality of parameters associated with an adaptive filter based on the plurality of sensed positions and the plurality of predicted positions.

17. A method of predictively compensating for a latency associated with an input device of a computer, the computer including an input sensing unit, an output device, and a controller of the output device, the input sensing unit configured to sense input and to provide a plurality of sensed inputs, the output device controller configured to control the output device based on a selected plurality of inputs, the method comprising:

obtaining a plurality of parameters of the input sensing unit;

calculating a plurality of prediction parameters of an input processing component based on the plurality of parameters of the input sensing unit and on the plurality of sensed inputs;

obtaining additional data associated with the input;

adapting the plurality of prediction parameters based on the additional data associated with the input; and

predicting a plurality of predicted inputs, based on the plurality of prediction parameters and on the plurality of sensed inputs.

18. The method of claim 17, wherein obtaining a plurality of parameters of the input sensing unit comprises:

receiving a latency associated with the input sensing unit; and

sensing a sample time associated with the input sensing unit.

19. The method of claim 17, wherein the additional data associated with the input comprises a second plurality of sensed inputs.

20. The method of claim 17, wherein the plurality of predicted inputs 210 accounts for a latency associated with the input device.