PREDICTIVE INTERFACES WITH USABILITY CONSTRAINTS

• US 20100315266A1
• Filed: 06/15/2009
• Published: 12/16/2010
• Est. Priority Date: 06/15/2009
• Status: Abandoned Application

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Paek, Timothy S., Meek, Christopher A., Gunawardana, Asela J.
• Application Number:
  US12/484,532
• Publication Number:
  US 20100315266A1
• Time in Patent Office: Days
• US Class Current: 341/22
• CPC Class Codes: G06F 3/0237 using prediction or retrieval techniques
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus

Abstract

A “Constrained Predictive Interface” uses predictive constraints to improve accuracy in user interfaces such as soft keyboards, pen interfaces, multi-touch interfaces, 3D gesture interfaces, EMG based interfaces, etc. In various embodiments, the Constrained Predictive Interface allows users to take any desired action at any time by taking into account a likelihood of possible user actions in different contexts to determine intended user actions. For example, to enable a virtual keyboard interface, various embodiments of the Constrained Predictive Interface provide key “sweet spots” as predictive constraints that allow the user to select particular keys regardless of any probability associated with the selected or neighboring keys. In further embodiments, the Constrained Predictive Interface provides hit target resizing via various piecewise constant touch models in combination with various predictive constraints. In general, hit target resizing provides dynamic real-time virtual resizing of one or more particular keys based on various probabilistic criteria.

Claims

1. A computer-readable medium having computer executable instructions stored therein for implementing a predictive user interface, said instructions comprising:

a program module for receiving one or more user inputs from a user interface device;

a program module for probabilistically evaluating each user input to determine an intended user action corresponding to each user input as a probabilistic function of a current probabilistic user input context;

wherein the program module for probabilistically evaluating each user input comprises a source-channel model having one or more predictive constraints on the source-channel model;

wherein the predictive constraints limit the source-channel model by forcing specific user actions regardless of the current user input context when conditions corresponding to specific predictive constraints are met by the received user input; and

a program module for outputting the intended user action.

2. The computer-readable medium of claim 1 wherein the user input device is a soft keyboard.

3. The computer-readable medium of claim 2 wherein the soft keyboard is rendered on a touch-screen device.

4. The computer-readable medium of claim 2 wherein the predictive constraints comprise a “

sweet spot”

for one or more keys of the soft keyboard, each sweet spot being defined by a physical region within each corresponding key that causes the source-channel model to return that key, regardless of the current probabilistic user input context.

5. The computer-readable medium of claim 4 further comprising a program module for resizing hit targets for keys of the soft keyboard.

6. The computer-readable medium of claim 5 wherein the hit targets are defined using a “

piecewise constant touch model”

comprising one or more nested regions of hit targets for each key surrounding the sweet spot of each corresponding key.

7. The computer-readable medium of claim 5 wherein hit targets are defined using a “

piecewise constant approximable touch model”

comprising a series of one or more nested regions of hit targets for each key surrounding the sweet spot of each corresponding key.

8. The computer-readable medium of claim 1 further comprising a context weight that is automatically adjusted as a function of observed user input behaviors for limiting probabilistic influence of any component of the source-channel model.

9. The computer-readable medium of claim 1 further comprising the use of a “

neutral source model”

when a context weight on any component of the source-channel model is set to a value that reduces a predictive influence of a source model component of the source-channel model to a negligible level, and wherein the neutral source model ensures that user inputs correspond to expected user input boundaries.

10. The computer-readable medium of claim 1 wherein the user input device is a handwriting input device, and wherein the program module for probabilistically evaluating each user input determines intended user actions by recognizing specific handwritten characters corresponding user handwriting inputs.

11. The computer-readable medium of claim 1 wherein the user input device is a gesture input device, and wherein the program module for probabilistically evaluating each user input determines intended user actions by recognizing specific user gestures as inputs corresponding to the intended user actions.

12. The computer-readable medium of claim 1 wherein the user input device is a myoelectric signal capture device worn by the user, and wherein the program module for probabilistically evaluating each user input determines intended user actions by recognizing specific myoelectric signals as corresponding to the intended user actions.

13. A predictive user interface, comprising:

a user input device for receiving one or more user inputs;

a probabilistic source-channel model of the user input device;

a set of one or more predictive constraints for limiting a probabilistic influence of the source-channel model;

wherein the user inputs are evaluated by the source-channel model as limited by the predictive constraints to determine an intended user action corresponding to each user input; and

outputting each intended user action.

14. The predictive user interface of claim 13 wherein the predictive constraints limit the source-channel model by forcing specific user actions regardless of a current user input context when conditions corresponding to specific predictive constraints are met by the received user input.

15. The predictive user interface of claim 13 wherein the user input device is a virtual keyboard.

16. The predictive user interface of claim 15 wherein the predictive constraints comprise a “

sweet spot”

for each key of the soft keyboard, each sweet spot being defined by a physical region within each corresponding key that causes the source-channel model to return that key, regardless of any probabilistic user input context associated with the source-channel model.

17. The predictive user interface of claim 16 wherein variably sized hit targets for keys of the soft keyboard are defined using a probabilistic “

piecewise constant touch model”

comprising one or more nested regions of hit targets for each key surrounding the sweet spot of each corresponding key.

18. A system for receiving a user input for use in a computing device, comprising:

a user input device for receiving a user input;

a probabilistic source-channel model of the user input device;

a set of one or more predictive constraints for limiting a probabilistic influence of a channel model portion of the source-channel model;

a device for using the source-channel model to probabilistically evaluate the received user input to determine an intended user action corresponding to each user input as a probabilistic function of a current probabilistic user input context,

wherein the probabilistic evaluation of the received user input via the source-channel model is limited by one or more of the predictive constraints to force specific user actions regardless of the current user input context when conditions corresponding to specific predictive constraints are met by the received user input;

a device for applying an adjustable context weight for limiting probabilistic influence of any component of the source-channel model.

a device for outputting the intended user action.

19. The system of claim 18 wherein the user input device is a soft keyboard rendered on a touch-screen device, each rendered key of the soft keyboard having a resizable hit target representing a physical region in proximity to each key which enables either the corresponding key or a neighboring key to be selected based on the probabilistic evaluation of the received user input.

20. The system of claim 19 wherein the predictive constraints comprise a “

sweet spot”

for each key of the soft keyboard, each sweet spot being defined by a physical region within the boundaries of the hit targets corresponding to each rendered key of the soft keyboard that causes the source-channel model to return that key, regardless of the probabilistic evaluation of the received user input.