Multi-feature interactive touch user interface

• US 8,587,532 B2
• Filed: 12/18/2009
• Issued: 11/19/2013
• Est. Priority Date: 12/18/2009
• Status: Active Grant

• Current Assignee: Intel Corporation
• Original Assignee: Intel Corporation
• Inventors: Adamson, Peter S., Bateman, Steven S., Graumann, David L., Sharma, Sangita
• Primary Examiner(s): GIESY, ADAM
• Application Number:
  US12/641,585
• Publication Number:
  US 20110148770A1
• Time in Patent Office: 1,432 Days
• Field of Search: None
• US Class Current: 345/173
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text

Abstract

Briefly, a feature rich touch subsystem is disclosed. The feature rich touch subsystem includes one or more novel user input capabilities that enhance the user experience.

Claims

1. A method comprising:

receiving user input with a touch panel interface;

recognizing a complex touch pattern in the user input wherein the complex touch pattern includes one or more touches in a rest state;

filtering to remove the one or more touches in the rest state;

determining respective intensity values associated with respective touches in the complex touch pattern; and

determining, based at least in part on the respective intensity values, one or more hover instances in the complex touch pattern.

2. An apparatus comprising:

a feature rich touch subsystem including a touch panel for receiving user input in the form of a complex touch pattern;

a processing unit to recognize the complex touch pattern and perform an action associated with the complex touch pattern, wherein the complex touch pattern comprises movement of one or more touches across a location on a keyboard, and wherein the action is one of executing a system action, adding expressive features to text, and filtering to remove resting interactions; and

an intensity change threshold unit to determine, based at least in part on respective intensity values associated with respective touches in the complex touch pattern, one or more hover instances in the complex touch pattern.

3. The apparatus as recited in claim 2, further comprising:

a shape classifier to classify the complex touch pattern into one or more identifiable touch instances including one of a finger, a heel and a thumb touch instance.

4. The apparatus as recited in claim 2, further comprising:

a normalization unit to normalize the complex touch pattern; and

a pattern comparison unit to compare the complex touch pattern to known patterns.

5. The apparatus as recited in claim 4, further comprising:

a feature extraction unit shape classifier to identify a region of touches, track changes in the region over a period of time, extract shape and location features of the changes in the region, and create a time series of the extracted features.

6. The apparatus as recited in claim 5, further comprising:

a keyboard grid displayed on the touch panel, the complex touch pattern including a stream of key strikes and the movement of one or more touches across the location on the keyboard grid; and

an attributes generator to assign attributes to the stream of key strikes, wherein the attributes comprise one or more of a font size, font thickness, font color, font style, start of animation, end of animation, line offset positions and a font motion path.

7. The apparatus as recited in claim 2, further comprising:

a shape classifier to distinguish finger from non-finger typing in the complex touch pattern;

a proximity clustering unit to analyze the complex touch pattern to identify proximity clustering to avoid transient panel reading from being identified as finger typing;

a touch duration threshold unit to identify long panel interactions as resting interactions;

an intensity change threshold unit to monitor intensity of the complex touch pattern to identify hover instances;

a measurement unit to measure movement of the complex touch pattern; and

decision logic to assign keystroke and rest contact types to the complex touch pattern.

8. The apparatus as recited in claim 2, wherein to recognize the complex touch pattern when the touch pattern is a temporal tapping pattern, the processing unit is configured to:

recognize a pattern initiation shape;

establish a persistent region;

tally and time touch up and touch down instances into the temporal tapping pattern;

identify a pattern timeout in a touch up instance;

normalize a duration of the temporal tapping pattern;

compare the temporal tapping pattern to known patterns; and

if the temporal tapping pattern is recognized as a known pattern, perform the action associated to the known pattern.

9. The apparatus as recited in claim 2, wherein to recognize the complex touch pattern when the complex touch pattern is multi-shape, multi-touch gesture including finger and non-finger touches, the processing unit is configured to:

identify a region of touches;

track changes in the region over a period of time;

extract shape and location features of the changes in the region;

create a time series of the extracted features;

normalize the features; and

match the normalized features to known patterns.

10. The apparatus as recited in claim 2, wherein to recognize the complex touch pattern when the complex touch pattern is movement of one or more touches across a location on a keyboard, the processing unit is configured to:

record a series of touch instances including taps and sweeping movements on a touch panel with a keyboard grid;

classify recorded shapes into finger, thumb, and heel shapes;

further classify the recorded shapes according to one or more of a keyboard key, path attributes, intensity attribute, directional attribute and location attribute;

generate a final attribute classification that defines attributes to be assigned to typed text; and

apply the final attributes to the typed text.

11. The apparatus as recited in claim 2, wherein to recognize the complex pattern when the action is filtering to remove resting interactions, the processing unit is configured to:

receive a series of touch instances as shapes on a touch panel displaying a keyboard;

classify the shapes distinguish finger from non-finger typing;

analyze the shapes to identify proximity clustering to avoid transient panel reading from being identified as finger typing;

identify long panel interactions as resting interactions;

monitor intensity of the series of touch instances to identify hover instances;

measure movement of the touch instances; and

assign keystroke and rest contact types to the shapes.

12. The apparatus as recited in claim 2, wherein executing a system action comprises executing a complex action which otherwise would require one of multiple user steps, a short cut action, and a macro function to execute.

13. An apparatus comprising:

a feature rich touch subsystem including a touch panel for receiving user input in the form of a complex touch pattern;

a processing unit to recognize the complex touch pattern and perform an action associated with the complex touch pattern, wherein the complex touch pattern comprises movement of one or more touches across a location on a keyboard, and wherein the action is one of executing a system action, adding expressive features to text, and filtering to remove resting interactions;

a shape classifier to distinguish finger from non-finger typing in the complex touch pattern;

a proximity clustering unit to analyze the complex touch pattern to identify proximity clustering to avoid transient panel reading from being identified as finger typing;

a touch duration threshold unit to identify long panel interactions as resting interactions;

an intensity change threshold unit to monitor intensity of the complex touch pattern to identify hover instances;

a measurement unit to measure movement of the complex touch pattern; and

decision logic to assign keystroke and rest contact types to the complex touch pattern.