MULTI-FEATURE INTERACTIVE TOUCH USER INTERFACE

• US 20110148770A1
• Filed: 12/18/2009
• Published: 06/23/2011
• Est. Priority Date: 12/18/2009
• Status: Active Grant

• Current Assignee: Intel Corporation
• Original Assignee: Intel Corporation
• Inventors: Sharma, Sangita, Adamson, Peter S., Graumann, David L., Bateman, Steven S.
• Granted Patent: US 8,587,532 B2
• Time in Patent Office: Days
• US Class Current: 345/173
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text

Abstract

Briefly, a feature rich touch subsystem is disclosed. The feature rich touch subsystem includes one or more novel user input capabilities that enhance the user experience.

Claims

1. A method comprising:

receiving user input with a touch panel interface;

recognizing a complex touch pattern in the user input; and

performing an action associated with the complex touch pattern;

wherein the complex touch pattern is one of a temporal tapping pattern, a multi-shape, multi-touch gesture including finger and non-finger touches, movement of one or more touches across a location on a keyboard, and a series of touches with varying intensity or angle of descending;

wherein the action is one of executing a system action, adding expressive features to text, and filtering to remove resting interactions.

2. The method as recited in claim 1, wherein recognizing the complex touch pattern when the touch pattern is a temporal tapping pattern comprises:

recognizing a pattern initiation shape;

establishing a persistent region;

tallying and timing touch up and touch down instances into the temporal tapping pattern;

identifying a pattern timeout in a touch up instance;

normalizing a duration of the temporal tapping pattern;

comparing the temporal tapping pattern to known patterns; and

if the temporal tapping pattern is recognized as a known pattern, performing the action associated to the known pattern.

3. The method as recited in claim 1, wherein recognizing the complex touch pattern when the complex touch pattern is multi-shape, multi-touch gesture including finger and non-finger touches comprises:

identifying a region of touches;

tracking changes in the region over a period of time;

extracting shape and location features of the changes in the region;

creating a time series of the extracted features;

normalizing the features; and

matching the normalized features to know patterns.

4. The method as recited in claim 1, wherein recognizing the complex touch pattern when the complex touch pattern is movement of one or more touches across a location on a keyboard comprises:

recording a series of touch instances including taps and sweeping movements on a touch panel with a keyboard grid;

classifying recorded shapes into finger, thumb, and heel shapes;

further classifying the recorded shapes according to one or more of a keyboard key, path attributes, intensity attribute, directional attribute and location attribute;

generating a final attribute classification that defines attributes to be assigned to typed text; and

applying the final attributes to the typed text.

5. The method as recited in claim 1, wherein recognizing the complex pattern when the action is filtering to remove resting interactions comprises:

receiving a series of touch instances as shapes on a touch panel displaying a keyboard;

classifying the shapes distinguish finger from non-finger typing;

analyzing the shapes to identify proximity clustering to avoid transient panel reading from being identified as finger typing;

identifying long panel interactions as resting interactions;

monitoring intensity of the series of touch instances to identify hover instances;

measuring movement of the touch instances; and

assigning keystroke and rest contact types to the shapes.

6. The method as recited in claim 1, wherein executing a system action comprises executing a complex action which otherwise would require one of multiple user steps, a short cut action, and a macro function to execute.

7. A method comprising:

receiving user input with a touch panel interface;

recognizing a temporal tapping pattern in the user input; and

performing an action associated with the temporal tapping pattern.

8. A method comprising:

receiving user input with a touch panel interface;

recognizing a multi-shape, multi-touch gesture including finger and non-finger touches in the user input; and

performing an action associated with the multi-shape, multi-touch gesture.

9. A method comprising:

comprising;

receiving user input with a touch panel interface;

recognizing a series of touches with varying intensity or angle of descending in the user input; and

performing an action associated with the series of touches.

10. A method comprising:

receiving user input with a touch panel interface;

recognizing a complex touch pattern in the user input wherein the complex touch pattern includes one or more touches in a rest state; and

filtering to remove the one or more touches in the rest state.

11. An apparatus comprising:

a feature rich touch subsystem including a touch panel for receiving user input in the form of a complex touch pattern; and

a processing unit to recognize the complex touch pattern and perform an action associated with the complex touch pattern;

wherein the complex touch pattern is one of a temporal tapping pattern, a multi-shape, multi-touch gesture including finger and non-finger touches, movement of one or more touches across a location on a keyboard, a series of touches with varying intensity or angle of descending;

wherein the action is one of executing a system action, adding expressive features to text, and filtering to remove resting interactions.

12. The apparatus as recited in claim 11, further comprising:

a shape classifier to classify the complex touch pattern into one or more identifiable touch instances including one of a finger, a heel and a thumb touch instance.

13. The apparatus as recited in claim 11, further comprising:

a normalization unit to normalize the complex touch pattern; and

a pattern comparison unit to compare the complex touch pattern to known patterns.

14. The apparatus as recited in claim 13, further comprising:

a feature extraction unit shape classifier to identify a region of touches, track changes in the region over a period of time, extract shape and location features of the changes in the region, and create a time series of the extracted features.

15. The apparatus as recited in claim 14, further comprising:

a keyboard grid displayed on the touch panel, the complex touch pattern including a stream of key strikes and the movement of one or more touches across the location on the keyboard grid; and

an attributes generator to assign attributes to the stream of key strikes, wherein the attributes comprise one or more of a font size, font thickness, font color, font style, start of animation, end of animation, line offset positions and a font motion path.

16. The apparatus as recited in claim 11, further comprising:

a shape classifier to distinguish finger from non-finger typing in the complex touch pattern;

a proximity clustering unit to analyze the complex touch pattern to identify proximity clustering to avoid transient panel reading from being identified as finger typing;

a touch duration threshold unit to identify long panel interactions as resting interactions;

an intensity change threshold unit to monitor intensity of the complex touch pattern to identify hover instances;

a measurement unit to measure movement of the complex touch pattern; and

decision logic to assign keystroke and rest contact types to the complex touch pattern.

17. The apparatus as recited in claim 11, wherein to recognize the complex touch pattern when the touch pattern is a temporal tapping pattern, the processing unit is configured to:

recognize a pattern initiation shape;

establish a persistent region;

tally and time touch up and touch down instances into the temporal tapping pattern;

identify a pattern timeout in a touch up instance;

normalize a duration of the temporal tapping pattern;

compare the temporal tapping pattern to known patterns; and

if the temporal tapping pattern is recognized as a known pattern, perform the action associated to the known pattern.

18. The apparatus as recited in claim 11, wherein to recognize the complex touch pattern when the complex touch pattern is multi-shape, multi-touch gesture including finger and non-finger touches, the processing unit is configured to:

identify a region of touches;

track changes in the region over a period of time;

extract shape and location features of the changes in the region;

create a time series of the extracted features;

normalize the features; and

match the normalized features to know patterns.

19. The apparatus as recited in claim 11, wherein to recognize the complex touch pattern when the complex touch pattern is movement of one or more touches across a location on a keyboard, the processing unit is configured to:

record a series of touch instances including taps and sweeping movements on a touch panel with a keyboard grid;

classify recorded shapes into finger, thumb, and heel shapes;

further classify the recorded shapes according to one or more of a keyboard key, path attributes, intensity attribute, directional attribute and location attribute;

generate a final attribute classification that defines attributes to be assigned to typed text; and

apply the final attributes to the typed text.

20. The apparatus as recited in claim 11, wherein to recognize the complex pattern when the action is filtering to remove resting interactions, the processing unit is configured to:

receive a series of touch instances as shapes on a touch panel displaying a keyboard;

classify the shapes distinguish finger from non-finger typing;

analyze the shapes to identify proximity clustering to avoid transient panel reading from being identified as finger typing;

identify long panel interactions as resting interactions;

monitor intensity of the series of touch instances to identify hover instances;

measure movement of the touch instances; and

assign keystroke and rest contact types to the shapes.

21. The apparatus as recited in claim 11, wherein executing a system action comprises executing a complex action which otherwise would require one of multiple user steps, a short cut action, and a macro function to execute.