Multimodal Touchscreen Interaction Apparatuses, Methods and Systems

• US 20120274583A1
• Filed: 02/08/2012
• Published: 11/01/2012
• Est. Priority Date: 02/08/2011
• Status: Abandoned Application

• Current Assignee: Haworth Incorporated
• Original Assignee: Haworth Incorporated
• Inventors: Haggerty, Ammon
• Application Number:
  US13/369,137
• Publication Number:
  US 20120274583A1
• Time in Patent Office: Days
• US Class Current: 345/173
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures

Abstract

The MULTIMODAL TOUCHSCREEN INTERACTION APPARATUSES, METHODS AND SYSTEMS (“MTI”) transform multi-user, multi-modal touchscreen input gestures via MTI components into user-customized computation result displays. In one implementation, the MTI obtains, from a touchscreen sensor, a sensor signal including information on a user touch event on a touchscreen. The MTI determines location coordinates of the user touch event from the sensor signal. The MTI identifies a touch type of the user touch event from the sensor signal, and determines a user touchscreen gesture using the touch type of the user touch event. The MTI queries a memory for a user command associated with the user touchscreen gesture, and executing the user command via a processor.

Claims

1. A multimodal touchscreen interaction processor-implemented method, comprising:

obtaining, from a touchscreen sensor, a sensor signal including information on a user touch event on a touchscreen;

determining, via a processor, location coordinates of the user touch event from the sensor signal;

identifying a touch type of the user touch event from the sensor signal; and

determining, via the processor, a user touchscreen gesture using the touch type of the user touch event.

2. The method of claim 1, further comprising:

querying a memory for a user command associated with the user touchscreen gesture; and

executing, via the processor the user command.

3. The method of claim 2, further comprising:

querying a memory for a prior user touch event within a predetermined time window; and

identifying a gesture pattern using the prior user touch event and the user touchscreen gesture.

4. The method of claim 3, wherein the query for the user command associated with the user touchscreen gesture is based on the identified gesture pattern.

5. The method of claim 2, further comprising:

identifying a modification to the user command associated with the user touchscreen gesture, based on the identified touch type of the user touch event; and

wherein executing, via the processor the user command is based on the modification to the user command based on the identified touch type.

6. The method of claim 1, wherein the user touch event includes a finger touch and a stylus touch.

7. The method of claim 6, wherein the user touch event includes a multiple-finger touch and a stylus touch.

8. A multimodal touchscreen interaction system, comprising:

a processor; and

a memory disposed in communication with the processor and storing processor-issuable instructions to;

obtain, from a touchscreen sensor, a sensor signal including information on a user touch event on a touchscreen;

determine, via the processor, location coordinates of the user touch event from the sensor signal;

identify a touch type of the user touch event from the sensor signal; and

determine, via the processor, a user touchscreen gesture using the touch type of the user touch event.

9. The system of claim 8, the memory further storing instructions to:

query a memory for a user command associated with the user touchscreen gesture; and

execute, via the processor the user command.

10. The system of claim 9, the memory further storing instructions to:

query a memory for a prior user touch event within a predetermined time window; and

identify a gesture pattern using the prior user touch event and the user touchscreen gesture.

11. The system of claim 10, wherein the query for the user command associated with the user touchscreen gesture is based on the identified gesture pattern.

12. The system of claim 9, the memory further storing instructions to:

identify a modification to the user command associated with the user touchscreen gesture, based on the identified touch type of the user touch event; and

wherein executing, via the processor the user command is based on the modification to the user command based on the identified touch type.

13. The system of claim 8, wherein the user touch event includes a finger touch and a stylus touch.

14. The system of claim 13, wherein the user touch event includes a multiple-finger touch and a stylus touch.

15. A processor-readable tangible medium storing processor-issuable multimodal touchscreen interaction instructions to:

obtain, from a touchscreen sensor, a sensor signal including information on a user touch event on a touchscreen;

determine, via the processor, location coordinates of the user touch event from the sensor signal;

identify a touch type of the user touch event from the sensor signal; and

determine, via the processor, a user touchscreen gesture using the touch type of the user touch event.

16. The medium of claim 15, further storing instructions to:

query a memory for a user command associated with the user touchscreen gesture; and

execute, via the processor the user command.

17. The medium of claim 16, further storing instructions to:

query a memory for a prior user touch event within a predetermined time window; and

identify a gesture pattern using the prior user touch event and the user touchscreen gesture.

18. The medium of claim 17, wherein the query for the user command associated with the user touchscreen gesture is based on the identified gesture pattern.

19. The medium of claim 16, further storing instructions to:

identify a modification to the user command associated with the user touchscreen gesture, based on the identified touch type of the user touch event; and

wherein executing, via the processor the user command is based on the modification to the user command based on the identified touch type.

20. The medium of claim 15, wherein the user touch event includes a finger touch and a stylus touch.

21. The medium of claim 20, wherein the user touch event includes a multiple-finger touch and a stylus touch.