Semantic Gesture Processing Device and Method Providing Novel User Interface Experience

• US 20140282283A1
• Filed: 03/15/2014
• Published: 09/18/2014
• Est. Priority Date: 03/15/2013
• Status: Abandoned Application

• Current Assignee: Caesar Ian Glebocki
• Original Assignee: Caesar Ian Glebocki
• Inventors: Glebocki, Caesar Ian
• Application Number:
  US14/214,718
• Publication Number:
  US 20140282283A1
• Time in Patent Office: Days
• US Class Current: 715/863
• CPC Class Codes: G06F 2203/04101 2.5D-digitiser, i.e. digitiser detecting the X/Y position of the input means, finger or stylus, also when it does not touch, but is proximate to the digitiser's interaction surface and also measures the distance of the input means within a short range in the Z direction, possibly with a separate measurement setup
• CPC Class Codes: G06F 3/044 by capacitive means
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text

Abstract

A method for semantic processing of gestures on a user interface, a method for semantic processing of gestures on a user interface using remote resources, and a device incorporating the method as a novel user interface paradigm. User gestural input is sampled, analyzed, and interpreted while input is still occurring, and a change in user intent effects an action.

Claims

1. :

A method for semantic processing of gestures on a user interface comprising;

receiving an instruction on a user interface;

identifying a position of the received instruction on the user interface;

correlating the identified position to a content area, the content area including content area information and content area metadata associated therewith;

registering additional instructions at the identified position of the received instruction on the user interface;

transforming the registered additional instructions to a semantic instruction, the semantic instruction comprising a semantic interpretation of the registered additional instructions, the semantic interpretation being based on at least one or more of the following data;

registration times of the registered additional instructions, the content area, content area information, content area metadata, and a duration of the registered additional instructions;

executing a set of actions as a function of the semantic instruction; and

providing a result in response to the executed set of actions.

2. :

The method according to claim 1, wherein identifying comprises identifying the position of the received instruction on a display.

3. :

The method according to claim 1, wherein transforming comprises collecting information relating to at least one of the following from a remote information source;

the registered additional instructions and the received instructions.

4. :

The method according to claim 1, wherein identifying comprises identifying the position of the received instruction according to at least two scalar values corresponding to dimensional axes in Euclidean space.

5. :

The method according to claim 4, wherein the position of the received instruction further comprises at least one vector value corresponding to at least one of the following;

a change in position, a change in velocity, and a force.

6. :

The method according to claim 1, wherein providing a result further comprises;

correlating the additional received instructions and the generated semantic instructions in a database; and

generating numerical weights for the registered additional instructions based on one or more of the following;

a frequency of occurrence, a numerical average of substantially all occurrences, a maximum numerical occurrence, a minimum numerical occurrence, and one or more statistical deviation from the numerical average of substantially all occurrences.

7. :

The method according to claim 6, wherein transforming the registered additional instructions into the semantic instruction further comprises;

increasing error tolerance by mathematically weighting the data of the registered additional instructions based on the numerical weights for registered additional instructions.

8. :

The method according to claim 1, wherein receiving the instruction on a user interface comprises reading the position of a touch on a touch surface or a touch screen display.

9. :

The method according to claim 1, wherein receiving an instruction on a user interface comprises reading a position of a finger of a user above or on a surface or a display.

10. :

A system for semantic processing of gestures on a user interface comprising;

a surface or a display for receiving an instruction from a user;

a user interface for identifying a position of the received instruction on the surface or the display;

a memory for storing data relating to one or more content areas;

the user interface rendering the one or more content areas on the surface or the display;

a processor configured for correlating the identified position to the one or more content areas, the one or more content areas including content area information and content area metadata associated therewith;

the user interface registering additional instructions at the identified position of the received instruction on the user interface;

the processor being configured for transforming the registered additional instructions to a semantic instruction, the semantic instruction comprising an interpretation of the registered additional instructions based on at least one or more of the following factors;

registration times of the registered additional instructions, the content area, the content area information and content area metadata, and a duration of the registered additional instructions;

wherein the processor executes a set of actions as a function of the semantic instruction; and

wherein the user interface provides a result in response to the executed set of actions on the surface or the display.

11. :

The system of claim 10, wherein the surface or the display, the user interface, the memory and the processor comprise a hand-held device.

12. :

The system of claim 10, wherein the surface or the display comprises a capacitive touch surface or a screen overlay.

13. :

A device configured to process gestures on a user interface comprising;

a surface or a display for receiving an instruction from the user;

a user interface for identifying the position of a received instruction on the surface or the display;

a memory for storing data relating to one or more content areas;

the user interface rendering the one or more content areas on the surface or the display;

a processor configured for correlating the identified position to the one or more content areas;

the one or more content areas including content area information and content area metadata associated therewith;

the user interface registering additional instructions at the identified position of the received instruction on the user interface;

the processor being configured for transforming the registered additional instructions to a semantic instruction, the semantic instruction comprising an interpretation of the registered additional instructions based on at least one or more of the following factors;

registration times of the registered additional instructions, the content area, the content area information and content area metadata, and a duration of the registered additional instructions;

wherein the processor executes a set of actions as a function of the semantic instruction; and

wherein the user interface provides a result in response to the executed set of actions on the surface or the display.

14. :

The device of claim 13, further comprising;

at least one network interface configured to communicate with a remote processor;

the remote processor being configured for transforming the registered additional instructions to a semantic instruction, the semantic instruction comprising an interpretation of the registered additional instructions based on at least one or more of the following factors;

registration times of the registered additional instructions, the content area, the content area information and content area metadata, and a duration of the registered additional instructions; and

the network interface being configured to receive a semantic instruction from the remote processor for execution on the processor on the device.

15. :

The device of claim 13 further comprising;

a three-dimensional content area;

the three-dimensional content area being displayable as a two-dimensional projection on a flat display;

the three-dimensional content area being displayable as two stereoscopic projections on a flat display;

correlating the position of a received instruction to the three-dimensional content area comprises;

sampling a position from two perpendicular axes coplanar with the display and correlating the position with one or more of the following;

a third sampled axis normal to the display, a pressure, a velocity, an acceleration, a force, content area information, content area metadata, temporal parameters, and registered additional instructions.

16. :

A networked system for semantic processing of gestures on a user interface comprising;

a network interface configured to communicate with a remote client;

the remote client having a remote display, a remote user interface, a remote processor, and a remote memory;

the network interface being configured to receive encoded instructions;

the encoded instructions comprising one or more received instructions at the remote display;

a memory for storing data related to one or more content areas;

a processor being configured for decoding the encoded instructions to produce registered instructions;

the processor being configured for transforming the registered instructions to a semantic instruction, the semantic instruction comprising an interpretation of the registered instructions based on at least one or more of the following factors;

registration times of the registered instructions, the content area, the content area information and content area metadata, and a duration of the registered instructions;

the processor being configured for encoding the semantic instruction to produce an encoded semantic instruction; and

the network interface being configured to send encoded semantic instructions to a remote device.

17. :

The networked system of claim 16 further comprising;

a database for storing statistical information related to the input and output of the transformation of the registered instructions to a semantic instruction; and

the processor being configured to filter information from the database to produce filtered statistics based on one or more of the following criteria;

the identity of the user, characteristics of the input device, characteristics of the display, characteristics of the user interface, the user'"'"'s location, and metadata associated with the semantic instruction.

18. :

The networked system of claim 16 further comprising;

The processor being configured for transforming the registered instructions to a semantic instruction, the semantic instruction comprising an interpretation of the registered instructions based on at least one or more of the following factors;

registration times of the registered instructions, the content area, the content area information and content area metadata, a duration of the registered instructions, and filtered statistics from the database.

19. :

A method for semantic processing of gestures on a user interface of a device comprising;

receiving an instruction on a user interface of a device;

identifying a position of the received instruction on the user interface;

correlating the identified position to a content area, the content area including content area information and content area metadata associated therewith;

registering additional instructions at the identified position of the received instruction on the user interface;

transforming the registered additional instructions to a semantic instruction, the semantic instruction comprising a semantic interpretation of the registered additional instructions, the semantic interpretation being based on at least one or more of the following factors;

registration times of the registered additional instructions, the content area, content area information, content area metadata, and a duration of the registered additional instructions;

sending a request to a remote source to process the semantic instruction;

receiving a response from the remote source; and

providing the received response.