Method and Device for Touchless Signing and Recognition

• US 20110041100A1
• Filed: 11/07/2007
• Published: 02/17/2011
• Est. Priority Date: 11/09/2006
• Status: Active Grant

• Current Assignee: Navisense
• Original Assignee: Navisense
• Inventors: Boillot, Marc
• Granted Patent: US 8,904,312 B2
• Time in Patent Office: Days
• US Class Current: 715/863
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0304 Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042

Abstract

A touchless sensor device (110) for touchless signing and recognition is provided. The sensor device can include a recognition engine (114) for recognizing at least one finger sign (140), and a controller (120) for composing a text from the recognized at least one finger sign and providing predictive texting. A recognized pattern can be an alphanumeric character or a finger gesture. The controller can generate a trace (145) from the finger sign. The trace can include spatio-temporal information (153) that is characteristic to a touchless writing style. The controller can provide text messaging services, email composition services, biometric identification services, phone dialing, and navigation entry services through touchless finger signing.

Claims

13. A touchless sensor device, comprising

a recognition engine for recognizing at least one pattern of a touchless finger signing;

and

a controller for composing a text from the at least one pattern and providing predictive texting in view of the text,

wherein the at least one pattern is an alphanumeric character or a finger gesture.

1. A touchless user interface device, comprising:

a sensory device for tracking a movement of a finger in a touchless sensing space; and

a recognition engine for identifying at least one pattern in the movement, wherein the at least one pattern is an alphanumeric character or a finger gesture.

2. The touchless user interface device of claim 1, further comprising

a display for displaying the at least one pattern;

and

an audio module for audibly presenting the at least one pattern.

3. The touchless user interface device of claim 1, wherein the sensory device is integrated within a mobile device, a headset, or an earpiece.

4. The touchless user interface device of claim 1, further comprising a controller operatively coupled to the sensory device and the recognition engine, the controller:

creating a trace of the movement received from the sensory device; and

identifying finger start and finger stop actions from the trace.

5. The touchless user interface device of claim 4, wherein the recognition engine is a neural network that classifies the at least one pattern from the trace.

6. The touchless user interface of claim 4, wherein the sensory device projects the touchless sensing space on a surface of a mobile device.

7. The touchless user interface of claim 4, wherein the trace is a differential trajectory of an x, y, and z component of the movement.

8. The touchless user interface of claim 5, wherein the neural network classifies the pattern using a spatio-temporal trace of the finger movement.

9. The touchless user interface of claim 4, wherein a temporal trace is an acceleration vector.

10. The touchless user interface device of claim 4, wherein the recognition engine is a Hidden Markov Model that classifies the at least one pattern from the trace.

11. The touchless user interface of claim 4, wherein the controller performs biometric identification on a finger signing to verify an identity of a user.

12. The touchless user interface of claim 4, wherein the controller performs a software action in response to the recognition engine recognizing a finger gesture.

14. The touchless sensor device of claim 13, wherein the controller suggests word completions in view of the text.

15. The touchless sensor device of claim 13, wherein the controller provides text messaging services for touchless finger signing.

16. The touchless sensor device of claim 13, wherein the controller provides email composition services for touchless finger signing.

17. The touchless sensor device of claim 13, wherein the controller provides navigation services for touchless finger signing.

17-1. The touchless sensor device of claim 13, wherein the controller provides biometric identification for touchless finger signing.

19. A touchless signing engine comprising:

a sensor device for tracking a finger movement in a touchless sensing space and creating a trace from the finger movement; and

a recognition engine for recognizing a pattern from the trace.

20. The touchless signing engine of claim 19, further comprising a controller for performing a software action in response to the recognition engine recognizing a finger sign.