GESTURE IDENTIFICATION

• US 20150054748A1
• Filed: 09/27/2013
• Published: 02/26/2015
• Est. Priority Date: 08/26/2013
• Status: Active Grant

• Current Assignee: PayPal, Inc. (PayPal Holdings, Inc.)
• Original Assignee: PayPal, Inc. (PayPal Holdings, Inc.)
• Inventors: Mason, Robert A.
• Granted Patent: US 9,785,241 B2
• Time in Patent Office: Days
• US Class Current: 345/168
• CPC Class Codes: G06F 21/00 Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
• CPC Class Codes: G06F 21/31 User authentication
• CPC Class Codes: G06F 3/005 Input arrangements through a video camera
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0304 Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042

Abstract

Various methods and systems are provided to allow a user to perform finger gesture motions, such as making typing, swiping, tapping, or other types of finger motions to provide device input, such as typing, clicking, or selecting data into a webpage, application, operating system, or toolbar, that was normally performed by the user having to use a keyboard, mouse, stylus, microphone, touchscreen, or another input device.

Claims

1. A system comprising:

a memory storing gesture mappings associated with specific actions or inputs; and

one or more hardware processors in communication with the memory and configured for;

receiving an input of one or more finger gesture motions made by a user and sensed by a user device, wherein the input is made without the user touching the user device and the one or more finger gesture motions correspond to keys of a QWERTY keypad or to a specific spatial position of one or more data inputs on a current display of the user device;

identifying a current gesture mapping based on the one or more finger gesture motions;

matching the current gesture mapping with the stored gesture mappings; and

determining a corresponding device input based on the stored gesture mapping that matches the current gesture mapping.

2. The system of claim 1, wherein one or more processors is further configured for associating distinct finger gesture motions with specific functions.

3. The system of claim 1, wherein the specific spatial position corresponds to a button or link on the current display.

4. The system of claim 3, wherein the button or link corresponds to an action performed during a payment process.

5. The system of claim 3, wherein the button or link corresponds to an action performed during a search process.

6. The system of claim 1, wherein the matching is within a tolerance or an error threshold of the stored gesture mapping.

7. The system of claim 1, wherein the receiving is from a camera.

8. The system of claim 1, wherein the one or more hardware processors is further configured for requesting the user to repeat the one or more finger gesture motions or enter a different finger gesture motion when the current gesture mapping does not match the stored gesture mappings.

9. The system of claim 1, wherein the one or more hardware processors is further configured for notifying the user of a successful match.

10. The system of claim 1, wherein matching the current gesture mapping with the stored gesture mappings is based on a set of discrete points that represent a path taken by the finger gesture motions.

11. The system of claim 1, wherein matching the current gesture mapping with the stored gesture mappings is based on the order of the finger gesture motions.

12. A method of processing data input through a user device, comprising:

receiving, by a hardware processor from a user device, an input of one or more finger gesture motions made by a user and sensed by the user device, wherein the input is made without the user touching the user device and the one or more finger gesture motions correspond to keys of a QWERTY keypad or to a specific spatial position of one or more data inputs on a current display of the user device;

identifying, by the hardware processor, a current gesture mapping based on the one or more finger gesture motions;

accessing a database of a plurality of stored gesture mappings associated with finger gesture motions of the user;

matching, by the hardware processor, the current gesture mapping with the stored gesture mappings; and

determining a corresponding device input based on the stored gesture mapping that matches the current gesture mapping.

13. The method of claim 12, wherein the determining is based on the combination of one or more finger gesture motions involving one or more fingers associated with one or more functions.

14. The method of claim 12, further comprising requesting the user to repeat the finger gesture motion(s) or enter a different finger gesture motion when the current gesture mapping does not match the stored gesture mappings.

15. The method of claim 12, wherein the matching is based on determining a set of discrete points that represent a path taken by the finger gesture motions.

16. The method of claim 12, wherein the stored gesture mappings are based on an average of finger gesture motions from the user.

17. The method of claim 12, wherein the corresponding device input is an alphanumeric sequence corresponding to a user identifier or user authenticator.

18. A non-transitory computer readable medium having instructions stored and tangibly embodied thereon that, when executed, cause one or more processing devices to perform operations comprising:

receiving an input of one or more finger gesture motions made by a user and sensed by a user device, wherein the input is made without the user touching the user device and the one or more finger gesture motions correspond to keys of a QWERTY keypad or to a specific spatial position of one or more data inputs on a current display of the user device;

identifying a current gesture mapping based on the one or more finger gesture motions;

accessing a database of stored gesture mappings associated with finger gesture motions for the user;

matching the current gesture mapping with the stored gesture mappings; and

determining a corresponding device input based on the stored gesture mapping that matches the current gesture mapping.

19. The non-transitory computer readable medium of claim 18, wherein the stored gesture mappings are based on an average of finger gesture motions from the user.

20. The non-transitory computer readable medium of claim 18, wherein the corresponding device input is an alphanumeric sequence corresponding to a user identifier or user authenticator.