Real-time detection of user intention based on kinematics analysis of movement-oriented biometric data

• US 9,633,252 B2
• Filed: 12/20/2013
• Issued: 04/25/2017
• Est. Priority Date: 12/20/2013
• Status: Active Grant

• Current Assignee: Lenovo PC International Limited (Lenovo Group Ltd.)
• Original Assignee: Lenovo Singapore Pte Limited (Lenovo Group Ltd.)
• Inventors: Feng, Xin
• Primary Examiner(s): Fitzpatrick, Atiba O
• Application Number:
  US14/137,472
• Publication Number:
  US 20150178555A1
• Time in Patent Office: 1,222 Days
• Field of Search: None
• CPC Class Codes: G06F 1/1694 the I/O peripheral being a single or a set of motion sensors for pointer control or gesture input obtained by sensing movements of the portable computer
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06V 40/197 Matching; Classification
• CPC Class Codes: G06V 40/20 Movements or behaviour, e.g. gesture recognition recognition of facial expressions G06V40/16
• CPC Class Codes: G06V 40/28 Recognition of hand or arm movements, e.g. recognition of deaf sign language static hand signs G06V40/113

Abstract

An apparatus for real-time detection of user intention based on kinematic analysis of movement-oriented biometric data includes a biometric data module that receives movement-oriented biometric data, a movement module that identifies an acceleration value using the movement-oriented biometric data, and an evaluation module that interprets a user intention based at least in part on the acceleration value.

Claims

1. A method comprising:

receiving movement-oriented biometric data;

determining, with a processor, an acceleration value at a time corresponding to a position threshold being exceeded using the movement-oriented biometric data;

identifying a velocity value corresponding to the acceleration value; and

interpreting a user intention based on whether the acceleration value exceeds an acceleration threshold and whether the velocity value exceeds a velocity threshold, wherein interpreting the user intention comprises interpreting the user intention to be an extra-interface movement in response to the acceleration value corresponding to the position threshold being above the acceleration threshold.

2. The method of claim 1, further comprising:

identifying a position value using the movement-oriented biometric data;

wherein interpreting the user intention is also based on the position value exceeding a position threshold corresponding to a boundary of a computer interface.

3. The method of claim 2, wherein interpreting user intention comprises determining an inattention movement in response to the position value exceeding the position threshold by a predetermined amount.

4. The method of claim 1, wherein interpreting user intention comprises:

interpreting the user intention to be an intra-interface movement in response to the acceleration value being below the acceleration threshold and the velocity value being zero.

5. The method of claim 1, further comprising adjusting a threshold selected from the group consisting of a position threshold and an acceleration threshold in response to a change selected from the group consisting of a user-to-interface distance and a computer interface dimension.

6. The method of claim 1, further comprising:

identifying a jerk value using the movement-oriented biometric data;

interpreting the user intention to be an inattention movement in response to the acceleration values being positive and below an acceleration threshold for a predetermined period of time and in response to the jerk value exceeding the jerk threshold during the predetermined period of time.

7. The method of claim 6, further comprising identifying a human reaction time for a user, wherein the predetermined period of time is greater than the human reaction time.

8. The method of claim 7, further comprising measuring a user reaction time value based on the calibration routine, wherein the user reaction time value is identified as the human reaction time.

9. The method of claim 1, wherein the movement-oriented biometric data comprises a plurality of position values and a plurality of timestamps, each timestamp of the plurality of timestamps corresponding to one of the plurality of position values.

10. The method of claim 1, wherein the movement-oriented biometric data is selected from the group consisting of eye tracking data, eye gazing data, and finger position data.

11. An apparatus comprising:

a processor;

a memory that stores code executable by the processor to;

receive movement-oriented biometric data;

identify an acceleration value at a time corresponding to a position threshold being exceeded using the movement-oriented biometric data;

identify a velocity value corresponding to the acceleration value; and

interpret a user intention based on whether the acceleration value exceeds an acceleration threshold and whether the velocity value exceeds a velocity threshold, wherein interpreting the user intention comprises interpreting the user intention to be an intra-interface movement in response to the acceleration value being below the acceleration threshold and the velocity value being zero at the time corresponding to a position threshold being exceeded.

12. The apparatus of claim 11, wherein the processor further identifies position values using the movement-oriented biometric data, wherein the code interprets the user intention based at least in part on whether the position values exceed a position threshold corresponding to a boundary of a computer interface.

13. The apparatus of claim 12, wherein the processor determines an inattention movement in response to the position value exceeding the position threshold by a predetermined amount during a predetermined time period.

14. The apparatus of claim 11, wherein the processor determines an extra-interface movement in response the acceleration value being above the acceleration threshold at the time corresponding to a position threshold being exceeded.

15. The apparatus of claim 11, wherein the processor further adjusts a threshold selected from the group consisting of the acceleration threshold and the position threshold responsive to a change in dimensions of a computer interface.

16. The apparatus of claim 11, wherein the processor further identifies a jerk value using the movement-oriented biometric data, wherein the code determines user attention in response to the acceleration value being positive and below an acceleration threshold for a predetermined period of time and determines user distraction in response to the jerk value exceeding a jerk threshold during the predetermined period of time.

17. A program product comprising a non-transitory computer readable storage medium storing code executable by a processor to perform:

receiving movement-oriented biometric data;

identifying an acceleration value at a time corresponding to a position threshold being exceeded using the movement-oriented biometric data;

identifying a velocity value corresponding to the acceleration value; and

interpreting a user intention based on whether the acceleration value exceeds an acceleration threshold and whether the velocity value exceeds a velocity threshold, wherein interpreting the user intention comprises interpreting the user intention to be an extra-interface movement in response to the acceleration value corresponding to the position threshold being above the acceleration threshold.

18. The program product of claim 17, wherein the code further performs:

identifying a position value using the movement-oriented biometric data, wherein interpreting the user intention is also based on the position value exceeding a position threshold corresponding to a boundary of a computer interface.

19. The program product of claim 17, wherein the code further performs:

determining an intra-interface movement in response to the acceleration value being below the acceleration threshold and the velocity value being zero at a time corresponding to a position threshold being exceeded.

20. The program product of claim 17, wherein the code further performs:

identifying a jerk value using the movement-oriented biometric data;

interpreting the user intention to be an inattention movement in response to the acceleration value being positive and below an acceleration threshold for a predetermined period of time and in response to the jerk value exceeding the jerk threshold during the predetermined period of time.