Providing last known browsing location cue using movement-oriented biometric data

• US 10,180,716 B2
• Filed: 12/20/2013
• Issued: 01/15/2019
• Est. Priority Date: 12/20/2013
• Status: Active Grant

• Current Assignee: Lenovo PC International Limited (Lenovo Group Ltd.)
• Original Assignee: Lenovo Singapore Pte Limited (Lenovo Group Ltd.)
• Inventors: Feng, Xin, Hilburger, Paul
• Primary Examiner(s): Boddie, William
• Assistant Examiner(s): Schnirel, Andrew
• Application Number:
  US14/137,451
• Publication Number:
  US 20150177830A1
• Time in Patent Office: 1,852 Days
• CPC Class Codes: G06F 2203/04801 Cursor retrieval aid, i.e. visual aspect modification, blinking, colour changes, enlargement or other visual cues, for helping user do find the cursor in graphical user interfaces
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/04812 Interaction techniques based on cursor appearance or behaviour, e.g. being affected by the presence of displayed objects
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence

Abstract

Methods, apparatus, and computer program products for providing a last known browsing location cue using movement-oriented biometric data are presented. Movement-oriented biometric data is received and used to detect that a user is distracted from a computer interface. A visual cue is provided indicating a last known browsing location. The visual cue may be provided after a certain amount of time or in response to detecting that the user'"'"'s attention is returned to the computer interface. The visual cue may be removed after a certain amount of time or in response to detecting that the user'"'"'s attention is returned to the computer interface. An inattention time corresponding to the user distraction may be determined and used to identify the last known browsing location. The biometric data may be compared to thresholds and profiles to determine whether the user is attentive or distracted.

Claims

1. A method comprising:

identifying a plurality of regions within a computer interface, the plurality of regions including a boundary of the computer interface;

identifying a boundary velocity profile specific to the boundary of the computer interface, the boundary velocity profile differing from a velocity profile specific to another of the plurality of regions within the computer interface, the boundary velocity profile being specific to a user of the computer interface and comprising a plurality of specific velocity values over a period of time, wherein the plurality of velocity values form a bell-curve;

identifying a boundary acceleration threshold specific to the boundary of the computer interface, the boundary acceleration threshold differing from an acceleration threshold specific to another of the plurality of regions within the computer interface;

identifying a boundary jerk threshold corresponding to the boundary of the computer interface, the boundary jerk threshold differing from a jerk threshold specific to another of the plurality of regions within the computer interface;

receiving, by use of a processor, movement-oriented biometric data, wherein the movement-oriented biometric is received in real-time and comprises a plurality of viewing position values and a plurality of viewing timestamps, each viewing timestamp corresponding to one of the plurality of viewing position values;

determining, from the movement-oriented biometric data, whether the user'"'"'s gaze is at the boundary of the computer interface;

identifying a plurality of velocity values from the movement-oriented biometric data in response to the user'"'"'s gaze being at the boundary of the computer interface, the plurality of velocity values corresponding to a period of time when the user'"'"'s gaze is near the boundary of the computer interface;

identifying an acceleration value from the movement-oriented biometric data in response to the user'"'"'s gaze being at the boundary of the computer interface, the acceleration value corresponding to the moment when the user'"'"'s gaze is at the boundary of the computer interface, wherein the acceleration value is derived from the viewing position values and the corresponding viewing timestamps;

identifying a jerk value from movement-oriented biometric data in response to the user'"'"'s gaze being at the boundary of the computer interface, the jerk value corresponding to the moment when the user'"'"'s gaze is at the boundary of the computer interface, wherein the jerk value is derived from the viewing position values and the corresponding viewing timestamps;

determining whether the plurality of velocity values identified from the movement-oriented biometric data form a bell-curve that matches the boundary velocity profile;

determining whether the acceleration value exceeds the boundary acceleration threshold;

determining whether the jerk value exceeds the boundary jerk threshold;

detecting user distraction from the computer interface in response to the plurality of velocity values forming a bell-curve that matches the boundary velocity profile, the acceleration value exceeding the boundary acceleration threshold, and the jerk value exceeding the boundary jerk threshold;

detecting that a user attention is returned to the computer interface subsequent to the user distraction;

providing a visual cue in the computer interface indicating a last known browsing location in response to detecting the returning user attention;

initiating a removal timer in response to providing the visual cue; and

removing the visual cue from the computer interface after expiration of the removal timer.

2. The method of claim 1, further comprising:

identifying a plurality of browsing locations on the computer interface based on the movement-oriented biometric data; and

identifying an inattention time corresponding to the detected user distraction, wherein providing the visual cue in the computer interface comprises displaying the visual cue at a browsing location corresponding to the inattention time.

3. The method of claim 1, further comprising:

initiating a marking timer in response to detecting user distraction, wherein providing the visual cue is conducted in response to expiration of the marking timer.

4. The method of claim 1, further comprising comparing the movement-oriented biometric data to at least one profile to determine whether the user is attentive to the computer interface, the at least one profile selected from the group consisting of an eye acceleration profile and an eye jolt profile.

5. The method of claim 1, wherein the movement-oriented biometric data is selected from the group consisting of eye gazing data and eye tracking data.

6. The method of claim 1, wherein the visual cue is selected from the group consisting of a highlight, an underline, a trace, a marker, a watermark, color-differentiated text, faded text, animated text, and an icon.

13. The method of claim 1, further comprising:

monitoring for changes in a distance between the user and the computer interface;

adjusting the boundary velocity profile in response to a change in the distance between the user and the computer interface;

adjusting the boundary acceleration threshold in response to a change in the distance between the user and the computer interface; and

adjusting the boundary jerk threshold in response to a change in the distance between the user and the computer interface.

7. An apparatus comprising:

a processor;

a memory that stores code executable by the processor to;

identify a boundary of a computer interface;

identify a boundary velocity profile that is specific to the boundary of the computer interface, the boundary velocity profile differing from a velocity profile specific to another of the plurality of regions within the computer interface, the boundary velocity profile and comprising a plurality of specific velocity values over a period of time, wherein the plurality of velocity values form a bell-curve;

identify a boundary acceleration profile that is specific to the boundary of the computer interface, the boundary acceleration profile differing from an acceleration threshold specific to another of the plurality of regions within the computer interface, the boundary acceleration profile comprising a plurality of acceleration values over a period of time;

identify a boundary jerk threshold specific to the boundary of the computer interface, the boundary jerk threshold differing from a jerk threshold specific to another of the plurality of regions within the computer interface;

receive movement-oriented biometric data, wherein the movement-oriented biometric is received in real-time and comprises a plurality of viewing position values and a plurality of viewing timestamps, each viewing timestamp corresponding to one of the plurality of viewing position values;

determine, from the movement-oriented biometric data, whether the user'"'"'s gaze is at the boundary of the computer interface;

identify a plurality of velocity values from the movement-oriented biometric data in response to the user'"'"'s gaze being at the boundary of the computer interface, the plurality of velocity values corresponding to a period of time when the user'"'"'s gaze is near the boundary of the computer interface;

identify a plurality of acceleration values from the movement-oriented biometric data in response to the user'"'"'s gaze being at the boundary of the computer interface, the plurality of acceleration values corresponding to the period of time when the user'"'"'s gaze is near the boundary of the computer interface, wherein the acceleration values are derived from the viewing position values and the corresponding viewing timestamps;

identify a jerk value from movement-oriented biometric data in response to the user'"'"'s gaze being at the boundary of the computer interface, the jerk value corresponding to a moment when the user'"'"'s gaze is at the boundary of the computer interface, wherein the jerk value is derived from the viewing position values and the corresponding viewing timestamps;

determine whether the plurality of velocity values identified from the movement-oriented biometric data form a bell-curve that matches the boundary velocity profile;

determine whether the plurality of acceleration values identified from the movement-oriented biometric data match the values in the boundary acceleration profile;

determine whether the jerk value exceeds the boundary jerk threshold;

detect user distraction from the computer interface in response to the plurality of velocity values forming a bell-curve that matches the boundary velocity profile, the plurality of acceleration values matching the values in the boundary acceleration profile, and the jerk value exceeding the boundary jerk threshold;

detect that a user attention is returned to the computer interface subsequent to the user distraction;

provide a visual cue in the computer interface indicating a last known browsing location in response to detecting the returning user attention;

initiate a removal timer in response to providing the visual cue; and

remove the visual cue from the computer interface after expiration of the removal timer.

8. The apparatus of claim 7, wherein the memory further stores code executable by the processor to:

identify a browsing location on the computer interface based on the movement-oriented biometric data; and

identify an inattention time corresponding to the detected user distraction, wherein the code displays the visual cue at a browsing location corresponding to the inattention time.

9. The apparatus of claim 7, wherein the memory further stores code executable by the processor to;

initiate a marking timer in response to detecting user distraction, wherein the code provides the visual cue in response to expiration of the marking timer.

10. The apparatus of claim 7, wherein the memory further stores code executable by the processor to:

compare the movement-oriented biometric data to at least one profile to determine whether the user is attentive to the computer interface, the at least one profile selected from the group consisting of an eye speed profile, an eye acceleration profile, and an eye jolt profile.

14. The apparatus of claim 7, wherein the processor further:

monitors for changes in a distance between the user and the computer interface;

adjusts the boundary velocity profile in response to a change in the distance between the user and the computer interface;

adjusts the boundary acceleration profile in response to a change in the distance between the user and the computer interface; and

adjusts the boundary jerk threshold in response to a change in the distance between the user and the computer interface.

11. A program product comprising a non-transitory computer readable storage medium storing machine readable code executable by a processor to perform:

accessing a user profile comprising a plurality of user-specific movement profiles, including a velocity profile for a user of a computer interface and an acceleration profile for the user of the computer interface;

identifying a current boundary of the computer interface;

determining a boundary velocity profile based on the velocity profile and the current boundary of the computer interface, the boundary velocity profile differing from a velocity profile specific to another of the plurality of regions within the computer interface and comprising a plurality of specific velocity values over a period of time, wherein the plurality of velocity values form a bell-curve;

determining a boundary acceleration profile based on the acceleration profile and the current boundary of the computer interface, the boundary acceleration profile differing from an acceleration profile specific to another of the plurality of regions within the computer interface, the boundary acceleration profile comprising a plurality of acceleration values over a period of time;

determining a boundary jerk threshold based on the current boundary of the computer interface, the boundary jerk threshold differing from a jerk threshold specific to another of the plurality of regions within the computer interface;

receiving movement-oriented biometric data, wherein the movement-oriented biometric is received in real-time and comprises a plurality of viewing position values and a plurality of viewing timestamps, each viewing timestamp corresponding to one of the plurality of viewing position values;

determining, from the movement-oriented biometric data, whether the user'"'"'s gaze is at the current boundary of the computer interface;

identifying a plurality of velocity values from the movement-oriented biometric data in response to the user'"'"'s gaze being at the current boundary of the computer interface, the plurality of velocity values corresponding to a period of time when the user'"'"'s gaze is near the current boundary of the computer interface;

identifying a plurality of acceleration values from the movement-oriented biometric data in response to the user'"'"'s gaze being at the current boundary of the computer interface, the plurality of acceleration values corresponding to the period of time when the user'"'"'s gaze is near the current boundary of the computer interface, wherein the acceleration values are derived from the viewing position values and the corresponding viewing timestamps;

identifying a jerk value from movement-oriented biometric data in response to the user'"'"'s gaze being at the current boundary of the computer interface, the jerk value corresponding to a moment when the user'"'"'s gaze is at the current boundary of the computer interface, wherein the jerk value is derived from the viewing position values and the corresponding viewing timestamps;

determining whether the plurality of velocity values identified from the movement-oriented biometric data form a bell-curve that matches the boundary velocity profile;

determining whether the plurality of acceleration values match the boundary acceleration profile;

determining whether the jerk value exceeds the boundary jerk threshold;

detecting user distraction from the computer interface in response to the plurality of velocity values forming a bell-curve that matches the boundary velocity profile, the plurality of acceleration values matching the values in the boundary acceleration profile, and the jerk value exceeding the boundary jerk threshold;

detecting that a user attention is returned to the computer interface subsequent to the user distraction;

providing a visual cue in the computer interface indicating a last known browsing location in response to detecting the returning user attention;

initiating a removal timer in response to providing the visual cue; and

removing the visual cue from the computer interface after expiration of the removal timer.

12. The program product of claim 11, wherein the machine readable code, when executed, further performs:

initiating a marking timer in response to detecting user distraction; and

providing the visual cue in response to expiration of the marking timer.

15. The program product of claim 11, wherein the machine readable code, when executed, further performs:

monitoring for changes in a distance between a user and a computer interface;

adjusting the boundary velocity profile in response to a change in the distance between the user and the computer interface;

adjusting the boundary acceleration profile in response to a change in the distance between the user and the computer interface; and

adjusting the boundary jerk threshold in response to a change in the distance between the user and the computer interface.