Method and apparatus for eyetrack derived backtrack

• US 5,831,594 A
• Filed: 06/25/1996
• Issued: 11/03/1998
• Est. Priority Date: 06/25/1996
• Status: Expired due to Term

• Current Assignee: Oracle America, Inc. (Oracle Corporation)
• Original Assignee: Sun Microsystems Incorporated (Oracle Corporation)
• Inventors: Tognazzini, Bruce, Nielsen, Jakob, Glass, Robert
• Primary Examiner(s): WU, XIAO MIN
• Assistant Examiner(s): Tran, Vui T.
• Application Number:
  US08/670,056
• Time in Patent Office: 861 Days
• Field of Search: 345/7-9, 345/146, 345/156, 345/326, 345/335, 345/338, 345/339, 345/117, 345/328, 395/352, 395/353, 395/357
• US Class Current: 345/156
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G06F 3/0485 Scrolling or panning
• CPC Class Codes: G06F 3/04895 Guidance during keyboard input operation, e.g. prompting

Abstract

Apparatus, methods, systems and computer program products are disclosed to assist a user of a display device to more quickly recover from a distraction causing the user to look away from the display device. The user is also assisted when navigating hypertext documents by the invention indicating where the user last looked in a restored, previously viewed hypertext document.

Claims

1. A computer controlled method for assisting a user of a computer to reestablish a lost context;

said computer having a display device, and a gaze-tracking device;

said gaze-tracking device for determining a gaze position on said display device;

said computer controlled method comprising the steps of;

(a) monitoring said gaze position to track a current context within an active area of said display device;

(b) detecting a break of attention from said active area and saving said current context at the time of said break of attention as said lost context;

(c) restoring said lost context; and

(d) indicating said lost context to said user by applying an indicator to said lost context.

2. The computer controlled method of claim 1 wherein said break of attention is detected when said gaze position moves out of said active area.

3. The computer controlled method of claim 2 wherein step (c) further comprises:

(c1) detecting entry of said gaze position into a target area having said lost context; and

(c2) making said target area said active area.

4. The computer controlled method of claim 3 wherein step (d) further comprises:

(d1) detecting an intersection with said gaze position and said lost context;

(d2) removing said indicator; and

(d3) resuming current context monitoring.

5. The computer controlled method of claim 1 wherein said break of attention is detected by activation of a hypertext link transition away from a visited page.

6. The computer controlled method of claim 5 wherein step (c) further comprises restoring said visited page containing said lost context.

7. The computer controlled method of claim 6 wherein step (d) further comprises:

(d1) detecting an intersection with said gaze-position and said lost context;

(d2) removing said indicator; and

(d3) resuming current context monitoring.

8. An information presentation apparatus configured to assist a user of a computer to reestablish a lost context;

said apparatus having a central processor unit, a memory, a display device, and a gaze-tracking device for determining a gaze position on said display device;

said apparatus comprising;

a monitor mechanism configured to monitor said gaze position to track a current context within an active area of said display device;

a first detection mechanism cooperating with said monitor mechanism, configured to detect a break of attention from said active area;

said first detection mechanism also configured to save said current context at the time of said break of attention as said lost context;

a second detection mechanism also cooperating with said monitor mechanism configured to detect when said gaze position enters a target area on said display device;

said target area having said lost context;

a restoration mechanism configured to restore said lost context in said target area responsive to said second detection mechanism; and

an indication mechanism configured to indicate said lost context to said user by applying an indicator to said lost context on said display device.

9. The information presentation apparatus of claim 8 wherein said break of attention is detected when said gaze position moves out of said active area.

10. The information presentation apparatus of claim 8 wherein said indication mechanism further comprises:

an intersection detection mechanism configured to detect an intersection with said gaze position and said lost context;

an indicator removal mechanism configured to remove said indicator after said intersection detection mechanism detects said intersection; and

a resumption mechanism configured to resume said monitor mechanism.

11. The information presentation apparatus of claim 8 wherein said break of attention is detected by activation of a hypertext link transition away from a visited page.

12. The information presentation apparatus of claim 11 wherein said restoration mechanism is further configured to restore said visited page containing said lost context.

13. The information presentation apparatus of claim 12 wherein said indication mechanism is further comprises:

an intersection detection mechanism configured to detect an intersection with said gaze position and said lost context;

an indicator removal mechanism configured to remove said indicator after said intersection detection mechanism detects said intersection; and

a resumption mechanism configured to resume said monitor mechanism.

14. An information presentation system configured to assist a user to reestablish a lost context;

said system having a display device, and a gaze-tracking device for determining a gaze position on said display device;

said system comprising;

a monitor mechanism configured to monitor said gaze position to track a current context within an active area of said display device;

a first detection mechanism cooperating with said monitor mechanism, configured to detect a break of attention from said active area;

said first detection mechanism also configured to save said current context at the time of said break of attention as said lost context;

a second detection mechanism also cooperating with said monitor mechanism configured to detect when said gaze position enters a target area on said display device;

said target area having said lost context;

a restoration mechanism configured to restore said lost context in said target area responsive to said second detection mechanism; and

an indication mechanism configured to indicate said lost context to said user by applying an indicator to said lost context on said display device.

15. The information presentation system of claim 14 wherein said break of attention is detected when said gaze position moves out of said active area.

16. The information presentation system of claim 14 wherein said indication mechanism further comprises:

an intersection detection mechanism configured to detect an intersection with said gaze position and said lost context;

an indicator removal mechanism configured to remove said indicator after said intersection detection mechanism detects said intersection; and

a resumption mechanism configured to resume said monitor mechanism.

17. The information presentation system of claim 14 wherein said break of attention is detected by activation of a hypertext link transition away from a visited page.

18. The information presentation system of claim 17 wherein said restoration mechanism is further configured to restore said visited page containing said lost context.

19. The information presentation system of claim 18 wherein said indication mechanism is further comprises:

an intersection detection mechanism configured to detect an intersection with said gaze position and said lost context;

an indicator removal mechanism configured to remove said indicator after said intersection detection mechanism detects said intersection; and

a resumption mechanism configured to resume said monitor mechanism.

20. A computer program product comprising:

(a) a computer usable storage medium having computer readable code embodied therein for causing a computer to assist a user to reestablish a lost context;

said computer readable code comprising;

(b) computer readable code configured to cause said computer to effect a monitor mechanism configured to monitor a gaze position to track a current context within an active area of a display device;

computer readable code configured to cause said computer to effect a first detection mechanism cooperating with said monitor mechanism, configured to detect a break of attention from said active area;

said first detection mechanism also configured to save said current context at the time of said break of attention as said lost context;

computer readable code configured to cause said computer to effect a second detection mechanism also cooperating with said monitor mechanism configured to detect when said gaze position enters a target area on said display device;

said target area having said lost context;

computer readable code configured to cause said computer to effect a restoration mechanism configured to restore said lost context in said target area responsive to said second detection mechanism; and

computer readable code configured to cause said computer to effect an indication mechanism configured to indicate said lost context to said user by applying an indicator to said lost context on said display device.

21. The computer program product of claim 20 wherein said break of attention is detected when said gaze position moves out of said active area.

22. The computer program product of claim 20 wherein said indication mechanism further comprises:

computer readable code configured to cause said computer to effect an intersection detection mechanism configured to detect an intersection with said gaze position and said lost context;

computer readable code configured to cause said computer to effect an indicator removal mechanism configured to remove said indicator after said intersection detection mechanism detects said intersection; and

computer readable code configured to cause said computer to effect a resumption mechanism configured to resume said monitor mechanism.

23. The computer program product of claim 20 wherein said break of attention is detected by activation of a hypertext link transition away from a visited page.

24. The computer program product of claim 23 wherein said restoration mechanism further comprises computer readable code configured to cause said computer to restore said visited page containing said lost context.

25. The computer program product of claim 24 wherein said indication mechanism is further comprises:

computer readable code configured to cause said computer to effect an intersection detection mechanism configured to detect an intersection with said gaze position and said lost context;

computer readable code configured to cause said computer to effect an indicator removal mechanism configured to remove said indicator after said intersection detection mechanism detects said intersection; and

computer readable code configured to cause said computer to effect a resumption mechanism configured to resume said monitor mechanism.