Method and apparatus for eyetrack-driven captioning
First Claim
Patent Images
1. A computer controlled method for presenting information to a user of a computer;
- said computer having a display device, an audio reproduction mechanism and a gaze-tracking device;
said gaze-tracking device determining a gaze position on said display device;
said method comprising the steps of;
(a) displaying a first information on said display device resulting in a captioned image on said display device;
(b) detecting when said gaze position intersects said captioned image;
(c) associating an additional information with said first information said additional information being caption information; and
(d) presenting said additional information as sound to said user using said audio reproduction mechanism.
2 Assignments
0 Petitions
Accused Products
Abstract
Apparatus, methods, systems and computer program products are disclosed that detect when a user is interested in information presented on a display device. The invention then automatically presents additional information to the user about the information presented on the display device.
150 Citations
20 Claims
-
1. A computer controlled method for presenting information to a user of a computer;
- said computer having a display device, an audio reproduction mechanism and a gaze-tracking device;
said gaze-tracking device determining a gaze position on said display device;
said method comprising the steps of;(a) displaying a first information on said display device resulting in a captioned image on said display device; (b) detecting when said gaze position intersects said captioned image; (c) associating an additional information with said first information said additional information being caption information; and (d) presenting said additional information as sound to said user using said audio reproduction mechanism. - View Dependent Claims (2, 3, 4, 5)
- said computer having a display device, an audio reproduction mechanism and a gaze-tracking device;
-
6. An information presentation apparatus configured to present information to a user;
- said apparatus having a central processor unit, a memory, a display device, an audio reproduction mechanism, and a gaze-tracking device for determining a gaze position on said display device;
said apparatus comprising;a display mechanism configured to display a first information on said display device resulting in a captioned image on said display device; a detection mechanism configured to detect an intersection of said gaze position and said captioned image displayed on said display device; an association mechanism configured to associate an additional information with said first information after said detection mechanism detects said intersection, said additional information being caption information; and a presentation mechanism configured to present said additional information as sound to said user using said audio reproduction mechanism. - View Dependent Claims (7, 8, 9, 10)
- said apparatus having a central processor unit, a memory, a display device, an audio reproduction mechanism, and a gaze-tracking device for determining a gaze position on said display device;
-
11. An information presentation system configured to present information to a user;
- said system having a display device, an audio reproduction mechanism and a gaze-tracking device for determining a gaze position on said display device;
said system comprising;a display mechanism configured to display a first information on said display device resulting in a captioned image on said display device; a detection mechanism configured to detect an intersection of said gaze position and said captioned image displayed on said display device; an association mechanism configured to associate an additional information with said first information after said detection mechanism detects said intersection, said additional information being caption information; and a presentation mechanism configured to present said additional information as sound to said user using said audio reproduction mechanism. - View Dependent Claims (12, 13, 14, 15)
- said system having a display device, an audio reproduction mechanism and a gaze-tracking device for determining a gaze position on said display device;
-
16. A computer program product comprising:
-
(a) a computer usable storage medium having computer readable code embodied therein for causing a computer to present information to a user;
said computer readable code comprising;(b) computer readable code configured to cause said computer to effect a display mechanism configured to display a first information on said display device resulting in a captioned image on said display device; computer readable code configured to cause said computer to effect a detection mechanism configured to detect an intersection of a gaze position and said image displayed on said display device;
said gaze position determined from a gaze-tracking device;computer readable code configured to cause said computer to effect an association mechanism configured to associate an additional information with said first information after said detection mechanism detects said intersections, said additional information being caption information; and computer readable code configured to cause said computer to effect a presentation mechanism configured to present said additional information as sound to said user using an audio reproduction mechanism. - View Dependent Claims (17, 18, 19, 20)
-
Specification