Method and apparatus for recording reading behavior
First Claim
Patent Images
1. A method for recording reading behaviour, comprising:
- performing a correction procedure before an eye tracking procedure is executed, wherein the correction procedure comprises sequentially receiving a plurality of correction images, obtaining a reference correction parameter according to two bright spot positions in an eye area of each of the correction images, and generating a coordinate transformation matrix according to the correction images;
displaying an electronic document on a display unit, wherein the electronic document comprises a plurality of parts;
capturing an image sequence of a user through an image capturing unit;
executing the eye-tracking procedure on the image sequence to track a movement trajectory of an eye of the user, wherein the step of tracking the movement trajectory of the eye of the user comprises;
detecting the eye area of a current image in the image sequence to obtain a pupil position in the current image;
obtaining a comparison correction parameter according to the two bright spot positions in the eye area of the current image;
obtaining a dynamic compensation parameter according to the reference correction parameter and the comparison correction parameter;
calculating eye movement coordinates according to one of the two bright spot positions and the pupil position in the current image and the dynamic compensation parameter;
converting the eye movement coordinates into sight landing coordinates corresponding to the display unit by using the coordinate transformation matrix; and
recording the sight landing coordinates;
detecting whether a sight of the eye leaves a gazing part when it is detected that the eye gazes the gazing part of the parts;
calculating a reading time of the gazing part when it is detected that the sight of the eye leaves the gazing part, wherein the reading time is a time required for the sight moving from a position where the sight starts to gaze the gazing part to a position where the sight leaves the gazing part;
calculating the reading time of the gazing part when it is detected that the eye keeps gazing the electronic document and reading of the gazing part is finished; and
recording the reading time to a storage space corresponding to the gazing part.
1 Assignment
0 Petitions
Accused Products
Abstract
A method and an apparatus for recording reading behavior are provided. A movement trajectory of a user'"'"'s eye is tracked based on an eye-tracking procedure, so as to calculate reading time of a gazing part of an electronic document when it is detected that sight of an eye leaves the gazing part, or when it is detected that the eye keeps gazing the electronic document and reading of the gazing part is finished. And the reading time is recorded to a storage space corresponding to the gazing part.
-
Citations
17 Claims
-
1. A method for recording reading behaviour, comprising:
-
performing a correction procedure before an eye tracking procedure is executed, wherein the correction procedure comprises sequentially receiving a plurality of correction images, obtaining a reference correction parameter according to two bright spot positions in an eye area of each of the correction images, and generating a coordinate transformation matrix according to the correction images; displaying an electronic document on a display unit, wherein the electronic document comprises a plurality of parts; capturing an image sequence of a user through an image capturing unit; executing the eye-tracking procedure on the image sequence to track a movement trajectory of an eye of the user, wherein the step of tracking the movement trajectory of the eye of the user comprises; detecting the eye area of a current image in the image sequence to obtain a pupil position in the current image; obtaining a comparison correction parameter according to the two bright spot positions in the eye area of the current image; obtaining a dynamic compensation parameter according to the reference correction parameter and the comparison correction parameter; calculating eye movement coordinates according to one of the two bright spot positions and the pupil position in the current image and the dynamic compensation parameter; converting the eye movement coordinates into sight landing coordinates corresponding to the display unit by using the coordinate transformation matrix; and recording the sight landing coordinates; detecting whether a sight of the eye leaves a gazing part when it is detected that the eye gazes the gazing part of the parts; calculating a reading time of the gazing part when it is detected that the sight of the eye leaves the gazing part, wherein the reading time is a time required for the sight moving from a position where the sight starts to gaze the gazing part to a position where the sight leaves the gazing part; calculating the reading time of the gazing part when it is detected that the eye keeps gazing the electronic document and reading of the gazing part is finished; and recording the reading time to a storage space corresponding to the gazing part. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8)
-
-
9. An apparatus for recording reading behaviour, comprising:
-
a display unit, displaying an electronic document, wherein the electronic document comprises a plurality of parts; an image capturing unit, capturing an image sequence of a user; a storage unit, storing the electronic document and the image sequence; and a processing unit, coupled to the display unit, the image capturing unit and the storage unit, wherein the storage unit further stores a behaviour analysis module, driven by the processing unit, wherein the behaviour analysis module comprises a correction module, wherein the correction module sequentially receives a plurality of correction images, obtains a reference correction parameter according to two bright spot positions in an eye area of each of the correction images, and generates a coordinate transformation matrix based on the correction images according to a perspective transformation method, wherein the behaviour analysis module further comprises an eye-tracking module, executing an eye-tracking procedure on the image sequence to track the movement trajectory of the eye of the user, wherein the eye-tracking module detects the eye area of a current image in the image sequence to obtain a pupil position in the current image;
obtains a comparison correction parameter according to the two bright spot positions in the eye area of the current image;
obtains a dynamic compensation parameter according to the reference correction parameter and the comparison correction parameter;
calculates eye movement coordinates according to one of the two bright spot positions and the pupil position in the current image and the dynamic compensation parameter;
converts the eye movement coordinates into sight landing coordinates corresponding to the display unit by using the coordinate transformation matrix, and records the sight landing coordinates;wherein when the processing unit detects that the eye gazes a gazing part of the parts, the processing unit detects whether a sight of the eye leaves the gazing part; when the processing unit detects that the sight of the eye leaves the gazing part, the processing unit calculates a reading time of the gazing part, and records the reading time to a storage space corresponding to the gazing part, wherein the reading time is a time required for the sight moving from a position where the sight starts to gaze the gazing part to a position where the sight leaves the gazing part; when the processing unit detects that the eye keeps gazing the electronic document and reading of the gazing part is finished, the processing unit calculates the reading time of the gazing part, and records the reading time to a storage space corresponding to the gazing part. - View Dependent Claims (10, 11, 12, 13, 14, 15, 16, 17)
-
Specification