Image manipulation based on tracked eye movement
First Claim
Patent Images
1. A method comprising:
- displaying an image of an object in a viewing area;
tracking an eye gaze at a predetermined sampling interval while the image is displayed;
obtaining a data point of the tracked eye gaze at the predetermined sampling interval, the data point representing a detected location of the eye gaze within the viewing area;
analyzing the data point obtained during the predetermined sampling interval;
determining a range of the viewing area in which a predetermined concentration of the analyzed data point is located;
modifying the image when the determined range is smaller than a first predetermined range, wherein the displayed object of the modified image is magnified according to a zoom-in operation;
modifying the image when the determined range is larger than a second predetermined range, wherein the displayed object of the modified image is shrunk according to a zoom-out operation; and
displaying the modified image.
3 Assignments
0 Petitions
Accused Products
Abstract
The disclosure relates to controlling and manipulating an image of an object on a display device based on tracked eye movements of an observer. When the object is displayed according to an initial view, the observer'"'"'s eye movement is tracked and processed in order to determine the focus of the observer'"'"'s attention or gaze on the image. Thereafter, the displayed image is modified to provide a better view of the part of the object in which the observer is most interested. This is accomplished by modifying at least one of the spatial positioning of the object within the viewing area, the angle of view of the object, and the viewing direction of the object.
-
Citations
24 Claims
-
1. A method comprising:
-
displaying an image of an object in a viewing area; tracking an eye gaze at a predetermined sampling interval while the image is displayed; obtaining a data point of the tracked eye gaze at the predetermined sampling interval, the data point representing a detected location of the eye gaze within the viewing area; analyzing the data point obtained during the predetermined sampling interval; determining a range of the viewing area in which a predetermined concentration of the analyzed data point is located; modifying the image when the determined range is smaller than a first predetermined range, wherein the displayed object of the modified image is magnified according to a zoom-in operation; modifying the image when the determined range is larger than a second predetermined range, wherein the displayed object of the modified image is shrunk according to a zoom-out operation; and displaying the modified image. - View Dependent Claims (2, 3, 4, 5, 6)
-
-
7. A method comprising,
displaying an image of an object in a viewing area, wherein a surface of the displayed object is displayed three-dimensionally on the viewing area; -
tracking an eye gaze at a predetermined sampling interval while the image is displayed; obtaining a data point of the tracked eye gaze at the predetermined sampling interval, the data point representing a detected location of the tracked eye gaze within the viewing area; identifying eye attention points on the surface of the displayed object by applying an unprojection process to translate the obtained data point to a point on the three-dimensionally displayed surface of the displayed object; determining a modification to the image based on the identified eye attention points; modifying the image in accordance with the modification; and displaying the modified image. - View Dependent Claims (8, 9, 10)
-
-
11. A method comprising:
-
displaying an image of an object in a viewing area, wherein a surface of the displayed object is displayed three-dimensionally on the viewing area; tracking an eye gaze at a predetermined sampling interval while the image is displayed; obtaining a data point of the tracked eye gaze at the predetermined sampling interval, the data point representing a detected location of the tracked eye gaze within the viewing area; mapping a degree of eye attention to a plurality of regions of the viewing area based on the obtained data point; when the region of the viewing area with the highest degree of eye attention is outside of the displayed object, modifying the image by rotating the displayed object toward the region of the viewing area having the highest degree of eye attention; and displaying the modified image.
-
-
12. A non-transitory computer-readable medium storing executable instructions that, when executed, cause a computer to perform operations comprising:
-
displaying an image of an object in a viewing area; tracking an eye gaze at a predetermined sampling interval while the image is displayed; obtaining a data point of the tracked eye gaze at the predetermined sampling interval, the data point representing a detected location of the tracked eye gaze within the viewing area; analyzing the data point obtained during the predetermined sampling interval; determining a range of the viewing area in which a predetermined concentration of the analyzed data point is located; modifying the image when the determined range is smaller than a first predetermined range, wherein the displayed object of the modified image is magnified according to a zoom-in operation; modifying the image when the determined range is larger than a second predetermined range, wherein the displayed object of the modified image is shrunk according to a zoom-out operation; and displaying the modified image. - View Dependent Claims (13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23)
-
-
24. A system comprising:
-
a display device configured to display an image on a two-dimensional viewing area; and one or more computer processors, storing executable instructions, operably connected to the display device, the instructions causing the one or more computer processors to perform operations including; displaying an image of an object in a viewing area, wherein a surface of the displayed object is displayed three-dimensionally on the viewing area, tracking an eye gaze at a predetermined sampling interval while the image is displayed, obtaining a data point of the tracked eye gaze at the predetermined sampling interval, the data point representing a detected location of the tracked eye gaze within the viewing area, identifying eye attention points on the surface of the displayed object by applying an unprojection process to translate the obtained data point to a point on the three-dimensionally displayed surface of the displayed object, determining a modification to the image based on the identified eye attention points, modifying the image in accordance with the modification, and displaying the modified image.
-
Specification