Adjusting image frames based on tracking motion of eyes
First Claim
Patent Images
1. A system comprising:
- a light emitter to emit light toward an eye of a subject, the eye having a retina and a cornea;
a camera to capture images of the cornea of the eye having glints produced by reflection of the light from the cornea;
a display device operated by a display module to sequentially display image frames; and
a processor to;
determine, based at least in part on a first captured image of the cornea, first locations of the glints at a first time, while the display device is displaying an image frame, and a first gaze direction, and generate a first virtual cornea sphere based on the first locations, with the first virtual cornea sphere having a first center;
determine, based at least in part on a second captured image of the cornea, second locations of the glints at a second time, while the display device is displaying the image frame, and a second gaze direction, and generate a second virtual cornea sphere based on the second locations, with the second virtual cornea sphere having a second center;
generate a virtual sphere having a center, using the first and second centers;
determine a retinal velocity of the eye corresponding to differences between the first gaze direction and the second gaze direction, the determined retinal velocity being velocity of the image frame projected onto the retina, measured in a retinal coordinate frame using the center of the virtual sphere; and
provide signals to the display module to change a display time for the image frame based, at least in part, on the retinal velocity.
1 Assignment
0 Petitions
Accused Products
Abstract
In some examples, techniques and architectures for operating a device that may be wearable, such as a head-mounted device, may be used for virtual reality applications. A processor of the device may operate by dynamically tracking the cornea, and thus the gaze direction, of a user'"'"'s eyes. By tracking the gaze direction, retinal velocity of a display image projected onto the retina, measured in the retina coordinate frame may be computed. Display times of image frames viewable by the user may be modified based on the retinal velocity.
-
Citations
20 Claims
-
1. A system comprising:
-
a light emitter to emit light toward an eye of a subject, the eye having a retina and a cornea; a camera to capture images of the cornea of the eye having glints produced by reflection of the light from the cornea; a display device operated by a display module to sequentially display image frames; and a processor to; determine, based at least in part on a first captured image of the cornea, first locations of the glints at a first time, while the display device is displaying an image frame, and a first gaze direction, and generate a first virtual cornea sphere based on the first locations, with the first virtual cornea sphere having a first center; determine, based at least in part on a second captured image of the cornea, second locations of the glints at a second time, while the display device is displaying the image frame, and a second gaze direction, and generate a second virtual cornea sphere based on the second locations, with the second virtual cornea sphere having a second center; generate a virtual sphere having a center, using the first and second centers; determine a retinal velocity of the eye corresponding to differences between the first gaze direction and the second gaze direction, the determined retinal velocity being velocity of the image frame projected onto the retina, measured in a retinal coordinate frame using the center of the virtual sphere; and provide signals to the display module to change a display time for the image frame based, at least in part, on the retinal velocity. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10)
-
-
11. A head-mounted device comprising:
-
multiple light emitters configured to direct infrared light toward an eye of a wearer of the head-mounted device, the eye having a retina and a cornea; a camera configured to capture images of the cornea of an eye of the wearer with respect to image frames displayed to the eye; and a processor to; determine relative positions of glints on the cornea in images captured by the camera for an image frame of the image frames; determine multiple gaze directions and multiple virtual cornea spheres, based at least in part on the relative positions of glints, with each virtual cornea sphere having a center and with each gaze direction and each virtual cornea sphere corresponding to a time different from times corresponding to the other gaze directions and other virtual cornea sphere; generate a virtual sphere having a center of the virtual sphere, using the centers of the virtual cornea spheres; determine retinal velocity of the eye based, at least in part, on the gaze directions associated with the relative positions of the glints on the cornea, the determined retinal velocity being velocity of the image frame projected onto the retina, measured in a retinal coordinate frame, using the center of the virtual sphere; and modify display times of image frames based, at least in part, on the retinal velocity. - View Dependent Claims (12, 13, 14, 15)
-
-
16. A method comprising:
-
capturing images of a cornea of an eye of a subject while the subject gazes at a display device, wherein the images include sets of glint points on the cornea produced by specular reflection of light by a surface of the cornea; determining, based at least in part on a series of the images, if the cornea is moving in a saccadic motion or is moving substantially continuously; and adjusting durations of image frames displayed on the display device based, at least in part, on whether the cornea is moving in the saccadic motion or moving substantially continuously using a retinal velocity of the eye determined from gaze directions and a center of a virtual sphere calculated from generation of virtual cornea spheres associated with relative positions of the glints captured with respect to an image frame of the image frames displayed, the determined retinal velocity being velocity of the image frame projected onto a retina of the eye, measured in a retinal coordinate frame using the center of the virtual sphere. - View Dependent Claims (17, 18, 19, 20)
-
Specification