Image stabilization for color-sequential displays
First Claim
1. In a wearable head-mounted display (HMD), a computer-implemented method comprising:
- while displaying temporally sequential color sub-frames of a video display image on a color-sequential display (CSD) of the HMD, determining motion of an eye of a user of the HMD with respect to the CSD;
based on the determined motion, computing an expected change in position of the eye with respect to the CSD over a time interval from a first temporally sequential color sub-frame to a second temporally sequential color sub-frame that follows the first temporally sequential color sub-frame; and
based on the computed expected change in position, compensating for the determined motion of the eye by adjusting a display position on the CSD of the second temporally sequential color sub-frame with respect to a display position on the CSD of the first temporally sequential color sub-frame,wherein computing the expected change in position of the eye with respect to the CSD over the time interval from the first temporally sequential color sub-frame to the second temporally sequential color sub-frame based on the determined motion comprises;
determining a predicted change in angular orientation of an eye-gaze direction of the eye with respect to a plane of the CSD as a function of the determined motion over the time interval from the first temporally sequential color sub-frame to the second temporally sequential color sub-frame.
2 Assignments
0 Petitions
Accused Products
Abstract
A computing system that includes a color sequential display (CSD) and an eye-tracking device may determine motion of an eye with respect to the CSD, while displaying temporally sequential color sub-frames of a video display image on CSD. Based on the determined motion, the computing system may determine an expected change in position of the eye with respect to the CSD over a time interval from a first temporally sequential color sub-frame to a second temporally sequential color sub-frame that follows the first temporally sequential color sub-frame. Then, based on the determined expected change in position, the computing system may compensate for the determined motion of the eye by adjusting a display position on the CSD of the second temporally sequential color sub-frame with respect to a display position on the CSD of the first temporally sequential color sub-frame. A head-mounted display is an example of such a computing system.
152 Citations
34 Claims
-
1. In a wearable head-mounted display (HMD), a computer-implemented method comprising:
-
while displaying temporally sequential color sub-frames of a video display image on a color-sequential display (CSD) of the HMD, determining motion of an eye of a user of the HMD with respect to the CSD; based on the determined motion, computing an expected change in position of the eye with respect to the CSD over a time interval from a first temporally sequential color sub-frame to a second temporally sequential color sub-frame that follows the first temporally sequential color sub-frame; and based on the computed expected change in position, compensating for the determined motion of the eye by adjusting a display position on the CSD of the second temporally sequential color sub-frame with respect to a display position on the CSD of the first temporally sequential color sub-frame, wherein computing the expected change in position of the eye with respect to the CSD over the time interval from the first temporally sequential color sub-frame to the second temporally sequential color sub-frame based on the determined motion comprises; determining a predicted change in angular orientation of an eye-gaze direction of the eye with respect to a plane of the CSD as a function of the determined motion over the time interval from the first temporally sequential color sub-frame to the second temporally sequential color sub-frame. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 13, 14)
-
-
12. In a wearable head-mounted display (HMD), a computer-implemented method comprising:
-
while displaying temporally sequential color sub-frames of a video display image on a color-sequential display (CSD) of the HMD, determining motion of an eye of a user of the HMD with respect to the CSD; based on the determined motion, computing an expected change in position of the eye with respect to the CSD over a time interval from a first temporally sequential color sub-frame to a second temporally sequential color sub-frame that follows the first temporally sequential color sub-frame; and based on the computed expected change in position, compensating for the determined motion of the eye by adjusting a display position on the CSD of the second temporally sequential color sub-frame with respect to a display position on the CSD of the first temporally sequential color sub-frame, wherein computing the expected change in position of the eye with respect to the CSD over the time interval from the first temporally sequential color sub-frame to the second temporally sequential color sub-frame based on the determined motion comprises; determining a location of a first point in a plane of the CSD corresponding to a first eye-gaze direction of the eye at a time of display of the first temporally sequential color sub-frame; and based on the determined location of the first point and the determined motion, making a prediction of a location of a second point in the plane of the CSD corresponding to a predicted eye-gaze of the eye at a time of display of the second temporally sequential color sub-frame, the prediction being made prior to the time of display of the second temporally sequential color sub-frame.
-
-
15. In a system including a color-sequential display (CSD), a computer-implemented method comprising:
-
while displaying temporally sequential color sub-frames of a display image on the CSD, determining motion of an eye with respect to the CSD; based on the determined motion, computing an expected change in position of the eye with respect to the CSD from one temporally sequential color sub-frame to a next temporally sequential color sub-frame; and based on the computed expected change in position, adjusting a display position on the CSD of the next temporally sequential color sub-frame with respect to a display position on the CSD of the one temporally sequential color sub-frame, wherein computing the expected change in position of the eye with respect to the CSD from the one temporally sequential color sub-frame to the next temporally sequential color sub-frame comprises; determining a predicted change in angular orientation of an eye-gaze direction of the eye with respect to a plane of the CSD as a function of the determined motion over the time interval from the one temporally sequential color sub-frame to the next temporally sequential color sub-frame.
-
-
16. A wearable head-mounted display (HMD) comprising:
-
means for determining motion of an eye of a user of the HMD with respect to a color-sequential display (CSD) of the HMD, while displaying temporally sequential color sub-frames of a video display image on the CSD; means for computing an expected change in position of the eye with respect to the CSD over a time interval from a first temporally sequential color sub-frame to a second temporally sequential color sub-frame that follows the first temporally sequential color sub-frame, wherein the computing is based on the determined motion; and means for using the computed expected change in position to compensate for the determined motion of the eye by adjusting a display position on the CSD of the second temporally sequential color sub-frame with respect to a display position on the CSD of the first temporally sequential color sub-frame, wherein the expected change in position corresponds to a change from (i) a first eye-gaze direction of the eye in a plane of the CSD at a time of the first temporally sequential color sub-frame to (ii) a second eye-gaze direction of the eye in the plane of the CSD at a time of the second temporally sequential color sub-frame, and wherein adjusting the display position on the CSD of the second temporally sequential color sub-frame based on the computed expected change in position comprises displaying the second temporally sequential sub-frame at a relative position with respect to the second eye-gaze direction that is substantially the same as a relative position of the first temporally sequential sub-frame with respect to the first eye-gaze direction. - View Dependent Claims (17, 18, 19, 20, 21, 22, 23)
-
-
24. A non-transitory computer-readable medium having instructions stored thereon that, upon execution by one or more processors of a wearable head-mounted display (HMD), cause the wearable HMD to carry out operations comprising:
-
while displaying temporally sequential color sub-frames of a video display image on a color-sequential display (CSD) of the HMD, determining motion of an eye of a user of the HMD with respect to the CSD; based on the determined motion, computing an expected change in position of the eye with respect to the CSD over a time interval from a first temporally sequential color sub-frame to a second temporally sequential color sub-frame that follows the first temporally sequential color sub-frame; and based on the computed expected change in position, compensating for the determined motion of the eye by adjusting a display position on the CSD of the second temporally sequential color sub-frame with respect to a display position on the CSD of the first temporally sequential color sub-frame, wherein computing the expected change in position of the eye with respect to the CSD over the time interval from the first temporally sequential color sub-frame to the second temporally sequential color sub-frame based on the determined motion comprises; determining a location of a first point in a plane of the CSD corresponding to a first eye-gaze direction of the eye at a time of display of the first temporally sequential color sub-frame; and based on the determined location of the first point and the determined motion, making a prediction of a location of a second point in the plane of the CSD corresponding to a predicted eye-gaze of the eye at a time of display of the second temporally sequential color sub-frame, the prediction being made prior to the time of display of the second temporally sequential color sub-frame. - View Dependent Claims (25, 26, 27, 28, 29, 30, 31, 32, 33)
-
-
34. A non-transitory computer-readable medium having instructions stored thereon that, upon execution by one or more processors of a system, cause the system to carry out operations comprising:
-
while displaying temporally sequential color sub-frames of a display image on a color-sequential display (CSD) of the system, determining motion of an eye with respect to the CSD; based on the determined motion, computing an expected change in position of the eye with respect to the CSD from one temporally sequential color sub-frame to a next temporally sequential color sub-frame; and based on the computed expected change in position, adjusting a display position on the CSD of the next temporally sequential color sub-frame with respect to a display position on the CSD of the one temporally sequential color sub-frame, wherein computing the expected change in position of the eye with respect to the CSD from the one temporally sequential color sub-frame to the next temporally sequential color sub-frame comprises; determining a predicted change in angular orientation of an eye-gaze direction of the eye with respect to a plane of the CSD as a function of the determined motion over the time interval from the one temporally sequential color sub-frame to the next temporally sequential color sub-frame.
-
Specification