Image rendering responsive to user actions in head mounted display
First Claim
1. A method for rendering images on a head mounted display (HMD), the method comprising:
- tracking, with one or more first cameras inside the HMD, a gaze of a user, wherein the HMD cooperates with a computing device for rendering images in the HMD, wherein the computing device tracks motion of the HMD by analyzing images of the HMD taken with a second camera that is not in the HMD;
predicting an upcoming movement of the gaze based on a trajectory of the gaze of the user and the motion of the HMD, wherein said predicting the upcoming movement is configured to identify a first region within a view rendered by the HMD where the gaze is to move to at a future time;
determining rendering policies for a plurality of regions defined on the view rendered by the HMD based on the upcoming movement of the gaze, wherein when the computing device predicts that the gaze of the user is to move towards the first region of the view and away from a current region of the view, then rendering the first region with higher image quality than regions away from the first region before the gaze of the user is directed toward the first region; and
rendering images by the HMD based on the rendering policies.
2 Assignments
0 Petitions
Accused Products
Abstract
Methods, systems, and computer programs are presented for rendering images on a head mounted display (HMD). One method includes operations for tracking, with one or more first cameras inside the HMD, the gaze of a user and for tracking motion of the HMD. The motion of the HMD is tracked by analyzing images of the HMD taken with a second camera that is not in the HMD. Further, the method includes an operation for predicting the motion of the gaze of the user based on the gaze and the motion of the HMD. Rendering policies for a plurality of regions, defined on a view rendered by the HMD, are determined based on the predicted motion of the gaze. The images are rendered on the view based on the rendering policies.
25 Citations
20 Claims
-
1. A method for rendering images on a head mounted display (HMD), the method comprising:
-
tracking, with one or more first cameras inside the HMD, a gaze of a user, wherein the HMD cooperates with a computing device for rendering images in the HMD, wherein the computing device tracks motion of the HMD by analyzing images of the HMD taken with a second camera that is not in the HMD; predicting an upcoming movement of the gaze based on a trajectory of the gaze of the user and the motion of the HMD, wherein said predicting the upcoming movement is configured to identify a first region within a view rendered by the HMD where the gaze is to move to at a future time; determining rendering policies for a plurality of regions defined on the view rendered by the HMD based on the upcoming movement of the gaze, wherein when the computing device predicts that the gaze of the user is to move towards the first region of the view and away from a current region of the view, then rendering the first region with higher image quality than regions away from the first region before the gaze of the user is directed toward the first region; and rendering images by the HMD based on the rendering policies. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12)
-
-
13. A computer program embedded in a non-transitory computer-readable storage medium, when executed by one or more processors, for rendering images on a head mounted display (HMD), the computer program comprising:
-
program instructions for tracking, with one or more first cameras inside the HMD, a gaze of a user, wherein the HMD cooperates with a computing device for rendering images in the HMD, wherein the computing device tracks motion of the HMD by analyzing images of the HMD taken with a second camera that is not in the HMD; program instructions for predicting an upcoming movement of the gaze based on a trajectory of the gaze of the user and the motion of the HMD, wherein said predicting the upcoming movement of the gaze identifies a first region of a view rendered by the HMD where the gaze is to move to at a future time; program instructions for determining rendering policies for a plurality of regions defined on the view rendered by the HMD based on the upcoming movement of the gaze, wherein when the computing device predicts the gaze of the user is to move toward the first region of the view and away from a current region of the view, then rendering the first region with higher image quality than regions away from the first region before the gaze of the user directed toward the first region; and program instructions for rendering images by the HMD based on the rendering policies. - View Dependent Claims (14, 15)
-
-
16. A method for rendering images on a head mounted display (HMD), the method comprising:
-
tracking a gaze of a user wearing the HMD; predicting an upcoming movement of the gaze of the user based on a trajectory of the gaze, wherein said predicting the upcoming movement is configured to identify a first region within a view rendered by the HMD to which the gaze is to move to at a future time; assigning rendering priority values for a plurality of game objects being rendered by the HMD based on the upcoming movement of the gaze of the user, the rendering priority value for each game object defining at least one of frequency of rendering, complexity of rendering game object, image quality of game object, or rendering resolution, wherein the rendering priority values are assigned based on an importance value of each game object in the game, wherein game objects with higher importance values than game objects with lower importance values have higher rendering priority values than the game objects with the lower importance values; and rendering by the HMD the plurality of game objects according to the rendering priority values before the gaze of the user is directed toward the first region. - View Dependent Claims (17, 18, 19, 20)
-
Specification