Time-warping adjustment based on depth information in a virtual/augmented reality system
First Claim
1. A method of adjusting time-warping of a frame for a virtual reality or augmented reality system based on depth information, the method including:
- determining depth values of a frame;
down-sampling the depth values of a tile of the frame to obtain a plurality of down-sampled depth values, the frame including one or more tiles;
determining a change in a head pose;
determining, from the plurality of down-sampled depth values, a down-sampled depth value for a vertex;
determining an adjusted position for the vertex based on the change in the head pose and the down-sampled depth value for the vertex;
performing, based on at least the adjusted position for the vertex, a depth-adjusted time-warping of the frame to obtain a depth-adjusted time-warped frame; and
triggering display of the depth-adjusted time-warped frame.
2 Assignments
0 Petitions
Accused Products
Abstract
A technique includes determining a depth value for each of a plurality of pixels of a frame, down-sampling the depth values of a tile of the frame to obtain a plurality of down-sampled depth values, the frame including one or more tiles, determining a change in a head pose, determining, from the plurality of down-sampled depth values, a down-sampled depth value for a vertex, determining an adjusted position for the vertex based on the change in head pose and the down-sampled depth value for the vertex, performing, based on at least the adjusted position for the vertex, a depth-adjusted time-warping of the frame to obtain a depth-adjusted time-warped frame, and triggering display of the depth-adjusted time-warped frame.
-
Citations
17 Claims
-
1. A method of adjusting time-warping of a frame for a virtual reality or augmented reality system based on depth information, the method including:
-
determining depth values of a frame; down-sampling the depth values of a tile of the frame to obtain a plurality of down-sampled depth values, the frame including one or more tiles; determining a change in a head pose; determining, from the plurality of down-sampled depth values, a down-sampled depth value for a vertex; determining an adjusted position for the vertex based on the change in the head pose and the down-sampled depth value for the vertex; performing, based on at least the adjusted position for the vertex, a depth-adjusted time-warping of the frame to obtain a depth-adjusted time-warped frame; and triggering display of the depth-adjusted time-warped frame. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15)
-
-
16. An apparatus comprising at least one processor and at least one memory including computer instructions, when executed by the at least one processor, cause the apparatus to:
-
determine depth values of a frame; down-sample the depth values of a tile of the frame to obtain a plurality of down-sampled depth values, the frame including one or more tiles; determine a change in a head pose; determine, from the plurality of down-sampled depth values, a down-sampled depth value for a vertex; determine an adjusted position for the vertex based on the change in the head pose and the down-sampled depth value for the vertex; perform, based on at least the adjusted position for the vertex, a depth-adjusted time-warping of the frame to obtain a depth-adjusted time-warped frame; and trigger display of the depth-adjusted time-warped frame.
-
-
17. A computer program product, the computer program product comprising a computer-readable storage medium and storing executable code that, when executed by at least one data processing apparatus, is configured to cause the at least one data processing apparatus to perform a method comprising:
-
determining depth values of a frame; down-sampling the depth values of a tile of the frame to obtain a plurality of down-sampled depth values, the frame including one or more tiles; determining a change in a head pose; determining, from the plurality of down-sampled depth values, a down-sampled depth value for a vertex; determining an adjusted position for the vertex based on the change in the head pose and the down-sampled depth value for the vertex; performing, based on at least the adjusted position for the vertex, a depth-adjusted time-warping of the frame to obtain a depth-adjusted time-warped frame; and triggering display of the depth-adjusted time-warped frame.
-
Specification