Reprojection OLED display for augmented reality experiences
First Claim
1. A mobile device, comprising:
- one or more processors configured to determine a first predicted pose and a second predicted pose associated with the mobile device, the first predicted pose corresponds with a first point in time and the second predicted pose corresponds with a second point in time subsequent to the first point in time, the one or more processors configured to acquire a rendered image, the one or more processors configured to determine a first homographic transformation based on the first predicted pose and determine a second homographic transformation based on the second predicted pose, the one or more processors configured to generate a first portion of an updated image by causing the first homographic transformation to be applied to a first portion of the rendered image and generate a second portion of the updated image by causing the second homographic transformation to be applied to a second portion of the rendered image; and
a see-through display configured to display the updated image.
2 Assignments
0 Petitions
Accused Products
Abstract
Methods for generating and displaying images associated with one or more virtual objects within an augmented reality environment at a frame rate that is greater than a rendering frame rate are described. The rendering frame rate may correspond with the minimum time to render images associated with a pose of a head-mounted display device (HMD). In some embodiments, the HMD may determine a predicted pose associated with a future position and orientation of the HMD, generate a pre-rendered image based on the predicted pose, determine an updated pose associated with the HMD subsequent to generating the pre-rendered image, generate an updated image based on the updated pose and the pre-rendered image, and display the updated image on the HMD. The updated image may be generated via a homographic transformation and/or a pixel offset adjustment of the pre-rendered image by circuitry within the display.
49 Citations
20 Claims
-
1. A mobile device, comprising:
-
one or more processors configured to determine a first predicted pose and a second predicted pose associated with the mobile device, the first predicted pose corresponds with a first point in time and the second predicted pose corresponds with a second point in time subsequent to the first point in time, the one or more processors configured to acquire a rendered image, the one or more processors configured to determine a first homographic transformation based on the first predicted pose and determine a second homographic transformation based on the second predicted pose, the one or more processors configured to generate a first portion of an updated image by causing the first homographic transformation to be applied to a first portion of the rendered image and generate a second portion of the updated image by causing the second homographic transformation to be applied to a second portion of the rendered image; and a see-through display configured to display the updated image. - View Dependent Claims (2, 3, 4, 5, 6, 7)
-
-
8. A method for displaying images, comprising:
-
determining a first predicted pose and a second predicted pose associated with a mobile device, the first predicted pose corresponds with a first point in time and the second predicted pose corresponds with a second point in time subsequent to the first point in time; acquiring a rendered image; determining a first homographic transformation to be applied to a first portion of the rendered image based on the first predicted pose; determining a second homographic transformation to be applied to a second portion of the rendered image based on the second predicted pose; generating a first portion of an updated image by applying the first homographic transformation to the first portion of the rendered image using the mobile device; generating a second portion of the updated image by applying the second homographic transformation to the second portion of the rendered image using the mobile device; and displaying the updated image on a display of the mobile device. - View Dependent Claims (9, 10, 11, 12, 13, 14, 15, 16)
-
-
17. One or more storage devices containing processor readable code for programming one or more processors to perform a method for displaying images using an HMD comprising the steps of:
-
acquiring a pose history associated with the HMD, the pose history corresponds with a time period prior to a first point in time; determining a current pose associated with the HMD corresponding with the first point in time; determining a first predicted pose associated with the HMD corresponding with a second point in time subsequent to the first point in time, the determining a first predicted pose includes determining the first predicted pose based on the current pose and the pose history; determining a second predicted pose associated with the HMD corresponding with a third point in time subsequent to the second point in time; acquiring a rendered image; determining a first homographic transformation to be applied to a first portion of the rendered image based on the first predicted pose; determining a second homographic transformation to be applied to a second portion of the rendered image based on the second predicted pose; generating a first portion of an updated image by applying the first homographic transformation to the first portion of the rendered image; generating a second portion of the updated image by applying the second homographic transformation to the second portion of the rendered image; and displaying the updated image on a display of the HMD. - View Dependent Claims (18, 19, 20)
-
Specification