Optimizing head mounted displays for augmented reality
First Claim
1. A system comprising:
- a movable display;
memory including instructions;
at least one processor to execute the instructions to, at least;
retrieve first image data during a first time, the first image data corresponding to a first camera position;
transform a frame of the first image data into a transformed frame;
impose a border constraint on a first portion of the transformed frame, the border constraint outside a field of view of the movable display, the border constraint to cause a second portion of the transformed frame to be within the field of view of the movable display during the first time;
retrieve inertial measurement unit (IMU) data during a second time, the IMU data corresponding to a second camera position to retrieve second image data; and
cause a subset of the first portion of the transformed frame to be within the field of view of the movable display during the second time to reduce processing latency effects associated with the second image data.
2 Assignments
0 Petitions
Accused Products
Abstract
While many augmented reality systems provide “see-through” transparent or translucent displays upon which to project virtual objects, many virtual reality systems instead employ opaque, enclosed screens. Indeed, eliminating the user'"'"'s perception of the real-world may be integral to some successful virtual reality experiences. Thus, head mounted displays designed exclusively for virtual reality experiences may not be easily repurposed to capture significant portions of the augmented reality market. Various of the disclosed embodiments facilitate the repurposing of a virtual reality device for augmented reality use. Particularly, by anticipating user head motion, embodiments may facilitate scene renderings better aligned with user expectations than naïve renderings generated within the enclosed field of view. In some embodiments, the system may use procedural mapping methods to generate a virtual model of the environment. The system may then use this model to supplement the anticipatory rendering.
87 Citations
21 Claims
-
1. A system comprising:
-
a movable display; memory including instructions; at least one processor to execute the instructions to, at least; retrieve first image data during a first time, the first image data corresponding to a first camera position; transform a frame of the first image data into a transformed frame; impose a border constraint on a first portion of the transformed frame, the border constraint outside a field of view of the movable display, the border constraint to cause a second portion of the transformed frame to be within the field of view of the movable display during the first time; retrieve inertial measurement unit (IMU) data during a second time, the IMU data corresponding to a second camera position to retrieve second image data; and cause a subset of the first portion of the transformed frame to be within the field of view of the movable display during the second time to reduce processing latency effects associated with the second image data. - View Dependent Claims (2, 3, 4, 5, 6, 7)
-
-
8. A computer readable storage device or storage disk comprising instructions that, when executed, cause the at least one processor to at least:
-
retrieve first image data during a first time, the first image data corresponding to a first camera position; transform a frame of the first image data into a transformed frame; impose a border constraint on a first portion of the transformed frame, the border constraint outside a field of view of the movable display, the border constraint to cause a second portion of the transformed frame to be within the field of view of the movable display during the first time; retrieve inertial measurement unit (IMU) data during a second time, the IMU data corresponding to a second camera position to retrieve second image data; and cause a subset of the first portion of the transformed frame to be within the field of view of the movable display during the second time to reduce processing latency effects associated with the second image data. - View Dependent Claims (9, 10, 11, 12, 13, 14)
-
-
15. A computer implemented method, comprising:
-
retrieving first image data during a first time, the first image data corresponding to a first camera position; transforming a frame of the first image data into a transformed frame; imposing a border constraint on a first portion of the transformed frame, the border constraint outside a field of view of the movable display, the border constraint to cause a second portion of the transformed frame to be within the field of view of the movable display during the first time; retrieving inertial measurement unit (IMU) data during a second time, the IMU data corresponding to a second camera position to retrieve second image data; and causing a subset of the first portion of the transformed frame to be within the field of view of the movable display during the second time to reduce processing latency effects associated with the second image data. - View Dependent Claims (16, 17, 18, 19, 20, 21)
-
Specification