Smart placement of virtual objects to stay in the field of view of a head mounted display
First Claim
1. A method performed by a head mounted display (HMD) device that supports rendering of a virtual reality environment within a field of view, comprising:
- obtaining sensor data describing a physical space adjoining a user of the HMD device;
using the sensor data, reconstructing a geometry of the physical space;
tracking the user'"'"'s head in the physical space using the reconstructed geometry to determine a current field of view of the user;
when a new virtual object is being introduced into the virtual reality environment, checking its original intended location; and
relocating the new virtual object when and while the original intended location is outside the user'"'"'s current field of view so that at least a portion of the new virtual object is within the user'"'"'s current field of view when relocated.
1 Assignment
0 Petitions
Accused Products
Abstract
An HMD device is configured to check the placement of newly introduced objects in a virtual reality environment such as interactive elements like menus, widgets, and notifications to confirm that the objects are significantly present within the user'"'"'s field of view. If the intended original placement would locate the object outside the field of view, the HMD device relocates the object so that a portion of the object is viewable at the edge of the HMD display closest to its original placement. Such smart placement of virtual objects enables the user to readily discover new objects when they are introduced into the virtual reality environment, and then interact with the objects within a range of motions and/or head positions that is comfortable to support a more optimal interaction and user experience.
-
Citations
20 Claims
-
1. A method performed by a head mounted display (HMD) device that supports rendering of a virtual reality environment within a field of view, comprising:
-
obtaining sensor data describing a physical space adjoining a user of the HMD device; using the sensor data, reconstructing a geometry of the physical space; tracking the user'"'"'s head in the physical space using the reconstructed geometry to determine a current field of view of the user; when a new virtual object is being introduced into the virtual reality environment, checking its original intended location; and relocating the new virtual object when and while the original intended location is outside the user'"'"'s current field of view so that at least a portion of the new virtual object is within the user'"'"'s current field of view when relocated. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10)
-
-
11. A head mounted display (HMD) device operable by a user in a physical environment, comprising:
-
one or more processors; a display for rendering a virtual reality environment to the user, a field of view of the rendered virtual reality environment being variable depending at least in part on a pose of the user'"'"'s head in the physical environment; a sensor package; and one or more memory devices storing computer-readable instructions which, when executed by the one or more processors, cause the processors to; generate surface reconstruction data for at least a portion of the physical environment using the sensor package, dynamically track the user'"'"'s field of view of the virtual reality environment using the surface reconstruction data, determine if an original intended location for a new virtual object being introduced into the virtual reality environment enables the new virtual object to be viewable within the user'"'"'s current field of view, and operate the HMD device to relocate the new virtual object from the original intended location in response to the determination so that at least a portion of the new virtual object is viewable within the user'"'"'s current field of view, the determination being that the new virtual object is not within the user'"'"'s current field of view. - View Dependent Claims (12, 13, 14, 15, 16)
-
-
17. One or more computer readable memories storing computer-executable instructions that cause one or more processors of a head mounted display (HMD) device located in a real world space and rendering a virtual reality environment within a variable field of view to:
-
use data from a sensor package incorporated into the HMD device to dynamically generate a surface reconstruction model of the real world space; determine a user'"'"'s current field of view of the virtual reality environment using the model; determine that an intended original position of a virtual object lies outside the current field of view; when and while the virtual object lies outside the current field of view, enable discovery by the user of the virtual object introduced into the virtual reality environment by locating at least a portion of the virtual object at an edge of the current field of view; and adjust the location of the virtual object as the current field of view changes with movement by the user. - View Dependent Claims (18, 19, 20)
-
Specification