Molding and anchoring physically constrained virtual environments to real-world environments
First Claim
1. A computer-implemented process for constructing virtual environments, comprising:
- using a computer to perform process actions for;
generating environmental information by scanning a real-world environment to classify geometry of surfaces and objects within that environment;
receiving a master set of virtual building blocks, each virtual building block including a plurality of characteristics and including semantic and geometric constraints relating to the virtual building blocks;
procedurally molding a physically constrained virtual environment by performing two or more iterations of a joint optimization of a layout of an automatically selected variable subset of at least two of the virtual building blocks selected for each iteration relative to a scene-specific cost function;
each iteration of the physically constrained virtual environment comprising a different trial solution of a joint layout of all the virtual building blocks in the automatically selected variable subset;
each iteration being consistent with the characteristics and constraints of the variable subset of virtual building blocks and the environmental information of the real-world environment;
the scene-specific cost function being derived for each iteration from the characteristics and constraints of the subset of virtual building blocks in combination with the environmental information;
displaying the physically constrained virtual environment via a display device, such that at least a portion of the physically constrained virtual environment is anchored to the real-world environment in a way that at least partially matches tactile truth for one or more surfaces and objects within the real-world environment.
1 Assignment
0 Petitions
Accused Products
Abstract
An “Anchored Environment Generator” generates a physically constrained virtual environment that is molded and anchored to a real-world environment around a user (or multiple users). This molding and anchoring of the physically constrained virtual environment ensures that at least a portion of the physically constrained virtual environment matches tactile truth for one or more surfaces and objects within the real-world environment. Real objects and surfaces in the real-world environment may appear as different virtual objects, and may have different functionality, in the physically constrained virtual environment. Consequently, users may move around within the physically constrained virtual environment while touching and interacting with virtual objects in the physically constrained virtual environment. In some implementations, the physically constrained virtual environment is constructed from virtual building blocks that are consistent with a theme-based specification (e.g., French bistro, space station, starship, alternate real-world environments, alien world, apocalyptic wasteland, medieval village, hospital, castle, etc.).
-
Citations
20 Claims
-
1. A computer-implemented process for constructing virtual environments, comprising:
-
using a computer to perform process actions for; generating environmental information by scanning a real-world environment to classify geometry of surfaces and objects within that environment; receiving a master set of virtual building blocks, each virtual building block including a plurality of characteristics and including semantic and geometric constraints relating to the virtual building blocks; procedurally molding a physically constrained virtual environment by performing two or more iterations of a joint optimization of a layout of an automatically selected variable subset of at least two of the virtual building blocks selected for each iteration relative to a scene-specific cost function; each iteration of the physically constrained virtual environment comprising a different trial solution of a joint layout of all the virtual building blocks in the automatically selected variable subset; each iteration being consistent with the characteristics and constraints of the variable subset of virtual building blocks and the environmental information of the real-world environment; the scene-specific cost function being derived for each iteration from the characteristics and constraints of the subset of virtual building blocks in combination with the environmental information; displaying the physically constrained virtual environment via a display device, such that at least a portion of the physically constrained virtual environment is anchored to the real-world environment in a way that at least partially matches tactile truth for one or more surfaces and objects within the real-world environment. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12)
-
-
13. A method for generating an immersive virtual environment, comprising:
-
receiving a classification of geometry of surfaces and objects within a real-world environment; receiving a set of virtual objects comprising virtual object characteristics and including semantic, geometric, and objective constraints relating to the virtual objects; iteratively jointly optimizing, via two or more iterations, a layout of an automatically selected variable subset of at least two of the virtual objects selected for each iteration relative to a scene-specific cost function; each iteration of the subset of virtual objects comprising a different trial solution of a joint layout of all of the virtual objects in the automatically selected variable subset of virtual objects; each iteration being consistent with the geometry of surfaces and objects within the real-world environment; wherein the scene-specific cost function scores each iteration of the jointly optimized layout based on the characteristics and constraints of the subset of virtual objects relative to the geometry of surfaces and objects within the real-world environment; rendering the iteratively jointly optimized layout of virtual objects to generate a tactile virtual reality (TVR); replacing a view of the real-world environment around a plurality of users by displaying the TVR to those users via head worn display devices, such that at least a portion of the TVR is anchored to the real-world environment in a way that at least partially matches tactile truth for one or more surfaces and objects within the real-world environment; and dynamically performing real-time updates to the TVR in response to user interaction with the TVR. - View Dependent Claims (14, 15, 16, 17, 18)
-
-
19. A computer-readable storage device having computer executable instructions stored therein, said instructions causing a computing device to:
-
automatically classify geometry of surfaces and objects within a real-world environment in response to environmental information received from one or more scanning devices; receive a set of virtual objects comprising virtual object characteristics and including semantic and geometric constraints relating to the virtual objects; perform two or more iterations to iteratively jointly optimize a layout of an automatically selected variable subset of at least two of the virtual objects selected for each iteration relative to a scene-specific cost function that scores each iteration of the jointly optimized layout based on the characteristics and constraints of the subset of virtual objects relative to the geometry of surfaces and objects within the real-world environment; wherein each iteration of jointly optimized layout of the subset of virtual objects comprises a different trial solution of a joint layout of all of the virtual objects of the automatically selected variable subset of virtual objects; wherein each iteration is consistent with the geometry of surfaces and objects within the real-world environment; render the iteratively jointly optimized layout of virtual objects to generate a tactile virtual reality (TVR) that is anchored to the real-world environment in a way that at least partially matches tactile truth for one or more surfaces and objects within the real-world environment; and replace a view of the real-world environment around one or more users by displaying the TVR via an immersive display device. - View Dependent Claims (20)
-
Specification