Methods and systems for mapping virtual objects in an augmented or virtual reality system
First Claim
Patent Images
1. A method of displaying virtual or augmented reality, comprising:
- capturing a first set of data at one or more first sensors in a first virtual or augmented reality display system corresponding to a first location;
capturing a second set of data at one or more second sensors in a second virtual or augmented reality display system corresponding to a second location;
receiving the first set of data and the second set of data from the first and second virtual or augmented reality display systems via one or more computer networks;
providing, by at least one processor, one or more timing or quality targets to at least a mapping module for allocating computational resources;
constructing or updating, by the at least one processor of a computing system, a map of a real world at least by stitching, into the map of the real world, a smaller world model including a first node representing the first location and a second node representing the second location in the map with an edge that is emphasized with a first emphasis and is associated with a connectivity strength that represents an extent of sharing between the first node and the second node;
determining, at the computing system, the first virtual or augmented reality system, or the second virtual or augmented reality system, one or more map points for the smaller world model at least by viewing one or more existing features with one or more new, virtual keyframes that are positioned in relation to the first location and the second location;
identifying a map point from the map, a maximum residual stress value for the map, and a bundle adjust process;
determining whether a stress value associated with the map point exceeds the maximum residual stress value;
adjusting the stress value associated with the map point by applying the bundle adjust process to the map point; and
identifying a topological map that corresponds to the map.
3 Assignments
0 Petitions
Accused Products
Abstract
An augmented reality display system comprises a passable world model data comprises a set of map points corresponding to one or more objects of the real world. The augmented reality system also comprises a processor to communicate with one or more individual augmented reality display systems to pass a portion of the passable world model data to the one or more individual augmented reality display systems, wherein the piece of the passable world model data is passed based at least in part on respective locations corresponding to the one or more individual augmented reality display systems.
-
Citations
17 Claims
-
1. A method of displaying virtual or augmented reality, comprising:
-
capturing a first set of data at one or more first sensors in a first virtual or augmented reality display system corresponding to a first location; capturing a second set of data at one or more second sensors in a second virtual or augmented reality display system corresponding to a second location; receiving the first set of data and the second set of data from the first and second virtual or augmented reality display systems via one or more computer networks; providing, by at least one processor, one or more timing or quality targets to at least a mapping module for allocating computational resources; constructing or updating, by the at least one processor of a computing system, a map of a real world at least by stitching, into the map of the real world, a smaller world model including a first node representing the first location and a second node representing the second location in the map with an edge that is emphasized with a first emphasis and is associated with a connectivity strength that represents an extent of sharing between the first node and the second node; determining, at the computing system, the first virtual or augmented reality system, or the second virtual or augmented reality system, one or more map points for the smaller world model at least by viewing one or more existing features with one or more new, virtual keyframes that are positioned in relation to the first location and the second location; identifying a map point from the map, a maximum residual stress value for the map, and a bundle adjust process; determining whether a stress value associated with the map point exceeds the maximum residual stress value; adjusting the stress value associated with the map point by applying the bundle adjust process to the map point; and identifying a topological map that corresponds to the map. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16)
-
-
17. A system for displaying augmented reality, comprising:
-
one or more image capturing devices configured to capture a first set of data at one or more first sensors in a first virtual or augmented reality display system corresponding to a first location; the one or more image capturing devices further configured to capture a second set of data at one or more second sensors in a second virtual or augmented reality display system corresponding to a second location; a processor operatively connected to a network component and configured to receive the first set of data and the second set of data from the first and second virtual or augmented reality display systems; the processor further configured to provide one or more timing or quality targets to at least a mapping module for allocating computational resources; the processor further configured to construct or update a map of a real world at least by stitching, into the map of the real world, a smaller world model including a first node representing the first location and a second node representing the second location in the map with an edge that is associated with connectivity strength that represents an extent of sharing between the first node and the second node; the processor further configured to determine, at the computing system, the first virtual or augmented reality system, or the second virtual or augmented reality system, one or more map points for the smaller world model at least by viewing one or more existing features with one or more new, virtual keyframes that are positioned in relation to the first location and the second location; the processor further configured to identify a map point from the map, a maximum residual stress value for the map, and a bundle adjust process; the processor further configured to determine whether a stress value associated with the map point exceeds the maximum residual stress value; the processor further configured to adjust the stress value associated with the map point by applying the bundle adjust process to the map point; and the processor further configured to identify a topological map that corresponds to the map.
-
Specification