Method and system for generating virtual rooms
First Claim
1. A method for generating a virtual room, comprising:
- identifying a user specification of confines of a virtual object;
identifying a virtual room or virtual space in the virtual room from a plurality of virtual rooms or virtual spaces in the plurality of virtual rooms to be displayed to a user, the virtual room or virtual space including a virtual tool and the virtual object on which the virtual tool is used, wherein a virtual or augmented reality system displays the virtual tool and virtual object to a user wearing the virtual or augmented reality system, and the user performs one or more actions on the virtual object by manipulating the virtual tool;
obtaining a first set of map points, which is associated with the virtual room or virtual space, from one or more images or keyframes captured with a virtual or augmented reality display system, the first set of map points comprising a plurality of map points within a first physical room or space having physical confines at a location of the user;
determining and storing one or more map points of the first set of map points as one or more fiducial points in a non-transitory computer readable medium, wherein a fiducial point is a point in the first physical room or space at the location of the user and is characterized by and used for consistent extraction by a plurality of different hardware devices for performing machine recognition of one or more real-world objects and one or more respective object types of the one or more real-world objects in the first location;
tethering the virtual room or virtual space in the virtual room to the first set of map points; and
displaying the virtual object and the virtual tool in the virtual room or virtual space to the user in or on the first physical room or space at least by rendering the virtual object such that the confines of the virtual object extend beyond the physical confines of the first physical room or space and further at least by projecting light beams to at least one eye of the user with a projector of a virtual or augmented reality display system.
3 Assignments
0 Petitions
Accused Products
Abstract
A waveguide apparatus includes a planar waveguide and at least one optical diffraction element (DOE) that provides a plurality of optical paths between an exterior and interior of the planar waveguide. A phase profile of the DOE may combine a linear diffraction grating with a circular lens, to shape a wave front and produce beams with desired focus. Waveguide apparati may be assembled to create multiple focal planes. The DOE may have a low diffraction efficiency, and planar waveguides may be transparent when viewed normally, allowing passage of light from an ambient environment (e.g., real world) useful in AR systems. Light may be returned for temporally sequentially passes through the planar waveguide. The DOE(s) may be fixed or may have dynamically adjustable characteristics. An optical coupler system may couple images to the waveguide apparatus from a projector, for instance a biaxially scanning cantilevered optical fiber tip.
-
Citations
20 Claims
-
1. A method for generating a virtual room, comprising:
-
identifying a user specification of confines of a virtual object; identifying a virtual room or virtual space in the virtual room from a plurality of virtual rooms or virtual spaces in the plurality of virtual rooms to be displayed to a user, the virtual room or virtual space including a virtual tool and the virtual object on which the virtual tool is used, wherein a virtual or augmented reality system displays the virtual tool and virtual object to a user wearing the virtual or augmented reality system, and the user performs one or more actions on the virtual object by manipulating the virtual tool; obtaining a first set of map points, which is associated with the virtual room or virtual space, from one or more images or keyframes captured with a virtual or augmented reality display system, the first set of map points comprising a plurality of map points within a first physical room or space having physical confines at a location of the user; determining and storing one or more map points of the first set of map points as one or more fiducial points in a non-transitory computer readable medium, wherein a fiducial point is a point in the first physical room or space at the location of the user and is characterized by and used for consistent extraction by a plurality of different hardware devices for performing machine recognition of one or more real-world objects and one or more respective object types of the one or more real-world objects in the first location; tethering the virtual room or virtual space in the virtual room to the first set of map points; and displaying the virtual object and the virtual tool in the virtual room or virtual space to the user in or on the first physical room or space at least by rendering the virtual object such that the confines of the virtual object extend beyond the physical confines of the first physical room or space and further at least by projecting light beams to at least one eye of the user with a projector of a virtual or augmented reality display system. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18)
-
-
19. A system for generating a virtual room, comprising:
-
a virtual or augmented reality display system configured to identify a virtual room or virtual space to be displayed to a user, the virtual room or virtual space including a virtual tool and a virtual object on which the virtual tool is used and to display the virtual tool and virtual object to a user wearing the virtual or augmented reality system, wherein the user performs one or more actions on the virtual object by manipulating the virtual tool; a data collection module in the virtual or augmented reality display system configured to obtain a first set of map points, which is associated with the virtual room or virtual space, from one or more images or keyframes obtained with the virtual or augmented reality display system, the first set of map points corresponding to a first physical room or space at a location of the user; the virtual or augmented reality display system comprising a networking component and configured to determine and store one or more map point of the first set of map points as one or more fiducial points in a non-transitory computer readable medium, wherein a fiducial point is a point in the first physical room or space at the location of the user and is characterized by consistent extraction by a plurality of different hardware devices for machine recognition of one or more real-world objects and one or more respective object types in the first location; the virtual or augmented reality display system configured to tether the virtual room or virtual space to the first set of map points; and a projector in the virtual or augmented reality display system configured to display the virtual room or virtual space to the user by projecting light beams to at least one eye of the user, such that the virtual room, when viewed by the user, appears to be stationary at the set of first set of map points.
-
-
20. A computer program product comprising a non-transitory computer-usable storage medium storing executable code which, when executed by at least one processor, causes the at least one processor to perform a set of acts, the set of acts comprising:
-
identifying a user specification of confines of a virtual object; identifying a virtual room or virtual space to be displayed to a user, the virtual room or virtual space including a virtual tool and a virtual object on which the virtual tool is used, wherein a virtual or augmented reality system displays the virtual tool and virtual object to a user wearing the virtual or augmented reality system, and the user performs one or more actions on the virtual object by manipulating the virtual tool; obtaining a first set of map points, which is associated with the virtual room or virtual space, from one or more images or keyframes obtained with a virtual or augmented reality display system, the first set of map points corresponding to a first physical room or space at a location of the user; determining and storing one or more map point of the first set of map points as one or more fiducial points in a non-transitory computer readable medium, wherein a fiducial point is a point in the first physical room or space at the location of the user and is characterized by consistent extraction by a plurality of different hardware devices for machine recognition of one or more real-world objects and one or more respective object types in the first location; tethering the virtual room or virtual space to the first set of map points; and displaying the virtual room or virtual space to the user by projecting light beams to at least one eye of the user with a projector of a virtual or augmented reality display system, such that the virtual room, when viewed by the user, appears to be stationary at the set of first set of map points.
-
Specification