Method and system for generating a virtual user interface related to a totem
First Claim
1. A method for generating a virtual user interface, comprising:
- detecting a manipulation of a totem, said manipulation being an action by a user;
recognizing, based on the detected manipulation, a first active command by the user to create a first virtual user interface;
determining, from a virtual world model obtained through a cloud network, a set of map points associated with a position of the totem, wherein the set of map points correspond to a finger of the user;
rendering, in real-time, the first virtual user interface at the determined map points associated with the position of the totem such that the first virtual user interface, when viewed by the user, appears to be stationary at the position of the totem and includes a plurality of first level menu items; and
detecting a further manipulation of the totem, the further manipulation triggering an expansion of the plurality of first level menu items by spreading apart fingers of a hand, wherein the expansion of the plurality of first level menu items renders a plurality of second level menu items that appears on the finger of the user;
recognizing, based on the detected further manipulation, a second active command to create a second virtual user interface comprising the plurality of second level menu items such that the second virtual user interface, when viewed by the user, appears to be stationary at the position of the totem; and
rendering, in real-time and based on the detected further manipulation, the second virtual user interface at the determined map points associated with the position of the totem such that the plurality of first level menu items of the virtual user interface and the plurality of second level menu items of the second virtual user interface are simultaneously viewable on the finger of the user, the second level menu items being derived from the first level menu items as lower level menu items.
3 Assignments
0 Petitions
Reexamination
Accused Products
Abstract
A waveguide apparatus includes a planar waveguide and at least one optical diffraction element (DOE) that provides a plurality of optical paths between an exterior and interior of the planar waveguide. A phase profile of the DOE may combine a linear diffraction grating with a circular lens, to shape a wave front and produce beams with desired focus. Waveguide apparati may be assembled to create multiple focal planes. The DOE may have a low diffraction efficiency, and planar waveguides may be transparent when viewed normally, allowing passage of light from an ambient environment (e.g., real world) useful in AR systems. Light may be returned for temporally sequentially passes through the planar waveguide. The DOE(s) may be fixed or may have dynamically adjustable characteristics. An optical coupler system may couple images to the waveguide apparatus from a projector, for instance a biaxially scanning cantilevered optical fiber tip.
-
Citations
17 Claims
-
1. A method for generating a virtual user interface, comprising:
-
detecting a manipulation of a totem, said manipulation being an action by a user; recognizing, based on the detected manipulation, a first active command by the user to create a first virtual user interface; determining, from a virtual world model obtained through a cloud network, a set of map points associated with a position of the totem, wherein the set of map points correspond to a finger of the user; rendering, in real-time, the first virtual user interface at the determined map points associated with the position of the totem such that the first virtual user interface, when viewed by the user, appears to be stationary at the position of the totem and includes a plurality of first level menu items; and detecting a further manipulation of the totem, the further manipulation triggering an expansion of the plurality of first level menu items by spreading apart fingers of a hand, wherein the expansion of the plurality of first level menu items renders a plurality of second level menu items that appears on the finger of the user; recognizing, based on the detected further manipulation, a second active command to create a second virtual user interface comprising the plurality of second level menu items such that the second virtual user interface, when viewed by the user, appears to be stationary at the position of the totem; and rendering, in real-time and based on the detected further manipulation, the second virtual user interface at the determined map points associated with the position of the totem such that the plurality of first level menu items of the virtual user interface and the plurality of second level menu items of the second virtual user interface are simultaneously viewable on the finger of the user, the second level menu items being derived from the first level menu items as lower level menu items. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14)
-
-
15. A method for generating a virtual user interface, comprising:
-
detecting a manipulation of a totem, said manipulation being an action by a user; recognizing, based on the detected manipulation, a first active command by a user to create a virtual user interface; determining, from a virtual world model residing in a cloud server, a set of map points associated with a position of the totem, wherein the set of map points correspond to a finger of the user; rendering, in real-time, the first virtual user interface at the determined map points associated with the position of the totem such that the virtual user interface, when viewed by the user, appears to be stationary at the position of the totem; detecting a further manipulation of the totem, the further manipulation triggering an expansion of the plurality of first level menu items by spreading apart fingers of a hand, wherein the expansion of the plurality of first level menu items renders a plurality of second level menu items that appears on the finger of the user; recognizing, based on the detected further manipulation, a further active command by the user to create a second virtual user interface comprising the plurality of second level menu items such that the second virtual user interface, when viewed by the user, appears to be stationary at the position of the totem; rendering, in real-time and based on the detected further manipulation, the second virtual user interface at the determined map points associated with the position of the totem such that the first virtual user interface and the second virtual user interface are simultaneously viewable on the finger of the user, the second level menu items being derived from the first level menu items as lower level menu items; and object recognizers examining a world model of the user'"'"'s physical environment, segmenting out tagged points associated with parametric and geometric information of particular identified objects in said physical environment, and inserting said parametric and geometric information into said world model to update said virtual world model. - View Dependent Claims (16, 17)
-
Specification