Method and system for determining user input based on totem
First Claim
1. A method for determining user input, comprising:
- capturing, at a virtual or augmented reality system, an image within a field of view of a user, the image comprising a totem;
analyzing, at one or more microprocessors, the image to detect a manipulation of the totem by the user, the user being discrete from the totem;
recognizing, at the one or more microprocessors, a pattern in response to the manipulation based at least in part on a scoring value that is generated by matching the manipulation to one or more predetermined movement patterns in a database, wherein the pattern includes information about a position, an orientation, or motion of the totem in response to the manipulation;
determining, at the virtual or augmented reality system, a user input based at least in part on the scoring value and a threshold value;
creating a virtual user interface associated with and relative to the manipulation of the totem;
in response to the manipulation and the pattern, rendering, at one or more graphics processing units of the virtual or augmented reality system, a plurality of virtual input structures in the virtual user interface relative to the totem, whereinthe totem is inanimate and includes no physical input structures in conjunction with the one or more virtual input structures while being used by the user to access the virtual user interface; and
displaying the plurality of virtual input structures relative to the totem at least by projecting light beams corresponding to the virtual user interface with one or more projectors to at least one eye of a user, wherein the one or more projectors of the virtual or augmented reality system are coupled to at least the one or more graphics processing units.
3 Assignments
0 Petitions
Accused Products
Abstract
A waveguide apparatus includes a planar waveguide and at least one optical diffraction element (DOE) that provides a plurality of optical paths between an exterior and interior of the planar waveguide. A phase profile of the DOE may combine a linear diffraction grating with a circular lens, to shape a wave front and produce beams with desired focus. Waveguide apparatus may be assembled to create multiple focal planes. The DOE may have a low diffraction efficiency, and planar waveguides may be transparent when viewed normally, allowing passage of light from an ambient environment (e.g., real world) useful in AR systems. Light may be returned for temporally sequentially passes through the planar waveguide. The DOE(s) may be fixed or may have dynamically adjustable characteristics. An optical coupler system may couple images to the waveguide apparatus from a projector, for instance a biaxially scanning cantilevered optical fiber tip.
302 Citations
19 Claims
-
1. A method for determining user input, comprising:
-
capturing, at a virtual or augmented reality system, an image within a field of view of a user, the image comprising a totem; analyzing, at one or more microprocessors, the image to detect a manipulation of the totem by the user, the user being discrete from the totem; recognizing, at the one or more microprocessors, a pattern in response to the manipulation based at least in part on a scoring value that is generated by matching the manipulation to one or more predetermined movement patterns in a database, wherein the pattern includes information about a position, an orientation, or motion of the totem in response to the manipulation; determining, at the virtual or augmented reality system, a user input based at least in part on the scoring value and a threshold value; creating a virtual user interface associated with and relative to the manipulation of the totem; in response to the manipulation and the pattern, rendering, at one or more graphics processing units of the virtual or augmented reality system, a plurality of virtual input structures in the virtual user interface relative to the totem, wherein the totem is inanimate and includes no physical input structures in conjunction with the one or more virtual input structures while being used by the user to access the virtual user interface; and displaying the plurality of virtual input structures relative to the totem at least by projecting light beams corresponding to the virtual user interface with one or more projectors to at least one eye of a user, wherein the one or more projectors of the virtual or augmented reality system are coupled to at least the one or more graphics processing units. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 12, 13, 16, 17, 18, 19)
-
-
10. An article of manufacture embodied on a non-transitory computer usable medium, the non-transitory computer readable medium having stored thereon a sequence of instructions which, when executed by a processor causes the processor to execute a set of acts for determining user input, the set of acts comprising:
-
capturing, at a virtual or augmented reality system, an image within a field of view of a user, the image comprising an inanimate totem that is non-humanoid and discrete with respect to the user; analyzing, at the one or more microprocessors, the image to detect a manipulation of the inanimate totem, the manipulation including an interaction between the user and the totem; recognizing, at the one or more microprocessors, a pattern in response to the manipulation based at least in part on a scoring value that is generated by matching the manipulation to one or more predetermined movement patterns in a database, wherein the pattern includes information about a position, an orientation, or motion of the totem in response to the manipulation; determining, at the virtual or augmented reality system, a user input based at least in part on a scoring value and a threshold value; creating a virtual user interface associated with and relative to the manipulation of the totem; in response to the manipulation and the pattern, rendering, at one or more graphics processing units of the virtual or augmented reality system, a plurality of virtual input structures in the virtual user interface relative to the totem, wherein the totem is inanimate and includes no physical input structures in conjunction with the one or more virtual input structures for accessing the virtual user interface; and displaying the plurality of virtual input structures relative to the totem at least by projecting light beams corresponding to the virtual user interface with one or more projectors to at least one eye of a user, wherein the one or more projectors of the virtual or augmented reality system are coupled to at least the one or more graphics processing units. - View Dependent Claims (14)
-
-
11. A system for determining user input, comprising:
-
at least one microprocessor; one or more graphics processing units coupled to at least the at least one microprocessor; one or more projectors coupled to at least the one or more graphics processing units; and memory storing thereupon a sequence of instructions which, when executed by the at least one microprocessor, causes the at least one processor to; capture, at a virtual or augmented reality system, an image within a field of view of a user, the image comprising an inanimate totem that includes no physical input devices and no electronics; analyze, at one or more microprocessors, the image to detect a manipulation of the inanimate totem; recognize, at the one or more microprocessors, a pattern in response to the manipulation based at least in part on a scoring value that is generated by matching the manipulation to one or more predetermined movement patterns in a database, wherein the pattern includes information about a position, an orientation, or motion of the totem in response to the manipulation; determine, at the virtual or augmented reality system, a user input based at least in part on the scoring value and a threshold value; create a virtual user interface associated with and relative to the manipulation of the inanimate totem; in response to the manipulation and the pattern, render, at one or more graphics processing units in the virtual or augmented reality system, a plurality of virtual input structures in the virtual user interface relative to the inanimate totem, wherein the inanimate totem includes no physical input structures in conjunction with the one or more virtual input structures for accessing the virtual user interface; and display the plurality of virtual input structures relative to the inanimate totem at least by projecting light beams corresponding to the virtual user interface with one or more projectors to at least one eye of a user, wherein the one or more projectors of the virtual or augmented reality system are coupled to at least the one or more graphics processing units. - View Dependent Claims (15)
-
Specification