KEYBOARDS FOR VIRTUAL, AUGMENTED, AND MIXED REALITY DISPLAY SYSTEMS
First Claim
Patent Images
1. A system comprising:
- a display system configured to present virtual content in a physical environment of a user;
an outward-facing imaging system configured to image the physical environment of the user;
a hardware processor in communication with the display system and the outward-facing imaging system, the hardware processor programmed to;
analyze an image of the physical environment acquired by the outward-facing imaging system;
recognize a physical keyboard having a plurality of keys based on an analysis of the image;
determine contextual information associated with the physical keyboard;
determine a specification for the physical keyboard based at least in part on the contextual information;
dynamically configure functions of at least a portion of the physical keyboard based at least in part on the specification;
determine a rendering location of a virtual key label based at least in part on the specification; and
instruct the display system to render the virtual key label at the determined rendering location.
3 Assignments
0 Petitions
Accused Products
Abstract
User interfaces for virtual reality, augmented reality, and mixed reality display systems are disclosed. The user interfaces may be virtual or physical keyboards. Techniques are described for displaying, configuring, and/or interacting with the user interfaces.
-
Citations
23 Claims
-
1. A system comprising:
-
a display system configured to present virtual content in a physical environment of a user; an outward-facing imaging system configured to image the physical environment of the user; a hardware processor in communication with the display system and the outward-facing imaging system, the hardware processor programmed to; analyze an image of the physical environment acquired by the outward-facing imaging system; recognize a physical keyboard having a plurality of keys based on an analysis of the image; determine contextual information associated with the physical keyboard; determine a specification for the physical keyboard based at least in part on the contextual information; dynamically configure functions of at least a portion of the physical keyboard based at least in part on the specification; determine a rendering location of a virtual key label based at least in part on the specification; and instruct the display system to render the virtual key label at the determined rendering location. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11)
-
-
12. A method comprising:
-
identifying a portion of a keyboard having a plurality of keys in a three-dimensional (3D) physical environment of a user; determining a specification for the portion of keyboard based at least in part on contextual information; dynamically configuring functions of the portion of the keyboard based at least in part on the specification; determining a rendering location of a virtual key label in the portion of the keyboard based at least in part on the specification; and instructing the display system to render the virtual key label at the determined rendering location. - View Dependent Claims (13, 14, 15, 16, 17, 18, 19, 20, 21)
-
-
22. A computer-readable medium with instructions which, when read by a hardware processor, cause the hardware processor to perform a method comprising:
-
identifying a portion of a keyboard having a plurality of keys in a three-dimensional (3D) physical environment of a user; determining a specification for the portion of keyboard based at least in part on contextual information; dynamically configuring functions of the portion of the keyboard based at least in part on the specification; determining a rendering location of a virtual key label in the portion of the keyboard based at least in part on the specification; and instructing the display system to render the virtual key label at the determined rendering location.
-
-
23-38. -38. (canceled)
Specification