Hands-free navigation of touch-based operating systems
First Claim
Patent Images
1. A computer-implemented method for hands-free navigation of a head-mounted computing device, the method comprising:
- initializing, by the head-mounted computing device (HMD), a hands-free interaction mode, wherein the hands-free interaction mode enables hands-free interaction with a user interface of a touch-based operating system of the HMD;
based on the hands-free interaction mode being initialized, detecting, by the HMD, an initial position of the head-mounted computing device based on sensor data received from a set of sensors coupled to the HMD;
based on the initial position being detected, displaying, by the HMD, a first instance of a user interface of the touch-based operating system on a display of the head-mounted computing device, the first instance of the user interface being displayed while the HMD is in the detected initial position;
determining, by the HMD, that a first displacement of the HMD is greater than a defined first threshold displacement relative to the detected initial position, wherein the first displacement is determined based on additional sensor data received from the set of sensors;
converting, by the HMD, the first displacement to a corresponding set of touch-based inputs for communication to the touch-based operating system based on the determination that the first displacement is greater than the defined first threshold displacement.
5 Assignments
0 Petitions
Accused Products
Abstract
Aspects of the present invention allow hands-free navigation of touch-based operating systems. The system may automatically interface with a touch-based operating system and generate hands-free commands that are associated with touch-based commands. Embodiments may utilize motion and/or audio inputs to facilitate hands-free interaction with the touch-based operating system.
-
Citations
13 Claims
-
1. A computer-implemented method for hands-free navigation of a head-mounted computing device, the method comprising:
-
initializing, by the head-mounted computing device (HMD), a hands-free interaction mode, wherein the hands-free interaction mode enables hands-free interaction with a user interface of a touch-based operating system of the HMD; based on the hands-free interaction mode being initialized, detecting, by the HMD, an initial position of the head-mounted computing device based on sensor data received from a set of sensors coupled to the HMD; based on the initial position being detected, displaying, by the HMD, a first instance of a user interface of the touch-based operating system on a display of the head-mounted computing device, the first instance of the user interface being displayed while the HMD is in the detected initial position; determining, by the HMD, that a first displacement of the HMD is greater than a defined first threshold displacement relative to the detected initial position, wherein the first displacement is determined based on additional sensor data received from the set of sensors; converting, by the HMD, the first displacement to a corresponding set of touch-based inputs for communication to the touch-based operating system based on the determination that the first displacement is greater than the defined first threshold displacement. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9)
-
-
10. A system for hands-free navigation of a head-mounted computing device (HMD), the system comprising:
-
one or more processors; and one or more computer storage media storing computer-useable instructions that, when executed by the one or more processors, implement a method comprising; initializing a hands-free interaction mode, wherein the hands-free interaction mode enables hand-free interaction with a user interface of a touch-based operating system of the HMD; displaying a first instance of a user interface of the touch-based operating system on a display of the HMD; detecting, while the first instance of the user interface is being displayed, a first hands-free input comprising one or more of; a first displacement of the head-mounted computing device based on sensor data received from a set of sensors coupled to the HMD, the first displacement being above a defined threshold displacement, or a first audible input corresponding to a touch-based control dialogue included in the displayed first instance of the user interface; converting the detected first hands-free input to a corresponding set of touch-based inputs for communication to the touch-based operating system; and displaying a second instance of the user interface of the touch-based operating system on the display of the HMD. - View Dependent Claims (11, 12, 13)
-
Specification