Behind the ear gesture control for a head mountable device

• US 10,289,205 B1
• Filed: 11/24/2015
• Issued: 05/14/2019
• Est. Priority Date: 11/24/2015
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google LLC (Alphabet Inc.)
• Inventors: Sumter, Cody, Suarez, Angela Guzman, Olsson, Maj Isabelle, Tait, Matthew, Chandel, Alok
• Primary Examiner(s): Rayan, Mihir K
• Application Number:
  US14/951,306
• Time in Patent Office: 1,267 Days
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 2027/0178 Eyeglass type eyeglass details G02C
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G02B 27/0172 characterised by optical features
• CPC Class Codes: G02B 27/0176 characterised by mechanical features
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/03547 Touch pads, in which fingers can move on a surface
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback

Abstract

Example embodiments include an example method that involves detecting, via a gesture-detection sensor of a head-mountable device (HMD), a first gesture in a buttonless-touch region. The buttonless-touch region is located behind an ear of a wearer of the HMD. The method also includes activating a voice interface responsive to detecting the first gesture and, while the voice interface is activated, receiving an audio input signal via a microphone. The method further includes detecting, via the gesture-detection sensor, a second gesture in the buttonless-touch region and, responsive to detecting the second gesture, deactivating the voice interface. The method still further includes processing the audio input signal to determine a voice command having a start-point corresponding to the detected first gesture and an end-point corresponding to the detected second gesture.

Claims

1. A head-mountable device (HMD) comprising:

a microphone;

a frame having an earpiece portion configured to be located proximate an ear of a wearer when the HMD is worn;

a gesture-detection sensor located in the earpiece portion, wherein the gesture-detection sensor is configured to detect a first gesture and a second gesture in a buttonless-touch region located posterior to the ear of the wearer; and

a processor configured to;

activate a voice interface responsive to a first signal from the gesture-detection sensor indicating that the gesture-detection sensor detected the first gesture in the buttonless-touch region located posterior to the ear,

receive an audio input signal from the microphone while the voice interface is activated,

after the first signal is received, deactivate the voice interface responsive to a second signal from the gesture-detection sensor indicating that the gesture-detection sensor detected the second gesture in the buttonless-touch region located posterior to the ear, and

determine a voice command based on the first signal, the second signal, and the audio input signal, the voice command having a start-point that corresponds to the detected first gesture and an end-point that corresponds to the detected second gesture,

wherein the first signal indicates that a finger is positioned and held in the buttonless-touch region to the posterior to the ear and the second signal indicates that the finger is removed from the buttonless-touch region to the posterior to the ear.

2. The HMD of claim 1, wherein the gesture-detection sensor is configured to detect physical contact between the wearer and an exterior surface of the earpiece portion, wherein the buttonless-touch region is provided on the exterior surface.

3. The HMD of claim 1, wherein the gesture-detection sensor is configured to detect the first gesture and the second gesture in a volume of free space adjacent to the earpiece portion, wherein the buttonless-touch region is provided in the volume of free space.

4. The HMD of claim 1, wherein the frame is in the form of eyeglasses.

5. The HMD of claim 1, wherein the processor is further configured to:

determine, using a syntax stored in memory, a programmed action corresponding to the voice command; and

perform the programmed action.

6. The HMD of claim 1, wherein the processor is further configured to:

determine data related to the voice command; and

transmit the data to a remote device to cause the remote device to carry out a programmed action corresponding to the voice command.

7. The HMD of claim 1 further comprising a display device, wherein the processor is further configured to cause the display device to display information responsive to the voice command.

8. The HMD of claim 1, wherein the processor is further configured to control operation of the microphone responsive to the first signal and the second signal.

9. A method comprising:

detecting, via a gesture-detection sensor of a head-mountable device (HMD), a first gesture in a buttonless-touch region of the HMD, wherein the buttonless-touch region is located posterior to an ear of a wearer when the HMD is worn;

responsive to detecting the first gesture in the buttonless-touch region located posterior to the ear, activating a voice interface;

while the voice interface is activated, receiving an audio input signal via a microphone;

detecting, via the gesture-detection sensor, a second gesture in the buttonless-touch region located posterior to the ear;

responsive to detecting the second gesture, deactivating the voice interface; and

processing the audio input signal to determine a voice command provided while the voice interface was activated,

wherein detecting the first gesture includes detecting a finger touched and held in the buttonless-touch region to the posterior of the ear, and wherein the detecting the second gesture includes detecting the finger removed from the buttonless-touch region to the posterior of the ear.

10. The method of claim 9, further comprising performing a programmed action corresponding to the voice command.

11. The method of claim 10, wherein the HMD includes an output device configured to provide at least one of an audio output or a visual output to the wearer of the HMD, and the performing the programmed action comprises providing information, responsive to the voice command, to the wearer via the output device.

12. The method of claim 10, further comprising:

determining, via the HMD, data corresponding to the voice command; and

transmitting the data from the HMD to a remote device, wherein the remote device performs the programmed action.

13. The method of claim 9, wherein the activating the voice interface comprises starting to capture the audio input signal via the microphone and the deactivating the voice interface comprises ceasing to capture the audio input signal via the microphone.

14. The method of claim 9, further comprising determining, using a syntax stored in a memory, the programmed action corresponding to the voice command.

15. The method of claim 9, further comprising providing the buttonless-touch region on an exterior surface of the HMD.

16. The method of claim 9, further comprising providing the buttonless-touch region in a volume of free space adjacent to the HMD.