Speaker localization by means of tactile input

• US 9,472,201 B1
• Filed: 05/22/2013
• Issued: 10/18/2016
• Est. Priority Date: 05/22/2013
• Status: Expired due to Fees

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google Inc. (Alphabet Inc.)
• Inventors: Sleator, Michael
• Primary Examiner(s): Reinier, Barbara
• Application Number:
  US13/899,832
• Time in Patent Office: 1,245 Days
• US Class Current: 1/1
• CPC Class Codes: G10L 15/20 Speech recognition techniques specially adapted for robustness in adverse environments, e.g. in noise, of stress induced speech G10L21/02 takes precedence
• CPC Class Codes: H04R 1/04 Structural association of microphone with electric circuitry therefor in deaf-aid sets H04R25/00
• CPC Class Codes: H04R 2227/003 Digital PA systems using, e.g. LAN or internet
• CPC Class Codes: H04R 2410/00 Microphones
• CPC Class Codes: H04R 3/00 Circuits for transducers , loudspeakers or microphones

Abstract

A system can receive a gesture from a user and configure a microphone system based on the received gesture to be more sensitive in the direction of a user from a device. The gesture can detected by a sensor and can be a touch input, input from a camera and a depth sensor and the like. The microphone system can include a microphone that can be electronically or mechanically steerable, or both. Acoustic signals received from the direction of the user and from other directions can be used in conjunction with an automatic speech recognition system to detect and process a command from the user.

Claims

1. A method comprising:

receiving a gesture from a user, wherein the gesture is a touch input;

configuring a microphone system based on the gesture received from the user to be more sensitive in the direction of the user that the gesture was received from based only on the direction from which the gesture was received; and

receiving a first acoustic input from the direction of the user.

2. The method of claim 1, further comprising receiving a second acoustic input from a direction other than the direction of the user.

3. The method of claim 2, further comprising increasing the signal-to-noise ratio of the first acoustic input based on the first acoustic input and the second acoustic input.

4. The method of claim 1, further comprising:

performing automatic speech recognition based on the first acoustic input; and

identifying a user command based on the performing automatic speech recognition based on the first acoustic input.

5. The method of claim 2, further comprising:

performing automatic speech recognition based on the first acoustic input and the second acoustic input; and

identifying a user command based on the performing automatic speech recognition based on the first acoustic input and the second acoustic input.

6. The method of claim 1, wherein the configuring a microphone system based on the gesture from the user includes increasing the sensitivity of at least one microphone by using at least one selected from the group of:

electronic steering and mechanical steering.

7. The method of claim 1, further comprising associating at least one of a plurality of microphones with the gesture.

8. The method of claim 7, wherein the first acoustic input is received from the at least one of a plurality of microphones associated with the gesture.

9. A system, comprising:

at least one sensor adapted and configured to receive a gesture from a user, wherein the sensor is a touch sensor or a button;

a microphone system; and

an audio processor in communication with the sensor and the microphone system to configure a microphone system based on the gesture received from the user at the sensor, the microphone system configured by the audio processor to be more sensitive in the direction of the user that the gesture was received from based only on the direction from which the gesture was received and to receive a first acoustic input from the direction of the user.

10. The system of claim 9, wherein the sensor includes at least one selected from the group consisting of:

a camera and a depth sensor.

11. The system of claim 9, wherein the microphone system includes at least one electronically steerable microphone.

12. The system of claim 9, wherein the microphone system includes at least one mechanically steerable microphone.

13. The system of claim 9, wherein the audio processor is adapted and configured to perform automatic speech recognition based on the first acoustic input.

14. The system of claim 9, wherein the audio processor is adapted and configured to receive a second acoustic input from a direction other than the direction of the user and to perform automatic speech recognition based on the first acoustic input and the second acoustic input.

15. A system comprising:

one or more computers and one or more storage devices storing instructions which are operable, when executed by the one or more computers, to cause the one or more computers to perform operations comprising;

receiving a gesture from a user, wherein the gesture is a touch input;

configuring a microphone system based on the gesture received from the user to be more sensitive in the direction of the user that the gesture was received from based only on the direction from which the gesture was received; and

receiving a first acoustic input from the direction of the user.

16. The system of claim 15 wherein the instructions further cause the one or more computers to perform operations comprising receiving a second acoustic input from a direction other than the direction of the user.

17. The system of claim 16 wherein the instructions further cause the one or more computers to perform operations comprising increasing the signal-to-noise ratio of the first acoustic input based on the first acoustic input and the second acoustic input.

18. The system of claim 15 wherein the instructions further cause the one or more computers to perform operations comprising:

performing automatic speech recognition based on the first acoustic input; and

identifying a user command based on the performing automatic speech recognition based on the first acoustic input.

19. The system of claim 16 wherein the instructions further cause the one or more computers to perform operations comprising:

performing automatic speech recognition based on the first acoustic input and the second acoustic input; and

identifying a user command based on the performing automatic speech recognition based on the first acoustic input and the second acoustic input.

20. The method of claim 15, wherein the instructions further cause the one or more computers to perform operations comprising:

increasing the sensitivity of at least one microphone by using at least one selected from the group of;

electronic steering and mechanical steering when configuring a microphone system based on the gesture from the user.