Sound conditioning

• US 10,283,114 B2
• Filed: 09/30/2014
• Issued: 05/07/2019
• Est. Priority Date: 09/30/2014
• Status: Active Grant

• Current Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Original Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Inventors: Brooks, Robert C, Biggs, Kent E, So, Chi
• Primary Examiner(s): Sirjani, Fariba
• Application Number:
  US15/514,640
• Publication Number:
  US 20170249939A1
• Time in Patent Office: 1,680 Days
• Field of Search: None
• CPC Class Codes: G10L 15/20 Speech recognition techniques specially adapted for robustness in adverse environments, e.g. in noise, of stress induced speech G10L21/02 takes precedence
• CPC Class Codes: G10L 15/22 Procedures used during a speech recognition process, e.g. man-machine dialogue
• CPC Class Codes: G10L 15/24 Speech recognition using non-acoustical features
• CPC Class Codes: G10L 2021/02082 the noise being echo, reverberation of the speech
• CPC Class Codes: G10L 2021/02166 Microphone arrays; Beamforming
• CPC Class Codes: G10L 21/0208 Noise filtering
• CPC Class Codes: G10L 21/0232 Processing in the frequency domain
• CPC Class Codes: G10L 25/60 for measuring the quality of voice signals
• CPC Class Codes: H04M 1/6008 in the transmitter circuit
• CPC Class Codes: H04R 1/406 microphones
• CPC Class Codes: H04R 2227/003 Digital PA systems using, e.g. LAN or internet
• CPC Class Codes: H04R 27/00 Public address systems circuits for preventing acoustic reaction H04R3/02; circuits for distributing signals to loudspeakers H04R3/12; monitoring or testing arrangements for public address systems H04R29/007; amplifiers H03F
• CPC Class Codes: H04R 3/005 for combining the signals of two or more microphones specially adapted for hearing aids H04R25/407

Abstract

Example implementations disclosed herein can be used to generate a local sound signal corresponding to utterances of a user and other sounds detected by a microphone array coupled to a communication device and to condition the local sound signals to separate the utterances of the user from the other sounds to generate a conditioned sound signal. The conditioned sound signals are evaluated to generate a local quality score for the conditioned sound signals, and when the local quality score of the conditioned sound signals is below a threshold associated with the communication device, a local feedback message indicating a local user position change can be generated. The local feedback message can include instructions for the user to move to another location to improve the quality of the condition sound signals.

Claims

1. A communication device comprising:

a microphone array to detect sounds and to generate sound signals corresponding to the sounds, wherein the sounds comprise utterances of a user and other sounds;

an audio processor coupled to the microphone array to perform sound conditioning on the sound signals to separate the utterances of the user from the other sounds to generate conditioned sound signals; and

a display device coupled to the audio processor,

wherein the audio processor;

monitors a quality of the conditioned sound signals,

detects that the quality of the conditioned sound signals has fallen below a threshold, and

generates, in response to detecting that the quality of the conditioned sound signals has fallen below the threshold, user feedback signals that instruct the user how to move relative to the microphone array to position the user in a location within a region of optimal sensitivity of the microphone array for detecting the sounds,

wherein the quality of the sound conditioning by the audio processor is optimized when the user is speaking the utterances while positioned within the region of optimal sensitivity of the microphone array, and

wherein the display device generates visual indicators corresponding to the user feedback signals that instruct the user how to move relative to the microphone array.

2. The communication device of claim 1, further comprising a speaker coupled to the audio processor to generate audio tones corresponding to the user feedback signals that instruct the user how to move relative to the microphone array.

3. The communication device of claim 2, wherein the audio tones comprise spoken language instructions.

4. The communication device of claim 1, further comprising a camera to capture an image of an environment in which the communication device is disposed, and

wherein the visual indicator includes the image of the environment and directional indicators superimposed on the image that instruct the user how to move relative to the microphone array.

5. The communication device of claim 1, wherein the other sounds comprise noise or echoes, and the quality of the sound conditioning comprises a measure of the separation of the utterances from the noise or the echoes in the conditioned sound signals.

6. The communication device of claim 1, further comprising a network interface coupled to the audio processor to transmit the conditioned sound signals to a remote communication device through a corresponding communication network, and wherein to generate the user feedback signals the audio processor receives a remote feedback signal from the remote communication device comprising an indication of a measure of the separation of the utterances from the other sounds.

7. The communication device of claim 1, wherein the user feedback signals guide the user to an optimal sound conditioning zone within the region of optimal sensitivity of the microphone array.

8. The communication device of claim 7, wherein the user feedback signals instruct the user of a direction the user is to move to remain in or return to the optimal sound conditioning zone within the region of optimal sensitivity of the microphone array.

9. The communication device of claim 1, wherein the user feedback signals instruct the user to move closer to or farther from the microphone array.

10. The communication device of claim 1, wherein the user feedback signals instruct the user to move left, right, up or down relative to the microphone array.

11. A non-transitory storage medium comprising instructions executable by a processor of a computing device coupled to a microphone array and a display device, the instructions executable to:

receive a conditioned sound signal, wherein the conditioned sound signal includes utterances of a user separated from other sounds as captured by the microphone array;

evaluate a quality of the conditioned sound signal;

determine that the quality of the conditioned sound signal has degraded below a threshold;

generate a user feedback signal that includes instructions to the user to position the user in a location within a region of optimal sensitivity for detecting sounds with the microphone array;

optimize the quality of the conditioned sound signal to correct the degraded conditioned sound signal, wherein the quality of the conditioned sound signal is optimized when the user is speaking the utterances while the user is positioned within the region of optimal sensitivity of the microphone array and the degraded conditioned sound signal is corrected to a level above the threshold; and

generate, on the display device, visual indicators corresponding to the user feedback signal that instruct the user how to move relative to the microphone array.

12. The storage medium of claim 11, wherein the instructions of the user feedback signal instruct the user of a direction to move to remain in or return to an optimal sound conditioning zone within the region of optimal sensitivity for detecting sounds with the microphone array.

13. The storage medium of claim 11, wherein the instructions of the user feedback signal instruct the user of a direction to move relative to the microphone array by displaying an arrow or flashing lights on the display device.

14. The storage medium of claim 11, wherein the instructions of the user feedback signal include directional indicators that instruct the user how to move relative to the microphone array superimposed on an image of an environment in which the microphone array is located as captured by a camera coupled to the computing device.

17. The method of claim 11, wherein the local quality score is a measure of separation of the utterances from the other sounds in the conditioned sound signal.

15. A processor-implemented method of optimizing sound conditioning in a communication device coupled to a microphone array and a display device, the method comprising:

generating, at the microphone array, a local sound signal corresponding to utterances of a user and other sounds detected by the microphone array;

conditioning the local sound signal to separate the utterances of the user from the other sounds to generate a conditioned sound signal;

evaluating the conditioned sound signal to generate a local quality score for the conditioned sound signal;

when the local quality score of the conditioned sound signal is below a threshold associated with the communication device, generating a local feedback message instructing the user of a direction the user is to move relative to the microphone array for positioning the user in a location within a region of optimal sensitivity for detecting sounds by the microphone array such that the local quality score of the conditioned sound signal rises above the threshold; and

generating, on the display device, visual indicators corresponding to the local feedback message that instruct the user of the direction the user is to move relative to the microphone array.

16. The method of claim 15, further comprising:

transmitting the conditioned sound signal to a remote device;

receiving a remote quality feedback signal from the remote device in response to the conditioned sound signal; and

when the remote quality feedback signal indicates the quality of the conditioned sound signal is below a threshold associated with the remote device, generating a secondary feedback message instructing the user of a secondary direction the user is to move relative to the microphone array such that the quality of the conditioned sound signal is above the threshold associated with the remote device.

18. The method of claim 15, wherein the local feedback message comprises instructions for the user to move in at least one direction relative to the microphone array superimposed on an image of an environment in which the communication device is located as captured by a camera coupled to the communication device.

19. The method of claim 15, wherein the local feedback message further includes an audio indication of the direction the user is to move relative to the microphone array.

20. The method of claim 15, wherein the local feedback message comprises instructions for guiding the user to an optimal sound conditioning zone within the region of optimal sensitivity for detecting sounds by the microphone array.