Dynamic player selection for audio signal processing

• US 9,978,390 B2
• Filed: 06/09/2016
• Issued: 05/22/2018
• Est. Priority Date: 06/09/2016
• Status: Active Grant

• Current Assignee: Sonos, Inc.
• Original Assignee: Sonos, Inc.
• Inventors: Shih, Shao-Fu
• Primary Examiner(s): Kurr, Jason R
• Application Number:
  US15/178,180
• Publication Number:
  US 20170358313A1
• Time in Patent Office: 712 Days
• CPC Class Codes: G06F 3/162 Interface to dedicated audio devices, e.g. audio drivers, interface to CODECs
• CPC Class Codes: G10L 15/22 Procedures used during a speech recognition process, e.g. man-machine dialogue
• CPC Class Codes: G10L 2015/223 Execution procedure of a spoken command
• CPC Class Codes: G10L 2021/02082 the noise being echo, reverberation of the speech
• CPC Class Codes: G10L 2021/02166 Microphone arrays; Beamforming
• CPC Class Codes: G10L 21/0208 Noise filtering
• CPC Class Codes: G10L 21/0216 characterised by the method used for estimating noise
• CPC Class Codes: G10L 21/0264 characterised by the type of parameter measurement, e.g. correlation techniques, zero crossing techniques or predictive techniques
• CPC Class Codes: H04R 2227/003 Digital PA systems using, e.g. LAN or internet
• CPC Class Codes: H04R 2227/005 Audio distribution systems for home, i.e. multi-room use
• CPC Class Codes: H04R 2227/009 Signal processing in [PA] systems to enhance the speech intelligibility
• CPC Class Codes: H04R 27/00 Public address systems circuits for preventing acoustic reaction H04R3/02; circuits for distributing signals to loudspeakers H04R3/12; monitoring or testing arrangements for public address systems H04R29/007; amplifiers H03F
• CPC Class Codes: H04R 3/005 for combining the signals of two or more microphones specially adapted for hearing aids H04R25/407
• CPC Class Codes: H04W 24/02 Arrangements for optimising operational condition

Abstract

A set of signal measures is received, wherein each signal measure in the set of signal measures corresponds to a respective audio signal received by a device in a media playback system which is processed based on a first set of audio processing algorithms. A plurality of signal measures is identified in the set of signal measures. Audio signals corresponding to the identified plurality of signal measures are processed by one or more devices in the media playback system to improve a signal measure of each of the audio signals. The audio signals are processed based on a second set of audio processing algorithms. The processed audio signals are then combined into a combined audio signal.

Claims

1. A network device comprising:

a network interface;

a processor; and

a non-transitory computer readable storage medium comprising instructions, which when executed, cause the processor to;

receive a set of signal measures, wherein each signal measure in the set of signal measures corresponds to a respective audio signal received by a device in a media playback system which is processed based on a first set of audio processing algorithms;

identify a plurality of signal measures in the set of signal measures;

cause, via the network interface, audio signals corresponding to the identified plurality of signal measures to be processed by one or more devices in the media playback system so as to improve a signal measure of each of the audio signals, wherein the audio signals are processed based on a second set of audio processing algorithms,

wherein causing the audio signals corresponding to the identified plurality of signal measures to be processed by one or more devices in the media playback system comprises receiving an indication of spare computational power from the one or more devices, identifying which devices have a spare computational power above a threshold amount, and causing the audio signals corresponding to the identified plurality of signal measures to be processed by the identified devices; and

combine the processed audio signals into a combined audio signal.

2. The network device of claim 1, wherein an algorithm of the second set of audio processing algorithms processes the audio signals based on content played by a playback device of the media playback system.

3. The network device of claim 1, wherein a resolution of the first set of audio processing algorithms is lower than a resolution of the second set of audio processing algorithms.

4. The network device of claim 1, further comprising instructions for causing the processor to send, via the network connection, the combined audio signal to a server.

5. The network device of claim 1, wherein the first set of audio processing algorithms and the second set of audio processing algorithms comprises one or more of an echo cancellation algorithm and a beamforming algorithm.

6. The network device of claim 1, wherein combining the processed audio signals into a combined audio signal comprises weighting one or more of the processed audio signals.

7. The network device of claim 1, wherein the audio signals are impulse responses.

8. The network device of claim 1, wherein a signal measure of the combined audio signal is higher than any of the processed audio signals.

9. The network device of claim 1, wherein the identified plurality of signal measures in the set of signal measures are those with signal to noise ratios above a threshold amount.

10. A method comprising:

receiving a set of signal measures, wherein each signal measure in the set of signal measures corresponds to a respective audio signal received by a device in a media playback system which is processed based on a first set of audio processing algorithms;

identifying a plurality of signal measures in the set of signal measures;

causing audio signals corresponding to the identified plurality of signal measures to be processed by one or more devices in the media playback system to improve a signal measure of each of the audio signals, wherein the audio signals are processed based on a second set of audio processing algorithms,

wherein causing the audio signals corresponding to the identified plurality of signal measures to be processed by one or more devices in the media playback system comprises receiving an indication of spare computational power from each device in the media playback system, identifying which devices have a spare computational power above a threshold amount, and causing the audio signals corresponding to the identified plurality of signal measures to be processed by the identified devices; and

combining the processed audio signals into a combined audio signal.

11. The method of claim 10, wherein combining the processed audio signals into a combined audio signal comprises weighting one or more of the processed audio signals.

12. The method of claim 10, further comprising sending the combined audio signal to a server.

13. The method of claim 10, wherein the first set of audio processing algorithms and the second set of audio processing algorithms comprises one or more of an echo cancellation algorithm and a beamforming algorithm.

14. The method of claim 10, wherein the identified plurality of signal measures in the set of signal measures are those with signal to noise ratios above a threshold amount.

15. The method of claim 10, wherein the signal measure is a signal to noise ratio.

16. A non-transitory computer readable storage medium including instructions for execution by a processor, the instructions, when executed, cause the processor to implement a method comprising:

receiving a set of signal measures, wherein each signal measure in the set of signal measures corresponds to a respective audio signal received by a device in a media playback system which is processed based on a first set of audio processing algorithms;

identifying a plurality of signal measures in the set of signal measures;

causing audio signals corresponding to the identified plurality of signal measures to be processed by one or more devices in the media playback system to improve a signal measure of each of the audio signals, wherein the audio signals are processed based on a second set of audio processing algorithms,

wherein causing the audio signals corresponding to the identified plurality of signal measures to be processed by one or more devices in the media playback system comprises receiving an indication of spare computational power from the one or more devices, identifying which devices have a spare computational power above a threshold amount, and causing the audio signals corresponding to the identified plurality of signal measures to be processed by the identified devices; and

combining the processed audio signals into a combined audio signal.

17. The non-transitory computer readable storage medium of claim 16, wherein combining the processed audio signals into a combined audio signal comprises weighting one or more of the processed audio signals.