Content mixing

• US 10,743,101 B2
• Filed: 04/14/2016
• Issued: 08/11/2020
• Est. Priority Date: 02/22/2016
• Status: Active Grant

• Current Assignee: Sonos, Inc.
• Original Assignee: Sonos, Inc.
• Inventors: Jarvis, Simon, Kadri, Romi, Bates, Paul Andrew, Vega-Zayas, Luis
• Primary Examiner(s): Goins, Davetta W
• Assistant Examiner(s): Ganmavo, Kuassi A
• Application Number:
  US15/098,760
• Publication Number:
  US 20170242650A1
• Time in Patent Office: 1,580 Days
• CPC Class Codes: G06F 3/162 Interface to dedicated audio devices, e.g. audio drivers, interface to CODECs
• CPC Class Codes: G06F 3/165 Management of the audio stream, e.g. setting of volume, audio stream path
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G10L 15/14 using statistical models, e.g. Hidden Markov Models [HMMs] G10L15/18 takes precedence
• CPC Class Codes: G10L 15/22 Procedures used during a speech recognition process, e.g. man-machine dialogue
• CPC Class Codes: G10L 2015/223 Execution procedure of a spoken command
• CPC Class Codes: G10L 21/02 Speech enhancement, e.g. noise reduction or echo cancellation reducing echo effects in line transmission systems H04B3/20; echo suppression in hands-free telephones H04M9/08
• CPC Class Codes: H04L 12/2803 Home automation networks
• CPC Class Codes: H04L 12/2809 indicating that an appliance service is present in a home automation network monitoring functionality H04L43/0817; discovery or management thereof, e.g. service location protocol [SLP] or web services, H04L67/51
• CPC Class Codes: H04L 2012/2849 Audio/video appliances
• CPC Class Codes: H04R 2227/003 Digital PA systems using, e.g. LAN or internet
• CPC Class Codes: H04R 2227/005 Audio distribution systems for home, i.e. multi-room use
• CPC Class Codes: H04R 2420/07 Applications of wireless loudspeakers or wireless microphones
• CPC Class Codes: H04R 27/00 Public address systems circuits for preventing acoustic reaction H04R3/02; circuits for distributing signals to loudspeakers H04R3/12; monitoring or testing arrangements for public address systems H04R29/007; amplifiers H03F
• CPC Class Codes: H04R 29/007 for public address systems public address systems per se H04R27/00
• CPC Class Codes: H04R 3/00 Circuits for transducers , loudspeakers or microphones
• CPC Class Codes: H04R 3/12 for distributing signals to two or more loudspeakers specially adapted for hearing aids H04R25/407
• CPC Class Codes: H04S 7/301 Automatic calibration of stereophonic sound system, e.g. with test microphone
• CPC Class Codes: H04S 7/303 Tracking of listener position or orientation
• CPC Class Codes: H04W 8/005 Discovery of network devices, e.g. terminals
• CPC Class Codes: H04W 8/24 : Transfer of terminal data
• CPC Class Codes: H04W 84/12 : WLAN [Wireless Local Area Networks]

Abstract

A playback device comprises a network interface configured to communicate with a network microphone device. A processor of the playback device comprises instructions, which when executed, cause the processor to receive a message associated with the network microphone device; and adjust a volume of audio content below a volume of content associated with the network microphone device based on the message.

Claims

1. A playback device comprising:

a network interface configured to communicate with a network microphone system, wherein the network microphone system comprises a network microphone device on a local area network with the playback device;

one or more processors; and

tangible, non-transitory computer-readable medium having stored thereon instructions, which when executed by the one or more processors, cause the playback device to perform functions comprising;

playing first audio content at a first volume;

receiving, from the network microphone system, a message indicating (i) second audio content to be output for a duration by the network microphone device, and (ii) a second volume as a default volume at which to output the second audio content by the network microphone device, wherein the second audio content comprises a response to a voice input detected by the network microphone device;

in response to receiving the message indicating the second volume, using at least the first volume and the second volume as a basis for-adaptively adjusting playback of the first audio content to be at a third volume for at least the duration of the second audio content when the second audio content is output by the network microphone device, wherein the third volume is lower than each of the first volume and the second volume;

receiving, from the network microphone system, a message indicating an updated second volume as an updated default volume at which to output the second audio content by the network microphone device; and

in response to receiving the message indicating the updated second volume, using at least the third volume and the second updated volume as a basis for adaptively adjusting playback of the first audio content to be at a fourth volume for at least the duration of the second audio content when the second audio content is output by the network microphone device, wherein the fourth volume is lower than each of the third volume and the updated second volume.

2. The playback device of claim 1, wherein the functions further comprise:

restoring playback of the first audio content to be at the first volume after the second audio content is output by the network microphone device.

3. The playback device of claim 1, wherein the functions further comprise:

playing the second audio content.

4. The playback device of claim 3, wherein playing the second audio content comprises:

mixing the first audio content and the second audio content to produce a mixed audio content; and

playing the mixed audio content.

5. The playback device of claim 3, wherein playing the second audio content comprises playing the second audio content in synchrony with output of the second audio content by the network microphone device.

6. The playback device of claim 1, wherein the network microphone device is a first microphone device, and wherein the playback device further comprises a second network microphone device on the local area network.

7. The playback device of claim 6, wherein the network microphone system further comprises the second network microphone device.

8. The playback device of claim 6, wherein the second network microphone device is configured to detect voice inputs associated with operations of the playback device.

9. The playback device of claim 8, wherein the playback device is configured to output audio in response to detected voice inputs by the second network microphone device.

10. The playback device of claim 1, wherein the third volume is not muted.

11. The playback device of claim 1, wherein using at least the first volume and the second volume as the basis for adaptively adjusting playback of the first audio content to be at the third volume comprises:

using the first volume, the second volume, and an indication of a physical location of the playback device relative to the network microphone device as the basis for adaptively adjusting playback of the first audio content to be at the third volume.

12. A method comprising:

communicating, by a playback device, with a network microphone system, wherein the network microphone system comprises a network microphone device on a local area network with the playback device;

playing, by the playback device, first audio content at a first volume;

receiving, by the playback device from the network microphone system, a message indicating (i) second audio content to be output for a duration by the network microphone device, and (ii) a second volume as a default volume at which to output the second audio content by the network microphone device, wherein the second audio content comprises a response to a voice input detected by the network microphone device;

in response to receiving the message indicating the second volume, using at least the first volume and the second volume as a basis for adaptively adjusting, by the playback device, playback of the first audio content to be at a third volume for at least the duration of the second audio content when the second audio content is output by the network microphone device, wherein the third volume is lower than each of the first volume and the second volume;

receiving, from the network microphone system, a message indicating an updated second volume as an updated default volume at which to output the second audio content by the network microphone device; and

in response to receiving the message indicating the updated second volume, using at least the third volume and the second updated volume as a basis for adaptively adjusting playback of the first audio content to be at a fourth volume for at least the duration of the second audio content when the second audio content is output by the network microphone device, wherein the fourth volume is lower than each of the third volume and the updated second volume.

13. The method of claim 12, further comprising:

restoring, by the playback device, playback of the first audio content to be at the first volume after the second audio content is output by the network microphone device.

14. The method of claim 12, further comprising:

playing, by the playback device, the second audio content.

15. The method of claim 14, wherein playing the second audio content comprises:

mixing, by the playback device, the first audio content and the second audio content to produce a mixed audio content; and

playing, by the playback device, the mixed audio content.

16. The method of claim 14, wherein playing the second audio content comprises playing, by the playback device, the second audio content in synchrony with output of the second audio content by the network microphone device.

17. The method of claim 12, wherein the network microphone device is a first microphone device, and wherein the playback device further comprises a second network microphone device on the local area network.

18. The method of claim 17, wherein the network microphone system further comprises the second network microphone device.

19. The method of claim 17, wherein the second network microphone device is configured to detect voice inputs associated with operations of the playback device.

20. The method of claim 19, wherein the playback device is configured to output audio in response to detected voice inputs by the second network microphone device.

21. The method of claim 12, wherein the third volume is not muted.

22. The method of claim 12, wherein using at least the first volume and the second volume as the basis for adaptively adjusting playback of the first audio content to be at the third volume comprises:

using the first volume, the second volume, and an indication of a physical location of the playback device relative to the network microphone device as the basis for adaptively adjusting playback of the first audio content to be at the third volume.

23. A tangible, non-transitory computer readable storage medium having stored thereon instructions, which when executed by one or more processors, cause a playback device to perform functions comprising:

communicating with a network microphone system, wherein the network microphone system comprises a network microphone device on a local area network with the playback device;

playing first audio content at a first volume;

receiving from the network microphone system, a message indicating (i) second audio content to be output for a duration by the network microphone device, and (ii) a second volume as a default volume at which to output the second audio content by the network microphone device, wherein the second audio content comprises a response to a voice input detected by the network microphone device;

in response to receiving the message indicating the second volume, using at least the first volume and the second volume as a basis for adaptively adjusting playback of the first audio content to be at a third volume for at least the duration of the second audio content when the second audio content is output by the network microphone device, wherein the third volume is lower than each of the first volume and the second volume;

receiving, from the network microphone system, a message indicating an updated second volume as an updated default volume at which to output the second audio content by the network microphone device; and

in response to receiving the message indicating the updated second volume, using at least the third volume and the second updated volume as a basis for adaptively adjusting playback of the first audio content to be at a fourth volume for at least the duration of the second audio content when the second audio content is output by the network microphone device, wherein the fourth volume is lower than each of the third volume and the updated second volume.

24. The tangible, non-transitory computer readable storage medium of claim 23, further comprising restoring playback of the first audio content to be at the first volume after the second audio content is output by the network microphone device.

25. The tangible, non-transitory computer readable storage medium of claim 23, wherein the functions further comprise:

playing the second audio content.

26. The tangible, non-transitory computer readable storage medium of claim 25, wherein playing the second audio content comprises:

mixing, by the playback device, the first audio content and the second audio content to produce a mixed audio content for playback on the playback device.

27. The tangible, non-transitory computer readable storage medium of claim 25, wherein playing the second audio content comprises playing the second audio content in synchrony with output of the second audio content by the network microphone device.

28. The tangible, non-transitory computer readable storage medium claim 23, wherein the network microphone device is a first microphone device, and wherein the playback device further comprises a second network microphone device on the local area network.

29. The tangible, non-transitory computer readable storage medium of claim 28, wherein the network microphone system further comprises the second network microphone device.

30. The tangible, non-transitory computer readable storage medium of claim 28, wherein the second network microphone device is configured to detect voice inputs associated with operations of the playback device.

31. The tangible, non-transitory computer readable storage medium of claim 30, wherein the playback device is configured to output audio in response to detected voice inputs by the second network microphone device.

32. The tangible, non-transitory computer readable storage medium of claim 23, wherein the third volume is not muted.

33. The tangible, non-transitory computer readable storage medium of claim 23, wherein using at least the first volume and the second volume as the basis for adaptively adjusting playback of the first audio content to be at the third volume comprises:

using the first volume, the second volume, and an indication of a physical location of the playback device relative to the network microphone device as the basis for adaptively adjusting playback of the first audio content to be at the third volume.