Wireless transmission to satellites for multichannel audio system

• US 10,681,463 B1
• Filed: 05/17/2019
• Issued: 06/09/2020
• Est. Priority Date: 05/17/2019
• Status: Active Grant

• Current Assignee: Sonos, Inc.
• Original Assignee: Sonos, Inc.
• Inventors: Beckhardt, Steven
• Primary Examiner(s): Matar, Ahmad F.
• Assistant Examiner(s): Diaz, Sabrina
• Application Number:
  US16/415,796
• Time in Patent Office: 389 Days
• Field of Search: 381300, 381307, 381303
• CPC Class Codes: H04J 3/0632 Synchronisation of packets and cells, e.g. transmission of voice via a packet network, circuit emulation service [CES] queuing arrangements in packet switching elements H04L49/90; synchronising systems for the synchronous transmission of a pulse code modulated video signal with one or more other pulse code modulated signals H04N7/56
• CPC Class Codes: H04J 3/0667 Bidirectional timestamps, e.g. NTP or PTP for compensation of clock drift and for compensation of propagation delays arrangements for monitoring round trip delays in packet switching networks H04L43/0864
• CPC Class Codes: H04L 65/611 for multicast or broadcast systems for broadcast or conference H04L12/18; arrangements for broadcast or distribution combined with broadcast H04H20/00; arrangements for broadcast applications with a direct linkage to broadcast information or to broadcast space-time H04H60/00; selective distribution of broadcast services, e.g. multimedia broadcast multicast service [MBMS], H04W4/06
• CPC Class Codes: H04L 65/762 at the source reformatting of additional data in video distribution servers H04N21/2355
• CPC Class Codes: H04L 65/80 Responding to QoS
• CPC Class Codes: H04N 21/43072 of multiple content streams on the same device
• CPC Class Codes: H04N 21/43076 of the same content streams on multiple devices, e.g. when family members are watching the same movie on different devices
• CPC Class Codes: H04N 21/43615 Interfacing a Home Network, e.g. for connecting the client to a plurality of peripherals home Audio Video Interoperability [HAVI] data switching networks H04L12/2805
• CPC Class Codes: H04N 21/44227 Monitoring of local network, e.g. connection or bandwidth variations; Detecting new devices in the local network configuring of peripheral devices in general G06F9/4411; monitoring connectivity in data switched networks H04L43/0811
• CPC Class Codes: H04N 21/8106 involving special audio data, e.g. different tracks for different languages
• CPC Class Codes: H04N 21/8113 comprising music, e.g. song in MP3 format
• CPC Class Codes: H04R 2227/005 Audio distribution systems for home, i.e. multi-room use
• CPC Class Codes: H04R 2420/07 Applications of wireless loudspeakers or wireless microphones
• CPC Class Codes: H04R 5/02 Spatial or constructional arrangements of loudspeakers
• CPC Class Codes: H04R 5/04 Circuit arrangements, e.g. for selective connection of amplifier inputs/outputs to loudspeakers, for loudspeaker detection, or for adaptation of settings to personal preferences or hearing impairments combinations of amplifiers H03F3/68; stereophonic systems H04S
• CPC Class Codes: H04S 2400/01 Multi-channel, i.e. more than two input channels, sound reproduction with two speakers wherein the multi-channel information is substantially preserved
• CPC Class Codes: H04S 3/008 in which the audio signals are in digital form, i.e. employing more than two discrete digital channels data reduction aspects thereof based on psychoacoustics G10L19/02
• CPC Class Codes: H04S 7/30 Control circuits for electronic adaptation of the sound field

Abstract

Some disclosed systems and methods include assigning channel streams to satellite playback devices, delaying initial transmission of surround sound content to satellite playback devices to accumulate audio samples for transmission in individual frames of surround sound content, and taking advantage of configured playback delays for different channels of surround sound content to prioritize transmission of channels of surround sound content having shorter configured playback delays over transmission of channels of surround sound content having longer configured playback delays.

Claims

1. A soundbar comprising:

one or more processors;

one or more speaker drivers;

one or more network interfaces configured to communicatively couple the soundbar to a local area network (LAN); and

tangible, non-transitory computer-readable media with instructions encoded thereon, wherein the instructions, when executed, cause the soundbar to perform functions comprising;

during a first time interval, (i) for each playback device in a first set of playback devices, generating a first portion of a channel stream for the playback device, and (ii) for each playback device in a second set of playback devices, generating a first portion of a channel stream for the playback device;

during a second time interval following the first time interval, (i) for each playback device in the first set of playback devices, generating a second portion of the channel stream for the playback device, and (ii) for each playback device in the second set of playback devices, generating a second portion of the channel stream for the playback device;

during a third time interval following the second time interval, (i) for each playback device in the first set of playback devices, generating a third portion of the channel stream for the playback device and transmitting the first portion and the second portion of the channel stream to the playback device via the LAN and (ii) for each playback device in the second set of playback devices, generating a third portion of the channel stream for the playback device; and

during a fourth time interval following the third time interval, (i) for each playback device in the first set of playback devices, generating a fourth portion of the channel stream for the playback device and (ii) for each playback device in the second set of playback devices, generating a fourth portion of the channel stream for the playback device and transmitting the second portion and the third portion of the channel stream to the playback device via the LAN.

2. The soundbar of claim 1, wherein the functions further comprise:

receiving surround sound content comprising surround sound audio information and surround sound audio object data, and wherein individual channel streams are based on the surround sound audio information and surround sound audio object data.

3. The soundbar of claim 1, wherein the LAN comprises one or more of a wireless LAN or a wired LAN.

4. The soundbar of claim 1, wherein the first time interval, the second time interval, the third time interval, and the fourth time interval have substantially the same duration.

5. The soundbar of claim 1, wherein each of the first time interval, the second time interval, the third time interval, and the fourth time interval is about 2.9 ms, and wherein an individual portion of the channel stream for an individual playback device comprises about 5.8 ms of audio.

6. The soundbar of claim 1, wherein transmitting the first portion and the second portion of the channel stream to an individual playback device via the LAN comprises:

generating one or more packets comprising the first portion and the second portion of the channel stream and playback timing for the first portion and the second portion of the channel stream for the individual playback device, wherein the playback timing specifies a future time at which the individual playback device is to play the first portion and the second portion of the channel stream; and

transmitting the one or more packets to the individual playback device via the LAN.

7. The soundbar of claim 1, wherein the functions further comprise:

providing clock timing information of a clock at the soundbar to individual playback devices in the first set of playback devices and the second set of playback devices, wherein the clock timing information is suitable for an individual playback device to determine a difference between the clock at the soundbar and a clock at the individual playback device.

8. The soundbar of claim 1, wherein the first set of playback devices comprises a first subwoofer, a second subwoofer, and an overhead speaker, and wherein the second set of playback devices comprises a left rear speaker and a right rear speaker.

9. The soundbar of claim 8, wherein the functions further comprise:

during the first time interval, additionally generating a first portion of a channel stream for the soundbar;

during the second time interval following the first time interval, additionally generating a second portion of the channel stream for the soundbar;

during the third time interval following the second time interval, additionally generating a third portion of the channel stream for the soundbar; and

during the fourth time interval following the third time interval, additionally generating a fourth portion of the channel stream for the soundbar.

10. The soundbar of claim 9, wherein the functions further comprise:

during a fifth time interval following the fourth time interval, playing the first portion of the channel stream for the soundbar;

during a sixth time interval following the fifth time interval, playing the second portion of the channel stream for the soundbar;

during a seventh time interval following the sixth time interval, playing the third portion of the channel stream for the soundbar while (i) the first subwoofer plays the first portion of the channel stream for the first subwoofer and (ii) the second subwoofer plays the first portion of the channel stream for the second subwoofer; and

during an eight time interval following the seventh time interval, playing the fourth portion of the channel stream for the soundbar while (i) the first subwoofer plays the second portion of the channel stream for the first subwoofer, (ii) the second subwoofer plays the second portion of the channel stream for the second subwoofer, (iii) the overhead speaker plays the first portion of the channel stream for the overhead speaker, (iv) the rear left speaker plays the first portion of the channel stream for the rear left speaker, and (v) the rear right speaker plays the first portion of the channel stream for the rear right speaker.

11. Tangible, non-transitory computer-readable media comprising instructions encoded therein, wherein the instructions, when executed by one or more processors, cause a soundbar to perform functions comprising:

during a first time interval, (i) for each playback device in a first set of playback devices, generating a first portion of a channel stream for the playback device, and (ii) for each playback device in a second set of playback devices, generating a first portion of a channel stream for the playback device;

during a second time interval following the first time interval, (i) for each playback device in the first set of playback devices, generating a second portion of the channel stream for the playback device, and (ii) for each playback device in the second set of playback devices, generating a second portion of the channel stream for the playback device;

during a third time interval following the second time interval, (i) for each playback device in the first set of playback devices, generating a third portion of the channel stream for the playback device and transmitting the first portion and the second portion of the channel stream to the playback device via a local area network (LAN) and (ii) for each playback device in the second set of playback devices, generating a third portion of the channel stream for the playback device; and

during a fourth time interval following the third time interval, (i) for each playback device in the first set of playback devices, generating a fourth portion of the channel stream for the playback device and (ii) for each playback device in the second set of playback devices, generating a fourth portion of the channel stream for the playback device and transmitting the second portion and the third portion of the channel stream to the playback device via the LAN.

12. The tangible, non-transitory computer-readable media of claim 11, wherein the functions further comprise:

receiving surround sound content comprising surround sound audio information and surround sound audio object data, and wherein individual channel streams are based on the surround sound audio information and surround sound audio object data.

13. The tangible, non-transitory computer-readable media of claim 11, wherein the LAN comprises one or more of a wireless LAN or a wired LAN.

14. The tangible, non-transitory computer-readable media of claim 11, wherein the first time interval, the second time interval, the third time interval, and the fourth time interval have substantially the same duration.

15. The tangible, non-transitory computer-readable media of claim 11, wherein each of the first time interval, the second time interval, the third time interval, and the fourth time interval is about 2.9 ms, and wherein an individual portion of the channel stream for an individual playback device comprises about 5.8 ms of audio.

16. The tangible, non-transitory computer-readable media of claim 11, wherein transmitting the first portion and the second portion of the channel stream to an individual playback device via the LAN comprises:

generating one or more packets comprising the first portion and the second portion of the channel stream and playback timing for the first portion and the second portion of the channel stream for the individual playback device, wherein the playback timing specifies a future time at which the individual playback device is to play the first portion and the second portion of the channel stream; and

transmitting the one or more packets to the individual playback device via the LAN.

17. The tangible, non-transitory computer-readable media of claim 11, wherein the functions further comprise:

providing clock timing information of a clock at the soundbar to individual playback devices in the first set of playback devices and the second set of playback devices, wherein the clock timing information is suitable for an individual playback device to determine a difference between the clock at the soundbar and a clock at the individual playback device.

18. The tangible, non-transitory computer-readable media of claim 11, wherein the first set of playback devices comprises a first subwoofer, a second subwoofer, and an overhead speaker, and wherein the second set of playback devices comprises a left rear speaker and a right rear speaker.

19. The tangible, non-transitory computer-readable media of claim 18, wherein the functions further comprise:

during the first time interval, additionally generating a first portion of a channel stream for the soundbar;

during the second time interval following the first time interval, additionally generating a second portion of the channel stream for the soundbar;

during the third time interval following the second time interval, additionally generating a third portion of the channel stream for the soundbar; and

during the fourth time interval following the third time interval, additionally generating a fourth portion of the channel stream for the soundbar.

20. The tangible, non-transitory computer-readable media of claim 19, wherein the functions further comprise:

during a fifth time interval following the fourth time interval, playing the first portion of the channel stream for the soundbar;

during a sixth time interval following the fifth time interval, playing the second portion of the channel stream for the soundbar;

during a seventh time interval following the sixth time interval, playing the third portion of the channel stream for the soundbar while (i) the first subwoofer plays the first portion of the channel stream for the first subwoofer and (ii) the second subwoofer plays the first portion of the channel stream for the second subwoofer; and

during an eight time interval following the seventh time interval, playing the fourth portion of the channel stream for the soundbar while (i) the first subwoofer plays the second portion of the channel stream for the first subwoofer, (ii) the second subwoofer plays the second portion of the channel stream for the second subwoofer, (iii) the overhead speaker plays the first portion of the channel stream for the overhead speaker, (iv) the rear left speaker plays the first portion of the channel stream for the rear left speaker, and (v) the rear right speaker plays the first portion of the channel stream for the rear right speaker.