Media playback system with virtual line-in

• US 10,452,345 B1
• Filed: 08/31/2018
• Issued: 10/22/2019
• Est. Priority Date: 05/15/2018
• Status: Active Grant

• Current Assignee: Sonos, Inc.
• Original Assignee: Sonos, Inc.
• Inventors: Coburn, IV, Arthur L., Kotowski, Chris
• Primary Examiner(s): Saunders, Jr., Joseph
• Application Number:
  US16/119,516
• Time in Patent Office: 417 Days
• CPC Class Codes: G05B 15/02 electric
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/162 Interface to dedicated audio devices, e.g. audio drivers, interface to CODECs
• CPC Class Codes: G06F 3/165 Management of the audio stream, e.g. setting of volume, audio stream path
• CPC Class Codes: H04L 12/2805 Home Audio Video Interoperability [HAVI] networks
• CPC Class Codes: H04N 21/4307 Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen
• CPC Class Codes: H04N 21/43076 of the same content streams on multiple devices, e.g. when family members are watching the same movie on different devices
• CPC Class Codes: H04N 21/43615 Interfacing a Home Network, e.g. for connecting the client to a plurality of peripherals home Audio Video Interoperability [HAVI] data switching networks H04L12/2805

Abstract

Example systems and techniques disclosed herein facilitate interoperability between different media playback systems referred to herein as a virtual line-in (VLI) media playback system and a native playback system. When a VLI session is created by a VLI sender, a first native playback device can join a VLI group as a VLI receiver. As a VLI receiver, the first native playback device receives audio content and playback commands from the VLI sender to facilitate synchronous playback with other VLI receivers. At the same time, this native playback device can concurrently operate as a native domain group coordinator of a native domain synchrony group. As the native domain group coordinator, the native playback device translates VLI domain audio, control, and timing signals into the native domain and distributes such signals to native domain group members. In this way, the native domain group members can synchronize their playback with the VLI group.

Claims

1. A system comprising a first native playback device configured as a first Virtual Line In (VLI) receiver of a VLI group, wherein the VLI group is configured to (i) receive via an input interface of a first VLI device, a command to play back audio content and (ii) send, via a network interface of the first VLI device, a VLI domain audio stream representing the audio content to one or more VLI receivers of the VLI group, and wherein the first native playback device is configured to perform functions as the VLI receiver of the VLI group comprising:

receiving, via a network interface of the first native playback device, the VLI domain audio stream representing the audio content;

converting, via one or more processors, the VLI domain audio stream to a native domain audio stream at a rate set by a device clock of the first native playback device;

receiving, from a VLI domain timing server, a VLI domain clock signal;

deriving a virtual clock signal synchronized to the VLI domain clock signal;

providing the derived virtual clock signal as a seed to a native domain timing server to generate a native domain clock signal synchronized to the VLI domain clock signal;

decoding, via the one or more processors, the native domain audio stream at a rate set by the native domain clock signal; and

playing back the decoded native domain audio stream.

2. The system of claim 1, wherein the first native playback device is configured as a native domain group coordinator of a native domain synchrony group to perform functions comprising:

distributing, to one or more native domain group members, (i) the native domain audio stream and (ii) the native domain clock signal synchronized to the VLI domain clock signal,

wherein the system further comprises a second native playback device configured as a native domain group member of a native domain synchrony group to perform functions comprising;

receiving the native domain audio stream and the native domain clock signal synchronized to the VLI domain clock signal;

decoding, via one or more processors of the second native playback device, the native domain audio stream at a rate set by the native domain clock signal; and

playing back the decoded native domain audio stream via an audio stage of the second native playback device in synchrony with the first native playback device.

3. The system of claim 1, wherein deriving the virtual clock signal synchronized to the VLI domain clock signal comprises:

generating a skew signal representing error between the device clock of the first native playback device and the VLI domain clock signal; and

generating the virtual clock signal synchronized to the VLI domain clock signal from the device clock and the skew signal.

4. The system of claim 1, wherein decoding the native domain audio stream at the rate set by the native domain clock signal comprises:

disciplining a digital-to-audio converter clock to the native domain clock signal synchronized to the VLI domain clock signal.

5. The system of claim 1, wherein decoding the native domain audio stream at the rate set by the native domain clock signal comprises:

inserting or removing samples from the native domain audio stream using the native domain clock signal to cause a playback rate of the first native playback device to match VLI domain clock signal.

6. The system of claim 1, wherein providing the derived virtual clock signal as the seed to the native domain timing server comprises:

switching the seed of the native domain timing server from the device clock to the derived virtual clock signal when the VLI group initiates playback.

7. The system of claim 6, wherein the first native playback device is configured as a native domain group coordinator of a native domain synchrony group to perform functions comprising:

switching the seed of the native domain timing server from the derived virtual clock signal to the device clock when the VLI group is terminated.

8. The system of claim 1, further comprising a second native playback device,

the second native playback device configured as a second VLI receiver of the VLI group to perform functions comprising:

receiving, via a network interface of the second native playback device, the VLI domain audio stream representing the audio content;

converting, via one or more processors, the VLI domain audio stream to a second native domain audio stream at a rate set by a device clock of the second native playback device;

receiving, from the VLI domain timing server, the VLI domain clock signal;

deriving a second virtual clock signal synchronized to the VLI domain clock signal;

providing the derived second virtual clock signal as a seed to a native domain timing server of the second native playback device to generate a second native domain clock signal synchronized to the VLI domain clock signal;

decoding, via the one or more processors, the native domain audio stream at a rate set by the second native domain clock signal; and

playing back the decoded native domain audio stream in synchrony with the first native playback device via an audio stage of the second native playback device.

9. The system of claim 1, further comprising a second VLI device, the second VLI device configured as a second VLI receiver of the VLI group to perform functions comprising:

receiving, via a network interface of the second VLI device, (i) the VLI domain audio stream representing the streamed audio content and (ii) the VLI domain clock signal;

decoding the VLI domain audio stream at the rate set by the VLI domain clock signal; and

playing back the decoded VLI domain audio stream in synchrony with the first native playback device via an audio stage of the second VLI device.

10. The system of claim 1, wherein the first VLI device is configured as a second VLI receiver of the VLI group to perform functions comprising:

receiving the VLI domain clock signal;

decoding the VLI domain audio stream at the rate set by the VLI domain clock signal; and

playing back the decoded VLI domain audio stream in synchrony with the first native playback device via an audio stage of the first VLI device.

11. A method to be performed by a system comprising a first native playback device configured as a first Virtual Line In (VLI) receiver of a VLI group, wherein the VLI group is configured to (i) receive via an input interface of a first VLI device, a command to play back audio content and (ii) send, via a network interface of the first VLI device, a VLI domain audio stream representing the audio content to one or more VLI receivers of the VLI group, and wherein the first native playback device is configured as the VLI receiver of the VLI group to perform steps of the method comprising:

receiving, via a network interface of the first native playback device, the VLI domain audio stream representing the audio content;

converting, via one or more processors, the VLI domain audio stream to a native domain audio stream at a rate set by a device clock of the first native playback device;

receiving, from a VLI domain timing server, a VLI domain clock signal;

deriving a virtual clock signal synchronized to the VLI domain clock signal;

providing the derived virtual clock signal as a seed to a native domain timing server to generate a native domain clock signal synchronized to the VLI domain clock signal;

decoding, via the one or more processors, the native domain audio stream at a rate set by the native domain clock signal; and

playing back the decoded native domain audio stream.

12. The method of claim 11, wherein the first native playback device is configured as a native domain group coordinator of a native domain synchrony group to perform steps of the method comprising:

distributing, to one or more native domain group members, (i) the native domain audio stream and (ii) the native domain clock signal synchronized to the VLI domain clock signal,

wherein the system further comprises a second native playback device configured as a native domain group member of a native domain synchrony group to perform functions comprising;

receiving the native domain audio stream and the native domain clock signal synchronized to the VLI domain clock signal;

decoding, via one or more processors of the second native playback device, the native domain audio stream at a rate set by the native domain clock signal; and

playing back the decoded native domain audio stream via an audio stage of the second native playback device in synchrony with the first native playback device.

13. The method of claim 11, wherein deriving the virtual clock signal synchronized to the VLI domain clock signal comprises:

generating a skew signal representing error between the device clock of the first native playback device and the VLI domain clock signal; and

generating the virtual clock signal synchronized to the VLI domain clock signal from the device clock and the skew signal.

14. The method of claim 11, wherein decoding the native domain audio stream at the rate set by the native domain clock signal comprises:

disciplining a digital-to-audio converter clock to the native domain clock signal synchronized to the VLI domain clock signal.

15. The method of claim 11, wherein decoding the native domain audio stream at the rate set by the native domain clock signal comprises:

inserting or removing samples from the native domain audio stream using the native domain clock signal to cause a playback rate of the first native playback device to match VLI domain clock signal.

16. The method of claim 11, wherein providing the derived virtual clock signal as the seed to the native domain timing server comprises:

switching the seed of the native domain timing server from the device clock to the derived virtual clock signal when the VLI group initiates playback.

17. The method of claim 16, wherein the first native playback device is configured as a native domain group coordinator of a native domain synchrony group to perform steps of the method comprising:

switching the seed of the native domain timing server from the derived virtual clock signal to the device clock when the VLI group is terminated.

18. The method of claim 11, wherein the system further comprises a second native playback device, the second native playback device configured as a second VLI receiver of the VLI group to perform steps of the method comprising:

receiving, via a network interface of the second native playback device, the VLI domain audio stream representing the audio content;

converting, via one or more processors, the VLI domain audio stream to a second native domain audio stream at a rate set by a device clock of the second native playback device;

receiving, from the VLI domain timing server, the VLI domain clock signal;

deriving a second virtual clock signal synchronized to the VLI domain clock signal;

providing the derived second virtual clock signal as a seed to a native domain timing server of the second native playback device to generate a second native domain clock signal synchronized to the VLI domain clock signal;

decoding, via the one or more processors, the native domain audio stream at a rate set by the second native domain clock signal; and

playing back the decoded native domain audio stream in synchrony with the first native playback device via an audio stage of the second native playback device.

19. The method of claim 11, wherein the system further comprises a second VLI device, the second VLI device configured as a second VLI receiver of the VLI group to perform steps of the method comprising:

receiving, via a network interface of the second VLI device, (i) the VLI domain audio stream representing the streamed audio content and (ii) the VLI domain clock signal;

decoding the VLI domain audio stream at the rate set by the VLI domain clock signal; and

playing back the decoded VLI domain audio stream in synchrony with the first native playback device via an audio stage of the second VLI device.

20. The method of claim 11, wherein the first VLI device is configured as a second VLI receiver of the VLI group to perform steps of the method comprising:

receiving the VLI domain clock signal;

decoding the VLI domain audio stream at the rate set by the VLI domain clock signal; and

playing back the decoded VLI domain audio stream in synchrony with the first native playback device via an audio stage of the first VLI device.