Playback device synchrony group states

• US 10,216,473 B2
• Filed: 08/22/2016
• Issued: 02/26/2019
• Est. Priority Date: 07/28/2003
• Status: Expired due to Term

• Current Assignee: Sonos, Inc.
• Original Assignee: Sonos, Inc.
• Inventors: Millington, Nicholas A. J.
• Primary Examiner(s): Survillo, Oleg
• Application Number:
  US15/243,186
• Publication Number:
  US 20160357499A1
• Time in Patent Office: 918 Days
• Field of Search: 709219, 709220, 709231
• CPC Class Codes: G05B 15/02 electric
• CPC Class Codes: G06F 1/00 Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00 architectures of general purpose stored program computers G06F15/76
• CPC Class Codes: G06F 1/12 Synchronisation of different clock signals provided by a plurality of clock generators
• CPC Class Codes: G06F 16/2322 using timestamps
• CPC Class Codes: G06F 16/60 of audio data
• CPC Class Codes: G06F 16/63 Querying
• CPC Class Codes: G06F 16/635 Filtering based on additional data, e.g. user or group profiles
• CPC Class Codes: G06F 16/638 Presentation of query results
• CPC Class Codes: G06F 16/639 using playlists
• CPC Class Codes: G06F 16/68 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G06F 17/00 Digital computing or data processing equipment or methods, specially adapted for specific functions information retrieval, database structures or file system structures therefor G06F16/00
• CPC Class Codes: G06F 3/048 Interaction techniques based on graphical user interfaces [GUI]
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/0484 for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/04847 Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
• CPC Class Codes: G06F 3/16 Sound input; Sound output speech processing G10L
• CPC Class Codes: G06F 3/162 Interface to dedicated audio devices, e.g. audio drivers, interface to CODECs
• CPC Class Codes: G06F 3/165 Management of the audio stream, e.g. setting of volume, audio stream path
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G11B 20/10527 : Audio or video recording; Data buffering arrangements G11B20/12 - G11B20/18 take precedence
• CPC Class Codes: G11B 2020/10592 : specifically adapted for recording or reproducing multichannel signals
• CPC Class Codes: H03G 3/00 : Gain control in amplifiers or frequency changers
• CPC Class Codes: H03G 3/20 : Automatic control H03G3/005 takes precedence; combined with volume compression or expansion H03G7/00
• CPC Class Codes: H04H 20/103 : Transmitter-side switching
• CPC Class Codes: H04H 20/26 : Arrangements for switching distribution systems
• CPC Class Codes: H04H 2201/20 : digital audio broadcasting [DAB]
• CPC Class Codes: H04J 3/0644 : External master-clock
• CPC Class Codes: H04J 3/0664 : unidirectional timestamps
• CPC Class Codes: H04L 12/2854 : Wide area networks, e.g. public data networks
• CPC Class Codes: H04L 65/1069 : Session establishment or de-establishment
• CPC Class Codes: H04L 65/1094 : Inter-user-equipment sessions transfer or sharing
• CPC Class Codes: H04L 65/60 : Network streaming of media packets
• CPC Class Codes: H04L 65/61 : for supporting one-way streaming services, e.g. Internet radio
• CPC Class Codes: H04L 65/611 : for multicast or broadcast systems for broadcast or conference H04L12/18; arrangements for broadcast or distribution combined with broadcast H04H20/00; arrangements for broadcast applications with a direct linkage to broadcast information or to broadcast space-time H04H60/00; selective distribution of broadcast services, e.g. multimedia broadcast multicast service [MBMS], H04W4/06
• CPC Class Codes: H04L 65/612 : for unicast
• CPC Class Codes: H04L 65/613 : for the control of the source by the destination control signals issued by the client directed to the server or network components specially adapted for selective content distribution H04N21/637
• CPC Class Codes: H04L 65/75 : Media network packet handling
• CPC Class Codes: H04L 65/80 : Responding to QoS
• CPC Class Codes: H04L 67/1095 : Replication or mirroring of data, e.g. scheduling or transport for data synchronisation between network nodes
• CPC Class Codes: H04L 67/12 : specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks
• CPC Class Codes: H04L 67/55 : Push-based network services
• CPC Class Codes: H04L 69/28 : Timers or timing mechanisms used in protocols
• CPC Class Codes: H04N 21/4307 : Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen
• CPC Class Codes: H04N 21/43076 : of the same content streams on multiple devices, e.g. when family members are watching the same movie on different devices
• CPC Class Codes: H04N 21/43615 : Interfacing a Home Network, e.g. for connecting the client to a plurality of peripherals home Audio Video Interoperability [HAVI] data switching networks H04L12/2805
• CPC Class Codes: H04N 5/04 : Synchronising for television systems using pulse code modulation H04N7/56
• CPC Class Codes: H04N 9/7904 : using intermediate digital signal processing
• CPC Class Codes: H04R 2227/003 : Digital PA systems using, e.g. LAN or internet
• CPC Class Codes: H04R 2227/005 : Audio distribution systems for home, i.e. multi-room use
• CPC Class Codes: H04R 27/00 : Public address systems circuits for preventing acoustic reaction H04R3/02; circuits for distributing signals to loudspeakers H04R3/12; monitoring or testing arrangements for public address systems H04R29/007; amplifiers H03F
• CPC Class Codes: H04R 3/12 : for distributing signals to two or more loudspeakers specially adapted for hearing aids H04R25/407
• CPC Class Codes: H04W 56/0015 : one node acting as a reference for the others
• CPC Class Codes: H04W 84/20 : Master-slave selection or change arrangements
• CPC Class Codes: H05K 999/99 : dummy group

Abstract

A system is described for maintaining synchrony of operations among a plurality of devices that have independent clocking arrangements. The system includes a task distribution device that distributes tasks to a synchrony group comprising a plurality of devices that are to perform the tasks distributed by the task distribution device in synchrony. The task distribution device distributes each task to the members of the synchrony group over a network. Each task is associated with a time stamp that indicates a time, relative to a clock maintained by the task distribution device, at which the members of the synchrony group are to execute the task. Each member of the synchrony group periodically obtains from the task distribution device an indication of the current time indicated by its clock, determines a time differential between the task distribution device'"'"'s clock and its respective clock and determines therefrom a time at which, according to its respective clock, the time stamp indicates that it is to execute the task.

Claims

1. A method performed by a first playback device, the method comprising:

receive from a network device, via the at least one of a LAN or a WAN, first control information comprising identification of an audio information source, instructions for the first playback device to play first audio information from the audio information source, and an instruction for the first playback device to operate in a first synchrony group state in which the first playback device is designated as a master of a first synchrony group, wherein the master provides the first audio information to each other member of the first synchrony group and coordinates synchronous playback of the first audio information in the first synchrony group, and wherein the first synchrony group comprises a second playback device;

after receiving the first control information, operating in the first synchrony group state during which the first playback device (1) obtains the first audio information from the audio information source, (2) provides the first audio information to the second playback device, (3) at least one of receives or transmits, over at least one of the LAN or the WAN, playback timing information associated with the first audio information, and (4) uses the playback timing information associated with the first audio information to play back the first audio information in synchrony with the second playback device;

while operating in the first synchrony group state, receiving, via the at least one of the LAN or the WAN, second control information from the network device, the second control information comprising instructions for the first playback device to transition from the first synchrony group state to a second synchrony group state and join a second synchrony group, wherein the second synchrony group comprises a third playback device and the first playback device, and wherein the third playback device is a master of the second synchrony group and not a member of the first synchrony group; and

after receiving the second control information, transitioning from operating in the first synchrony group state to operating in the second synchrony group state, wherein in the second synchrony group state, the first playback device (1) obtains second audio information from the third playback device, (2) at least one of receives or transmits, via the at least one of the LAN and the WAN, playback timing information associated with the second audio information, and (3) uses the playback timing information associated with the second audio information to play back the second audio information in synchrony with the third playback device.

2. The method of claim 1, further comprising:

while operating in the first synchrony group state, additionally provide clock timing to the second playback device, and wherein using the playback timing information associated with the first audio information to play back the first audio information in synchrony with the second playback device using the clock timing and the playback timing information associated with the first audio information to play back the first audio information in synchrony with the second playback device.

3. The method of claim 1, further comprising:

while operating in the second synchrony group state, additionally receive clock timing from the third playback device, and wherein using the playback timing information associated with the second audio information to play back the first audio information in synchrony with playback of the second audio information by the third playback device comprises using the clock timing and the playback timing information associated with the second audio information to play back the second audio information in synchrony with playback of the second audio information by the third playback device.

4. The method of claim 1, wherein the second control information comprises an instruction to obtain playback timing information associated with the second audio information from the third playback device.

5. The method of claim 1, wherein the second control information identifies the third playback device.

6. The method of claim 1, further comprising:

while transitioning from operating in the first synchrony group state to operating in the second synchrony group state, cease (1) obtaining the first audio information form the audio information source, (2) providing the first audio information to the second playback device, (2) receiving or transmitting playback timing associated with the first audio information, and

     4) using the playback timing information associated with the first audio information to play back the first audio information in synchrony with the second playback device.

7. The method of claim 1, wherein the first playback device receives the first and second control information via the LAN.

8. The method of claim 1, wherein the method further comprises:

receiving, via the at least one of the LAN or the WAN while operating in the second synchrony group state, third control information, the third control information comprising instructions for the first playback device to transition from the second synchrony group state to a third synchrony group state; and

after receiving the third control information, transitioning from operating in the second synchrony group state to operate in a third synchrony group state, wherein while in the third synchrony group state the first playback device is configured to (1) obtain, from a directly connected audio information source, third audio information and (2) play back the third audio information individually.

9. The method of claim 1, further comprising:

receive, via the at least one of the LAN or the WAN while operating in the second synchrony group state, third control information, the third control information comprising instructions for the first playback device to transition from the second synchrony group state to a third synchrony group state; and

after receiving the third control information, transition from operating in the second synchrony group state to operate in a third synchrony group state, wherein while in the third synchrony group state the first playback device is configured to (1) obtain, from a directly connected audio information source, third audio information (2) provide, to at least one of the second or the third playback devices, the third audio information and playback timing information associated with the third audio information, and (3) use the playback timing information associated with the third audio information to play back the third audio information in synchrony with at least one of the second or third playback devices.

10. The method of claim 9, further comprising:

receive, via the at least one of the LAN or the WAN while operating in the second synchrony group state, third control information, the third control information comprising instructions for the first playback device to transition from the second synchrony group state to a third synchrony group state; and

after receiving the third control information, transition from operating in the second synchrony group state to operate in a third synchrony group state, wherein while in the third synchrony group state the first playback device is configured to (1) obtain, from a directly connected audio information source, third audio information (2) provide, to at least one of the second or third playback devices, playback timing information associated with the third audio information and clock timing, and (3) use the playback timing information associated with the third audio information and the clock timing to play back the third audio information in synchrony with at least one of the second and third playback devices.

11. The method of claim 1, wherein the playback timing information comprises a plurality of timestamps.

12. The method of claim 1, wherein while operating in the first synchrony group state, the first playback device transmits playback timing information associated with the first audio information to the second playback device via the at least one of the LAN or the WAN.

13. The method of claim 1, wherein while operating in the second synchrony group state, the first playback device receives playback timing information associated with the second audio information via the at least one of the LAN or the WAN.

16. The first playback device of claim 1, wherein the program instructions, when executed by the one or more processors, further cause the first playback device to:

while operating in the second synchrony group state, additionally receive clock timing from the third playback device, and wherein using the playback timing information associated with the second audio information to play back the first audio information in synchrony with playback of the second audio information by the third playback device comprises using the clock timing and the playback timing information associated with the second audio information to play back the second audio information in synchrony with playback of the second audio information by the third playback device.

14. A first playback device, wherein the first playback device is configured to communicate over at least one of a local area network (LAN) or a wide area network (WAN) with a network device, and wherein the first playback device comprises:

one or more processors;

tangible, non-transitory computer-readable memory comprising program instructions that, when executed by the one or more processors, causes the first playback device to;

receive from the network device, via the at least one of the LAN or the WAN, first control information comprising identification of an audio information source, instructions for the first playback device to play first audio information from the audio information source, and an instruction for the first playback device to operate in a first synchrony group state in which the first playback device is designated as a master of a first synchrony group, wherein the master provides the first audio information to each other member of the first synchrony group and coordinates synchronous playback of the first audio information in the first synchrony group, and wherein the first synchrony group comprises a second playback device;

after receiving the first control information, operate in the first synchrony group state during which the first playback device (1) obtains the first audio information from the audio information source, (2) provides the first audio information to the second playback device, (3) at least one of receives or transmits, via the at least one of the LAN or the WAN, playback timing information associated with the first audio information, and (4) uses the playback timing information associated with the first audio information to play back the first audio information in synchrony with the second playback device;

while operating in the first synchrony group state, receive, via the at least one of the LAN or the WAN, second control information from the network device, the second control information comprising instructions for the first playback device to transition from the first synchrony group state to a second synchrony group state and join a second synchrony group, wherein the second synchrony group comprises a third playback device and the first playback device, and wherein the third playback device is a master of the second synchrony group and not a member of the first synchrony group; and

after receiving the second control information, transitioning from operating in the first synchrony group state to operating in the second synchrony group state, wherein in the second synchrony group state, the first playback device (1) obtains second audio information from the third playback device, (2) at least one of receives or transmits, via the at least one of the LAN or the WAN, playback timing information associated with the second audio information, and (3) uses the playback timing information associated with the second audio information to play back the second audio information in synchrony with the third playback device.

15. The first playback device of claim 14, wherein the program instructions, when executed by the one or more processors, further cause the first playback device to:

while operating in the first synchrony group state, additionally provide clock timing to the second playback device, and wherein using the playback timing information associated with the first audio information to play back the first audio information in synchrony with the second playback device comprises using the clock timing and the playback timing information associated with the first audio information to play back the first audio information in synchrony with the second playback device.

17. The first playback device of claim 14, wherein the second control information further comprises an instruction to obtain playback timing information associated with the second audio information from the third playback device.

18. The first playback device of claim 14, wherein the second control information identifies the third playback device.

19. The first playback device of claim 14, wherein the program instructions, when executed by the one or more processors, further cause the first playback device to:

while transitioning from operating in the first synchrony group state to operating in the second synchrony group state, cease (1) obtaining the first audio information from the audio information source, (2) providing the first audio information to the second playback device, (2) receiving or transmitting playback timing associated with the first audio information, and (4) using the playback timing information associated with the first audio information to play back the first audio information in synchrony with the second playback device.

20. The first playback device of claim 14, wherein the first playback device receives the first and second control information via the LAN.

21. The first playback device of claim 14, wherein the program instructions, when executed by the one or more processors, further cause the first playback device to:

receive, via the at least one of the LAN or the WAN while operating in the second synchrony group state, third control information, the third control information comprising instructions for the first playback device to transition from the second synchrony group state to a third synchrony group state; and

after receiving the third control information, transition from operating in the second synchrony group state to operate in a third synchrony group state, wherein while in the third synchrony group state the first playback device is configured to (1) obtain, from a directly connected audio information source, third audio information and (2) play back the third audio information individually.

22. The first playback device of claim 14, wherein the program instructions, when executed by the one or more processors, further cause the first playback device to:

receive, via the at least one of the LAN or the WAN while operating in the second synchrony group state, third control information, the third control information comprising instructions for the first playback device to transition from the second synchrony group state to a third synchrony group state; and

after receiving the third control information, transition from operating in the second synchrony group state to operate in a third synchrony group state, wherein while in the third synchrony group state the first playback device is configured to (1) obtain, from a directly connected audio information source, third audio information (2) provide, to at least one of the second or the third playback devices, the third audio information and playback timing information associated with the third audio information, and (3) use the playback timing information associated with the third audio information to play back the third audio information in synchrony with at least one of the second or third playback devices.

23. The first playback device of claim 22, wherein the program instructions, when executed by the one or more processors, further cause the first playback device to:

receive, via the at least one of the LAN or the WAN while operating in the second synchrony group state, third control information, the third control information comprising instructions for the first playback device to transition from the second synchrony group state to a third synchrony group state; and

after receiving the third control information, transition from operating in the second synchrony group state to operate in a third synchrony group state, wherein while in the third synchrony group state the first playback device is configured to (1) obtain, from a directly connected audio information source, third audio information (2) provide, to the at least one of the second or the third playback devices, playback timing information associated with the third audio information and clock timing, and (3) use the playback timing information associated with the third audio information and the clock timing to play back the third audio information in synchrony with at least one of the second and third playback devices.

24. The first playback device of claim 14, wherein the playback timing information comprises a plurality of timestamps.

25. The first playback device of claim 14, wherein while operating in the first synchrony group state, the first playback device transmits playback timing information associated with the first audio information to the second playback device via the at least one of the LAN or the WAN.

26. The first playback device of claim 14, wherein while operating in the second synchrony group state, the first playback device receives playback timing information associated with the second audio information via the at least one of the LAN or the WAN.

27. Tangible, non-transitory computer-readable media comprising instructions encoded therein, wherein the instructions, when executed by a first playback device, cause the first playback device to perform functions, comprising:

receiving from a network device, via the at least one of a LAN or a WAN, first control information comprising identification of an audio information source, instructions for the first playback device to play first audio information from the audio information source, and an instruction for the first playback device to operate in a first synchrony group state in which the first playback device is designated as a master of a first synchrony group, wherein the master provides the first audio information to each other member of the first synchrony group and coordinates synchronous playback of the first audio information in the first synchrony group, and wherein the first synchrony group comprises a second playback device;

after receiving the first control information, operating in the first synchrony group state during which the first playback device (1) obtains the first audio information from the audio information source, (2) provides the first audio information to the second playback device, (3) at least one of receives or transmits, over at least one of the LAN or the WAN, playback timing information associated with the first audio information, and (4) uses the playback timing information associated with the first audio information to play back the first audio information in synchrony with the second playback device;

while operating in the first synchrony group state, receiving, via the at least one of the LAN or the WAN, second control information from the network device, the second control information comprising instructions for the first playback device to transition from the first synchrony group state to a second synchrony group state and join a second synchrony group, wherein the second synchrony group comprises a third playback device and the first playback device, and wherein the third playback device is a master of the second synchrony group and not a member of the first synchrony group; and

after receiving the second control information, transitioning from operating in the first synchrony group state to operating in the second synchrony group state, wherein in the second synchrony group state, the first playback device (1) obtains second audio information from the third playback device, (2) at least one of receives or transmits, via the at least one of the LAN or the WAN, playback timing information associated with the second audio information, and (3) uses the playback timing information associated with the second audio information to play back the second audio information in synchrony with the third playback device.

28. The tangible, non-transitory computer-readable media of claim 27, wherein the functions further comprise:

while operating in the first synchrony group state, additionally providing clock timing to the second playback device, and wherein using the playback timing information associated with the first audio information to play back the first audio information in synchrony with the second playback device comprises using the clock timing and the playback timing information associated with the first audio information to playback the first audio information in synchrony with the second playback device.

29. The tangible, non-transitory computer-readable media of claim 27, wherein the functions further comprise:

while operating in the second synchrony group state, additionally receiving clock timing from the third playback device, and wherein using the playback timing information associated with the second audio information to play back the first audio information in synchrony with playback of the second audio information by the third playback device comprises using the clock timing and the playback timing information associated with the second audio information to play back the second audio information in synchrony with playback of the second audio information by the third playback device.

30. The tangible, non-transitory computer-readable media of claim 27, wherein the second control information further comprises an instruction to obtain playback timing information associated with the second audio information from the third playback device.

31. The tangible, non-transitory computer-readable media of claim 27, wherein the second control information identifies the third playback device.

32. The tangible, non-transitory computer-readable media of claim 27, wherein the functions further comprise:

while transitioning from operating in the first synchrony group state to operating in the second synchrony group state, cease (1) obtaining the first audio information from the audio information source, (2) providing the first audio information to the second playback device, (2) receiving or transmitting playback timing associated with the first audio information, and (4) using the playback timing information associated with the first audio information to play back the first audio information in synchrony with the second playback device.

33. The tangible, non-transitory computer-readable media of claim 27, wherein the first playback device receives the first and second control information via the LAN.

34. The tangible, non-transitory computer-readable media of claim 27, wherein the functions further comprise:

receiving, via the at least one of the LAN or the WAN while operating in the second synchrony group state, third control information, the third control information comprising instructions for the first playback device to transition from the second synchrony group state to a third synchrony group state; and

after receiving the third control information, transitioning from operating in the second synchrony group state to operate in a third synchrony group state, wherein while in the third synchrony group state the first playback device (1) obtains, from a directly connected audio information source, third audio information and (2) plays back the third audio information individually.

35. The tangible, non-transitory computer-readable media of claim 27, wherein the functions further comprise:

receiving, via the at least one of the LAN or the WAN while operating in the second synchrony group state, third control information, the third control information comprising instructions for the first playback device to transition from the second synchrony group state to a third synchrony group state; and

after receiving the third control information, transitioning from operating in the second synchrony group state to operate in a third synchrony group state, wherein while in the third synchrony group state the first playback device is configured to (1) obtain, from a directly connected audio information source, third audio information (2) provide, to at least one of the second or the third playback devices, the third audio information and playback timing information associated with the third audio information, and (3) use the playback timing information associated with the third audio information to play back the third audio information in synchrony with at least one of the second and third playback devices.

36. The tangible, non-transitory computer-readable media of claim 35, wherein the functions further comprise:

receiving, via the at least one of the LAN or the WAN while operating in the second synchrony group state, third control information, the third control information comprising instructions for the first playback device to transition from the second synchrony group state to a third synchrony group state; and

after receiving the third control information, transitioning from operating in the second synchrony group state to operate in a third synchrony group state, wherein while in the third synchrony group state the first playback device is configured to (1) obtain, from a directly connected audio information source, third audio information (2) provide, to at least one of the second or the third playback devices, playback timing information associated with the third audio information and clock timing, and (3) use the playback timing information associated with the third audio information and the clock timing to play back the third audio information in synchrony with at least one of the second or third playback devices.

37. The tangible, non-transitory computer-readable media of claim 27, wherein the playback timing information comprises a plurality of timestamps.

38. The tangible, non-transitory computer-readable media of claim 27, wherein while operating in the first synchrony group state, the first playback device transmits playback timing information associated with the first audio information to the second playback device via the at least one of the LAN or the WAN.

39. The tangible, non-transitory computer-readable media of claim 27, wherein while operating in the second synchrony group state, the first playback device receives playback timing information associated with the second audio information via the at least one of the LAN or the WAN.