Time-synchronized, multizone medial streaming

• US 10,334,306 B2
• Filed: 09/23/2016
• Issued: 06/25/2019
• Est. Priority Date: 09/28/2015
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google LLC (Alphabet Inc.)
• Inventors: Mackay, Kenneth J., Kim, Byungchul, Maclellan, Tavis A., Lyon, Richard F., Gnegy, Chet N., Getreuer, Pascal T., Kung, Chien-Jung, Shekel, Tomer, Rifkin, Ryan M.
• Primary Examiner(s): Hunter, Mishawn N
• Application Number:
  US15/762,903
• Publication Number:
  US 20180262792A1
• Time in Patent Office: 1,005 Days
• CPC Class Codes: H04N 21/4302 Content synchronisation processes, e.g. decoder synchronisation
• CPC Class Codes: H04N 21/4305 Synchronising client clock from received content stream, e.g. locking decoder clock with encoder clock, extraction of the PCR packets arrangements for synchronising receiver with transmitter by comparing receiver clock with transmitter clock H04L7/0012; arrangements for synchronising receiver with transmitter wherein the receiver takes measures against momentary loss of synchronisation H04L7/0083
• CPC Class Codes: H04N 21/43076 of the same content streams on multiple devices, e.g. when family members are watching the same movie on different devices
• CPC Class Codes: H04N 21/43615 Interfacing a Home Network, e.g. for connecting the client to a plurality of peripherals home Audio Video Interoperability [HAVI] data switching networks H04L12/2805
• CPC Class Codes: H04N 21/44209 Monitoring of downstream path of the transmission network originating from a server, e.g. bandwidth variations of a wireless network arrangements for maintenance or administration in data switching networks involving bandwidth and capacity management H04L41/0896
• CPC Class Codes: H04N 21/44227 Monitoring of local network, e.g. connection or bandwidth variations; Detecting new devices in the local network configuring of peripheral devices in general G06F9/4411; monitoring connectivity in data switched networks H04L43/0811
• CPC Class Codes: H04N 21/64 Addressing network arrangements, protocols or services for addressing or naming H04L61/00; support for multicast or broadcast of one-way stream services H04L65/611

Abstract

In a general aspect, a system for media playback can include a first media playback device configured to receive a media stream from a media casting device over a data network, the first media playback device being a member of the media playback group and a second media playback device configured to receive the media stream, the second media playback device being a member of the media playback group. The first media playback device and the second media playback device can be collectively configured to designate one of the first media playback device and the second media playback device as a leader playback device of the media playback group. The playback device not designated as the leader playback device can be designated as a follower playback device of the media playback group. The first media playback device and the second media playback device can be further collectively configured to determine a clock offset between the leader playback device and the follower playback device. The leader playback device can be configured to receive a broadcast of the media stream over the data network; play the media stream; and provide the media stream to the follower playback device. The follower playback device can be configured to play the media stream in synchronization with the leader playback device based on the clock offset.

Claims

1. A system comprising:

a first media playback device configured to receive a media stream from a media cast device via a data network, the first media playback device being a member of a media playback group; and

a second media playback device configured to receive the media stream from the media casting device via the data network, the second media playback device being a member of the media playback group,

the first media playback device and the second media playback device being collectively configured to;

designate one of the first media playback device and the second media playback device as a leader playback device of the media playback group based on a comparison of a measure of quality of a data connection of the first media playback device with the data network and a measure of quality of a data connection of the second media playback device with the data network;

designate the one of the first media playback device and the second media playback device not designated as the leader playback device as a follower playback device of the media playback group; and

determine a clock offset between the leader playback device and the follower playback device,

the leader playback device being configured to;

receive the broadcast of the media stream from media casting device via the data network;

play the media stream; and

provide the media stream to the follower playback device,

the follower playback device being configured to play the media stream in synchronization with the leader playback device based on the clock offset.

2. The system of claim 1, wherein the first media playback device and the second media playback device each include a respective record indicating membership in the media playback group.

3. The system of claim 2, wherein the media playback group is a first media playback group, the respective record of the first media playback device further indicating membership in a second media playback group.

4. The system of claim 1, further comprising a third media playback device configured to receive the media stream, the third media playback device being a member of the media playback group,

the third media playback device and the leader playback device being collectively configured to determine a clock offset between the leader playback device and the third playback device,

the leader playback device being further configured to provide the media stream to the third media playback device,

the third media playback device being configured to play the media stream in synchronization with the leader playback device based on the clock offset between the leader playback device and the third playback device.

5. The system of claim 1, wherein each of the first media playback device and the second media playback device is configured to implement a broadcast service to broadcast a message indicating membership in the media playback group.

6. The system of claim 5, wherein the broadcasted message includes a query requesting a response from media playback devices that are connected to the data network and members of the media playback group.

7. The system of claim 1, wherein the leader playback device providing the media stream to the follower playback device includes providing the media stream to the follower playback device in a sequence of timestamped data packets.

8. The system of claim 1, wherein playing, by the follower playback device, the media stream in synchronization with the leader playback device based on the clock offset includes playing, by the follower playback device, the media stream in synchronization with the leader playback device based on the clock offset and an output delay of the follower playback device.

9. The system of claim 1, wherein the clock offset is determined based on a round-trip-time (RTT) between the leader playback device and the follower playback device.

10. A method comprising:

connecting a first media playback device with a data network, the first media playback device being operationally associated with a media playback group;

connecting a second media playback device with the data network, the second media playback device being operationally associated with the media playback group;

designating one of the first media playback device and the second media playback device as a leader playback device of the media playback group based on a comparison of a measure of quality of a data connection of the first media playback device with the data network and a measure of quality of a data connection of the second media playback device with the data network;

designating the one of the first media playback device and the second media playback device not designated as the leader playback device as a follower playback device of the media playback group;

determining a clock offset between the leader playback device and the follower playback device;

receiving, at the leader playback device from a media casting device via the data network, a media stream for playback by the media playback group;

playing the media stream by the leader playback device;

providing, by the leader playback device, the media stream to the follower playback device; and

playing, by the follower playback device, the media stream in synchronization with the leader playback device based on the clock offset.

11. The method of claim 10, wherein connecting the first media playback device with the data network includes the first media playback device sending a broadcast message indicating the first media playback device'"'"'s membership in the media playback group.

12. The method of claim 11, wherein the broadcast message includes a query requesting a response from media playback devices that are connected to the data network and operationally associated with the media playback group.

13. The method of claim 11, wherein the media playback group is a first media playback group and the broadcast message further indicating the first media playback device'"'"'s membership in a second media playback group.

14. The method of claim 10, wherein connecting the second media playback device with the data network includes the second media playback device sending a broadcast message indicating the second media playback device'"'"'s membership in the media playback group.

15. The method of claim 10, wherein designating one of the first media playback device and the second media playback device as the leader playback device includes:

determining a leadership metric for the first media playback device;

determining a leadership metric for the second media playback device; and

designating one of the first media playback device and the second media playback device as the leader playback device based on a comparison of the leadership metric for the first media playback device and the leadership metric for the second media playback device.

16. The method of claim 15, wherein:

the leadership metric for the first media playback device is based on one or more attributes of a network connection of the first media playback with the data network; and

the leadership metric for the second media playback device is based on one or more attributes of a network connection of the second media playback with the data network.

17. The method of claim 10, wherein determining the clock offset between the leader playback device and the follower playback device includes iteratively:

sending, by the follower playback device, a synchronization request including a timestamped packet to the leader playback device, the timestamped packet indicating a time of a clock of the follower playback device;

receiving, by the leader playback device, the synchronization request from the follower playback device;

sending, by the leader playback device in response to the synchronization request, a synchronization response including an indication a time of a clock of the leader playback device and the time of the clock of the follower playback device included in the synchronization request; and

determining, by the follower device based on the synchronization response;

a round-trip-time (RTT) of the synchronization request and synchronization response; and

the clock offset based on the RTT.

18. The method of claim 17, wherein determining the RTT includes calculating at least one of a weighted moving average and a linear regression based on two or more synchronization responses.

19. The method of claim 10, wherein providing the media stream to the follower playback device includes providing the media stream to the follower playback device in a sequence of timestamped data packets.

20. The method of claim 10, further comprising buffering, by the leader playback device and the follower playback device, respective portions of the media stream.

21. The method of claim 10, wherein the follower playback device is a first follower playback device, the method further comprising:

connecting a third media playback device with the data network, the third media playback device being operationally associated with the media playback group;

designating the third media playback device as a second follower playback device;

determining a clock offset between the leader playback device and the second follower playback device;

providing, by the leader playback device, the media stream to the second follower playback device; and

playing, by the second follower playback device, the media stream in synchronization with the leader playback device based on the clock offset between the leader playback device and the second follower playback device.

22. The method of claim 10, further comprising:

sending, by the follower playback device to the leader playback device, an indication that the follower playback device is leaving the media playback group; and

in response to the indication;

discontinuing, by the leader playback device, providing the media stream to the follower device; and

updating, by the leader playback device, membership information for the media playback group to remove the follower playback device.

23. The method of claim 10, wherein playing, by the follower playback device, the media stream in synchronization with the leader playback device based on the clock offset includes playing, by the follower playback device, the media stream in synchronization with the leader playback device based on the clock offset and an output delay of the follower playback device.

24. The method of claim 10, wherein the media stream is a first media stream, the method further comprising:

receiving, at the leader playback device, a request to playback a second media stream by the media playback group;

in response to the request to playback the second media stream, stopping playback of the first media stream by the leader playback device and the follower playback device;

after stopping playback of the first media stream, playing the second media stream by the leader playback device;

providing, by the leader playback device, the second media stream to the follower playback device; and

playing, by the follower playback device, the second media stream in synchronization with the leader playback device based on the clock offset.