Time-synchronized, multizone media streaming

• US 10,587,908 B2
• Filed: 06/24/2019
• Issued: 03/10/2020
• Est. Priority Date: 09/28/2015
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google LLC (Alphabet Inc.)
• Inventors: Mackay, Kenneth J., Kim, Byungchul, Maclellan, Tavis A., Lyon, Richard F., Gnegy, Chet N., Getreuer, Pascal T., Kung, Chien-Jung, Shekel, Tomer, Rifkin, Ryan M.
• Primary Examiner(s): Hunter, Mishawn N.
• Application Number:
  US16/450,323
• Publication Number:
  US 20190313143A1
• Time in Patent Office: 260 Days
• CPC Class Codes: H04N 21/4302 Content synchronisation processes, e.g. decoder synchronisation
• CPC Class Codes: H04N 21/4305 Synchronising client clock from received content stream, e.g. locking decoder clock with encoder clock, extraction of the PCR packets arrangements for synchronising receiver with transmitter by comparing receiver clock with transmitter clock H04L7/0012; arrangements for synchronising receiver with transmitter wherein the receiver takes measures against momentary loss of synchronisation H04L7/0083
• CPC Class Codes: H04N 21/43076 of the same content streams on multiple devices, e.g. when family members are watching the same movie on different devices
• CPC Class Codes: H04N 21/43615 Interfacing a Home Network, e.g. for connecting the client to a plurality of peripherals home Audio Video Interoperability [HAVI] data switching networks H04L12/2805
• CPC Class Codes: H04N 21/44209 Monitoring of downstream path of the transmission network originating from a server, e.g. bandwidth variations of a wireless network arrangements for maintenance or administration in data switching networks involving bandwidth and capacity management H04L41/0896
• CPC Class Codes: H04N 21/44227 Monitoring of local network, e.g. connection or bandwidth variations; Detecting new devices in the local network configuring of peripheral devices in general G06F9/4411; monitoring connectivity in data switched networks H04L43/0811
• CPC Class Codes: H04N 21/64 Addressing network arrangements, protocols or services for addressing or naming H04L61/00; support for multicast or broadcast of one-way stream services H04L65/611

Abstract

In a general aspect, a system for media playback can include a first media playback device configured to receive a media stream from a media casting device over a data network, the first media playback device being a member of the media playback group and a second media playback device configured to receive the media stream, the second media playback device being a member of the media playback group. The first media playback device and the second media playback device can be collectively configured to designate one of the first media playback device and the second media playback device as a leader playback device of the media playback group. The playback device not designated as the leader playback device can be designated as a follower playback device of the media playback group. The first media playback device and the second media playback device can be further collectively configured to determine a clock offset between the leader playback device and the follower playback device. The leader playback device can be configured to receive a broadcast of the media stream over the data network; play the media stream; and provide the media stream to the follower playback device. The follower playback device can be configured to play the media stream in synchronization with the leader playback device based on the clock offset.

Claims

1. A method for synchronized media playback, the method comprising:

connecting, using a media playback device, to a communications network, wherein the media playback device is associated with a media playback group that includes a plurality of media playback devices;

receiving an indication that the media playback device has been designated as a follower playback device, wherein a remaining media playback device in the media playback group is designated as a leader playback device;

in response to receiving the indication that the media playback device has been designated as the follower playback device, transmitting, from the follower playback device to the leader playback device, a first series of synchronization requests, wherein a latency between two synchronization requests in the first series of synchronization requests is a first duration of time;

receiving a first series of synchronization responses from the leader playback device;

determining a clock offset between the follower playback device and the leader playback device based on at least a portion of the first series of synchronization responses;

receiving, from the leader playback device, an indication that media content is to be presented synchronously by the plurality of media playback devices in the media playback group;

in response to receiving the indication that media content is to be presented synchronously by the plurality of media playback devices, transmitting, from the follower playback device to the leader playback device, a second series of synchronization requests, wherein a latency between two synchronization requests in the second series of synchronization requests is a second duration of time, and wherein the second duration of time is shorter than the first duration of time;

receiving a second series of synchronization responses from the leader playback device;

determining an updated clock offset based on at least a portion of the second series of synchronization responses;

receiving a media stream for playback by the media playback group; and

causing the media stream to be played back on the follower playback device in synchronization with the leader playback device based on the updated clock offset.

2. The method of claim 1, wherein the media playback device has been designated as the follower playback device and the remaining media playback device has been designated as the leader playback device based on a comparison of a measure of quality of a data connection of the first media playback device with the communications network and a measure of quality of a data connection of the second media playback device with the communications network.

3. The method of claim 1, wherein the media playback device and the remaining media playback device each include a respective record indicating membership in the media playback group.

4. The method of claim 3, wherein the media playback group is a first media playback group and wherein the respective record of the media playback device further indicates membership in a second media playback group.

5. The method of claim 1, further comprising receiving the media stream by the follower playback device in a sequence of timestamped data packets.

6. The method of claim 1, wherein causing the media stream to be played back on the follower playback device in synchronization with the leader playback device based on the updated clock offset further comprises causing the media stream to be played back on the follower playback device in synchronization with the leader playback device based on the updated clock offset and an output delay of the follower playback device.

7. The method of claim 1, wherein the clock offset is determined based on a round-trip-time (RTT) between the leader playback device and the follower playback device.

8. A system for synchronized media playback, the system comprising:

a hardware processor of a media playback device, wherein the hardware processor is configured to;

connect to a communications network, wherein the media playback device is associated with a media playback group that includes a plurality of media playback devices;

receive an indication that the media playback device has been designated as a follower playback device, wherein a remaining media playback device in the media playback group is designated as a leader playback device;

in response to receiving the indication that the media playback device has been designated as the follower playback device, transmit, from the follower playback device to the leader playback device, a first series of synchronization requests, wherein a latency between two synchronization requests in the first series of synchronization requests is a first duration of time;

receive a first series of synchronization responses from the leader playback device;

determine a clock offset between the follower playback device and the leader playback device based on at least a portion of the first series of synchronization responses;

receive, from the leader playback device, an indication that media content is to be presented synchronously by the plurality of media playback devices in the media playback group;

in response to receiving the indication that media content is to be presented synchronously by the plurality of media playback devices, transmit, from the follower playback device to the leader playback device, a second series of synchronization requests, wherein a latency between two synchronization requests in the second series of synchronization requests is a second duration of time, and wherein the second duration of time is shorter than the first duration of time;

receive a second series of synchronization responses from the leader playback device;

determine an updated clock offset based on at least a portion of the second series of synchronization responses;

receive a media stream for playback by the media playback group; and

cause the media stream to be played back on the follower playback device in synchronization with the leader playback device based on the updated clock offset.

9. The system of claim 8, wherein the media playback device has been designated as the follower playback device and the remaining media playback device has been designated as the leader playback device based on a comparison of a measure of quality of a data connection of the first media playback device with the communications network and a measure of quality of a data connection of the second media playback device with the communications network.

10. The system of claim 8, wherein the media playback device and the remaining media playback device each include a respective record indicating membership in the media playback group.

11. The system of claim 10, wherein the media playback group is a first media playback group and wherein the respective record of the media playback device further indicates membership in a second media playback group.

12. The system of claim 8, wherein the hardware processor is further configured to receive the media stream by the follower playback device in a sequence of timestamped data packets.

13. The system of claim 8, wherein causing the media stream to be played back on the follower playback device in synchronization with the leader playback device based on the updated clock offset further comprises causing the media stream to be played back on the follower playback device in synchronization with the leader playback device based on the updated clock offset and an output delay of the follower playback device.

14. The system of claim 8, wherein the clock offset is determined based on a round-trip-time (RTT) between the leader playback device and the follower playback device.

15. A non-transitory computer-readable medium containing computer executable instructions that, when executed by a processor, cause the processor to perform a method for synchronized media playback, the method comprising:

connecting, using a media playback device, to a communications network, wherein the media playback device is associated with a media playback group that includes a plurality of media playback devices;

receiving an indication that the media playback device has been designated as a follower playback device, wherein a remaining media playback device in the media playback group is designated as a leader playback device;

in response to receiving the indication that the media playback device has been designated as the follower playback device, transmitting, from the follower playback device to the leader playback device, a first series of synchronization requests, wherein a latency between two synchronization requests in the first series of synchronization requests is a first duration of time;

receiving a first series of synchronization responses from the leader playback device;

determining a clock offset between the follower playback device and the leader playback device based on at least a portion of the first series of synchronization responses;

receiving, from the leader playback device, an indication that media content is to be presented synchronously by the plurality of media playback devices in the media playback group;

in response to receiving the indication that media content is to be presented synchronously by the plurality of media playback devices, transmitting, from the follower playback device to the leader playback device, a second series of synchronization requests, wherein a latency between two synchronization requests in the second series of synchronization requests is a second duration of time, and wherein the second duration of time is shorter than the first duration of time;

receiving a second series of synchronization responses from the leader playback device;

determining an updated clock offset based on at least a portion of the second series of synchronization responses;

receiving a media stream for playback by the media playback group; and

causing the media stream to be played back on the follower playback device in synchronization with the leader playback device based on the updated clock offset.

16. The non-transitory computer-readable medium of claim 15, wherein the media playback device has been designated as the follower playback device and the remaining media playback device has been designated as the leader playback device based on a comparison of a measure of quality of a data connection of the first media playback device with the communications network and a measure of quality of a data connection of the second media playback device with the communications network.

17. The non-transitory computer-readable medium of claim 15, wherein the media playback device and the remaining media playback device each include a respective record indicating membership in the media playback group.

18. The non-transitory computer-readable medium of claim 17, wherein the media playback group is a first media playback group and wherein the respective record of the media playback device further indicates membership in a second media playback group.

19. The non-transitory computer-readable medium of claim 15, wherein the method further comprises receiving the media stream by the follower playback device in a sequence of timestamped data packets.

20. The non-transitory computer-readable medium of claim 15, wherein causing the media stream to be played back on the follower playback device in synchronization with the leader playback device based on the updated clock offset further comprises causing the media stream to be played back on the follower playback device in synchronization with the leader playback device based on the updated clock offset and an output delay of the follower playback device.

21. The non-transitory computer-readable medium of claim 15, wherein the clock offset is determined based on a round-trip-time (RTT) between the leader playback device and the follower playback device.