Synchronizing multiple over the top streaming clients

• US 9,380,099 B2
• Filed: 05/31/2013
• Issued: 06/28/2016
• Est. Priority Date: 05/31/2013
• Status: Active Grant

• Current Assignee: Sonic IP Incorporated (Endeavor Group Holdings Inc.)
• Original Assignee: Sonic IP Incorporated (Endeavor Group Holdings Inc.)
• Inventors: Amidei, William David, Braness, Jason
• Primary Examiner(s): Luu, Le H
• Application Number:
  US13/906,952
• Publication Number:
  US 20140359075A1
• Time in Patent Office: 1,124 Days
• US Class Current: 1/1
• CPC Class Codes: H04L 65/61 for supporting one-way streaming services, e.g. Internet radio
• CPC Class Codes: H04L 65/70 Media network packetisation
• CPC Class Codes: H04L 65/764 at the destination reformatting of additional data in video clients H04N21/4355
• CPC Class Codes: H04L 65/80 Responding to QoS
• CPC Class Codes: H04L 7/00 Arrangements for synchronising receiver with transmitter synchronisation of generators of electric oscillations or pulses H03L7/00
• CPC Class Codes: H04L 7/0008 Synchronisation information channels, e.g. clock distribution lines
• CPC Class Codes: H04N 21/2387 Stream processing in response to a playback request from an end-user, e.g. for trick-play
• CPC Class Codes: H04N 21/242 Synchronization processes, e.g. processing of PCR [Program Clock References] arrangements for synchronising broadcast or distribution via plural systems in broadcast distribution systems H04H20/18
• CPC Class Codes: H04N 21/4305 Synchronising client clock from received content stream, e.g. locking decoder clock with encoder clock, extraction of the PCR packets arrangements for synchronising receiver with transmitter by comparing receiver clock with transmitter clock H04L7/0012; arrangements for synchronising receiver with transmitter wherein the receiver takes measures against momentary loss of synchronisation H04L7/0083
• CPC Class Codes: H04N 21/4307 Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen
• CPC Class Codes: H04N 21/43076 of the same content streams on multiple devices, e.g. when family members are watching the same movie on different devices

Abstract

Systems and methods for synchronizing the playback of OTT or other time sensitive content on multiple playback devices is disclosed. The systems and methods include receiving time information based on a network time source in the playback devices. The playback clock in each playback device is set based upon the time information. Stream initiation information derived using the time information from the network time source is received by each of the playback device from the media provider. The playback devices use the stream initiation information to adjust the presentation time stamps of the frames of the media content in the stream.

Claims

1. A method for playback of encoded media performed by a playback device comprising:

transmitting a request for time information from a playback device in a local network to a network time provider for the local network;

receiving the time information from the network time provider in the playback device wherein the time information from the network time provider is provided to the playback device and other playback devices in the local network;

setting a playback clock in the playback device using the received time information such that a time delay between the playback clock in the playback device and the playback clock of the other playback devices in the network is less than tens of milliseconds so that delay between the playback of the same media content on the playback device and other playback devices in the network is not noticeable by a human;

receiving stream initiation information for a stream of encoded media from a stream media provider in the playback device wherein the stream initiation information includes a stream start time;

receiving the stream of encoded media in the playback device wherein the stream includes a plurality of frames of the encoded content;

adjusting the presentation time information of each of the plurality of frames of the stream in the playback device based upon the stream initiation information and time information from the playback clock; and

presenting each of the plurality of frames using the playback device based upon the adjusted presentation time information such that there is no noticeable delay of the presentation of each of the plurality of frames by the playback device and the presentation of each of the plurality of frames by the other playback devices in the local network.

2. The method of claim 1 wherein the network time provider is a Network Time Protocol Server and the transmitting of the request and receiving of the time information are performed using Network Time Protocol.

3. The method of claim 1 wherein the time information is provided in Coordinated Universal Time.

4. The method of claim 1 wherein the start time is provided in Coordinated Universal Time.

5. The method of claim 1 wherein the network time provider is a local time server.

6. The method of claim 5 further comprising:

transmitting a request for time information from the local time server to a Network Time Protocol server;

receiving the time information from the Network Time Protocol server in the local time server;

receiving the request for time information from the playback device;

generating the time information for the playback device from the timing information received from the Network Time Protocol server;

transmitting the time information to the playback device.

7. The method of claim 1 further comprising:

transmitting a request for time information from the stream media provider to a Network Time Protocol server;

receiving the time information from the Network Time Protocol server in the local time server;

generating the stream initiation information for the stream of encoded media using the time information received by the stream media provider wherein the stream initiation information includes the stream start time;

receiving a request for the encoded playback from the playback device by the stream media provider;

transmitting the stream initiation information includes the stream start time from the stream media provider to the playback device; and

transmitting the stream of encoded media from the stream media provider to the playback device.

8. A playback device in a local network for providing playback of encoded media based on a provided start time comprising:

memory; and

a processor configured via a client application stored in the memory to;

transmit a request for time information to a network time provider for the local network,

receive the time information from the network time provider wherein the time information from the network time provider is provided to the playback device and other playback devices in the local network,

set a playback clock in the playback device using the received time information such that a time delay between the playback clock in the playback device and the playback clock of the other playback devices in the network is less than tens of milliseconds so that delay between the playback of the same media content on the playback device and other playback devices in the network is not noticeable by a human,

receive stream initiation information for a stream of encoded media from a stream media provider wherein the stream initiation information includes a stream start time,

receive the stream of encoded media wherein the stream includes a plurality of frames of the encoded content,

adjust presentation time information of each of the plurality of frames of the stream in the playback device based upon the stream initiation information and time information from the playback clock; and

presenting each of the plurality of frames using the adjusted presentation time information such that there is no noticeable delay of the presentation of each of the plurality of frames by the playback device and the presentation of each of the plurality of frames by the other playback devices in the local network.

9. The playback device of claim 8 wherein the network time provider is a Network Time Protocol Server and the transmitting of the request and receiving of the time information are performed using Network Time Protocol.

10. The playback device of claim 8 wherein the time information is provided in Coordinated Universal Time.

11. The playback device of claim 8 wherein the start time is provided in Coordinated Universal Time.

12. The playback device of claim 8 wherein the network time provider is a local time server.

13. The playback device of claim 12 wherein the time information provided by the local time server is based on time information from a Network Time Protocol Server.

14. A non-transitory machine readable medium containing processor instructions, where execution of the instructions by a processor causes the processor to perform a process for providing playback of encoded media based on a provided start time, the process comprising:

transmitting a request for time information to a network time provider for the local network;

receiving the time information from the network time provider wherein the time information from the network time provider is provided to the playback device and other playback devices in the local network;

setting a playback clock in the playback device using the received time information such that a time delay between the playback clock in the playback device and the playback clock of the other playback devices in the network is less than tens of milliseconds so that delay between the playback of the same media content on the playback device and other playback devices in the network is not noticeable by a human;

receiving stream initiation information for a stream of encoded media from a stream media provider wherein the stream initiation information includes a stream start time;

receiving the stream of encoded media wherein the stream includes a plurality of frames of the encoded content;

adjusting presentation time information of each of the plurality of frames of the stream in the playback device based upon the stream initiation information and time information from the playback clock; and

presenting each of the plurality of frames using the adjusted presentation time information such that there is no noticeable delay of the presentation of each of the plurality of frames by the playback device and the presentation of each of the plurality of frames by the other playback devices in the local network.

15. The non-transitory machine readable medium containing processor instructions of claim 14 wherein the network time provider is a Network Time Protocol Server and the transmitting of the request and receiving of the time information are performed using Network Time Protocol.

16. The non-transitory machine readable medium containing processor instructions of claim 14 wherein the time information is provided in Coordinated Universal Time.

17. The non-transitory machine readable medium containing processor instructions of claim 14 wherein the start time is provided in Coordinated Universal Time.

18. The non-transitory machine readable medium containing processor instructions of claim 14 wherein the network time provider is a local time server.

19. The non-transitory machine readable medium containing processor instructions of claim 18 wherein the time information provided by the local time server is based on time information from a Network Time Protocol Server.