Synchronizing multiple over the top streaming clients

• US 9,648,362 B2
• Filed: 06/24/2016
• Issued: 05/09/2017
• Est. Priority Date: 05/31/2013
• Status: Active Grant

• Current Assignee: Sonic IP Incorporated (Endeavor Group Holdings Inc.)
• Original Assignee: Sonic IP Incorporated (Endeavor Group Holdings Inc.)
• Inventors: Amidei, William David, Braness, Jason
• Primary Examiner(s): Luu, Le H
• Application Number:
  US15/192,695
• Publication Number:
  US 20160309206A1
• Time in Patent Office: 319 Days
• CPC Class Codes: H04L 65/61 for supporting one-way streaming services, e.g. Internet radio
• CPC Class Codes: H04L 65/70 Media network packetisation
• CPC Class Codes: H04L 65/764 at the destination reformatting of additional data in video clients H04N21/4355
• CPC Class Codes: H04L 65/80 Responding to QoS
• CPC Class Codes: H04L 7/00 Arrangements for synchronising receiver with transmitter synchronisation of generators of electric oscillations or pulses H03L7/00
• CPC Class Codes: H04L 7/0008 Synchronisation information channels, e.g. clock distribution lines
• CPC Class Codes: H04N 21/2387 Stream processing in response to a playback request from an end-user, e.g. for trick-play
• CPC Class Codes: H04N 21/242 Synchronization processes, e.g. processing of PCR [Program Clock References] arrangements for synchronising broadcast or distribution via plural systems in broadcast distribution systems H04H20/18
• CPC Class Codes: H04N 21/4305 Synchronising client clock from received content stream, e.g. locking decoder clock with encoder clock, extraction of the PCR packets arrangements for synchronising receiver with transmitter by comparing receiver clock with transmitter clock H04L7/0012; arrangements for synchronising receiver with transmitter wherein the receiver takes measures against momentary loss of synchronisation H04L7/0083
• CPC Class Codes: H04N 21/4307 Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen
• CPC Class Codes: H04N 21/43076 of the same content streams on multiple devices, e.g. when family members are watching the same movie on different devices

Abstract

Systems and methods for synchronizing the playback of OTT or other time sensitive content on multiple playback devices is disclosed. The systems and methods include receiving time information based on a network time source in the playback devices. The playback clock in each playback device is set based upon the time information. Stream initiation information derived using the time information from the network time source is received by each of the playback device from the media provider. The playback devices use the stream initiation information to adjust the presentation time stamps of the frames of the media content in the stream.

Claims

1. A method for playback of encoded media performed by a playback device comprising:

transmitting a request for time information from each of a plurality of playback devices in a local network to a network time provider for the local network;

receiving the time information from the network time provider in each of the plurality of playback devices;

setting a playback clock in each of the plurality of playback devices using the received time information such that a time delay between the playback clocks in each of the plurality of playback devices in the local network is less than tens of milliseconds so that delay between the playback of the same media content on each of the plurality of playback devices in the local network is not noticeable by a human;

receiving stream initiation information for a stream of encoded media from a stream media provider in the playback device wherein the stream initiation information includes a stream start time;

receiving the stream of encoded media in each of the plurality of playback devices wherein the stream includes a plurality of frames of the encoded content;

adjusting the presentation time information of each of the plurality of frames of the stream in each of the plurality of playback devices based upon the stream initiation information and time information from the playback clock in each of the plurality of playback devices; and

presenting each of the plurality of frames using each of the plurality of playback devices based upon the adjusted presentation time information in each of the plurality of playback devices such that there is no noticeable delay of the presentation of each of the plurality of frames by the plurality of playback devices in the local network.

2. The method of claim 1 wherein the network time provider is a Network Time Protocol Server and the transmitting of the request and receiving of the time information are performed using Network Time Protocol.

3. The method of claim 1 wherein the time information is provided in Coordinated Universal Time.

4. The method of claim 1 wherein the start time is provided in Coordinated Universal Time.

5. The method of claim 1 wherein the network time provider is a local time server.

6. The method of claim 5 further comprising:

transmitting a request for time information from the local time server to a Network Time Protocol server;

receiving the time information from the Network Time Protocol server in the local time server;

receiving the request for time information from the playback device;

generating the time information for the playback device from the timing information received from the Network Time Protocol server;

transmitting the time information to each of the plurality of playback devices.

7. The method of claim 1 further comprising:

transmitting a request for time information from the stream media provider to a Network Time Protocol server;

receiving the time information from the Network Time Protocol server in the local time server;

generating the stream initiation information for the stream of encoded media using the time information received by the stream media provider wherein the stream initiation information includes the stream start time;

receiving a request for the encoded playback from each of the plurality of playback devices by the stream media provider;

transmitting the stream initiation information includes the stream start time from the stream media provider to each of the plurality of playback devices; and

transmitting the stream of encoded media from the stream media provider to each of the plurality of playback devices.

8. A system of playback devices for providing synchronous playback of encoded media based on a provided start time comprising:

a local network;

a network time provider in the local network; and

a plurality of playback devices connected to the local network;

wherein each of the plurality of playback devices comprises;

memory; and

a processor configured via a client application stored in the memory to;

transmit a request for time information to the network time provider,

receive the time information from the network time provider wherein the time information is provided to each of the plurality of playback devices in the local network,

set a playback clock using the received time information such that a time delay between the playback clock in each of the playback devices is less than tens of milliseconds so that delay between the playback of the same media content on the plurality of playback devices in the local network is not noticeable by a human,

receive stream initiation information for a stream of encoded media from a stream media provider wherein the stream initiation information includes a stream start time,

receive the stream of encoded media wherein the stream includes a plurality of frames of the encoded content,

adjust presentation time information of each of the plurality of frames of the stream in the playback device based upon the stream initiation information and time information from the playback clock; and

present each of the plurality of frames using the adjusted presentation time information such that there is no noticeable delay of the presentation of each of the plurality of frames by the plurality of playback devices in the local network.

9. The system of claim 8 wherein the network time provider is a Network Time Protocol Server and the transmitting of the request and receiving of the time information are performed using Network Time Protocol.

10. The system of claim 8 wherein the time information is provided in Coordinated Universal Time.

11. The system of claim 8 wherein the start time is provided in Coordinated Universal Time.

12. The system of claim 8 wherein the network time provider is a local time server.

13. The system of claim 12 wherein the time information provided by the local time server is based on time information from a Network Time Protocol Server.