Synchronizing multiple over the top streaming clients

• US 10,063,896 B2
• Filed: 05/04/2017
• Issued: 08/28/2018
• Est. Priority Date: 05/31/2013
• Status: Active Grant

• Current Assignee: Sonic IP Incorporated (Endeavor Group Holdings Inc.)
• Original Assignee: DivX, LLC (f/k/a DivX CF Holdings LLC) (SoftBank Group Corp.)
• Inventors: Amidei, William David, Braness, Jason
• Primary Examiner(s): Luu, Le H
• Application Number:
  US15/587,200
• Publication Number:
  US 20170238027A1
• Time in Patent Office: 481 Days
• CPC Class Codes: H04L 65/61 for supporting one-way streaming services, e.g. Internet radio
• CPC Class Codes: H04L 65/70 Media network packetisation
• CPC Class Codes: H04L 65/764 at the destination reformatting of additional data in video clients H04N21/4355
• CPC Class Codes: H04L 65/80 Responding to QoS
• CPC Class Codes: H04L 7/00 Arrangements for synchronising receiver with transmitter synchronisation of generators of electric oscillations or pulses H03L7/00
• CPC Class Codes: H04L 7/0008 Synchronisation information channels, e.g. clock distribution lines
• CPC Class Codes: H04N 21/2387 Stream processing in response to a playback request from an end-user, e.g. for trick-play
• CPC Class Codes: H04N 21/242 Synchronization processes, e.g. processing of PCR [Program Clock References] arrangements for synchronising broadcast or distribution via plural systems in broadcast distribution systems H04H20/18
• CPC Class Codes: H04N 21/4305 Synchronising client clock from received content stream, e.g. locking decoder clock with encoder clock, extraction of the PCR packets arrangements for synchronising receiver with transmitter by comparing receiver clock with transmitter clock H04L7/0012; arrangements for synchronising receiver with transmitter wherein the receiver takes measures against momentary loss of synchronisation H04L7/0083
• CPC Class Codes: H04N 21/4307 Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen
• CPC Class Codes: H04N 21/43076 of the same content streams on multiple devices, e.g. when family members are watching the same movie on different devices

Abstract

Systems and methods for synchronizing the playback of OTT or other time sensitive content on multiple playback devices is disclosed. The systems and methods include receiving time information based on a network time source in the playback devices. The playback clock in each playback device is set based upon the time information. Stream initiation information derived using the time information from the network time source is received by each of the playback device from the media provider. The playback devices use the stream initiation information to adjust the presentation time stamps of the frames of the media content in the stream.

Claims

1. A method for playback of encoded media performed by a playback device comprising:

transmitting a request for time information from a first playback device in a local network to a network time provider for the local network;

receiving the time information from the network time provider in the first playback device;

transmitting a request for the time information from at least a second playback device in a local network to a network time provider for the local network;

receiving the time information from the network time provider in at least the second playback device of the plurality of playback devices; and

setting a playback clock in each playback device that received the time information using the received time information such that a time delay among each set playback clock is less than tens of milliseconds.

2. The method of claim 1 wherein the network time provider is a Network Time Protocol Server and the transmitting of the request and receiving of the time information are performed using Network Time Protocol.

3. The method of claim 1 wherein the time information is provided in Coordinated Universal Time.

4. The method of claim 1 wherein the network time provider is a local time server.

5. The method of claim 4 further comprising:

transmitting a request for time information from the local time server to a Network Time Protocol server;

receiving the time information from the Network Time Protocol server in the local time server;

receiving the request for time information from the playback device;

generating the time information for the playback device from the timing information received from the Network Time Protocol server;

transmitting the time information to each playback device that received the time information.

6. The method of claim 1 further comprising:

receiving stream initiation information for a stream of encoded media from a stream media provider in each playback device that received the time information, wherein the stream initiation information includes a stream start time;

receiving the stream of encoded media in each playback device that received the time information, wherein the stream includes a plurality of frames of the encoded content;

adjusting the presentation time information of each of the plurality of frames of the stream in each playback device that received the time information based upon the stream initiation information and the time information, wherein each playback device utilizes the time information from its playback clock; and

presenting each of the plurality of frames using each playback device that received the time information based upon the adjusted presentation time information in each playback device having received time information such that there is no noticeable delay of the presentation of each of the plurality of frames among the playback devices receiving the time information.

7. The method of claim 6 wherein the start time is provided in Coordinated Universal Time.

8. The method of claim 6 further comprising:

transmitting a request for time information from the stream media provider to a Network Time Protocol server;

receiving the time information from the Network Time Protocol server in the local time server;

generating the stream initiation information for the stream of encoded media using the time information received by the stream media provider wherein the stream initiation information includes the stream start time;

receiving a request for the encoded playback from playback device that received the time information by the stream media provider;

transmitting the stream initiation information includes the stream start time from the stream media provider to the playback device; and

transmitting the stream of encoded media from the stream media provider to each playback device that received the time information.

9. A system of playback devices for providing devices with synchronous playback of encoded media based on a provided start time comprising:

a local network;

a network time provider in the local network; and

at least a first and a second play back device connected to the local network;

wherein the at least first and second playback devices each comprises;

memory; and

a processor configured via a client application stored in the memory to;

transmit a request for time information to the network time provider,

receive the time information from the network time provider, wherein the time information is provided to at least the first and second play devices connected to the local network,

set a playback clock using the received time information such that a time delay among each playback clock that received the time information is less than tens of milliseconds.

10. The system of claim 9 wherein the network time provider is a Network Time Protocol Server and the transmitting of the request and receiving of the time information are performed using Network Time Protocol.

11. The system of claim 9 wherein the time information is provided in Coordinated Universal Time.

12. The system of claim 9 wherein the network time provider is a local time server.

13. The system of claim 12 wherein the time information provided by the local time server is based on time information from a Network Time Protocol Server.

14. The system of claim 9, the processor is further configured via a client application stored in the memory to:

receive stream initiation information for a stream of encoded media from a stream media provider wherein the stream initiation information includes a stream start time,

receive the stream of encoded media wherein the stream includes a plurality of frames of the encoded content,

adjust presentation time information of each of the plurality of frames of the stream in the playback device based upon the stream initiation information and the time information from its playback clock, and

present each of the plurality of frames using the adjusted presentation time information such that there is no noticeable delay of the presentation of each of the plurality of frames among the playback devices receiving the time information.

15. The system of claim 14 wherein the start time is provided in Coordinated Universal Time.