Synchronizing multiple over the top streaming clients

• US 10,523,984 B2
• Filed: 08/24/2018
• Issued: 12/31/2019
• Est. Priority Date: 05/31/2013
• Status: Active Grant

• Current Assignee: DivX, LLC (f/k/a DivX CF Holdings LLC) (SoftBank Group Corp.)
• Original Assignee: DivX, LLC (f/k/a DivX CF Holdings LLC) (SoftBank Group Corp.)
• Inventors: Amidei, William David, Braness, Jason
• Primary Examiner(s): Luu, Le H
• Application Number:
  US16/111,662
• Publication Number:
  US 20180367824A1
• Time in Patent Office: 494 Days
• CPC Class Codes: H04L 65/61 for supporting one-way streaming services, e.g. Internet radio
• CPC Class Codes: H04L 65/70 Media network packetisation
• CPC Class Codes: H04L 65/764 at the destination reformatting of additional data in video clients H04N21/4355
• CPC Class Codes: H04L 65/80 Responding to QoS
• CPC Class Codes: H04L 7/00 Arrangements for synchronising receiver with transmitter synchronisation of generators of electric oscillations or pulses H03L7/00
• CPC Class Codes: H04L 7/0008 Synchronisation information channels, e.g. clock distribution lines
• CPC Class Codes: H04N 21/2387 Stream processing in response to a playback request from an end-user, e.g. for trick-play
• CPC Class Codes: H04N 21/242 Synchronization processes, e.g. processing of PCR [Program Clock References] arrangements for synchronising broadcast or distribution via plural systems in broadcast distribution systems H04H20/18
• CPC Class Codes: H04N 21/4305 Synchronising client clock from received content stream, e.g. locking decoder clock with encoder clock, extraction of the PCR packets arrangements for synchronising receiver with transmitter by comparing receiver clock with transmitter clock H04L7/0012; arrangements for synchronising receiver with transmitter wherein the receiver takes measures against momentary loss of synchronisation H04L7/0083
• CPC Class Codes: H04N 21/4307 Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen
• CPC Class Codes: H04N 21/43076 of the same content streams on multiple devices, e.g. when family members are watching the same movie on different devices

Abstract

Systems and methods for synchronizing the playback of OTT or other time sensitive content on multiple playback devices is disclosed. The systems and methods include receiving time information based on a network time source in the playback devices. The playback clock in each playback device is set based upon the time information. Stream initiation information derived using the time information from the network time source is received by each of the playback device from the media provider. The playback devices use the stream initiation information to adjust the presentation time stamps of the frames of the media content in the stream.

Claims

1. A method for synchronizing playback of encoded media performed by a plurality of playback devices on a defined network comprising:

setting a playback clock in each playback device of a plurality of playback devices on a defined network such that a time delay between each playback clock in each playback devices of the plurality is less than tens of milliseconds;

receiving stream initiation information for a stream of encoded media from a stream media provider in the playback device wherein the stream initiation information includes a stream start time;

receiving the stream of encoded media in each playback device of the plurality playback devices wherein the stream of encoded media includes a plurality of frames;

adjusting the presentation time information of each frame of the plurality of frames of the stream in each playback device of the plurality of playback devices based upon the stream initiation information; and

presenting each frame of the plurality of frames using each playback device of the plurality of playback devices based upon the setting of the playback clock in each playback device such that the delay of presentation of each frame between each playback device of the plurality of playback devices is than tens of milliseconds.

2. The method of claim 1 further comprising:

transmitting a request for time information from each playback device of the plurality of playback devices to a network time provider;

receiving the time information from the network time provider in each playback device of the plurality of playback devices; and

wherein the network time provider is a Network Time Protocol Server and the transmitting of the request and receiving of the time information are performed using Network Time Protocol.

3. The method of claim 2 wherein the network time provider is a local time server.

4. The method of claim 3 further comprising:

transmitting a request for time information from the local time server to a Network Time Protocol server;

receiving the time information from the Network Time Protocol server in the local time server;

receiving the request for time information from the playback device;

generating the time information for the playback device from the timing information received from the Network Time Protocol server;

transmitting the time information to each playback device of the plurality of playback devices.

5. The method of claim 3 further comprising:

transmitting a request for time information from the stream media provider to a Network Time Protocol server;

receiving the time information from the Network Time Protocol server in the local time server;

generating the stream initiation information for the stream of encoded media using the time information received by the stream media provider wherein the stream initiation information includes the stream start time;

receiving a request for the encoded media from each playback device of the plurality of playback devices by the stream media provider;

transmitting the stream initiation information includes the stream start time from the stream media provider to the playback device; and

transmitting the stream of encoded media from the stream media provider to each playback device of the plurality of playback devices.

6. The method of claim 1 wherein the time information is provided in Coordinated Universal Time.

7. The method of claim 1 wherein the start time is provided in Coordinated Universal Time.

8. A system of playback devices for providing synchronous playback of encoded media based on a provided start time comprising:

a defined network; and

a plurality of playback devices connected to the defined network;

wherein each playback device of the playback devices each comprises;

memory; and

a processor configured via a client application stored in the memory to;

set a playback clock such that a time delay between each playback clock in each of the playback devices of the plurality of playback devices is less than tens of milliseconds,

receive stream initiation information for a stream of encoded media from a stream media provider wherein the stream initiation information includes a stream start time,

receive the stream of encoded media wherein the stream includes a plurality of frames of the encoded content,

adjust presentation time information of each frame of the plurality of frames of the stream in the playback device based upon the stream initiation information, and

present each frame of the plurality of frames based upon the setting of the playback clock such that the delay of presentation of each frame between each playback device of the plurality of playback devices is than tens of milliseconds.

9. The system of claim 8 further comprising a network time provider in the defined network wherein the processor is further configured to:

transmit a request for time information from each playback device of the plurality of playback devices to a network time provider;

receiving the time information from the network time provider in each playback device of the plurality of playback devices; and

wherein the network time provider is a Network Time Protocol Server and the transmitting of the request and receiving of the time information are performed using Network Time Protocol.

10. The system of claim 9 wherein the network time provider is a local time server.

11. The system of claim 10 wherein the time information provided by the local time server is based on time information from a Network Time Protocol Server.

12. The system of claim 8 wherein the time information is provided in Coordinated Universal Time.

13. The system of claim 8 wherein the start time is provided in Coordinated Universal Time.