System and method for synchronizing media presentation at multiple recipients

• US 10,264,070 B2
• Filed: 07/25/2017
• Issued: 04/16/2019
• Est. Priority Date: 06/04/2004
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Bradley, Bob, Newberry, Jr., Robert Dale
• Primary Examiner(s): Anwar, Mohammad S
• Application Number:
  US15/659,603
• Publication Number:
  US 20180054481A1
• Time in Patent Office: 630 Days
• CPC Class Codes: H04L 12/18 for broadcast or conference , e.g. multicast
• CPC Class Codes: H04L 12/1881 with schedule organisation, e.g. priority, sequence management
• CPC Class Codes: H04L 65/1101 Session protocols
• CPC Class Codes: H04L 65/75 Media network packet handling
• CPC Class Codes: H04L 65/756 adapting media to device capabilities
• CPC Class Codes: H04L 67/1095 Replication or mirroring of data, e.g. scheduling or transport for data synchronisation between network nodes
• CPC Class Codes: H04N 21/242 Synchronization processes, e.g. processing of PCR [Program Clock References] arrangements for synchronising broadcast or distribution via plural systems in broadcast distribution systems H04H20/18
• CPC Class Codes: H04N 21/4305 Synchronising client clock from received content stream, e.g. locking decoder clock with encoder clock, extraction of the PCR packets arrangements for synchronising receiver with transmitter by comparing receiver clock with transmitter clock H04L7/0012; arrangements for synchronising receiver with transmitter wherein the receiver takes measures against momentary loss of synchronisation H04L7/0083
• CPC Class Codes: H04N 21/8547 involving timestamps for synchronizing content

Abstract

A network media delivery system includes client devices and a host device. Each client device has a network interface, an engine for processing media data, and a media interface. The host device, which can be a computer, establishes network communication links with the client devices, which can be networked media stations, and sends media data to the client devices. The media data can be sent wirelessly as packets of media data transmitted at intervals to each client device. In one embodiment, the host device controls processing of media data such that processed media is delivered in a synchronized manner at each of the client devices. In another embodiment, the host device controls processing of media data such that processed media is delivered in a synchronized manner at the host device and at least one client device.

Claims

1. A method, comprising:

sending, by a host device to a first client device, a request for information describing latency within the first client device;

sending, by the host device to the first client device, one or more media packets based on a packet timeline determined for the first client device;

determining, by the host device, a first synchronization information based at least in part on the latency associated with the first client device; and

sending, by the host device to the first client device, the first synchronization information indicative of when to play back, at the first client device, media data included in the one or more media packets.

2. The method of claim 1, wherein sending the media data and the first synchronization information to the first client device comprises:

sending a unicast stream of first packets containing the media data to the first client device, each of the first packets having a timestamp specifying when to present the media data associated with the first packet.

3. The method of claim 2, wherein the first packets comprise Real-Time Transport Protocol encapsulated in User Datagram Protocol packets.

4. The method of claim 2, wherein the timestamps in the first packets comprise an adjustment based on a presentation latency associated with the first client device.

5. The method of claim 1, further comprising:

synchronizing the first local clock of the first client device with a reference clock of the host device;

receiving a request for reference clock time information from the first client device; and

in response to receiving the request for reference clock time information, sending a second packets to the first client device, the second packets having time information to correlate the first local clock with the reference clock.

6. The method of claim 5, wherein the second packets comprise Network Time Protocol (NTP) encapsulated in Real-Time Transport Control Protocol (RTCP) packets.

7. The method of claim 1, further comprising:

synchronizing a second local clock of a second client device with the reference clock;

generating a second synchronization information for the media data based on the reference clock, the second synchronization information specifying when to present the media data at the second client device such that the media data is presented in a synchronized manner at both the first client device and second client device;

sending the media data and the second synchronization information to the second client device; and

controlling presentation of the sent media data at the second client device with the second presentation time line.

8. The method of claim 1, wherein the media data is sent separately from the first synchronization information to the first client device, and further comprising:

sending the first synchronization information to the first client device as part of a time announcement that is sent periodically from the host device to the first client device, the periodic time announcement used to maintain a timing relationship between the host device and the first client device.

9. The method of claim 1, wherein the first synchronization information corresponds to a media presentation timeline generated by the host device, wherein the media presentation timeline controls the playback of media data at the first client device.

10. A method, comprising:

sending, by a host device to each of a plurality of client devices, a request for information about latency within each of the client devices;

sending, by the host device to each of the client devices, one or more media packets based on a packet timeline determined for each of the client devices;

determining, by the host device, synchronization data indicative of when to playback, at each of the client devices, media data included in the one or more media packets; and

sending, by the host device to each of the client devices, the synchronization data, where each of the client devices plays back the media data according to the synchronization data.

11. The method of claim 10, wherein sending the media data to each of the client devices comprises:

sending, from the host device, a separate unicast stream of first packets containing the media data to each of the client devices, each of the first packets having a timestamp specifying when to present the media data associated with the first packet.

12. The method of claim 11, wherein the timestamps in the first packets for a given one of the client devices comprise an adjustment based on a presentation latency associated with the given client device.

13. The method of claim 10, wherein the host device comprises a reference clock, and further comprising:

synchronizing each local clock of the client devices with the reference clock.

14. The method of claim 13, wherein synchronizing each of the local clocks with the reference clock comprises:

sending, by the host device, second packets to each of the client devices in response to requests from each of the client devices, the second packets having time information to correlate the local clocks with the reference clock.

15. The method of claim 10, further comprising:

generating processed media based on the media data; and

presenting the processed media data synchronously with the plurality of client devices.

16. The method of claim 10, wherein the media data is sent separately from the synchronization data to each of the client devices, and further comprising:

sending the synchronization information to each client device as part of a time announcement that is sent periodically from the host device to each client device, the periodic time announcement used to maintain a timing relationship between the host device and the client devices.

17. The method of claim 10, wherein the synchronization data corresponds to a media presentation timeline generated by the host device, wherein the media presentation timeline controls the synchronization of the playback of media data at each client device.