Synchronization of media stream components

• US 8,819,749 B2
• Filed: 06/04/2009
• Issued: 08/26/2014
• Est. Priority Date: 06/11/2008
• Status: Active Grant

• Current Assignee: Koninklijke Philips N.V.
• Original Assignee: Koninklijke Philips N.V.
• Inventors: De Nijs, Gilein, Van Gassel, Jozef Pieter
• Primary Examiner(s): Flynn, Nathan
• Assistant Examiner(s): Parra, Omar S
• Application Number:
  US12/995,683
• Publication Number:
  US 20110083155A1
• Time in Patent Office: 1,909 Days
• Field of Search: None
• US Class Current: 725/94
• CPC Class Codes: H04H 20/40 Arrangements for broadcast specially adapted for accumulation-type receivers
• CPC Class Codes: H04N 21/23406 involving management of server-side video buffer
• CPC Class Codes: H04N 21/234318 by decomposing into objects, e.g. MPEG-4 objects
• CPC Class Codes: H04N 21/426 Internal components of the client ; Characteristics thereof H04N5/44 takes precedence
• CPC Class Codes: H04N 21/4305 Synchronising client clock from received content stream, e.g. locking decoder clock with encoder clock, extraction of the PCR packets arrangements for synchronising receiver with transmitter by comparing receiver clock with transmitter clock H04L7/0012; arrangements for synchronising receiver with transmitter wherein the receiver takes measures against momentary loss of synchronisation H04L7/0083
• CPC Class Codes: H04N 21/43072 of multiple content streams on the same device
• CPC Class Codes: H04N 21/4348 Demultiplexing of additional data and video streams
• CPC Class Codes: H04N 21/4392 involving audio buffer management
• CPC Class Codes: H04N 21/44004 involving video buffer management, e.g. video decoder buffer or video display buffer
• CPC Class Codes: H04N 21/64315 DVB-H
• CPC Class Codes: H04N 21/6437 Real-time Transport Protocol [RTP]
• CPC Class Codes: H04N 7/56 Synchronising systems therefor

Abstract

A method for synchronizing a plurality of components of a broadcast media stream, includes buffering streams of data samples for a plurality of components of a broadcast media stream and buffering a plurality of information packets. The stream of data samples for each of the plurality of components includes relative timing information, each information packet including timing information indicating a relationship between the relative timing information in the components and an absolute time. The method further includes performing a look-ahead action on the buffered information packets to extract timing information for each of the plurality of components; and using the extracted timing information and relative timing information to synchronize the plurality of components.

Claims

1. A method for synchronizing a plurality of components of a broadcast media stream, each component comprising a plurality of data samples, the method comprising the acts of:

buffering the data samples comprising relative timing and a plurality of information packets comprising relationship timing indicating a relationship between the relative timing and an absolute time, each of the information packets corresponding to one of the data samples;

performing a look-ahead action on the buffered information packets to extract the relationship timing for each of the plurality of components;

using the extracted relationship timing and the relative timing to synchronize the data samples of the plurality of components and to identify the data samples in the plurality of components to be streamed at the same time;

comparing the identified data samples to a previously identified set of data samples to determine a drift between the plurality of components; and

adding or omitting data samples from the particular component to correct for the determined drift as the data samples are streamed from the buffer.

2. The method as claimed in claim 1, wherein each information packet is associated with a respective one of the plurality of components, and the relationship timing indicates a relationship between the relative timing in their respective components and the absolute time.

3. The method as claimed in claim 1, further comprising the act of streaming the synchronized data samples in the plurality of components.

4. The method as claimed in claim 1, further comprising the acts of:

storing the information packets in a memory; and

using the extracted relationship timing in the information packets stored in the memory to synchronize the data samples of plurality of components until further information packets are received.

5. The method as claimed in claim 4, wherein the broadcast media stream comprises a plurality of selectable services, each including the plurality of components, the method further comprising the acts of:

receiving information packets for components in each of the selectable services; and

storing the information packets in the memory.

6. The method as claimed in claim 5, wherein the data samples comprise a first selectable service in the broadcast media stream, and wherein the stored information packets for a second selectable service are used when the second selectable service is selected, and before respective information packets for the second selectable service received.

7. The method as claimed in claim 1, wherein the data samples are received in bursts and an information packet is received with each burst.

8. The method as claimed in claim 1, wherein the drift is corrected by adding or omitting the identified data samples before the one or more data samples corresponding to the information packet used to determine the drift are streamed.

9. The method as claimed claim 1, wherein the act of adding data samples comprises the act of duplicating data samples.

10. The method as claimed in claim 1, further comprising the act of storing results of the comparing act in a memory.

11. The method as claimed in claim 10, wherein the method further comprises the acts of:

calculating an average correction from the results stored in the memory; and

using the calculated average correction to predict a required correction for a particular component.

12. A device for presenting a broadcast media stream to a user, the device comprising:

a buffer for storing data samples of a plurality of components of the broadcast media stream and a plurality of information packets, each data sample comprising relative timing, and each information packet comprising relationship timing indicating a relationship between the relative timing and an absolute time, each information packet corresponding to one of the data samples; and

a processor configured to;

perform a look-ahead action to extract the relationship timing from the buffered information packets for each of the plurality of components;

use the extracted relationship timing and relative timing to synchronize the data samples of the plurality of components and to indentify the data samples in the plurality of components to be streamed at the same time;

compare the identified data samples to a previously identified set of data samples to determine a drift between the plurality of components; and

add or omit data samples from the particular component to correct for the determined drift as the data samples are streamed from the buffer.

13. The device as claimed in claim 12, further comprising a memory for storing the extracted relationship timing.