Modified Stream Synchronization

• US 20120036277A1
• Filed: 03/16/2010
• Published: 02/09/2012
• Est. Priority Date: 03/16/2009
• Status: Abandoned Application

• Current Assignee: Koninklijke KPN NV, Nederlandse Organisatie Voor Toegepast-Natuurwetenschappelijk Onderzoek Tno
• Original Assignee: Koninklijke KPN NV, Nederlandse Organisatie Voor Toegepast-Natuurwetenschappelijk Onderzoek Tno
• Inventors: Walraven, Fabian Arthur, Niamut, Omar Aziz, Stokking, Hans Maarten, Deventer, Mattijs Oskar van
• Application Number:
  US13/256,443
• Publication Number:
  US 20120036277A1
• Time in Patent Office: Days
• US Class Current: 709/231
• CPC Class Codes: H04L 65/765 intermediate
• CPC Class Codes: H04L 65/80 Responding to QoS
• CPC Class Codes: H04N 21/234309 by transcoding between formats or standards, e.g. from MPEG-2 to MPEG-4 or from Quicktime to Realvideo conversion of standards in analog television systems H04N7/01
• CPC Class Codes: H04N 21/234318 by decomposing into objects, e.g. MPEG-4 objects
• CPC Class Codes: H04N 21/23608 Remultiplexing multiplex streams, e.g. involving modifying time stamps or remapping the packet identifiers
• CPC Class Codes: H04N 21/2368 Multiplexing of audio and video streams
• CPC Class Codes: H04N 21/238 Interfacing the downstream path of the transmission network, e.g. adapting the transmission rate of a video stream to network bandwidth; Processing of multiplex streams hybrid fiber coaxial [HFC] networks for downstream channel allocation for video distribution H04L12/2801; flow control in packet networks H04L47/10; real-time communication protocols in data switching networks H04L65/00; scheduling or organising the servicing of application requests H04L67/60
• CPC Class Codes: H04N 21/2381 Adapting the multiplex stream to a specific network, e.g. an Internet Protocol [IP] network transmission of MPEG streams over ATM H04L12/5601
• CPC Class Codes: H04N 21/242 Synchronization processes, e.g. processing of PCR [Program Clock References] arrangements for synchronising broadcast or distribution via plural systems in broadcast distribution systems H04H20/18
• CPC Class Codes: H04N 21/2662 Controlling the complexity of the video stream, e.g. by scaling the resolution or bitrate of the video stream based on the client capabilities
• CPC Class Codes: H04N 21/4302 Content synchronisation processes, e.g. decoder synchronisation
• CPC Class Codes: H04N 21/43072 of multiple content streams on the same device
• CPC Class Codes: H04N 21/4341 Demultiplexing of audio and video streams
• CPC Class Codes: H04N 21/643 Communication protocols network streaming protocols, e.g. real-time transport protocol [RTP] or real-time control protocol [RTCP], H04L65/65
• CPC Class Codes: H04N 21/64322 IP
• CPC Class Codes: H04N 21/6437 Real-time Transport Protocol [RTP]
• CPC Class Codes: H04N 21/8547 involving timestamps for synchronizing content
• CPC Class Codes: H04N 7/24 Systems for the transmission of television signals using pulse code modulation H04N21/00 takes precedence

Abstract

A method and system for inter-destination synchronization of at least a first and a second stream is described, wherein the second stream is the output stream of a media stream modification unit using the first stream as an input stream. The method comprises the steps of: providing first arrival time information of a packet in the first stream arriving at a first synchronization point and second arrival time information of a packet in the second stream arriving at a second synchronization point; providing synchronization correlation information on the synchronicity relationship between said input stream and said output stream; and, calculating delay information on the basis of the first and second arrival time information and the synchronization correlation information.

Claims

1. Method for inter-destination synchronization of at least a first and at least a second stream, said second stream being associated with an output stream of a media stream modification unit using said first stream as an input stream, the method comprising:

providing first arrival time information of a packet in the first stream arriving at a first synchronization point and second arrival time information of a packet in the second stream arriving at a second synchronization point;

providing synchronization correlation information on a synchronicity relationship between said input stream and said output stream; and

calculating delay information based at least on the first and second arrival time information and the synchronization correlation information.

2. Method according to claim 1, the method further comprising:

providing at least said first or second synchronization point with said delay information and enabling the at least said first or second synchronization point to delay the output of a stream such that the first and second streams outputted by the first and second synchronization point respectively are substantially synchronized.

3. Method according to claim 1, wherein said first and second stream are outputted by at least said first and second synchronization points, and wherein said synchronization points being connected to at least one synchronization unit for synchronizing said first and second synchronization points.

4. Method according to claim 1, wherein calculating delay information comprises an adjustment step for adjusting the first and/or second arrival time information achieve a common timeline between first arrival time information and second arrival time information, said adjustment step being based on at least part of the synchronization correlation information.

5. Method according to claim 4, wherein the adjustment step is executed by an arrival time information adjustment module, wherein said arrival time information adjustment module is part of a synchronization unit, the synchronization unit being provided with at least part of the synchronization correlation information.

6. Method according to claim 4, wherein the adjustment step is executed at the synchronization point, the synchronization point comprising an arrival time information adjustment module, wherein the arrival time information adjustment module is provided with at least part of the synchronization correlation information and the synchronization unit being provided with adjusted second arrival time information.

7. Method according to claim 4, wherein the adjustment step is executed in a network element, wherein the network element is configured to receive arrival time information, the network element further comprising an arrival time information adjustment module, wherein the arrival time information adjustment module is provided with at least part of the synchronization correlation information and the synchronization unit is provided with adjusted second arrival time information.

8. Method according to claim 1, wherein the synchronization point is selected from the group consisting of a terminal, a network node, and an access node.

9. Method according to claim 1, wherein said stream modification unit is media stream processing device for receiving and processing at least a first media stream, wherein said processing modifies the timing information in said first media stream, preferably said media stream processing device being a translator or a mixer.

10. Method according to claim 1, wherein the synchronization unit is comprised in a synchronization point or a network node, preferably a synchronization server.

11. Method according to claim 1, wherein said arrival time information, said synchronization correlation information and/or said delay information is signaled in one or more RTCP messages, preferably one or more RTCP extended reports.

12. Method according to claim 11, wherein at least one of said RTCP messages comprises at least an identifier identifying the sender of the packet, an RIP timestamp, an NIP timestamp, a clock rate value or a media stream correlation identifier.

16. System for inter-destination synchronization of the output of at least a first and a second synchronization point, the system comprising:

a content delivery server for delivering a media stream;

a stream modification unit configured to modify an input media stream into a modified output media stream and configured for providing synchronization correlation information on the synchronicity relationship between said input stream and said output stream; and

at least one synchronization unit according to claim 11.

17. A synchronization point for use in a system according to claim 16, the synchronization comprising:

a first input for receiving synchronization correlation information from a stream modification unit;

an output for transmitting the arrival time information of a packet in the stream to a synchronization unit;

at least one variable delay unit; and

a second input for receiving delay information for the at least one variable delay unit enabling the synchronization point to delay the output of the stream.

18. A media stream modification unit for use in a system according to claim 16, wherein the media stream modification unit comprises means to provide synchronization correlation information associated with a synchronicity relationship between a first media stream, used by the media stream modification unit as an input stream, and a second stream being the output stream of the media stream modification unit using the first media stream as an input stream.

19. A network element for use in a system according to claim 16, wherein the network element comprises an arrival time information adjustment module, said module configured to adjust the arrival time information of a packet in a modified stream received by a synchronization point, based at least on the synchronization correlation information.

20. A data structure for use in a system according to claim 16, said data structure being used by said system for signaling synchronization status information associated with a packet in a stream arriving at a media synchronization point or a packet in a stream arriving at a media stream modification unit or a packet in a stream transmitted by said modification unit, said data structure comprising at least an identifier identifying the sender of said data structure, at least one timestamp, preferably an RIP and/or an NIP timestamp, and/or a media stream correlation identifier.

21. A computer program product comprising software code portions configured for, when run in the memory of a computer, executing the method steps as defined in claim 1.

13. A synchronization unit for synchronizing the output of at least a first synchronization point receiving a first media stream and a second synchronization point receiving a second media stream, said second stream being the output stream of a media stream modification unit using the first stream as an input stream, the synchronization unit comprising:

a first input for receiving first timing information associated with a packet in a stream, said stream being associated with a first synchronization point and second arrival time information of a packet in the second stream arriving at a second synchronization point;

a second input for receiving synchronization correlation information on a synchronicity relationship between said input stream and said output stream; and

a processor for calculating delay information based at least on the first and second arrival time information and the synchronization correlation information.

14. A synchronization unit according to claim 13, the synchronization unit further comprising:

an output for sending the first and the second synchronization point with the delay information enabling one or more variable delay units in the first and second synchronization points to delay an output time of the received streams such that they are substantially synchronized.

15. A synchronization unit according to claim 13, wherein said arrival time information, said synchronization correlation information and/or said delay information is signaled in one or more RTCP messages, preferably one or more RTCP extended reports.