Method for ensuring synchronization of MPEG-1 data carried in an MPEG-2 transport stream

• US 5,726,989 A
• Filed: 11/06/1995
• Issued: 03/10/1998
• Est. Priority Date: 11/06/1995
• Status: Expired due to Fees

• Current Assignee: Stellar One Corp.
• Original Assignee: Stellar One Corp.
• Inventors: Dokic, Miroslav V.
• Primary Examiner(s): MARCELO, MELVIN C
• Application Number:
  US08/554,146
• Time in Patent Office: 855 Days
• Field of Search: 370/397, 370/389, 370/412, 370/466, 370/469, 370/474, 370/476, 370/509, 370/510, 370/512, 370/517, 370/519, 348/423, 348/426, 348/512, 348/518, 364/514 R
• US Class Current: 370/509
• CPC Class Codes: G06T 9/007 Transform coding, e.g. discrete cosine transform
• CPC Class Codes: H04N 21/4305 Synchronising client clock from received content stream, e.g. locking decoder clock with encoder clock, extraction of the PCR packets arrangements for synchronising receiver with transmitter by comparing receiver clock with transmitter clock H04L7/0012; arrangements for synchronising receiver with transmitter wherein the receiver takes measures against momentary loss of synchronisation H04L7/0083
• CPC Class Codes: H04N 21/43072 of multiple content streams on the same device
• CPC Class Codes: H04N 21/4392 involving audio buffer management
• CPC Class Codes: H04N 21/44004 involving video buffer management, e.g. video decoder buffer or video display buffer

Abstract

A method for ensuring synchronization of MPEG-1 data is carried in an MPEG-2 transport stream for decoding by an MPEG-1 decoder. The method includes searching the MPEG-2 transport stream for a packet start code prefix indicating the start of a PES packet and storing the data associated with the PES packet into a buffer. If the PES packet is a video PES packet, the packet header is examined to determine if a PTS is present. If a PTS is present, the video data in the PES packet are examined during storage to the buffer to locate the first occurrence of a picture start code in the data. Once the first occurrence of a picture start code is located, a flag is set indicating the correspondence between the PTS and the identified picture start code. The video data remaining in the video PES packet is then stored to the buffer without further examination. The PES packet data are stored without examination if a PTS is not present. In either instance, the stored data are transmitted from the buffer to the video decoder in known lengths. If the PES packet is an audio PES packet, a current value of a system time clock is subtracted from a value of a first PTS contained in an audio PES packet to calculate an audio delay. The audio delay is then adjusted to account for audio decoding, audio transmission, and video decoding times. Audio data stored in the buffer are not enabled for delivery to an audio decoder until after the audio delay has elapsed.

Claims

1. A method of ensuring synchronization of MPEG-1 video and audio data carried in an MPEG-2 transport stream for decoding by an MPEG-1 video decoder and an MPEG-1 audio decoder, the transport stream including a plurality of packetized elementary stream (PES) packets containing video or audio data, each PES packet including a packet start code prefix identifying it as a PES packet and identifying the PES packet as either a video or an audio packet, with two or more of the PES packets including a video presentation time stamp (PTS) or an audio PTS that enables playback of data in the PES packet to be synchronized with a system time clock, the PES packets having video data and a video PTS including one or more picture start codes that indicate the beginning of a new frame of video data, the method comprising:

(a) searching the MPEG-2 transport stream for a packet start code prefix indicating the start of a PES packet;

(b) if the PES packet is a video PES packet, examining the video PES packet to determine if a video PTS is present;

(c) storing the data associated with the PES packet into a buffer;

(d) if the PES packet is a video PES packet that includes a video PTS in its header,

(i) examining the video data in the PES packet during storage to locate the first occurrence of a picture start code, and upon locating the first occurrence of a picture start code, setting a flag indicating the correspondence between the video PTS and the identified picture start code and storing the video data remaining in the video PES packet without further examination; and

(ii) transmitting blocks of the video data from the buffer to the video decoder in known lengths, each block including a flag indicative of whether the identified video PTS corresponds to a picture start code within that block, if a picture start code is present in that block; and

(e) if the PES packet is a video PES packet that does not include a video PTS in its header, transmitting blocks of the video data from the buffer to the video decoder in known lengths.

2. The method of claim 1, wherein the step of transmitting blocks of the video data from the buffer to the video decoder in known lengths for video PES packets that do not include a video PTS includes providing a flag in each block indicating that there is not a video PTS that corresponds to a picture start code within that block.

3. The method of claim 1, wherein the step of transmitting blocks of the video data from the buffer to the video decoder in known lengths includes the step of ensuring that each block contains an even number of bytes.

4. The method of claim 3, wherein the step of ensuring that each block contains an even number of bytes includes removing a byte of data from the PES packet being processed if the PES packet contains an odd number of bytes and appending the byte of data to a subsequent video PES packet.

5. The method of claim 1, wherein if the PES packet is an audio PES packet, transmitting blocks of the audio data from the buffer to the MPEG-1 audio decoder after an initial audio delay.

6. The method of claim 5, wherein the initial audio delay is computed by:

(a) searching the transport stream for an audio PTS and ascertaining its value;

(b) reading the value of the system time clock; and

(c) calculating the audio delay by computing the difference between the value of the audio PTS and the value of the system time clock.

7. The method of claim 6, wherein the audio delay is adjusted to account for audio decoding and audio transmission times.

8. The method of claim 7, wherein the audio delay is further adjusted to account for any delay associated with video decoding.

9. A method of ensuring synchronization of MPEG-1 data carried in an MPEG-2 transport stream for decoding by an MPEG-1 decoder, the transport stream including a plurality of packetized elementary stream (PES) packets having video or audio data, each PES packet-including a packet start code prefix identifying it as a PES packet and identifying the PES packet as either a video or an audio packet, with two or more of the PES packets including a video presentation time stamp (PTS) or an audio PTS that enables playback of data in the PES packet to be synchronized with a system time clock, the PES packets having video data and a video PTS including one or more picture start codes that indicate the beginning of a new frame of video data, the method comprising:

(a) searching the MPEG-2 transport stream for a packet start code prefix indicating the start of a PES packet;

(b) if the PES packet is a video PES packet, examining the video PES packet to determine if a video PTS is present;

(c) storing the data associated with the PES packet into a buffer;

(d) if the PES packet is a video PES packet that includes a video PTS in its header,

(i) examining the video data in the PES packet during storage to locate the first occurrence of a picture start code and, upon beating the first occurrence of a picture start code, setting a flag indicating the correspondence between the video PTS and the identified picture start code and storing the video data remaining in the video PES packet without further examination; and

(ii) transmitting blocks of the video data from the buffer to the video decoder in known lengths, each block including a flag indicative of whether the identified video PTS corresponds to a picture start code within that block, if a picture start code is present in that block;

(e) if the PES packet is a video PES packet that does not include a video PTS in its header, transmitting blocks of the video data from the buffer to the video decoder in known lengths; and

(f) if the PES packet is an audio PES packet, transmitting blocks of the audio data from the buffer to the audio decoder after an audio delay.

10. The method of claim 9, and further including repeating steps (a)-(f) for each PES packet in the MPEG-2 transport stream.

11. The method of claim 9, wherein the step of transmitting blocks of the video data from the buffer to the video decoder in known lengths includes the step of ensuring that each block contains an even number of bytes.

12. The method of claim 11, wherein the step of ensuring that each block contains an even number of bytes includes removing a byte of data from the PES packet being processed if the PES packet contains an odd number of bytes and appending the byte of data to a subsequent PES packet.

13. The method of claim 9, wherein the audio delay is computed by:

(a) searching the transport stream for an audio PTS and ascertaining its value;

(b) reading the value of the system time clock; and

(c) calculating the audio delay by computing the difference between the value of the audio PTS and the value of the system time clock.

14. The method of claim 13, wherein the audio delay is adjusted to account for audio decoding, audio transmission, and video decoding times.