Robust method for achieving audio/video synchronization in MPEG decoders in personal video recording applications

• US 20040001591A1
• Filed: 06/27/2002
• Published: 01/01/2004
• Est. Priority Date: 06/27/2002
• Status: Active Grant

• Current Assignee: Dynamic Data Technologies LLC
• Original Assignee: Koninklijke Philips Electronics N.V. (Koninklijke Philips N.V.)
• Inventors: van der Schaar, Auke Sjoerd, Meenakshisundaram, Ramanathan, Mani, Murali, Wester, Rogatus Hubertus Hermanus
• Granted Patent: US 7,315,622 B2
• Time in Patent Office: Days
• US Class Current: 380/210
• CPC Class Codes: H04N 21/4147 PVR [Personal Video Recorder] H04N5/76 takes precedence ; arrangements for broadcast with accumulation-type receivers H04H20/40
• CPC Class Codes: H04N 21/42661 for reading from or writing on a magnetic storage medium, e.g. hard disk drive
• CPC Class Codes: H04N 21/4305 Synchronising client clock from received content stream, e.g. locking decoder clock with encoder clock, extraction of the PCR packets arrangements for synchronising receiver with transmitter by comparing receiver clock with transmitter clock H04L7/0012; arrangements for synchronising receiver with transmitter wherein the receiver takes measures against momentary loss of synchronisation H04L7/0083
• CPC Class Codes: H04N 21/43072 of multiple content streams on the same device
• CPC Class Codes: H04N 21/4325 by playing back content from the storage medium reproduction of recorded television signals H04N5/76; reproduction of recorded television signals H04N9/79
• CPC Class Codes: H04N 21/4343 Extraction or processing of packetized elementary streams [PES]
• CPC Class Codes: H04N 21/4385 Multiplex stream processing, e.g. multiplex stream decrypting
• CPC Class Codes: H04N 21/43853 involving multiplex stream decryption arrangements using cryptography for the use of broadcast information or broadcast-related information H04H60/23

Abstract

A receiver for receiving an MPEG encrypted transport stream and outputting audio and video signals comprising: a decryptor adapted to receive and decrypt the encrypted transport stream; a de-multiplexer adapted to convert the decrypted transport stream to audio and video elementary streams and to change the values in presentation time stamp and decoding time stamp fields of each packet of the audio and elementary streams to match the time of a receiver record clock; a storage sub-system adapted to store the audio and the video elementary streams and to change the values in the presentation time stamp and decoding time stamp fields of each header of the audio and video elementary streams to compensate for the amount of time the audio and video elementary streams are stored; and audio and video decoders to decode the audio and video elementary streams respectively.

Claims

1. A receiver for receiving an MPEG encrypted transport stream and outputting audio and video signals, comprising:

a decryptor adapted to receive the encrypted transport stream, to decrypt the encrypted transport stream and to output the decrypted transport stream;

a de-multiplexer adapted to receive the decrypted transport stream, adapted to convert the decrypted transport stream to an audio elementary stream and a video elementary stream and adapted to change the values in presentation time stamp and decoding time stamp fields of each header of each packet of the audio elementary stream and of the video elementary stream to match the time of a receiver record clock and adapted to output the audio elementary stream and the video elementary stream;

a storage sub-system adapted to receive and store the audio elementary stream and the video elementary stream, adapted to change the values in the presentation time stamp and decoding time stamp fields of each header of each packet of the audio elementary stream and of the video elementary stream to compensate for the amount of time the audio elementary stream and of the video elementary stream are stored in the storage sub-system;

an audio decoder adapted to receive and to decode the audio elementary stream and adapted to output an audio signal; and

a video decoder adapted to receive and to decode the video elementary stream and adapted to output a video signal.

2. The receiver of claim 1, further including frequency adjusting means for adjusting the frequency of a receiver play clock to match the frequency of the receiver record clock.

3. The receiver of claim 2, wherein the storage sub-system adds the difference between a storage time on the receiver play clock when the audio and video elementary streams are stored in the storage sub-system and a play time on the receiver play clock when the audio and video elementary streams are read out of the storage sub-system to each presentation time stamp field and each decoding time stamp field of each header of each packet in the audio and video elementary streams.

4. The receiver of claim 1, wherein the de-multiplexer adds the difference in the value of a first program clock reference field in the header of a packet in the decrypted transport stream, the packet associated with a program to be stored, and the current time of the receiver record clock to each presentation time stamp field and each decoding time stamp field of each header of each packet in the audio and video elementary streams.

5. The receiver of claim 1, wherein the de-multiplexer is adapted to input the audio elementary stream directly to the audio decoder and to input the video elementary stream directly to the video decoder.

10. The receiver of claim 5, wherein the selector is adapted to input the partial transport stream directly to the de-multiplexer.

6. A receiver for receiving an MPEG encrypted transport stream and outputting audio and video signals, comprising:

a decryptor adapted to receive the encrypted transport stream, decrypt the encrypted transport stream and output a decrypted transport stream;

a selector adapted to receive the decrypted transport stream, adapted to select packets associated with one or more programs and adapted to create a partial transport containing only packets associated with the one or more programs, adapted to add a time stamp based on a receiver record clock to each packet in the partial transport stream and adapted to output the partial transport stream;

a storage sub-system adapted to receive and store the partial transport stream;

a de-multiplexer adapted to receive the partial transport stream, adapted to convert the partial transport stream to an audio elementary stream and a video elementary stream, adapted to change the values in presentation time stamp and decoding time stamp fields of each header of each packet of the audio elementary stream and of the video elementary stream to compensate for the amount of time the partial transport stream is stored in the storage sub-system;

an audio decoder adapted to receive and to decode the audio elementary stream and output an audio signal; and

a video decoder adapted to receive and to decode the video elementary stream and output a video signal.

7. The receiver of claim 6, further including frequency adjusting means for adjusting the frequency of a receiver play clock to match the frequency of the receiver record clock.

8. The receiver of claim 7, wherein the frequency adjusting means adjusts the frequency of the receiver play clock based upon the values of presentation time stamps fields of the headers of each packet in the partial transport stream and the current value of the receiver play clock.

9. The receiver of claim 6, wherein the de-multiplexer adds the difference in the value of a first program clock reference field in the header of a packet in the decrypted transport stream, the packet associated with a program to be stored, and the current time of the receiver record clock to each presentation time stamp field and each decoding time stamp field of each header of each packet in the audio and video elementary streams.

11. The receiver of claim 6, wherein the storage sub-system injects packets based upon the time stamp added to each packet of the partial transport stream.

12. A method of synchronization of audio and video in an MPEG decoder comprising:

decrypting a transport stream;

de-multiplexing the transport stream;

extracting the value of a first program clock reference field from the header of a first packet associated with a program in the transport stream;

de-multiplexing the transport stream into an audio elementary stream and a video elementary stream;

adding a difference between a current time and a value of a first program clock reference field in the header of a packet in the decrypted transport stream, the packet associated with a program to be stored to each presentation time stamp field and each decoding time stamp field of each header of each packet in the audio and video elementary streams associated with the program to be stored;

storing the audio and video elementary streams;

upon reading out the audio and video elementary streams, adding a difference between a time when the audio and video elementary streams were stored and a play time when the audio and video elementary streams are read out of storage to each presentation time stamp field and each decoding time stamp field of each header of each packet in the audio and video elementary streams; and

decoding the audio and video elementary streams.

13. The method of claim 12, further including:

adjusting a frequency of the play time to match a frequency of the record time.

14. The method of claim 12, further including:

upon resuming a normal rate of reading out after a change from the normal rate of reading out of the audio and video elementary streams, adding an offset based on values of the presentation time stamp field of the header of the audio elementary stream packets and the header of the video elementary stream packets and the current play time to each presentation time stamp field and each decoding time stamp field of each header of each packet in the audio and video elementary streams.

19. The method of claim 12, wherein the selecting is based on values in program ID fields of the headers of packets in the transport stream.

20. The receiver of claim 12, wherein a rate of reading out of the audio and video elementary streams is based upon the time stamp added to the header of each packet of the partial transport stream.

15. A method of synchronization of audio and video in an MPEG decoder comprising:

decrypting a transport stream;

selecting packets associated with one or more programs and creating a partial transport stream containing only packets associated with the one or more programs;

adding a time stamp based on a current record time to each header of each packet in the partial transport stream;

storing the partial transport stream;

reading out partial transport stream;

de-multiplexing the partial transport stream into an audio elementary stream and a video elementary stream;

adding a difference between a value of a first program clock reference field in the header of a packet in the decrypted transport stream, the packet associated with a program to be stored, and a current time to each presentation time stamp field and each decoding time stamp field of each header of each packet in the audio and video elementary streams; and

decoding the audio and video elementary streams.

16. The method of claim 15, further including:

adjusting a frequency the play time to match a frequency of the record time.

17. The method of claim 16, wherein the frequency is adjusted based upon the values of presentation time stamps fields of the headers of each packet in the partial transport stream and the current play time.

18. The method of claim 15, further including:

upon resuming a normal rate of reading out after a change from the normal rate of reading out of the audio and video elementary streams, adding an offset based values in the presentation time stamp field of the header of the audio elementary stream packets and the header of the video elementary stream packets and the current play time to each presentation time stamp field and each decoding time stamp field of each header of each packet in the audio and video elementary streams.