MPEG decoding system including tag list for associating presentation time stamps with encoded data units

• US 5,559,999 A
• Filed: 09/09/1994
• Issued: 09/24/1996
• Est. Priority Date: 09/09/1994
• Status: Expired due to Term

• Current Assignee: Avago Technologies General IP PTE Limited (Broadcom, Inc.)
• Original Assignee: LSI Logic Corporation (Broadcom, Inc.)
• Inventors: Neuman, Darren, Auld, David R., Maturi, Greg
• Primary Examiner(s): KIM, KENNETH S
• Application Number:
  US08/303,444
• Time in Patent Office: 746 Days
• Field of Search: 395/200.17, 395/550, 395/182.18, 395/250, 348/7, 348/512, 348/10, 370/110.1, 370/94.2
• US Class Current: 713/400
• CPC Class Codes: G06T 9/007 Transform coding, e.g. discrete cosine transform
• CPC Class Codes: H04N 21/4305 Synchronising client clock from received content stream, e.g. locking decoder clock with encoder clock, extraction of the PCR packets arrangements for synchronising receiver with transmitter by comparing receiver clock with transmitter clock H04L7/0012; arrangements for synchronising receiver with transmitter wherein the receiver takes measures against momentary loss of synchronisation H04L7/0083
• CPC Class Codes: H04N 21/43072 of multiple content streams on the same device
• CPC Class Codes: H04N 21/44004 involving video buffer management, e.g. video decoder buffer or video display buffer

Abstract

A Motion Picture Experts Group (MPEG) multiplexed data bitstream includes encoded video and audio data units, which are prefixed with headers including Presentation Time Stamps (PTS) indicating desired presentation times for the respective data units. The data units are decoded, and presented at a fixed time after decoding, such that the fixed time can be subtracted from the PTS to provide a desired decoding time. The bitstream is parsed, the video and audio headers are stored in video and audio header memories, and the associated video and audio data units are stored in video and audio channel memories respectively. A first interrupt is generated each time a header is stored, and a host microcontroller responds by storing the PTS from the header and the starting address of the corresponding data unit in the channel memory as an entry in a list. A second interrupt is generated each time a data unit is decoded, and the host microcontroller responds by accessing the list using the starting address of the data unit to obtain the corresponding PTS and thereby the desired decoding time. Decoding and presentation are synchronized by comparing the desired decoding time with a system clock time. If the desired decoding time is later than the system clock time by more than one presentation (frame) time period for the data unit, presentation of the data unit is skipped. If the desired decoding time is earlier than the system clock time by more than the presentation time period, presentation of the data unit is repeated.

Claims

1. A decoding system for decoding a data stream:

the data stream comprising;

an encoded data unit;

a header corresponding to said encoded data unit; and

a time stamp included in said header for indicating a requested decoding time for said encoded data unit;

the system comprising;

a header memory;

a data memory;

a list memory;

parsing means for parsing said data stream, storing said header in the header memory, storing said encoded data unit in the data memory beginning at a starting address and capturing said time stamp;

computing means responsive to said parsing by the parsing means for storing said time stamp and said starting address as a list entry in said list memory; and

decoding means for reading and decoding said encoded data unit from the data memory at an actual decoding time which can differ from said requested decoding time to produce a decoded data unit;

the computing means being further responsive to said reading and decoding by the decoding means for accessing said list entry in the list memory using said starting address to obtain said time stamp;

wherein the relationship between said requested decoding time and said actual decoding time can be utilized to synchronize subsequent presentation of said decoded data unit.

2. A system as in claim 1, further comprising:

system timer means for maintaining a system clock time; and

comparator means for comparing said time stamp with a current value of said system clock time which constitutes said actual decoding time from the system timer means when the decoder means begins to read and decode said encoded data unit.

3. A system as in claim 1, in which:

the data memory comprises a circular buffer; and

the parsing means appends a value indicating a number of times the circular buffer has rolled over to the starting address for storing in the list memory.

4. A system as in claim 3, in which:

said starting address is a binary number; and

the parsing means appends said value to said binary number as a predetermined number of most significant bits.

5. A system as in claim 1, in which:

said data stream further comprises a system time stamp; and

the system further comprises;

system timer means for maintaining a system clock time;

comparator means for comparing said system time stamp to a current value of said system clock time; and

synchronization means for adjusting the system timer means such that said current value of said system clock time becomes substantially equal to said system time stamp.

6. A system as in claim 5, in which the synchronization means adjusts the system timer means by resetting said system clock time to a value that is based on said system time stamp.

7. A system as in claim 5, in which:

the system timer means comprises;

a clock pulse generator; and

a counter that is clocked by the clock pulse generator such that said system clock time is constituted by a count of the counter; and

the synchronization means adjusts the system timer means by altering a frequency of the clock pulse generator.

8. A system as in claim 1, in which:

the parsing means generates a first interrupt upon storing said header in said header memory;

the computing means stores said time stamp and said starting address as a list entry in said list memory in response to said first interrupt;

the decoding means generates a second interrupt upon beginning of reading and decoding said encoded data unit at said actual decoding time; and

the computing means accesses said list entry in the list memory using said starting address to obtain said time stamp in response to said second interrupt.

9. A decoding system for decoding a data stream:

the data stream comprising;

an encoded data unit;

a header corresponding to said encoded data unit; and

a time stamp included in said header for indicating a decoding time for said encoded data unit;

the system comprising;

a header memory;

a data memory;

a list memory;

parsing means for parsing said data stream, storing said header in the header memory, storing said encoded data unit in the data memory beginning at a starting address and capturing said time stamp;

computing means responsive to said .parsing by the parsing means for storing said time stamp and said starting address as a list entry in said list memory;

decoding means for reading and decoding said encoded data unit from the data memory to produce a decoded data unit;

the computing means being further responsive to said reading and decoding by the decoding means for accessing said list entry in the list memory using said starting address to obtain said time stamp;

system timer means for maintaining a system clock time;

comparator means for comparing said time stamp with a current value of said system clock time from the system timer means when the decoder means begins to read and decode said encoded data unit;

presentation means for presenting said decoded data unit; and

synchronization means for controlling the presentation means to repeat presentation of said decoded data unit if said time stamp exceeds said current value of said system clock time by more than a first predetermined value; and

controlling the presentation means to skip presentation of said decoded data unit if said current value of said system clock time exceeds said time stamp by more than a second predetermined value.

10. A system as in claim 9, in which:

the presentation means begins to present said decoded data unit at a predetermined time interval after the decoder means begins to decode said encoded data unit;

said time stamp indicates said presentation time directly, and thereby indicates said decoding time indirectly as being equal to said presentation time minus said predetermined time interval; and

the synchronization means determines said decoding time by subtracting said predetermined time interval from said time stamp.

11. A system as in claim 10, in which:

said data stream is an MPEG bitstream; and

said time stamp is a presentation time stamp.

12. A system as in claim 9, in which said first predetermined value is equal to said second predetermined value.

13. A system as in claim 12, in which:

said decoded data unit is a video frame; and

said first and second predetermined values are substantially equal to a frame presentation rate.

14. A decoder for decoding a data stream:

the data stream comprising;

an encoded data unit; and

a header corresponding to said encoded data unit;

the decoder comprising;

a header memory;

a data memory;

parsing means for parsing said data stream, storing said header in the header memory, storing said encoded data unit in the data memory, and generating a first interrupt upon storing said header in the header memory; and

decoding means for reading and decoding said encoded data unit from the data memory to produce a decoded data unit, and generating a second interrupt upon beginning of reading and decoding said encoded data unit;

in which

the data stream further comprises a time stamp included in said header for indicating a requested decoding time for said encoded data unit;

the parsing means further captures and stores said time stamp; and

the decoder further comprises;

system timer means for maintaining a system clock time; and

comparator means for reading and comparing said time stamp with a current value of said system clock time which constitutes an actual decoding time from the system timer means when the decoder means begins to read and decode said encoded data unit.

15. A decoder as in claim 14, in which:

said data stream further comprises a system time stamp; and

the decoder further comprises;

system timer means for maintaining a system clock time;

comparator means for comparing said system time stamp to a current value of said system time; and

synchronization means for adjusting the system timer means such that said current value of said system clock time becomes substantially equal to said system time stamp.

16. A decoder as in claim 15, in which the synchronization means adjusts the system timer means by resetting said system clock time to a value that is based on said system time stamp.

17. A decoder as in claim 16, in which:

the system timer means comprises;

a clock pulse generator; and

a counter that is clocked by the clock pulse generator such that said system clock time is constituted by a count of the counter; and

the synchronization means adjusts the system timer means by altering a frequency of the clock pulse generator.

18. A decoder for decoding a data stream:

the data stream comprising;

an encoded data unit; and

a header corresponding to said encoded data unit;

..

the decoder comprising;

a header memory;

a data memory;

parsing means for parsing said data stream, storing said header in the header memory, storing said encoded data unit in the data memory, and generating a first interrupt upon storing said header in the header memory; and

decoding means for reading and decoding said encoded data unit from the data memory to produce a decoded data unit, and generating a second interrupt upon beginning of reading and decoding said encoded data unit;

the data stream further comprising a time stamp included in said header for indicating a decoding time for said encoded data unit;

the parsing means further capturing said time stamp;

system timer means for maintaining a system clock time;

comparator means for comparing said time stamp with a current value of said system clock time from the system timer means when the decoder means begins to read and decode said encoded data unit;

presentation means for presenting said decoded data unit; and

synchronization means for controlling the presentation means to repeat presentation of said decoded data unit if said time stamp exceeds said current value of said system clock time by more than a first predetermined value; and

controlling the presentation means to skip presentation of said decoded data unit if said current value of said system clock time exceeds said time stamp by more than a second predetermined value.

19. A decoder as in claim 18, in which:

the presentation means begins to present said decoded data unit at a predetermined time interval after the decoder means begins to decode said encoded data unit;

said time stamp indicates said presentation time directly, and thereby indicates said decoding time indirectly as being equal to said presentation time minus said predetermined time interval; and

the synchronization means determines said decoding time by subtracting said predetermined time interval from said time stamp.

20. A decoder as in claim 19, in which:

said data stream is an MPEG bitstream; and

said time stamp is a presentation time stamp.

21. A decoder as in claim 18, in which said first predetermined value is equal to said second predetermined value.

22. A decoder as in claim 21, in which:

said decoded data unit is a video frame; and

said first and second predetermined values are substantially equal to a frame presentation rate.

23. A method of decoding a data stream:

the data stream comprising;

an encoded data unit;

a header corresponding to said encoded data unit; and

a time stamp included in said header for indicating a requested decoding time for said encoded data unit;

the method comprising the steps of;

(a) parsing said data stream;

(b) storing said header in a header memory;

(c) storing said encoded data unit in a data memory beginning at a starting address;

(d) capturing said time stamp;

(e) storing said time stamp and said starting address as a list entry in a list memory;

(f) reading and decoding said encoded data unit from the data memory at an actual decoding time which can differ from said requested decoding time to produce a decoded data unit; and

(g) accessing said list entry in the list memory using said starting address to obtain said time stamp;

wherein the relationship between said requested decoding time and said actual decoding time can be utilized to synchronize subsequent presentation of said decoded data unit.

24. A method as in claim 23, further comprising the steps of:

(h) maintaining a system time; and

(i) comparing said time stamp with a current value of said system clock time which constitutes said actual decoding time from the system timer means upon performing step (f).

25. A method as in claim 23, in which:

step (b) further comprises generating a first interrupt;

step (e) comprises storing said time stamp and said starting address as a list entry in said list memory in response to said first interrupt;

step (f) comprises generating a second interrupt upon beginning of reading and decoding said encoded data unit; and

step (g) comprises accessing said list entry in the list memory using said starting address to obtain said time stamp in response to said second interrupt.

26. A method of decoding a data stream:

the data stream comprising;

an encoded data unit;

a header corresponding to said encoded data unit; and

a time stamp included in said header for indicating a decoding time for said encoded data unit;

the method comprising the steps of;

(a) parsing said data stream;

(b) storing said header in a header memory;

(c) storing said encoded data unit in a data memory beginning at a starting address;

(d) capturing said time stamp;

(e) storing said time stamp and said starting address as a list entry in a list memory;

(f) reading and decoding said encoded data unit from the data memory to produce a decoded data unit; and

(g) accessing said list entry in the list memory using said starting address to obtain said time stamp;

(h) maintaining a system time;

(i) comparing said time stamp with a current value of said system clock time from the system timer means upon performing step (f);

(j) repeating presentation of said decoded data unit if said time stamp exceeds said current value of said system clock time by more than a first predetermined value; and

(k) skipping presentation of said decoded data unit if said current value of said system clock time exceeds said time stamp by more than a second predetermined value.