Processing coded video

• US 6,741,290 B1
• Filed: 04/04/2000
• Issued: 05/25/2004
• Est. Priority Date: 08/08/1997
• Status: Expired due to Fees

• Current Assignee: British Broadcasting Corporation
• Original Assignee: British Broadcasting Corporation
• Inventors: Wells, Nicholas Dominic
• Primary Examiner(s): LEE, MICHAEL
• Application Number:
  US09/485,342
• Time in Patent Office: 1,512 Days
• Field of Search: H04/N.9475, H04/N.712, H04/N 1.120, 348/512, 348/513, 348/515, 348/425.1, 348/425.2, 348/425.3, 348/425.4, 348/705, 348/706, 348/553, 348/554, 348/555, 348/556, 348/558, 348/518, 348/500, 348/510, 348/722
• US Class Current: 348/512
• CPC Class Codes: G06T 9/007 Transform coding, e.g. discrete cosine transform
• CPC Class Codes: G11B 27/031 Electronic editing of digitised analogue information signals, e.g. audio or video signals
• CPC Class Codes: G11B 27/036 Insert-editing
• CPC Class Codes: G11B 27/10 Indexing; Addressing; Timing or synchronising; Measuring tape travel
• CPC Class Codes: H04N 21/23406 involving management of server-side video buffer
• CPC Class Codes: H04N 21/23424 involving splicing one content stream with another content stream, e.g. for inserting or substituting an advertisement
• CPC Class Codes: H04N 21/23608 Remultiplexing multiplex streams, e.g. involving modifying time stamps or remapping the packet identifiers
• CPC Class Codes: H04N 21/242 Synchronization processes, e.g. processing of PCR [Program Clock References] arrangements for synchronising broadcast or distribution via plural systems in broadcast distribution systems H04H20/18
• CPC Class Codes: H04N 21/2665 Gathering content from different sources, e.g. Internet and satellite

Abstract

A method of processing coded video, for example by inserting generated frames, or adjusting values in timing fields, or adjusting the time at which it is output, to adjust the timing of output of decoded video from a decoder receiving the coded video is disclosed, together with corresponding apparatus. The outputting apparatus may be included in a multiple-source video system, to enable multiple video sources to be synchronized. The output video can be synchronized to a studio reference clock.

Claims

1. Apparatus for outputting a coded video sequence comprising:

means for receiving a coded video sequence to be output;

means for receiving a studio reference clock;

means for outputting the coded video sequence in a form enabling real-time decoding of the coded video sequence to produce a sequence of pictures;

means for processing the coded video sequence by altering one or more values in timing fields contained within the coded video sequence in dependence on timing information derived from the studio reference clock so that a decoder receiving the output coded video sequence produces decoded picture output from at a predetermined timing,

means for determining a delay between commencement of output of data corresponding to a frame by said outputting means and display of the frame by a decoder, said means for processing being controlled in dependence on the determined delay, and including means for determining said delay time based on a predetermined offset value corresponding to a measure of propagation delay through said decoder and a variable value corresponding to the delay before decoding for said frame.

9. A multiple source video system comprising:

a plurality of video sequence sources, at least one video sequence source comprising outputting apparatus according to any preceding claim, each arranged to receive a respective coded video sequence and having a decoder coupled to the output thereof to produce a respective decoded video sequence output therefrom;

means for supplying a studio reference clock to the or each outputting apparatus;

means for receiving editing or playout information specifying timing of changes between video sequence sources;

means for supplying a selected video sequence source to a video output channel based on said editing or playout information; and

means for supplying desired picture output time information to the or each outputting apparatus based on said editing information.

2. Apparatus for outputting a coded video sequence comprising:

means for receiving a coded video sequence to be output;

means for receiving a studio reference clock;

means for outputting the coded video sequence in a form enabling real-time decoding of the coded video sequence to produce a sequence of pictures;

means for processing the coded video sequence by altering one or more values in timing fields contained within the coded video sequence in dependence on timing information derived from the studio reference clock so that a decoder receiving the output coded video sequence produces decoded picture output from at a predetermined timing and having means for inputting information specifying a measure of desired picture output time of at least one frame or field of a video sequence or a DTS or PTS value, said processing and/or adjusting being selected based on the measure of desired picture output time and the studio reference clock so that said at least one frame or field is output from a decoder at the desired picture output time.

3. Apparatus for outputting a coded video sequence comprising:

means for receiving a coded video sequence to be output;

means for receiving a studio reference clock;

means for outputting the coded video sequence in a form enabling real-time decoding of the coded video sequence to produce a sequence of pictures;

means for processing the coded video sequence by altering one or more values in timing fields contained within the coded video sequence in dependence on timing information derived from the studio reference clock so that a decoder receiving the output coded video sequence produces decoded picture output from at a predetermined timing, arranged to receive a desired display time specified in a first format and the studio reference clock input in a second format and having means for converting between the first and second formats, wherein the first format includes hour, minute, second and frame display time information, and the second format includes a studio clock counter value, preferably having a clock frequency of at least 50 kHz and a size of at least 32 bits.

4. Apparatus for outputting a coded video sequence comprising:

means for receiving a coded video sequence to be output, means for receiving a studio reference clock;

means for outputting the coded video sequence in a form enabling real-time decoding of the coded video sequence to produce a sequence of pictures;

means for processing, the coded video sequence by altering one or more values in timing fields contained within the coded video sequence in dependence on timing information derived from the studio reference clock so that a decoder receiving the output coded video sequence produces decoded picture output from at a predetermined timing, having means for determining an effective clock frequency for the output coded video sequence based on the rate of change of clock values contained within the output data and means for comparing or synchronising the effective clock frequency to the studio reference clock frequency.

5. Apparatus according to claim 4, wherein said clock values are PCR fields within an MPEG video sequence.

6. Apparatus for outputting a coded video sequence comprising:

means for receiving a coded video sequence to be output;

means for receiving a studio reference clock;

means for outputting the coded video sequence in a form enabling real-time decoding of the coded video sequence to produce a sequence of pictures;

means for processing the coded video sequence by altering one or more values in timing fields contained within the coded video sequence in dependence on timing information derived from the studio reference clock so that a decoder receiving the output coded video sequence produces decoded picture output from at a predetermined timing,

including means for generating a sequence of one or more frames to be inserted in the output sequence and means for inserting the generated sequence into said coded video sequence to adjust the timing of picture output of frames of said coded video sequence the generated sequence being selected to maintain or establish synchronisation of a buffer of a decoder receiving the output sequence, for facilitating switching an output video sequence from a first coded video sequence to a second coded video sequence, wherein the size of the generated frames and/or the timing information associated with the generated frames and/or frames of said first and second coded video sequences is selected so that, on commencement of decoding of the second coded video sequence following said switching, the buffer occupancy of a decoder receiving said output video sequence will be substantially at a desired value.

7. Apparatus according to claim 6, wherein the desired value of buffer occupancy is determined based on an estimate of the buffer occupancy if the decoder had been receiving the second coded video sequence instead of the first coded video sequence and the generated sequence.

8. Apparatus according to claim 6 further including means for receiving editing list information specifying desired picture output time.

10. A method of outputting a coded video sequence comprising:

receiving a coded video sequence to be output;

receiving a studio reference clock;

processing the coded video sequence by altering one or more values in timing fields contained within the coded video sequence in dependence on timing information derived from the studio reference clock so that a decoder receiving the output coded video sequence produces decoded picture output from at a predetermined timing;

outputting the coded video sequence in a form enabling real-time decoding of the sequence to produce a sequence of pictures including inputting information specifying a measure of desired picture output time of at least one frame or field of a video sequence or a DTS or PTS value, said processing and/or adjusting being selected based on the measure of desired picture output time and the studio reference clock so that said at least one frame or field is output from a decoder at the desired picture output time.

11. A method according to claim 10 including receiving a desired display time specified in a first format, and the studio reference clock input in a second format, and converting between the first and second formats.

12. A method of outputting a coded video sequence comprising:

receiving a coded video sequence to be output;

receiving a studio reference clock;

processing the coded video sequence by altering one or more values in timing fields contained within the coded video sequence in dependence on timing information derived from the studio reference clock so that a decoder receiving the output coded video sequence produces decoded picture output from at a predetermined timing;

outputting the coded video sequence in a form enabling real-time decoding of the sequence to produce a sequence of pictures including receiving a desired display time specified in a first format, and the studio reference wherein the first format includes hour, minute, second and frame display time information, and the second format includes a studio clock counter value, preferably having a clock frequency of at least 50 kHz and a size of at least 32 bits.

13. A method of outputting a coded video sequence comprising:

receiving a coded video sequence to be output;

receiving a studio reference clock;

processing the coded video sequence by altering one or more values in timing fields contained within the coded video sequence in dependence on timing information derived from the studio reference clock so that a decoder receiving the output coded video sequence produces decoded picture output from at a predetermined timing;

outputting the coded video sequence in a form enabling real-time decoding of the sequence to produce a sequence of pictures including determining an effective clock frequency for the output coded video sequence based on the rate of change of clock values contained within the output data and comparing or synchronising the effective clock frequency to the studio reference clock frequency.

14. A method according to claim 13, wherein said clock values are PCR fields within an MPEG video sequence.

15. A method of outputting a coded video sequence comprising:

receiving a coded video sequence to be output;

receiving a studio reference clock;

processing the coded video sequence by altering one or more values in timing fields contained within the coded video sequence in dependence on timing information derived from the studio reference clock so that a decoder receiving the output coded video sequence produces decoded picture output from at a predetermined timing;

outputting the coded video sequence in a form enabling real-time decoding of the sequence to produce a sequence of pictures including generating a sequence of one or more frames to be inserted in the output sequence and inserting the generated sequence into said coded video sequence to adjust the timing of picture output of frames of said coded video sequence, the generated sequence being selected to maintain or establish synchronisation of a buffer of a decoder receiving the output sequence, for facilitating switching an output video sequence from a first coded video sequence to a second coded video sequence, wherein the size of the generated frames and/or the timing information associated with the generated frames and/or frames of said first and second coded video sequences is selected so that, on commencement of decoding of the second coded video sequence following said switching, the buffer occupancy of a decoder receiving said output video sequence will be substantially at a desired value.

16. A method according to claim 15, wherein the desired value of buffer occupancy is determined based on an estimate of the buffer occupancy if the decoder had been receiving the second coded video sequence instead of the first coded video sequence and the generated sequence.

17. A method of controlling a multiple source video system including at least one apparatus for outputting a coded video sequence comprising:

means for receiving a coded video sequence to be output;

means for receiving a studio reference clock;

means for outputting the coded video sequence in a form enabling real-time decoding of the coded video sequence to produce a sequence of pictures;

means for processing the coded video sequence by altering one or more values in timing fields contained within the coded video sequence in dependence on timing information derived from the studio reference clock so that a decoder receiving the output coded video sequence produces decoded picture output from at a predetermined timing, and a decoder connected thereto, the method comprising;

supplying a studio reference clock to the or each outputting apparatus;

receiving editing or playout information specifying timing of changes between video sequence sources;

selecting a video sequence source for supply to a video output channel based on said editing information;

supplying desired picture output time information to the or each outputting apparatus based on said editing or playout information; and

controlling the or each outputting apparatus based on said studio reference clock and said desired picture output time so that a desired picture output is available from said decoder at the time the decoder output is selected as said video sequence source.

18. Apparatus for processing frame display time information in real time comprising means for receiving data indicating a desired frame display time, the data including hour, minute, second and frame display time information, means for correlating the frame display time information to a studio clock counter value, preferably having a clock frequency of at least 50 kHz and a size of at least 32 bits, and means for producing output data encoding the frame display time information as a studio clock counter value.