Method and System to Improve the Transport of Compressed Video Data

• US 20090190664A1
• Filed: 02/06/2009
• Published: 07/30/2009
• Est. Priority Date: 08/28/2001
• Status: Active Grant

• Current Assignee: AT&T Intellectual Property I LP (AT&T, Inc.)
• Original Assignee: AT&T Intellectual Property I LP (AT&T, Inc.)
• Inventors: Costa, Pierre, Ansari, Ahmad, Erickson, John Robert
• Granted Patent: US 8,218,647 B2
• Time in Patent Office: Days
• US Class Current: 375/240.24
• CPC Class Codes: H04N 19/115 Selection of the code volume for a coding unit prior to coding
• CPC Class Codes: H04N 19/132 Sampling, masking or truncation of coding units, e.g. adaptive resampling, frame skipping, frame interpolation or high-frequency transform coefficient masking
• CPC Class Codes: H04N 19/15 by monitoring actual compressed data size at the memory before deciding storage at the transmission buffer
• CPC Class Codes: H04N 19/152 by measuring the fullness of the transmission buffer
• CPC Class Codes: H04N 19/169 characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
• CPC Class Codes: H04N 19/172 the region being a picture, frame or field
• CPC Class Codes: H04N 19/176 the region being a block, e.g. a macroblock
• CPC Class Codes: H04N 19/188 the unit being a video data packet, e.g. a network abstraction layer [NAL] unit
• CPC Class Codes: H04N 19/30 using hierarchical techniques, e.g. scalability H04N19/63 takes precedence
• CPC Class Codes: H04N 19/40 using video transcoding, i.e. partial or full decoding of a coded input stream followed by re-encoding of the decoded output stream
• CPC Class Codes: H04N 19/46 Embedding additional information in the video signal during the compression process H04N19/517, H04N19/68, H04N19/70 take precedence
• CPC Class Codes: H04N 19/60 using transform coding
• CPC Class Codes: H04N 19/61 in combination with predictive coding
• CPC Class Codes: H04N 19/85 using pre-processing or post-processing specially adapted for video compression
• CPC Class Codes: H04N 19/88 involving rearrangement of data among different coding units, e.g. shuffling, interleaving, scrambling or permutation of pixel data or permutation of transform coefficient data among different blocks
• CPC Class Codes: H04N 19/91 Entropy coding, e.g. variable length coding [VLC] or arithmetic coding
• CPC Class Codes: H04N 21/23418 involving operations for analysing video streams, e.g. detecting features or characteristics television picture signal circuitry for scene change detection H04N5/147; filtering for image enhancement G06T5/00; methods or arrangements for recognising scenes G06V20/00; arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59
• CPC Class Codes: H04N 21/2343 involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements video transcoding H04N19/40; media packet handling at the source H04L65/762
• CPC Class Codes: H04N 21/235 Processing of additional data, e.g. scrambling of additional data or processing content descriptors
• CPC Class Codes: H04N 21/23614 Multiplexing of additional data and video streams arrangements for simultaneous broadcast of plural pieces of information H04H20/28
• CPC Class Codes: H04N 21/238 : Interfacing the downstream path of the transmission network, e.g. adapting the transmission rate of a video stream to network bandwidth; Processing of multiplex streams hybrid fiber coaxial [HFC] networks for downstream channel allocation for video distribution H04L12/2801; flow control in packet networks H04L47/10; real-time communication protocols in data switching networks H04L65/00; scheduling or organising the servicing of application requests H04L67/60
• CPC Class Codes: H04N 21/23805 : Controlling the feeding rate to the network, e.g. by controlling the video pump
• CPC Class Codes: H04N 21/4305 : Synchronising client clock from received content stream, e.g. locking decoder clock with encoder clock, extraction of the PCR packets arrangements for synchronising receiver with transmitter by comparing receiver clock with transmitter clock H04L7/0012; arrangements for synchronising receiver with transmitter wherein the receiver takes measures against momentary loss of synchronisation H04L7/0083
• CPC Class Codes: H04N 21/435 : Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream
• CPC Class Codes: H04N 21/44004 : involving video buffer management, e.g. video decoder buffer or video display buffer
• CPC Class Codes: H04N 21/8456 : by decomposing the content in the time domain, e.g. in time segments

Abstract

A method comprises determining a plurality of time intervals Tp and Tn within a variable bit rate (VBR) representation of an image sequence. The time intervals Tp are those in which a number of blocks of information per unit time is greater than a baseline value. The time intervals Tn are those in which a number of blocks of information per unit time is less than the baseline value. A second representation of the image sequence is created in which some blocks of information Bp are removed from the time intervals Tp and interlaced with blocks of information Bn in the time intervals Tn to reduce a variation in a number of blocks of information per unit time between the time intervals Tp and Tn.

Claims

1. A method of reconstructing an image sequence originally encoded in a variable bit rate (VBR) representation, the VBR representation comprising a first plurality of blocks of information and a second plurality of blocks of information, the first plurality of blocks of information comprising more blocks of information than the second plurality of blocks of information, the method comprising:

receiving a second representation of the image sequence in which some blocks of information of the first plurality of blocks of information are interlaced with blocks of information of the second plurality of blocks of information to reduce a variation in a number of blocks of information per unit time in the image sequence; and

reconstructing frames of the image sequence concurrently with said receiving, said reconstructing comprising;

during a period of time when the received stream comprises blocks of information of the first plurality of blocks of information only, reconstructing frames of the image sequence based on blocks of information of the first plurality of blocks of information stored in a buffer and blocks of information received about in real time.

2. The method of claim 1, wherein reconstructing frames of the image sequence comprises:

during a period of time when the received stream comprises block of information of the first plurality of blocks of information interlaced with blocks of information of the second plurality of blocks of information, reconstructing frames of the image sequence based on blocks of information of the second plurality of blocks of information received about in real time, and storing blocks of information of the first plurality of blocks of information in the buffer.

3. The method of claim 1, wherein the first plurality of blocks of information comprises blocks of information per unit of time and the second plurality of blocks of information comprises blocks of information per unit of time.

4. The method of claim 1, wherein the blocks of information per unit time in the second representation is about equal to a baseline value.

5. The method of claim 1 wherein the second representation of the image sequence comprises a header with data indicating which blocks of information of the first plurality of blocks of information are interlaced with blocks of information of the second plurality of blocks of information, and wherein said reconstructing the frames is based on the data comprising the header.

6. A computer-readable storage medium comprising a set of instructions for reconstructing an image sequence originally encoded in a variable bit rate (VBR) representation, the VBR representation comprising a first plurality of blocks of information and a second plurality of blocks of information, the first plurality of blocks of information comprising more blocks of information than the second plurality of blocks of information, the set of instructions to direct a processor to perform acts of:

receiving a second representation of the image sequence in which some blocks of information of the first plurality of blocks of information are interlaced with blocks of information of the second plurality of blocks of information to reduce a variation in a number of blocks of information per unit time in the image sequence; and

reconstructing frames of the image sequence concurrently with said receiving, said reconstructing comprising;

during a period of time when the received stream comprises blocks of information of the first plurality of blocks of information only, reconstructing frames of the image sequence based on blocks of information of the first plurality of blocks of information stored in a buffer and blocks of information received about in real time.

7. The computer-readable storage medium of claim 6, wherein reconstructing frames of the image sequence comprises:

during a period of time when the received stream comprises block of information of the first plurality of blocks of information interlaced with blocks of information of the second plurality of blocks of information, reconstructing frames of the image sequence based on blocks of information of the second plurality of blocks of information received about in real time, and storing blocks of information of the first plurality of blocks of information in the buffer.

8. The computer-readable storage medium of claim 6, wherein the first plurality of blocks of information comprises blocks of information per unit of time and the second plurality of blocks of information comprises blocks of information per unit of time.

9. The computer-readable storage medium of claim 6, wherein the blocks of information per unit time in the second representation is about equal to a baseline value.

10. The computer-readable storage medium of claim 6, wherein the second representation of the image sequence comprises a header with data indicating which blocks of information of the first plurality of blocks of information are interlaced with blocks of information of the second plurality of blocks of information, and wherein said reconstructing the frames is based on the data comprising the header.

11. A method of reconstructing an image sequence originally encoded in a variable bit rate (VBR) representation, the VBR representation comprising a first plurality of blocks of information and a second plurality of blocks of information, the first plurality of blocks of information comprising more blocks of information than the second plurality of blocks of information, the method comprising:

receiving a second representation of the image sequence in which some blocks of information of the first plurality of blocks of information are interlaced with blocks of information of the second plurality of blocks of information to reduce a variation in a number of blocks of information per unit time in the image sequence; and

reconstructing frames of the image sequence concurrently with said receiving, said reconstructing comprising;

during a period of time when the received stream comprises blocks of information of the first plurality of blocks of information interlaced with blocks of information of the second plurality of blocks of information, reconstructing frames of the image sequence based on blocks of information of the second plurality of information received about in real time, and storing blocks of information of the first plurality of blocks of information in a buffer.

12. The method of claim 11, wherein reconstructing frames of the image sequence comprises:

during a period of time when the received stream comprises blocks of information of the first plurality of blocks of information only, reconstructing frames of the image sequence based on blocks of information of the first plurality of blocks of information stored in the buffer and blocks of information received about in real time.

13. The method of claim 11, wherein the first plurality of blocks of information comprises blocks of information per unit of time and the second plurality of blocks of information comprises blocks of information per unit of time.

14. The method of claim 11, wherein the blocks of information per unit time in the second representation is about equal to a baseline value.

15. The method of claim 11 wherein the second representation of the image sequence comprises a header with data indicating which blocks of information of the first plurality of blocks of information are interlaced with blocks of information of the second plurality of blocks of information, and wherein said reconstructing the frames is based on the data comprising the header.

16. A computer-readable storage medium comprising a set of instructions for reconstructing an image sequence originally encoded in a variable bit rate (VBR) representation, the VBR representation comprising a first plurality of blocks of information and a second plurality of blocks of information, the first plurality of blocks of information comprising more blocks of information than the second plurality of blocks of information, the set of instructions to direct a processor to perform acts of:

receiving a second representation of the image sequence in which some blocks of information of the first plurality of blocks of information are interlaced with blocks of information of the second plurality of blocks of information to reduce a variation in a number of blocks of information per unit time in the image sequence; and

reconstructing frames of the image sequence concurrently with said receiving, said reconstructing comprising;

during a period of time when the received stream comprises block of information of the first plurality of blocks of information interlaced with blocks of information of the second plurality of blocks of information, reconstructing frames of the image sequence based on blocks of information of the second plurality of blocks of information received about in real time, and storing blocks of information of the first plurality of blocks of information in a buffer.

17. The computer-readable storage medium of claim 16, wherein reconstructing frames of the image sequence comprises:

during a period of time when the received stream comprises blocks of information of the first plurality of blocks of information only, reconstructing frames of the image sequence based on blocks of information of the first plurality of blocks of information stored in the buffer and blocks of information received about in real time.

18. The computer-readable storage medium of claim 16, wherein the first plurality of blocks of information comprises blocks of information per unit of time and the second plurality of blocks of information comprises blocks of information per unit of time.

19. The computer-readable storage medium of claim 16, wherein the blocks of information per unit time in the second representation is about equal to a baseline value.

20. The computer-readable storage medium of claim 16, wherein the second representation of the image sequence comprises a header with data indicating which blocks of information of the first plurality of blocks of information are interlaced with blocks of information of the second plurality of blocks of information, and wherein said reconstructing the frames is based on the data comprising the header.