Multimedia compression system with additive temporal layers

• US 20030012279A1
• Filed: 05/20/2002
• Published: 01/16/2003
• Est. Priority Date: 03/17/1997
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Navin Chaddha
• Inventors: Chaddha, Navin
• Granted Patent: US 7,082,164 B2
• Time in Patent Office: Days
• US Class Current: 375/240.12
• CPC Class Codes: G06T 9/40 Tree coding, e.g. quadtree, octree
• CPC Class Codes: H04N 19/30 using hierarchical techniques, e.g. scalability H04N19/63 takes precedence
• CPC Class Codes: H04N 19/51 Motion estimation or motion compensation
• CPC Class Codes: H04N 19/527 Global motion vector estimation

Abstract

A multimedia compression system for generating frame rate scaleable data in the case of universally scaleable data. Universally scaleable data is scaleable across all of the relevant characteristics of the data (e.g., frame rate, resolution, and quality for video). The scaleable data generated by the compression system includes multiple additive layers for each characteristic across which the data is scaleable. For video, the frame rate layers are additive temporal layers, the resolution layers are additive base and enhancement layers, and the quality layers are additive index planes of embedded codes. Various techniques can be used for generating these layers (e.g., Laplacian pyramid decomposition or wavelet decomposition for generating the resolution layers; tree structured vector quantization or tree structured scalar quantization for generating the quality layers). The system further provides for embedded inter-frame compression in the context of frame rate scalability, and non-redundant layered multicast network delivery of the scaleable data.

Claims

1. A system comprising:

means for receiving original video data; and

means for encoding said original video data into encoded video data, said encoded video data comprising multiple additive temporal layers of video frames so as to provide frame rate scalability.

2. The system of claim 1, wherein said encoded video data additionally comprises multiple additive resolution layers so as to provide resolution scalability.

3. The system of claim 1, wherein said encoded video data additionally comprises multiple additive index planes so as to provide quality scalability.

4. The system of claim 3, wherein said encoded video data additionally comprises multiple additive resolution layers so as to provide resolution scalability.

5. The system of claim 1, further comprising:

means for performing inter-frame compression, wherein forward inter-frame compression is optionally performed on the first temporal layer, and for a frame in a subsequent temporal layer, forward inter-frame compression is optionally performed against one or more previous frames in higher layers, and reverse inter-frame compression is optionally performed against one or more subsequent frames in higher layers.

6. The system of claim 5 wherein said inter-frame compression technique is conditional replenishment.

7. The system of claim 5 wherein said inter-frame compression technique is motion compensation.

8. The system of claim 7 wherein said inter-frame compression technique includes conditional replenishment and motion compensation.

9. The system of claim 1 further comprising:

means for multicast network delivery of said encoded video data wherein the temporal layers are distributed, in a non-redundant way, among various multicast channels.

10. The system of claim 4 further comprising:

means for multicast network delivery of said encoded video data wherein the temporal layers, resolution layers, and index planes are distributed, in a non-redundant way, among various multicast channels.

11. A system comprising:

means for receiving original multimedia data; and

means for encoding said original multimedia data into encoded multimedia data, said encoded multimedia data comprising multiple additive layers for each relevant characteristic of said multimedia data type.

12. A data compression system comprising:

a predictor configured to make a prediction of a current data vector based on at least one previous data vector;

a segmentor coupled to receive the prediction and configured to segment the current data vector into a plurality of sub-vectors based on the prediction; and

a hierarchical lookup table comprising a plurality of lookup tables, the hierarchical lookup table configured to map the plurality of sub-vectors to a set of codes by successive utilization of the plurality of lookup tables in stages so that one of the codes is generated in response to each of the sub-vectors, the hierarchical lookup table being coupled to the segmentor for receiving the plurality of sub-vectors.

13. A method of compressing data comprising:

converting data into a series of data vectors;

making a prediction of a current data vector based at least in part on one previous data vector;

segmenting the current data vector into a plurality of sub-vectors; and

mapping, using a hierarchical lookup table comprising a plurality of lookup tables, the plurality of sub-vectors to a set of codes by successive utilization of the plurality of lookup tables in stages so that one of the codes is generated in response to each of the sub-vectors.