System for content adaptive video decoding

• US 6,970,513 B1
• Filed: 06/05/2001
• Issued: 11/29/2005
• Est. Priority Date: 06/05/2001
• Status: Expired due to Term

• Current Assignee: AT&T Corporation (AT&T, Inc.)
• Original Assignee: AT&T Corporation (AT&T, Inc.)
• Inventors: Civanlar, Mehmet Reha, Puri, Atul
• Primary Examiner(s): RAO, ANAND SHASHIKANT
• Application Number:
  US09/874,879
• Time in Patent Office: 1,638 Days
• Field of Search: 37524001-24029
• US Class Current: 375/240.25
• CPC Class Codes: H04N 19/17 the unit being an image region, e.g. an object
• CPC Class Codes: H04N 19/20 using video object coding
• CPC Class Codes: H04N 19/23 with coding of regions that are present throughout a whole video segment, e.g. sprites, background or mosaic
• CPC Class Codes: H04N 19/25 with scene description coding, e.g. binary format for scenes [BIFS] compression
• CPC Class Codes: H04N 19/44 Decoders specially adapted therefor, e.g. video decoders which are asymmetric with respect to the encoder
• CPC Class Codes: H04N 19/80 Details of filtering operations specially adapted for video compression, e.g. for pixel interpolation H04N19/635, H04N19/86 take precedence
• CPC Class Codes: H04N 19/86 involving reduction of coding artifacts, e.g. of blockiness

Abstract

A system for content adaptively decoding video content is disclosed. The system receives a bitstream which was segmented into segments based on predefined classifications. Examples of such classifications include action scenes, slow scenes, low or high detail scenes, and brightness of the scenes. Based on the segment classifications, each segment was encoded with a different encoder chosen from a plurality of encoders. The chosen encoder is particularly suited to encoding the unique subject matter of the segment. The coded bit-stream for each segment includes information regarding which encoder was used to encode that segment. A matching decoder of a plurality of decoders is chosen using the information in the coded bitstream to decode each segment using a decoder suited for the classification of the segment. If scenes exist which do not fall in a predefined classification, or where classification is more difficult based on the scene content, these scenes are segmented, coded and decoded using a generic coder and decoder.

Claims

1. An apparatus for decoding a bitstream encoded via a plurality of encoders, the bitstream being divided into portions, and each portion having an associated model chosen from a plurality of predefined models, the apparatus comprising:

a plurality of decoders; and

an input switch that routes each portion to a decoder of the plurality of decoders based on the associated model of the portion, wherein each of the plurality of decoders can decode bitstream portions based on at least one of the plurality of predefined models.

2. The apparatus of claim 1, wherein each decoder of the plurality of decoders is associated with a different predetermined model.

3. The apparatus of claim 2, wherein the plurality of decoders includes a generic decoder.

4. The apparatus of claim 3, wherein if a portion cannot be associated with one of a plurality of predetermined models, then the portion is routed to the generic decoder.

5. The apparatus of claim 4, further comprising:

an output switch for controlling an output signal routed from one of the plurality of decoders.

6. An apparatus for decoding a bitstream composed of video content portions, each portion of the bitstream having an associated model and having been encoded via either a generic encoder or an encoder from a plurality of encoders, the apparatus comprising:

an input switch that receives the encoded bitstream;

a plurality of decoders, wherein the input switch routes each bitstream portion to a decoder of the plurality of decoders based on the model associated with the bitstream portion, wherein each of the plurality of decoders can decode bitstream portions based on at least one of the plurality of redefined models.

7. The apparatus of claim 6, further comprising:

an output switch connected to an output port from each of the decoders, the output switch determining which signal to output from the plurality of decoders.

8. The apparatus of claim 7, wherein each decoder of the plurality of decoders is associated with a different model.

9. The apparatus of claim 8, wherein the models are associated with video characteristics of the portions.

10. The apparatus of claim 9, wherein the characteristics comprise scene concepts, properties of the scene, camera operations or special effects.

11. A device for decoding video content divided into portions, each portion being associated with either a generic model or a model from a plurality of predefined models, the device comprising:

a generic decoder;

a plurality of decoders, each decoder of the plurality of decoders being associated with different model of the plurality of predefined models;

a switch that routes each portion of the video content to either the generic decoder or a decoder from the plurality of decoders based on the model associated with the video content portion.

12. An apparatus for decoding video content encoded in portions either by a generic encoder or an encoder chosen from a plurality of encoders, each of the plurality of encoders associated with a model chosen from a plurality of predetermined models related to the characteristics of the video content, the video content having video content descriptors used for characterizing the video content, the apparatus comprising:

a switch receiving at a first input port a control signal and receiving the video content at a second input port, the control signal being associated with the video content descriptors, the switch having a plurality of output ports;

a generic decoder connected to an output port of the plurality of switch output ports; and

a plurality of decoders, each decoder of the plurality of decoders being connected to an output port of the plurality of switch output ports and being associated with a model of the plurality of predetermined models related to the characteristics of the video content, wherein the video content is routed to either the generic decoder or a decoder of the plurality of decoders by the switch.

13. The apparatus of claim 12, wherein a portion further comprises a video content segment.

14. The apparatus of claim 12, wherein a portion further comprises a video content region of interest.

15. The apparatus of claim 12, further comprising:

a second switch having a plurality of input ports and an output port, each of the plurality of input ports being connected to an output of the generic decoder or an output port of a decoder of the plurality of decoders.