Computer-readable medium for content adaptive video decoding

• US 7,277,485 B1
• Filed: 08/03/2005
• Issued: 10/02/2007
• Est. Priority Date: 06/05/2001
• Status: Expired due to Term

• Current Assignee: AT&T Corporation (AT&T, Inc.)
• Original Assignee: AT&T Corporation (AT&T, Inc.)
• Inventors: Civanlar, Mehmet Reha, Puri, Atul
• Primary Examiner(s): LEE, Y YOUNG
• Application Number:
  US11/196,122
• Time in Patent Office: 790 Days
• Field of Search: 375/240.01, 375/240.1, 375/240.25, 375/240.26, 375/240.08, 382/173
• US Class Current: 375/240.08
• CPC Class Codes: G06T 9/001 Model-based coding, e.g. wire frame
• CPC Class Codes: H04N 19/11 among a plurality of spatial predictive coding modes
• CPC Class Codes: H04N 19/12 Selection from among a plurality of transforms or standards, e.g. selection between discrete cosine transform [DCT] and sub-band transform or selection between H.263 and H.264
• CPC Class Codes: H04N 19/14 Coding unit complexity, e.g. amount of activity or edge presence estimation H04N19/146 takes precedence
• CPC Class Codes: H04N 19/20 using video object coding
• CPC Class Codes: H04N 19/44 Decoders specially adapted therefor, e.g. video decoders which are asymmetric with respect to the encoder
• CPC Class Codes: H04N 19/80 Details of filtering operations specially adapted for video compression, e.g. for pixel interpolation H04N19/635, H04N19/86 take precedence
• CPC Class Codes: H04N 19/86 involving reduction of coding artifacts, e.g. of blockiness

Abstract

A method of content adaptive decoding involves receiving a bitstream encoded wherein video content is segmented into portions based on predefined classifications or models, such as action scenes, slow scenes, low or high detail scenes, and brightness of the scenes. Based on the segment classifications, each segment or portion is encoded with a different encoder chosen from a plurality of encoders. The chosen encoder is particularly suited to encoding the unique subject matter of the segment. The coded bit-stream for each segment includes information regarding which encoder was used to encode that segment. A matching decoder of a plurality of decoders is chosen using the information in the coded bitstream to decode each segment using a decoder suited for the classification or model of the segment on a generic decoder.

Claims

1. A computer-readable medium storing a computer program for controlling a computing device to decode a bitstream encoded via a plurality of encoders, the bitstream arranged in portions, and each portion having an associated model chosen from a plurality of predefined models, the instructions comprising:

identifying the portions within the bitstream; and

routing via an input switch the identified portions to one of a plurality of decoders based on a model associated with each identified portion, wherein each of the plurality of decoders can decode bitstream portions based on at least one of the plurality of predefined models.

2. The computer-readable medium of claim 1, wherein if content of a portion does not match a predetermined model, then the portion is assigned a generic model.

3. The computer-readable medium of claim 2, wherein each decoder of the plurality of decoders is optimized for one of the predetermined models.

4. The computer-readable medium of claim 3, wherein the plurality of decoders further comprises a generic decoder.

5. The computer-readable medium of claim 4, wherein the instructions further comprise routing the identified portions to one of a plurality of decoders based on a model associated with each identified portion further comprises routing the identified portions to the generic decoder if the identified portions relate to the generic model.

6. A computer-readable medium storing a computer program for controlling a computing device to decode a bitstream divided into portions, each portion being encoded by an encoder of a plurality of encoders, the encoder being chosen based on a model from a plurality of predefined models and the chosen model being associated with each portion, the instructions comprising:

receiving the bitstream at an input switch;

routing each bitstream portion from the input switch to a decoder of a plurality of decoders based on the portion model, wherein each of the plurality of decoders can decode bitstream portions based on at least one of the plurality of predefined models; and

decoding each bitstream portion.

7. The computer-readable medium of claim 6, wherein the instructions further comprise outputting each decoded bitstream portion.

8. The computer-readable medium of claim 7, wherein the instructions further comprise:

receiving an output from each of the plurality of decoders at an output switch; and

outputting a decoded bitstream from the output switch.

9. The computer-readable medium of claim 8, wherein the portion model is chosen from the group of models consisting of action, slow, opposing glances, scene detail, establishing shot, camera handling, animation mixture, and light changes.

10. The computer-readable medium of claim 9, wherein the portion model further comprises information associated with a source format, scene concepts, properties of the scene, camera operations and special effects.

11. A computer-readable medium storing a computer program for controlling a computing device to decode a bitstream divided into segments, each segment being encoded by one encoder of a plurality of encoders, the one encoder being chosen based on a profile of each segment and the plurality of encoders including a generic encoder, the instructions comprising:

receiving the bitstream at an input switch;

routing each bitstream segment from the input switch to one decoder of a plurality of decoders based on the segment profile, each decoder of the plurality of decoders being associated with one of a plurality of profiles and the plurality of decoders including a generic decoder;

routing the bitstream segment to the generic decoder if the bitstream segment does not have a profile; and

decoding each bitstream segment using one decoder of the plurality of decoders, wherein each segment having a profile is decoded via a decoder associated with that profile, and wherein a segment not having an associated profile is decoded using the generic decoder.

12. A computer-readable medium storing a computer program for controlling at least one computing device to encode and decode video content, the instructions associated with a plurality of encoders each associated with one of a plurality of content models and including a generic encoder associated with a generic content model, the instructions further using a plurality of decoders each associated with one of the plurality of content models and including a generic decoder associated with the generic content model, the instructions comprising:

extracting a portion from the video content;

mapping the portion to associate a model from the plurality of models;

if a model is mapped to the portion;

encoding the portion using an encoder associated with the portion model;

if a model is not mapped to the portion;

encoding the portion using the generic encoder;

transmitting the portion to a switch;

if a model is mapped to the portion;

routing the portion via the switch to a decoder associated with the portion model; and

if a model is not mapped to the portion;

routing the portion via the switch to the generic decoder.

13. The computer-readable medium of claim 12, wherein the instructions further comprise:

connecting an output from each decoder of the plurality of decoders to a second switch; and

receiving output from each decoder of the plurality of decoders to assemble a decoded segment for display.

14. A computer-readable medium storing a computer program for controlling a computing device to decode a bitstream, the bitstream divided into a plurality of portions including description portions and video content portions, each video content portion having an associated model which is either a generic model or a predetermined model from a plurality of models related to the video content, the instructions comprising:

determining whether each portion is a description portion or a video content portion;

if a portion is determined to be a description portion;

decoding the description portion using a first decoder; and

if a portion is determined to be a video content portion;

determining whether the associated model of the video content portion is the generic model or one of the predetermined models from the plurality of models; and

if the associated model is a generic model;

decoding the portion using a generic decoder; and

if the associated model is one of the predetermined models;

decoding the portion using a decoder chosen from a plurality of decoders, each decoder of the plurality of decoders being associated with one of the predetermined models from the plurality of models.

15. The computer-readable medium of claim 14, wherein the instructions further comprise:

using decoded descriptions from the description portions to determine whether the associated model of the video content portion is a general model or one of the predetermined models from the plurality of models.

16. The computer-readable medium of claim 15, wherein a portion of the bitstream is a segment.

17. The computer-readable medium of claim 15, wherein a portion of the bitstream is a subsegment.

18. The computer-readable medium of claim 15, wherein a portion of the bitstream is a region of interest.

19. A computer-readable medium storing a computer program for controlling a computing device to decode a bitstream, the bitstream being divided into a plurality of video content segments, each video content segment having an associated model which is either a generic model or a predetermined model from a plurality of models related to the video content, the computer program comprising:

determining whether the associated model of each video content segment is the generic model or one of the predetermined models from the plurality of models; and

if the associated model is a generic model;

decoding the segment using a generic decoder; and

if the associated model is one of the predetermined models;

decoding the segment using a decoder chosen from a plurality of decoders, each decoder of the plurality of decoders being associated with one of the predetermined models from the plurality of models.

20. The computer-readable medium of claim 19, wherein the predetermined models relate to concepts of a segment, properties of a segment, camera operation in a segment or special effects in a segment.