Signalling of maximum dynamic range of inverse discrete cosine transform

• US 8,300,698 B2
• Filed: 10/02/2007
• Issued: 10/30/2012
• Est. Priority Date: 10/23/2006
• Status: Active Grant

• Current Assignee: Qualcomm, Inc.
• Original Assignee: Qualcomm, Inc.
• Inventors: Reznik, Yuriy
• Primary Examiner(s): MATTIS, JASON E
• Application Number:
  US11/865,915
• Publication Number:
  US 20080095245A1
• Time in Patent Office: 1,855 Days
• Field of Search: 375/240.2, 375/240.02, 375/240.05
• US Class Current: 375/240.2
• CPC Class Codes: G06F 17/147 Discrete orthonormal transforms, e.g. discrete cosine transform, discrete sine transform, and variations therefrom, e.g. modified discrete cosine transform, integer transforms approximating the discrete cosine transform G06F17/145 takes precedence
• CPC Class Codes: H04N 19/122 Selection of transform size, e.g. 8x8 or 2x4x8 DCT; Selection of sub-band transforms of varying structure or type
• CPC Class Codes: H04N 19/156 Availability of hardware or computational resources, e.g. encoding based on power-saving criteria
• CPC Class Codes: H04N 19/45 performing compensation of the inverse transform mismatch, e.g. Inverse Discrete Cosine Transform [IDCT] mismatch
• CPC Class Codes: H04N 19/46 Embedding additional information in the video signal during the compression process H04N19/517, H04N19/68, H04N19/70 take precedence
• CPC Class Codes: H04N 19/60 using transform coding

Abstract

Techniques are described to signal a maximum dynamic range of inverse discrete cosine transform (“IDCT”) output values that may be produced when a set of encoded media data is decoded. In accordance with these techniques, an encoding device may generate a media file that includes encoded media data associated with a set of one or more video frames. The media file may also include a range indication element that indicates the maximum dynamic range of IDCT output values produced when the encoded media data is decoded. A decoding device that receives the media file may, prior to decoding the encoded media data, use the range indication element to determine whether to decode the encoded media data. For instance, the decoding device may not decode the encoded media data when the decoding device is not capable of producing IDCT output values in the indicated range of IDCT output values.

Claims

1. A method comprising:

receiving, with a decoding module, a media object that includes encoded media data that represents a set of one or more video frames and a range indication element that indicates a maximum dynamic range of inverse discrete cosine transform (“

IDCT”

) output values associated with the encoded media data;

determining whether the maximum dynamic range of IDCT output values associated with the encoded media data includes an IDCT output value that is outside a given range;

using a first operation to generate a set of IDCT output values based on the encoded media data when the maximum dynamic range of IDCT output values associated with the encoded media data does not include an IDCT output value that is outside the given range;

using the set of IDCT output values to generate reconstructed video frames associated with video frames in the set of video frames;

causing a media presentation unit to present the reconstructed video frames; and

performing a second operation when the maximum dynamic range of IDCT output values associated with the encoded media data includes an IDCT output value that is outside the given range, the second operation being different than the first operation.

2. The method of claim 1, wherein performing the second operation comprises:

requesting an alternate media object when the maximum dynamic range of IDCT output values associated with the encoded media data includes an IDCT output value that is outside the given range; and

receiving the alternate media object,

wherein the alternate media object includes alternate encoded media data that represents the set of video frames,

wherein a maximum dynamic range of IDCT output values associated with the alternate encoded media data does not include an IDCT output value that is outside the given range.

3. The method of claim 1, wherein performing the second operation comprises generating the set of IDCT output values based on the encoded media data when the maximum dynamic range of IDCT output values associated with the encoded media data includes an IDCT output value that is outside the given range.

4. The method of claim 1,

wherein the method further comprises:

performing an entropy decoding operation on the encoded media data to generate a set of matrixes of quantized coefficients associated with the set of video frames; and

generating matrixes of inverse quantized coefficients associated with the set of video frames at least in part by inverse quantizing quantized coefficients in the set of matrixes of quantized coefficients; and

wherein using the first operation to generate the set of IDCT output values comprises generating the set of IDCT output values by applying an IDCT to the matrixes of inverse quantized coefficients.

5. The method of claim 1, wherein using the set of IDCT output values to generate reconstructed video frames comprises:

generating reconstructed residual pictures that include the IDCT output values;

generating predicted pictures associated with the set of video frames by performing a motion compensation operation using motion data associated with the set of video frames; and

generating reconstructed pictures using the reconstructed residual pictures and the predicted pictures.

6. A device comprising:

a communications interface that receives a media object that includes encoded media data that represents a set of one or more video frames and a range indication element that indicates a maximum dynamic range of inverse discrete cosine transform (“

IDCT”

) output values associated with the encoded media data;

a range checking module that determines whether the maximum dynamic range of IDCT output values associated with the encoded media data includes an IDCT output value that is outside a given range;

a first inverse transform module that uses a first operation to generate a set of IDCT output values based on the encoded media data when the maximum dynamic range of IDCT output values associated with the encoded media data does not include an IDCT output value that is outside the given range;

a picture reconstruction module that uses the set of IDCT output values to generate reconstructed video frames associated with video frames in the set of video frames; and

a presentation driver that causes a media presentation unit to present the reconstructed video frames,

wherein the range checking module performs a second operation when the maximum dynamic range of IDCT output values associated with the encoded media data includes an IDCT output value that is outside the given range, the second operation being different than the first operation.

7. The device of claim 6, further comprising:

a range negotiation module that requests an alternate media object when the maximum dynamic range of IDCT output values associated with the encoded media data includes an IDCT output value that is outside the given range; and

wherein the communications interface receives the alternate media object,

wherein the alternate media object includes alternate encoded media data that represents the set of video frames,

wherein a maximum dynamic range of IDCT output values associated with the alternate encoded media data does not include an IDCT output value that is outside the given range.

8. The device of claim 6, further comprising a second inverse transform module that uses the second operation to generate the set of IDCT output values based on the encoded media data when the maximum dynamic range of IDCT output values associated with the encoded media data includes an IDCT output value that is outside the given range.

9. The device of claim 6,

wherein the device further comprises:

an entropy decoding module that performs an entropy decoding operation on the encoded media data to generate a set of matrixes of quantized coefficients associated with the set of video frames; and

an inverse quantization module that generates a set of inverse quantized coefficients associated with the set of video frames at least in part by inverse quantizing quantized coefficients in the set of matrixes of quantized coefficients; and

wherein the first inverse transform module generates the set of IDCT output values by applying an IDCT to the set of matrixes of inverse quantized coefficients.

10. The device of claim 6,

wherein the device further comprises:

a residual reconstruction module that generates reconstructed residual pictures that include the IDCT output values; and

a motion compensation module that generates predicted pictures associated with the set of video frames by performing a motion compensation operation using motion data associated with the set of video frames; and

wherein the picture reconstruction module uses the reconstructed residual pictures and the predicted pictures to generate the reconstructed video frames.

11. The device of claim 6, wherein the communications interface is a wireless communication interface.

12. A method comprising:

receiving, from a decoding device, a message that indicates a maximum dynamic range of inverse discrete cosine transform (“

IDCT”

) output values;

generating, in response to receiving the message, a first set of encoded media data that represents a set of one or more video frames, wherein IDCT output values associated with the first set of encoded media data do not include an IDCT output value that is outside the indicated maximum dynamic range of IDCT output values; and

outputting the first set of encoded media data to the decoding device.

13. The method of claim 12, wherein the method further comprises:

generating a second set of encoded media data that represents the set of video frames;

calculating a maximum dynamic range of IDCT output values associated with the second set of encoded media data;

generating a media object that includes the second set of encoded media data and a range indication element that indicates the maximum dynamic range of IDCT output values associated with the second set of encoded media data; and

outputting the media object to the decoding device.

14. The method of claim 12, wherein generating the first set of encoded media data comprises:

generating residual pictures associated with video frames in the set of video frames;

generating matrixes of transformed coefficients associated with the set of video frames at least in part by performing a forward discrete cosine transform on pixel component values in the residual pictures;

generating matrixes of quantized coefficients associated with the set of video frames at least in part by quantizing transformed coefficients in the matrixes of transformed coefficients; and

performing an entropy encoding operation on the matrixes of quantized coefficients, thereby creating the first set of encoded media data.

15. The method of claim 12,

wherein the method further comprises receiving a request from the decoding device for a media object that includes the set of video frames;

and

wherein receiving the message comprises receiving the message in conjunction with the request.

16. A device comprising:

a communications interface that receives, from a decoding device, a message that indicates a maximum dynamic range of inverse discrete cosine transform (“

IDCT”

) output values;

an encoding module that generates, in response to receiving the message, a first set of encoded media data that represents a set of one or more video frames, wherein IDCT output values associated with the first set of encoded media data do not include an IDCT output value that is outside the indicated maximum dynamic range of IDCT output values; and

wherein the communications interface outputs the first set of encoded media data to the decoding device.

17. The device of claim 16,

wherein the encoding module generates a second set of encoded media data that represents the set of video frames;

wherein the encoding module comprises;

a range detection module that calculates a maximum dynamic range of IDCT output values associated with the second set of encoded media data;

an object generation module that generates a media object that includes the second set of encoded media data and a range indication element that indicates the maximum dynamic range of IDCT output values associated with the second set of encoded media data; and

wherein the communications interface outputs the media object to the decoding device.

18. The device of claim 17, wherein the message is received from the decoding device when the decoding device determines that the maximum dynamic range of IDCT output values associated with the second set of encoded media data includes a value that is outside the maximum dynamic range indicated in the message.

19. The device of claim 16, wherein the encoding module comprises:

a residual picture construction module that generates residual pictures associated with video frames in the set of video frames;

a forward transform module that generates matrixes of transformed coefficients associated with the set of video frames at least in part by performing a forward discrete cosine transform on pixel component values in the residual pictures;

a quantization module that generates matrixes of quantized coefficients associated with the set of video frames at least in part by quantizing coefficients in the matrixes of transformed coefficients; and

an entropy encoding module that performs an entropy encoding operation on the matrixes of quantized coefficients, thereby creating the first set of encoded media data.

20. The device of claim 16, wherein the communications interface receives a request from the decoding device for a media object that includes the set of video frames, wherein the communications interface receives the message in conjunction with the request.

21. A system comprising:

an encoding device; and

a decoding device;

wherein the decoding device comprises;

a first communications interface that receives from the encoding device a media object that includes a first set of encoded media data that represents a set of one or more video frames and a range indication element that indicates a maximum dynamic range of inverse discrete cosine transform (“

IDCT”

) output values associated with the first set of encoded media data;

a range checking module that determines whether the maximum dynamic range of IDCT output values associated with the first set of encoded media data includes an IDCT output value that is outside a given range;

a range negotiation module that causes the first communication interface to output to the encoding device a message that indicates the maximum dynamic range of IDCT output values when the maximum dynamic range of IDCT output values associated with the encoded media data includes an IDCT output value that is outside the given range;

a first inverse transform module that uses a first operation to generate a set of IDCT output values based on the first set of encoded media data when the maximum dynamic range of IDCT output values associated with the first set of encoded media data does not include an IDCT output value that is outside the given range;

a picture reconstruction module that uses the set of IDCT output values to generate reconstructed video frames associated with video frames in the set of video frames; and

a presentation driver that causes a media presentation unit to present the reconstructed video frames; and

wherein the encoding device comprises;

a second communications interface that receives, from the decoding device, the message that indicates the given range;

an encoding module that generates, in response to receiving the message, a second set of encoded media data that represents the set of one or more video frames, wherein IDCT output values associated with the second set of encoded media data do not include an IDCT output value that is outside the given range; and

wherein the second communications interface outputs the second set of encoded media data to the decoding device.

22. The system of claim 21, wherein the encoding module comprises:

a range detection module that calculates a maximum dynamic range of IDCT output values associated with the second set of encoded media data;

an object generation module that generates a second media object that includes the second set of encoded media data and a second range indication element that indicates the maximum dynamic range of IDCT output values associated with the second set of encoded media data; and

wherein the second communications interface outputs the media object to the decoding device.

23. The system of claim 21, wherein the encoding module further comprises:

a residual picture construction module that generates residual pictures associated with video frames in the set of video frames;

a forward transform module that generates matrixes of transformed coefficients associated with the set of video frames at least in part by performing a forward discrete cosine transform on pixel component values in the residual pictures;

a quantization module that generates matrixes of quantized coefficients associated with the set of video frames at least in part by quantizing coefficients in the matrixes of transformed coefficients; and

an entropy encoding module that performs an entropy encoding operation on the matrixes of quantized coefficients, thereby creating the second set of encoded media data.

24. The system of claim 21, wherein the decoding device further comprises:

an entropy decoding module that performs an entropy decoding operation on the first set of encoded media data to generate a set of matrixes of quantized coefficients associated with the set of video frames; and

an inverse quantization module that generates a set of inverse quantized coefficients associated with the set of video frames at least in part by inverse quantizing quantized coefficients in the set of matrixes of quantized coefficients; and

wherein the first inverse transform module generates the set of IDCT output values by applying an IDCT to the set of matrixes of inverse quantized coefficients.

25. The system of claim 21, wherein the decoding device further comprises a second inverse transform module that uses a second operation to generate the set of IDCT output values based on the first set of encoded media data when the maximum dynamic range of IDCT output values associated with the first set of encoded media data includes an IDCT output value that is outside the given range.