Adaptive Deblocking Complexity Control Apparatus and Method

• US 20090304085A1
• Filed: 06/04/2008
• Published: 12/10/2009
• Est. Priority Date: 06/04/2008
• Status: Abandoned Application

• Current Assignee: Novafora, Inc.
• Original Assignee: Novafora, Inc.
• Inventors: Avadhanam, Niranjan, Bronstein, Michael, Bronstein, Alexander
• Application Number:
  US12/133,183
• Publication Number:
  US 20090304085A1
• Time in Patent Office: Days
• US Class Current: 375/240.240
• CPC Class Codes: H04N 19/117 Filters, e.g. for pre-processing or post-processing sub-band filter banks H04N19/635
• CPC Class Codes: H04N 19/127 Prioritisation of hardware or computational resources
• CPC Class Codes: H04N 19/156 Availability of hardware or computational resources, e.g. encoding based on power-saving criteria
• CPC Class Codes: H04N 19/164 Feedback from the receiver or from the transmission channel
• CPC Class Codes: H04N 19/174 the region being a slice, e.g. a line of blocks or a group of blocks
• CPC Class Codes: H04N 19/436 using parallelised computational arrangements
• CPC Class Codes: H04N 19/44 Decoders specially adapted therefor, e.g. video decoders which are asymmetric with respect to the encoder
• CPC Class Codes: H04N 19/82 involving filtering within a prediction loop
• CPC Class Codes: H04N 19/86 involving reduction of coding artifacts, e.g. of blockiness

Abstract

An encoder to adaptively alter video deblocking complexity is disclosed in one embodiment of the invention as including a video encoding engine to generate a stream of encoded video data. The encoded video data is characterized by a level of blocking distortion generated during the encoding process. A deblocking filter is coupled to the video encoding engine and reduces the effects of blocking distortion on the encoded video data. The deblocking filter is characterized by a level of deblocking complexity which may depend on the strength and granularity of the deblocking filter applied to the encoded video data. A resource manager is coupled to the deblocking filter and is configured to adaptively alter the deblocking complexity in order to alter the overall computational complexity of the encoder.

Claims

1. A video encoding system inputting video data and producing encoded video data, the video encoding system comprising:

a video encoding engine generating encoded video data from input video data, the video encoding engine configurable by a first set of parameters;

a deblocking filter coupled to the video encoding engine to reduce the effects of blocking distortion on the encoded video data, the deblocking filter configurable by a second set of parameters; and

a resource manager coupled to the encoding engine and the deblocking filter to adaptively alter at least one of the first and second sets of parameters in order to produce optimally encoded video data.

2. The video encoding system of claim 1, wherein each of the first and second sets of parameters have associated therewith a set of resources utilized by the video encoding system.

3. The video encoding system of claim 2, wherein the set of resources includes at least one of computational resources, bitrate, power dissipation, data memory, and memory bandwidth.

4. The video encoding system of claim 1, wherein the resource manager is configured to adaptively alter the first and second sets of parameters separately.

5. The video encoding system of claim 1, wherein the resource manager is configured to adaptively alter the first and second sets of parameters together.

6. The video encoding system of claim 1, wherein the resource manager is configured to adaptively alter the first set of parameters only.

7. The video encoding system of claim 1, wherein the resource manager is configured to adaptively alter the second set of parameters only.

8. The video encoding system of claim 1, wherein the resource manager is configured to adaptively alter the first and second sets of parameters in order to alter the overall computational complexity of the video encoding system.

9. The video encoding system of claim 1, wherein the video encoding engine and deblocking filter are implemented using different computational units.

10. The video encoding system of claim 1, wherein the video encoding engine and deblocking filter are implemented using the same computational unit.

11. The video encoding system of claim 1, wherein the resource manager is configured to adaptively alter the first and second sets of parameters based on resource availability of the video encoding system.

12. The video encoding system of claim 1, wherein the resource manager is configured to adaptively alter the first and second sets of parameters based on resource availability of a decoder.

13. The video encoding system of claim 1, wherein the resource manager is configured to adaptively alter the first and second sets of parameters to maximize encoded video quality while utilizing an available resource budget.

14. The video encoding system of claim 12, wherein the resource manager is configured to receive feedback from the decoder with respect to the resource availability of the decoder.

15. The video encoding system of claim 14, wherein the feedback is periodic.

16. The video encoding system of claim 1, wherein the resource manager is configured to adaptively alter deblocking complexity by controlling deblocking on at least one of a frame level, a slice level, a macroblock level, and a block level.

17. A method for adaptively altering video deblocking complexity, the method comprising:

encoding a stream of video data to generate a stream of encoded video data characterized by a level of blocking distortion;

filtering the encoded video data to reduce the effects of blocking distortion on the encoded video data, the filtering being characterized by a level of deblocking complexity; and

adaptively altering the deblocking complexity in order to alter the overall computational complexity of the encoding and filtering.

18. The method of claim 17, wherein the encoding is characterized by a level of encoding complexity.

19. The method of claim 18, further comprising adaptively altering the encoding complexity in order to alter the overall computational complexity of the encoding and filtering.

20. The method of claim 17, wherein encoding and filtering comprises encoding using a first processor core and filtering using a second processor core.

21. The method of claim 17, wherein encoding and filtering comprises encoding and filtering using the same processor core.

22. The method of claim 17, wherein adaptively altering the deblocking complexity comprises altering the deblocking complexity based on resource availability associated with the encoding and filtering.

23. The method of claim 17, wherein adaptively altering the deblocking complexity comprises altering the deblocking complexity based on resource availability associated with decoding the encoded video data;

24. The method of claim 23, further comprising receiving periodic feedback with respect to the resource availability associated with the decoding.

25. The method of claim 17, wherein adaptively altering the deblocking complexity comprises adaptively alter the deblocking complexity on at least one of a frame level, a slice level, a macroblock level, and a block level.

26. An apparatus comprising:

a decoder configured to decode a stream of encoded video data to generate a stream of decoded video data, the encoded video data being characterized a level of deblocking complexity.

a deblocking filter associated with the decoder to reduce the effects of blocking distortion in the decoded video data;

a resource manager associated with the decoder and generating feedback with respect to the availability of resources in the decoder; and

the resource manager configured to transmit the feedback to an encoder to enable the encoder to alter the deblocking complexity to conform to the availability of resources in the decoder.

27. The apparatus of claim 26, wherein the resources include at least one of processing resources and memory bandwidth.

28. The apparatus of claim 26, wherein the feedback is periodic feedback.

29. The apparatus of claim 26, wherein the encoder is configured to alter the deblocking complexity on at least one of a frame level, a slice level, a macroblock level, and a block level.

30. A method comprising:

decoding a stream of encoded video data to generate a stream of decoded video data, the encoded video data being characterized a level of deblocking complexity.

filtering the decoded video data to reduce the effects of blocking distortion in the decoded video data;

generating feedback with respect to the availability of resources to the decoding process; and

sending the feedback to an encoder to enable the encoder to alter the deblocking complexity to conform to the availability of resources to the decoding process.

31. The method of claim 30, wherein the resources include at least one of processing resources and memory bandwidth.

32. The method of claim 30, wherein generating feedback comprises generating periodic feedback.

33. The method of claim 30, wherein altering the deblocking complexity comprises altering the deblocking complexity on at least one of a frame level, a slice level, a macroblock level, and a block level.