Complexity-based rate control using adaptive prefilter

• US 20080198932A1
• Filed: 02/21/2007
• Published: 08/21/2008
• Est. Priority Date: 02/21/2007
• Status: Abandoned Application

• Current Assignee: MediaTek Singapore Pte. Ltd. (MediaTek, Inc.)
• Original Assignee: NuCORE Technology, Inc. (MediaTek, Inc.)
• Inventors: Sei, Kyojiro
• Application Number:
  US11/709,645
• Publication Number:
  US 20080198932A1
• Time in Patent Office: Days
• US Class Current: 375/240.16
• CPC Class Codes: H04N 19/117 Filters, e.g. for pre-processing or post-processing sub-band filter banks H04N19/635
• CPC Class Codes: H04N 19/124 Quantisation
• CPC Class Codes: H04N 19/139 Analysis of motion vectors, e.g. their magnitude, direction, variance or reliability
• CPC Class Codes: H04N 19/146 Data rate or code amount at the encoder output
• CPC Class Codes: H04N 19/172 the region being a picture, frame or field
• CPC Class Codes: H04N 19/176 the region being a block, e.g. a macroblock
• CPC Class Codes: H04N 19/42 characterised by implementation details or hardware specially adapted for video compression or decompression, e.g. dedicated software implementation H04N19/635 takes precedence
• CPC Class Codes: H04N 19/436 using parallelised computational arrangements
• CPC Class Codes: H04N 19/61 in combination with predictive coding
• CPC Class Codes: H04N 19/80 Details of filtering operations specially adapted for video compression, e.g. for pixel interpolation H04N19/635, H04N19/86 take precedence
• CPC Class Codes: H04N 19/85 using pre-processing or post-processing specially adapted for video compression
• CPC Class Codes: H04N 19/86 involving reduction of coding artifacts, e.g. of blockiness

Abstract

In an image capture device, a filter in a processing stage prior to an MPEG encoder applies unsharp masking and spatial filtering. MPEG encoder hardware that is used to determine SAD values also determines a complexity value. The complexity value indicates a complexity of a macroblock or a frame. The processor uses the complexity value to determine an appropriate transfer function of the spatial filter. The spatial filter smoothes information supplied to the MPEG encoder such that the MPEG encoder can apply less severe quantization, thereby reducing apparent block noise when the resulting MPEG video is later decoded and viewed on a display device.

Claims

1. An apparatus, comprising:

a video encoder that indicates at least one characteristic of a first portion of video during encoding of the first portion;

a processor that determines a filter control value based in part on the at least one characteristic; and

a pre-processing block that receives a second portion of video and applies filtering to the second portion prior to providing the second portion to the video encoder, wherein a transfer function of the filtering is based in part on the filter control value.

2. The apparatus of claim 1, wherein the video encoder applies encoding selected from a group consisting of:

MPEG-1, MPEG-2, and MPEG-4.

3. The apparatus of claim 1, wherein the at least one characteristic is selected from a group consisting of:

a frame complexity, macroblock complexity, motion vector for at least one macroblock, and a quantization value for a frame.

4. The apparatus of claim 1, wherein the first portion of video is taken from a group consisting of:

at least one macroblock and a first frame.

5. The apparatus of claim 4, wherein the second portion of video is taken from a group consisting of:

another at least one macroblock and a second frame.

6. The apparatus of claim 1, wherein the filtering comprises spatial filtering.

7. The apparatus of claim 1, wherein the filtering comprises using a digital filter used also for unsharp masking.

8. The apparatus of claim 1, wherein the filtering comprises applying a three-dimensional transfer function, wherein the pre-processing block adjusts a shape of the transfer function based in part on the filter control value.

9. The apparatus of claim 1, wherein the filtering applies a three-dimensional transfer function that is bell-shaped so that attenuation increases as horizontal or vertical spatial frequencies increase.

10. The apparatus of claim 1, wherein the filtering applies filtering along a first axis followed by filtering along second axis, wherein the first axis is selected from among a group consisting of horizontal spatial frequency and vertical spatial frequency.

11. The apparatus of claim 1, wherein the at least one characteristic is frame complexity, and wherein the frame complexity is based at least on complexities of a plurality of macroblocks in a frame.

12. The apparatus of claim 1, wherein the at least one characteristic is macroblock complexity, wherein the video encoder comprises a motion estimator that determines the macroblock complexity of the first portion of video during encoding of the first portion of video, wherein the motion estimator determines a motion vector of a macroblock of the first portion of video, and wherein the motion estimator provides the macroblock complexity and motion vector to the processor.

13. The apparatus of claim 1, wherein the video encoder further comprises a video encoder module that determines a bit count for a current macroblock, wherein the video encoder module provides the bit count to the processor and receives a bit budget for the current macroblock from the processor.

14. The apparatus of claim 1, wherein the video encoder comprises:

a motion estimator that determines a complexity of the first portion of video during encoding of the first portion of video, wherein the motion estimator determines a motion vector of a macroblock of the first portion of video, and wherein the motion estimator provides the complexity and the motion vector to the processor; and

a video encoder module that determines a bit count for a current macroblock, wherein the video encoder module provides the bit count to the processor and receives a bit budget for the current macroblock from the processor.

15. The apparatus of claim 1, wherein the pre-processing block applies to the second portion of video processing selected from a group consisting of:

unsharp masking, Bayer to RGB conversion, white balance, color correction, gamma correction, and RGB to YUV color space conversion.

16. The apparatus of claim 1, wherein the filter control value is at least one digital filter coefficient.

17. A method, comprising:

(a) determining at least one characteristic of video during encoding of the video; and

(b) controlling filtering of the video prior to video encoding based on the at least one characteristic of video.

18. The method of claim 17, wherein the at least one characteristic is selected from a group consisting of:

a frame complexity, macroblock complexity, motion vector for at least one macroblock, and a quantization value for a frame.

19. The method of claim 17, wherein (a) is performed by a video encoder and the at least one characteristic of video is output by the video encoder, and wherein the encoding is selected from a group consisting of:

MPEG-1, MPEG-2, and MPEG-4.

20. The method of claim 17, wherein controlling filtering comprises controlling a three-dimensional shape of a transfer function applied in the filtering.

21. The method of claim 17, wherein controlling filtering comprises controlling a three-dimensional shape of a transfer function applied in the filtering, wherein the transfer function is bell-shaped, and wherein gain of the bell-shaped transfer function decreases as horizontal or vertical spatial frequencies increase.

22. The method of claim 17, wherein controlling filtering comprises controlling filtering based in part on a frame quantization value.

23. The method of claim 17, wherein the filtering comprises filtering along a first axis followed by filtering along second axis, wherein the first axis is selected from among a group consisting of horizontal spatial frequency and vertical spatial frequency.

24. A image capture device, comprising:

an MPEG encoder that applies MPEG encoding to video; and

means for filtering video, wherein the means provides video to the MPEG encoder, wherein the means adjusts the filtering based on at least one characteristic of video provided by the MPEG encoder.

25. The image capture device of claim 24, wherein the MPEG encoding is selected from the group consisting of:

MPEG-1, MPEG-2, and MPEG-4.

26. The image capture device of claim 24, wherein the means for filtering has a transfer function that is a three-dimensional shape, wherein the transfer function is bell-shaped, and wherein gain of the bell-shaped transfer function decreases as horizontal or vertical spatial frequencies increase.

27. The image capture device of claim 24, wherein the means for filtering comprises a digital filter used also for unsharp masking.

28. The image capture device of claim 24, wherein the MPEG encoder provides an indication of macroblock complexity of video to the means.

29. The image capture device of claim 24, wherein the means comprises:

a spatial filter that filters the video; and

a processor that controls properties of a transfer function of the spatial filter based in part on a characteristic selected from a group consisting of;

a frame complexity, macroblock complexity, motion vector for at least one macroblock, and a quantization value for a frame.