Post-filtering for decoded video signals

• US 5,590,064 A
• Filed: 10/26/1994
• Issued: 12/31/1996
• Est. Priority Date: 10/26/1994
• Status: Expired due to Term

• Current Assignee: Intel Corporation
• Original Assignee: Intel Corporation
• Inventors: Astle, Brian
• Primary Examiner(s): Envall, Jr., Roy N.
• Assistant Examiner(s): MOISE, EMMANUEL LIONEL
• Application Number:
  US08/329,548
• Time in Patent Office: 797 Days
• Field of Search: 364/715.02, 348/398, 348/402, 348/403, 348/411, 348/412, 348/413, 348/416, 348/420, 348/699, 382/233, 382/268, 382/275, 382/277-284
• US Class Current: 708/203
• CPC Class Codes: H04N 11/044 involving transform coding
• CPC Class Codes: H04N 19/117 Filters, e.g. for pre-processing or post-processing sub-band filter banks H04N19/635
• CPC Class Codes: H04N 19/134 characterised by the element, parameter or criterion affecting or controlling the adaptive coding
• CPC Class Codes: H04N 19/18 the unit being a set of transform coefficients
• CPC Class Codes: H04N 19/192 the adaptation method, adaptation tool or adaptation type being iterative or recursive
• CPC Class Codes: H04N 19/86 involving reduction of coding artifacts, e.g. of blockiness
• CPC Class Codes: H04N 5/144 Movement detection for video coding H04N19/503; analysis of motion in general G06T7/20
• CPC Class Codes: H04N 7/15 Conference systems

Abstract

Encoded video signals comprise sets of transform coefficients (e.g., DCT coefficients) corresponding to different regions of a video frame. An inverse transform is applied to sets of transform coefficients to generate decoded regions of a decoded video frame. The discontinuities for boundaries between adjacent regions are used to adjust one or more of the transform coefficients. The adjusted sets of transform coefficients are then used to generate filtered regions of a filtered video frame corresponding to the decoded video frame. In a preferred embodiment, the transform coefficients are DCT coefficients and the DC and first two AC DCT coefficients are sequentially adjusted to correct for quantization errors in the encoding process.

Claims

1. A computer-implemented process for transforming encoded video signals into decoded video frames, comprising the steps of:

(a) providing encoded video signals corresponding to a video frame, wherein the encoded video signals comprise a first set of transform coefficients corresponding to a first region of the video frame and a second set of transform coefficients corresponding to a second region of the video frame;

(b) applying an inverse transform to the first set of transform coefficients to generate a decoded first region of a decoded video frame;

(c) applying the inverse transform to the second set of transform coefficients to generate a decoded second region of the decoded video frame;

(d) generating an original discontinuity measure for a boundary between the decoded first region and the decoded second region;

(e) adjusting at least one transform coefficient of the second set of transform coefficients in accordance with the original discontinuity measure to generate an adjusted second set of transform coefficients for the second region; and

(f) generating a filtered second region of a filtered video frame in accordance with the adjusted second set of transform coefficients.

2. The process of claim 1, wherein step (f) comprises the step of applying the inverse transform to the adjusted second set of transform coefficients to generate the filtered second region.

3. The process of claim 1, wherein step (f) comprises the steps of:

(1) applying the inverse transform to the adjusted second set of transform coefficients to generate an adjusted decoded second region;

(2) generating an adjusted discontinuity measure for a boundary between the decoded first region and the adjusted decoded second region; and

(3) generating the filtered second region in accordance with the adjusted discontinuity measure.

4. The process of claim 3, wherein step (f)(3) comprises the step of filtering the decoded first region and the adjusted decoded second region to generate the filtered second region.

5. The process of claim 4, wherein step (f)(3) comprises the step of applying a low-pass filter to pixels across the boundary between the decoded first region and the adjusted decoded second region to generate the filtered second region.

6. The process of claim 3, wherein step (f)(3) comprises the step of retaining the adjusted second region as the filtered second region.

7. The process of claim 6, wherein:

the transform coefficients are DCT coefficients;

the original discontinuity measure is a sum of squares of differences between pixels across the boundary between the decoded first region and the decoded second region;

step (e) comprises the step of adjusting a DC DCT coefficient of the second set of DCT coefficients in accordance with the original discontinuity measure and in accordance with a quantization step corresponding to the DC DCT coefficient to generate an adjusted second set of DCT coefficients for the second region; and

steps (e) and (f) are repeated one or more times for one or more AC DCT coefficients.

8. The process of claim 1, wherein the transform coefficients are DCT coefficients.

9. The process of claim 8, wherein step (e) comprises the step of adjusting a DC DCT coefficient of the second set of DCT coefficients in accordance with the original discontinuity measure to generate an adjusted second set of DCT coefficients for the second region.

10. The process of claim 9, wherein steps (e) and (f) are repeated one or more times for one or more AC DCT coefficients.

11. The process of claim 1, wherein the original discontinuity measure is a function of pixel values of the decoded first region and the decoded second region.

12. The process of claim 11, wherein the original discontinuity measure is the sum of squares of differences between pixels across the boundary between the decoded first region and the decoded second region.

13. The process of claim 1, wherein:

step (e) comprises the further step of adjusting at least one transform coefficient of the first set of transform coefficients in accordance with the original discontinuity measure to generate an adjusted first set of transform coefficients for the first region; and

step (f) comprises the further step of generating a filtered first region of the filtered video frame in accordance with the adjusted first set of transform coefficients.

14. The process of claim 1, wherein step (e) comprises the step of adjusting the transform coefficient of the second set of transform coefficients in accordance with a quantization step corresponding to the transform coefficient.

15. An apparatus for transforming encoded video signals into decoded video frames, comprising:

(a) means for providing encoded video signals corresponding to a video frame, wherein the encoded video signals comprise a first set of transform coefficients corresponding to a first region of the video frame and a second set of transform coefficients corresponding to a second region of the video frame;

(b) means for applying an inverse transform to the first set of transform coefficients to generate a decoded first region of a decoded video frame;

(c) means for applying the inverse transform to the second set of transform coefficients to generate a decoded second region of the decoded video frame;

(d) means for generating an original discontinuity measure for a boundary between the decoded first region and the decoded second region;

(e) means for adjusting at least one transform coefficient of the second set of transform coefficients in accordance with the original discontinuity measure to generate an adjusted second set of transform coefficients for the second region; and

(f) means for generating a filtered second region of a filtered video frame in accordance with the adjusted second set of transform coefficients.

16. The apparatus of claim 15, wherein means (f) applies the inverse transform to the adjusted second set of transform coefficients to generate the filtered second region.

17. The apparatus of claim 15, wherein means (f):

(1) applies the inverse transform to the adjusted second set of transform coefficients to generate an adjusted decoded second region;

(2) generates an adjusted discontinuity measure for a boundary between the decoded first region and the adjusted decoded second region; and

(3) generates the filtered second region in accordance with the adjusted discontinuity measure.

18. The apparatus of claim 17, wherein means (f) filters the decoded first region and the adjusted decoded second region to generate the filtered second region.

19. The apparatus of claim 18, wherein means (f) applies a low-pass filter to pixels across the boundary between the decoded first region and the adjusted decoded second region to generate the filtered second region.

20. The apparatus of claim 17, wherein means (f) retains the adjusted second region as the filtered second region.

21. The apparatus of claim 20, wherein:

the transform coefficients are DCT coefficients;

the original discontinuity measure is a sum of squares of differences between pixels across the boundary between the decoded first region and the decoded second region;

means (e) adjusts a DC DCT coefficient of the second set of DCT coefficients in accordance with the original discontinuity measure and in accordance with a quantization step corresponding to the DC DCT coefficient to generate an adjusted second set of DCT coefficients for the second region; and

the processing of means (e) and (f) is repeated one or more times for one or more AC DCT coefficients.

22. The apparatus of claim 21, wherein the apparatus is a microprocessor and the microprocessor is electrically connected to a memory device via a data bus.

23. The apparatus of claim 15, wherein the transform coefficients are DCT coefficients.

24. The apparatus of claim 23, wherein means (e) adjusts a DC DCT coefficient of the second set of DCT coefficients in accordance with the original discontinuity measure to generate an adjusted second set of DCT coefficients for the second region.

25. The apparatus of claim 24, wherein the processing of means (e) and (f) is repeated one or more times for one or more AC DCT coefficients.

26. The apparatus of claim 15, wherein the original discontinuity measure is a function of pixel values of the decoded first region and the decoded second region.

27. The apparatus of claim 26, wherein the original discontinuity measure is a sum of squares of differences between pixels across the boundary between the decoded first region and the decoded second region.

28. The apparatus of claim 15, wherein:

means (e) adjusts at least one transform coefficient of the first set of transform coefficients in accordance with the original discontinuity measure to generate an adjusted first set of transform coefficients for the first region; and

means (f) generates a filtered first region of the filtered video frame in accordance with the adjusted first set of transform coefficients.

29. The apparatus of claim 15, wherein means (e) adjusts the transform coefficient of the second set of transform coefficients in accordance with a quantization step corresponding to the transform coefficient.

30. The apparatus of claim 15, wherein the apparatus is a microprocessor and the microprocessor is electrically connected to a memory device via a data bus.