Color motion artifact detection and processing apparatus compatible with video coding standards

• US 7,023,918 B2
• Filed: 05/30/2002
• Issued: 04/04/2006
• Est. Priority Date: 05/30/2002
• Status: Active Grant

• Current Assignee: Pictos Technologies Inc. (f/k/a Imperium IP Holdings (Cayman), Ltd.) (Imperium (IP) Holdings Incorporated)
• Original Assignee: ESS Technology Incorporated (Semiconductor Holding Corp.)
• Inventors: Yu, Siu-Leong, Liu, Yi, Tzou, Kou-Hu
• Primary Examiner(s): VO, TUNG T
• Application Number:
  US10/159,805
• Publication Number:
  US 20030223500A1
• Time in Patent Office: 1,405 Days
• Field of Search: 375/240.27, 375/240.24, 375/240.12, 375/240.04, 375/240.16, 375/240.26, 375/240.03, 382/236
• US Class Current: 375/240.12
• CPC Class Codes: H04N 11/044 involving transform coding
• CPC Class Codes: H04N 19/186 the unit being a colour or a chrominance component
• CPC Class Codes: H04N 19/61 in combination with predictive coding
• CPC Class Codes: H04N 19/85 using pre-processing or post-processing specially adapted for video compression

Abstract

To detect color motion artifacts in a video frame, a motion-compensated color-distance value is compared against a threshold value. If the motion-compensated color-distance value is greater than or equal to the threshold value, color-motion artifacts are detected. The motion-compensated color-distance value is a sum of absolute values of the differences between corresponding pixel values of the video frame and a reference frame. To detect color motion artifacts in a video frame, in another embodiment, luminance and chrominance components of the intra-frame activity levels are compared against luminance and chrominance components of the inter-frame activity levels. If any of the components of the inter-frame activity levels is greater than the corresponding components of the intra-frame activity levels, color-motion artifacts are detected. To reduce color-motion artifacts, either a smaller quantization scale or intra-frame encoding is used to encode the data.

Claims

1. A method for detecting a color-motion artifact in a block of a video frame, the method comprising:

computing a motion-compensated color-difference value associated with the block;

determining an activity level associated with the block, wherein the activity level is indicative of a smoothness of transitions in pixel values disposed in the block;

selecting a threshold value based on the activity level and a target bit rate associated with the block; and

identifying the block as containing a color motion artifact if the motion-compensated color-distance value associated with the block is one of greater than and equal to the threshold value.

2. The method of claim 1 wherein the motion-compensated color-difference value is defined by a sum of squared differences of corresponding red, green and blue component values of similarly located pixels of the block and an associated block of a reference frame.

3. The method of claim 1 wherein the motion-compensated color-difference value is defined by a sum of absolute values of differences of corresponding luminance and chrominance component values of similarly located pixels of the block and an associated block of a reference frame.

4. The method of claim 3 wherein the motion-compensated color-difference value D is defined by $D\cong$

⁢

ay⁢

∑

i⁢

∑

j⁢



y⁡

(i,j)-y′

⁡

(i,j)

+⁢

au⁢

∑

i⁢

∑

j⁢



u⁡

(i,j)-u′

⁡

(i,j)

+av⁢

∑

i⁢

∑

j⁢



v⁡

(i,j)-v′

⁡

(i,j)

wherein y(i,j) represents a luminance component of a pixel disposed at coordinates (i,j) of the block and wherein u(i,j) and v(i,j) represent chrominance components of the pixel disposed at coordinates (i,j) of the block, wherein y′

(i,j) represents a luminance component of a pixel disposed at coordinates (i,j) of the associated block of the reference frame and wherein u(i,j) and v(i,j) represent chrominance components of the pixel disposed at coordinates (i,j) of the associated block of the reference frame, and wherein a_y, a_u and a_v are constants coefficients.

5. The method of claim 1 wherein the threshold value is further inversely proportional to the target bit rate associated with the block.

6. The method of claim 1 wherein the block includes one of 16×

16 and 8×

8 pixels.

7. The method of claim 1 wherein the block includes the entire video frame.

8. The method of claim 1 further comprising:

reducing the color-motion artifact by selecting a smaller quantization scale.

9. An apparatus adapted to detect a color-motion artifact in a block of a video frame, the apparatus comprising:

a first module for computing a motion-compensated color-difference value associated with the block;

a second module for determining an activity level associated with the block, wherein the activity level is indicative of a smoothness of transitions in pixel values disposed in the block;

a third module for selecting a threshold value based on the activity level and a target bit rate associated with the block; and

a fourth module for identifying the block as containing a color motion artifact if the motion-compensated color-distance value computed for the block is one of greater than and equal to a the threshold value.

10. The apparatus of claim 9 wherein the motion-compensated color-difference value is defined by a sum of squared differences of corresponding red, green and blue component values of similarly located pixels of the block and an associated block of a reference frame.

11. The apparatus of claim 9 wherein the motion-compensated color-difference value is defined by a sum of absolute values of differences of corresponding luminance and chrominance component values of similarly located pixels of the block and an associated block of a reference frame.

12. The apparatus of claim 11 wherein the motion-compensated color-difference value D is defined by $D\cong$

ay⁢

∑

i⁢

⁢

∑

j⁢

⁢



y⁡

(i,j)-y'"'"'⁡

(i,j)

+au⁢

∑

i⁢

⁢

∑

j⁢

⁢



u⁡

(i,j)-u'"'"'⁡

(i,j)

+av⁢

∑

i⁢

⁢

∑

j⁢

⁢



v⁡

(i,j)-v'"'"'⁡

(i,j)

wherein y(i,j) represents a luminance component of a pixel disposed at coordinates (i,j) of the block and wherein u(i,j) and v(i,j) represent chrominance components of the pixel disposed at coordinates (i,j) of the block, wherein y′

(i,j) represents a luminance component of a pixel disposed at coordinates (i,j) of the associated block of the reference frame and wherein u(i,j) and v(i,j) represent chrominance components of the pixel disposed at coordinates (i,j) of the associated block of the reference frame, and wherein a_y, a_u and a_v are constants coefficients.

13. The apparatus of claim 9 wherein the threshold value is further inversely proportional to the target bit rate associated with the block.

14. The apparatus of claim 9 wherein the block includes one of 16×

16 and 8×

8 pixels.

15. The apparatus of claim 9 wherein the block includes the entire video frame.

16. The apparatus of claim 9 wherein each of the first, second, third and fourth modules is a software module.

17. The apparatus of claim 9 wherein each of the first, second, third and fourth modules is a hardware module.

18. The apparatus of claim 9 wherein each of the first, second, third and fourth modules further includes software and hardware modules.

19. The apparatus of claim 9 wherein the color-motion artifact is reduced by selecting a smaller quantization scale.

20. A method for detecting a color-motion artifact in a block of a video frame, the method comprising:

computing a motion-compensated color-difference value associated with the block;

selecting a threshold value based on a target bit rate associated with the block, wherein the threshold value is inversely proportional to the target bit rate; and

identifying the block as containing a color motion artifact if the motion-compensated color-distance value associated with the block is one of greater than and equal to the threshold value.

21. A method for detecting a color-motion artifact in a block of a video frame, the method comprising:

computing a motion-compensated color-difference value associated with the block; and

identifying the block as containing a color motion artifact if the motion-compensated color-distance value associated with the block is one of greater than and equal to the threshold value;

wherein the motion-compensated color-difference value is defined by a luminance coefficient multiplied by a sum of absolute values of differences of corresponding luminance component values of similarly located pixels of the block and an associated block of a reference frame, and a chrominance coefficient multiplied by a sum of absolute values of differences of corresponding chrominance component values of similarly located pixels of the block and the associated block of the reference frame.