Artifact reduction in a digital video

• US 20060114358A1
• Filed: 12/01/2004
• Published: 06/01/2006
• Est. Priority Date: 12/01/2004
• Status: Active Grant

• Current Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Original Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Inventors: Silverstein, D. Amnon, Fan, Jian
• Granted Patent: US 7,643,088 B2
• Time in Patent Office: Days
• US Class Current: 348/616
• CPC Class Codes: G06T 2207/10016 Video; Image sequence
• CPC Class Codes: G06T 2207/10024 Color image
• CPC Class Codes: G06T 2207/20036 Morphological image processing
• CPC Class Codes: G06T 5/00 Image enhancement or restoration
• CPC Class Codes: G06T 5/50 using two or more images, e.g. averaging or subtraction
• CPC Class Codes: G06T 5/77 Retouching; Inpainting; Scratch removal
• CPC Class Codes: H04N 5/21 Circuitry for suppressing or minimising disturbance, e.g. moiré or halo
• CPC Class Codes: H04N 5/253 Picture signal generating by scanning motion picture films or slide opaques, e.g. for telecine scanning details therefor H04N3/36 ; standard conversion therefor H04N7/0112

Abstract

A method performed by a processing system is provided. The method comprises detecting a first pixel value associated with an artifact in a current frame of a digital video using a previous frame and a next frame and replacing the first pixel value in the first frame with a replacement value.

Claims

1. A method performed by a processing system, the method comprising:

detecting a first pixel value associated with an artifact in a current frame of a digital video using a previous frame and a next frame; and

replacing the first pixel value in the first frame with a replacement value.

2. The method of claim 1 further comprising:

detecting the first pixel value associated with the artifact in the current frame by comparing the first pixel value with a range of colors.

3. The method of claim 1 further comprising:

interpolating the replacement value using at least a second pixel value in the previous frame and a third pixel value in the next frame.

4. The method of claim 1 further comprising:

detecting the first pixel value associated with the artifact in the current frame by calculating a plurality of distances using the current frame, the previous frame, and the next frame.

5. The method of claim 1 further comprising:

detecting the first pixel value associated with the artifact in the current frame by comparing a second pixel value in the previous frame and a third pixel value in the next frame.

6. The method of claim 5 further comprising:

identifying a pixel associated with the first pixel value in a non-temporal mask in response to the second pixel value in the previous frame differing from the third pixel value in the next frame.

7. The method of claim 6 further comprising:

interpolating the replacement value using a plurality of values in the first frame in response to the second pixel value in the previous frame differing from the third pixel value in the next frame.

8. The method of claim 5 further comprising:

detecting the first pixel value associated with the artifact in the current frame by comparing a color of the first pixel value with colors of a plurality of pixel values in the current frame.

9. The method of claim 1 further comprising:

performing block matching between the current frame and a second region from the previous frame; and

replacing a first region that comprises the first pixel value with the second region from the previous frame, wherein the second region comprises the replacement value.

10. The method of claim 1 further comprising:

performing block matching between the current frame and a second region from the next frame; and

replacing a first region that comprises the first pixel value with the second region from the next frame, wherein the second region comprises the replacement value.

11. The method of claim 1 further comprising:

performing motion compensation on the previous frame with respect to the current frame prior to detecting the first pixel value associated with the artifact in the current frame.

12. The method of claim 1 further comprising:

performing motion compensation on the next frame with respect to the current frame prior to detecting the first pixel value associated with the artifact in the current frame.

13. A system comprising:

a processor; and

a memory system for storing a digital video and an artifact reduction module;

wherein the processor is configured to execute the artifact reduction module to;

detect a first pixel value associated with an artifact in a current frame of the digital video using a previous frame and a next frame; and

replace the first pixel value in the first frame with a replacement value.

14. The system of claim 13 wherein the processor is configured to execute the artifact reduction module to:

calculate a plurality of distances using the current frame, the previous frame, and the next frame; and

detect the first pixel value associated with the artifact in the current frame using the plurality of distances.

15. The system of claim 13 wherein the memory system comprises an artifact detection module, wherein the processor is configured to execute the artifact detection module to:

detect the first pixel value associated with the artifact in the current frame in response to determining that the first pixel value differs significantly a second pixel value in previous frame and a third pixel value in the next frame.

16. The system of claim 15 wherein the processor is configured to execute the artifact detection module to:

perform motion compensation on the previous frame with respect to the current frame to align a first pixel associated with the first pixel value with a second pixel associated with the second pixel value.

17. The system of claim 16 wherein the processor is configured to execute the artifact detection module to:

perform motion compensation on the next frame with respect to the current frame to align a first pixel associated with the first pixel value with a third pixel associated with the third pixel value.

18. The system of claim 15 wherein the memory system comprises an artifact removal module, wherein the processor is configured to execute the artifact removal module to:

calculate the replacement value from the second pixel value and the third pixel value.

19. The system of claim 13 wherein the processor is configured to execute the artifact reduction module to:

identify a pixel associated with the first pixel value in an artifact mask.

20. The system of claim 13 wherein the processor is configured to execute the artifact reduction module to:

identify a pixel associated with the first pixel value in a non-temporal mask in response to a second pixel value in the previous frame differing from a third pixel value in the next frame.

21. The system of claim 13 wherein the processor is configured to execute the artifact reduction module to:

interpolate the replacement value using a plurality of values in the first frame in response to a second pixel value in the previous frame differing from a third pixel value in the next frame.

22. The system of claim 13 wherein the processor is configured to execute the artifact reduction module to:

detect the first pixel value associated with the artifact in the current frame by comparing a color of the first pixel value with colors of a plurality of pixel values in the current frame in response to a second pixel value in the previous frame differing from a third pixel value in the next frame.

23. The system of claim 13 wherein the processor is configured to execute the artifact reduction module to:

perform block matching between the current frame and a second region from the previous frame; and

replace a first region that comprises the first pixel value with the second region from the previous frame, wherein the second region comprises the replacement value.

24. A system comprising:

means for detecting a first pixel value associated with an artifact in a current frame of a digital video using a previous frame and a next frame; and

means for replacing the first pixel value in the first frame with a replacement value.

25. The system of claim 24 further comprising:

means for performing motion compensation on the previous frame and the next frame with respect to the current frame.

26. A program product comprising a computer-readable medium including instructions executable by a processing system for:

detecting a first pixel value associated with an artifact in a current frame of a digital video using a previous frame and a next frame; and

replacing the first pixel value in the first frame with a replacement value.

27. The program product of claim 26 wherein the computer-readable medium includes instructions executable by the processing system for:

detecting the first pixel value associated with the artifact in the current frame by comparing the first pixel value with a range of colors.

28. The program product of claim 26 wherein the computer-readable medium includes instructions executable by the processing system for:

interpolating the replacement value using at least a second pixel value in the previous frame and a third pixel value in the next frame.

29. The program product of claim 26 wherein the computer-readable medium includes instructions executable by the processing system for:

calculating a plurality of distances using the current frame, the previous frame, and the next frame; and

detecting the first pixel value associated with the artifact in the current frame using the plurality of distances.

30. The program product of claim 26 wherein the computer-readable medium includes instructions executable by the processing system for:

identifying a pixel associated with the first pixel value in a non-temporal mask in response to a second pixel value in the previous frame differing from a third pixel value in the next frame.

31. The program product of claim 26 wherein the computer-readable medium includes instructions executable by the processing system for:

interpolating the replacement value using a plurality of values in the first frame in response to a second pixel value in the previous frame differing from a third pixel value in the next frame.

32. The program product of claim 26 wherein the computer-readable medium includes instructions executable by the processing system for:

detecting the first pixel value associated with the artifact in the current frame by comparing a color of the first pixel value with colors of a plurality of pixel values in the current frame.

33. The program product of claim 26 wherein the computer-readable medium includes instructions executable by the processing system for:

performing block matching between the current frame, the previous frame, and the next frame; and

replacing a first region that comprises the first pixel value with a second region from either the previous frame or the next frame, wherein the second region comprises the replacement value.

34. The program product of claim 26 wherein the computer-readable medium includes instructions executable by the processing system for:

performing motion compensation on the previous frame and the next frame with respect to the current frame prior to detecting the first pixel value associated with the artifact in the current frame.

35. A system comprising:

an artifact detection module configured to detect a first pixel value associated with an artifact in a current frame of a digital video using a previous frame and a next frame; and

an artifact removal module configured to replace the first pixel value in the first frame with a replacement value.