Video processing system and method with recursive and non-recursive filtering in separate high frequency bands

• US 7,969,510 B2
• Filed: 07/14/2003
• Issued: 06/28/2011
• Est. Priority Date: 07/12/2002
• Status: Expired due to Fees

• Current Assignee: Snell Limited (Belden Inc.)
• Original Assignee: Snell Limited (Belden Inc.)
• Inventors: Steinberg, Avigdor, Weston, Martin
• Primary Examiner(s): KOSTAK, VICTOR R
• Application Number:
  US10/520,945
• Publication Number:
  US 20060109383A1
• Time in Patent Office: 2,906 Days
• Field of Search: 348/241, 348/252, 348/606, 348/607, 348618-620, 348/625, 348/701, 345/611, 382260-266, 382/274, 382/275
• US Class Current: 348/606
• CPC Class Codes: H04N 19/117 Filters, e.g. for pre-processing or post-processing sub-band filter banks H04N19/635
• CPC Class Codes: H04N 19/1883 the unit relating to sub-band structure, e.g. hierarchical level, directional tree, e.g. low-high [LH], high-low [HL], high-high [HH]
• CPC Class Codes: H04N 19/63 using sub-band based transform, e.g. wavelets

Abstract

A video noise reducer divides a signal into spatial frequency bands and derives both recursively and non-recursively filtered signals for each band. Both signals are processed non-linearly. These signals are combined in ways that vary between the bands to provide a noise signal and a detail signal. A clean video signal with all noise removed is used in the recursive loop. The output signal includes detail enhancement and may have a subjectively pleasant amount of noise added back.

Claims

1. A process for processing a video signal in which spatially co-sited information from different temporal samples is recursively combined, comprising decomposing the video signal into a low frequency band and at least two high frequency bands, and carrying out both recursive non-linear processing and non-recursive non-linear processing in each high frequency band, wherein the input video signal, a recursive signal and a non-recursive signal are combined to derive separate noise reduced and noise corrected signals;

the noise reduced signal being utilised in said recursion and said noise corrected signal being output.

2. A process according to claim 1, wherein there is variation between high frequency bands of the relative contributions of the recursive signal, the non-recursive signal and input video signal in the noise reduced signal and wherein there is variation between high frequency bands of the relative contributions of the recursive signal, the non-recursive signal and input video signal in the noise corrected signal.

3. A process according to claim 1, comprising the further step of deriving a detail corrected signal and outputting a noise and detail corrected signal.

4. A process according to claim 3, wherein there is variation between high frequency bands of the contribution of the detail corrected signal to the noise and detail corrected signal that is output.

5. A video process in which spatially co-sited information from different temporal samples is recursively combined, comprising varying the combination in dependence upon spatial frequency, there being at least three spatial frequency bands, with different combination in each of the three bands and in which recursive and non-recursive filtering is combined, and in which one or more non-recursively separated detail components is combined with the video signal.

6. A process according to claim 5 in which one or more noise components are removed from one or more non-recursively separated detail components and the resulting noise-reduced detail is combined with the video signal.

7. A video process in which spatially co-sited information from different temporal samples is recursively combined, comprising varying the combination in dependence upon spatial frequency, there being at least three spatial frequency bands, with different combination in each of the three bands, and in which one or more detail components are separated from a video signal and combined with a noise reduced video signal.

8. A video process in which spatially co-sited information from different temporal samples is recursively combined, comprising varying the combination in dependence upon spatial frequency, there being at least three spatial frequency bands, with different combination in each of the three bands, and wherein recursively and non-recursively filtered signals are input to non-linear filters for removing specific components of the signals.

9. A process according to claim 8, wherein it is the noise component of a given signal which is filtered.

10. A video process in which spatially co-sited information from different temporal samples is recursively combined, comprising varying the combination in dependence upon spatial frequency, there being at least three spatial frequency bands, with different combination in each of the three bands and in which recursive and non-recursive filtering is combined, and wherein recursively and non-recursively filtered signals are input to band-splitting filters, and sub-bands of the recursively and non-recursively filtered signals are combined.

11. A process according to claim 10, wherein sub-bands of corresponding frequency from the respective recursively and non-recursively filtered signals are combined.

12. A process according to claim 10, wherein the set of sub-bands of the recursively and non-recursively filtered signals are both input to a single array of non-linear filters, the output of which being a signal multiplexed between the filtered recursive signal, and the filtered non-recursive signal.

13. Video processing apparatus comprising a filter structure serving to divide an input video signal into at least two high frequency bands;

at least one recursive loop providing for the recursive combination in each band of spatially co-sited information from different temporal samples;

a non-linear processor operating on a non-recursive signal in each band and a combiner serving to generate through parameterised combination of input video signal, recursively combined video signal and non-linearly processed signal, both a noise reduced signal for the or each recursive loop and a noise corrected signal for output.

14. Apparatus according to claim 13, wherein the parameters of said combination vary as between the spatial frequency bands.

15. Apparatus according to claim 13, wherein the combiner serves to generate a detail correction signal and a noise signal, the noise reduced signal being formed by subtraction of the noise signal from the input signal and the noise corrected signal being formed by weighted linear combination of the detail correction signal, the noise signal and the input signal.

16. Apparatus according to claim 15, wherein the weighting coefficients applied respectively to the detail correction signal, the noise signal and the input signal vary as between the bands.

17. Apparatus according to claim 13, wherein the characteristic of said non-linear processor varies between the bands.

18. Apparatus according to claim 13, wherein the recursive combination varies as between bands.

19. Apparatus according to claim 13, wherein the non-linear processor serves to pass differentially low amplitude signals expected to contain noise.

20. Apparatus according to claim 13, wherein the recursive loop is motion adapted.

21. Apparatus according to claim 13, wherein the recursive loop is motion compensated.

22. A video process comprising the steps of dividing an input video signal into at least two high frequency bands;

deriving for each band a recursively filtered signal and a non-recursively filtered signal;

combining the input video signal, the recursively filtered signal and the non-recursively filtered signal to derive separate noise reduced and noise corrected signals;

utilizing the noise reduced signal in said recursive filtering and outputting said noise corrected signal.

23. A process according to claim 22, wherein there is variation between frequency bands of at least one of:

the recursion constant, the characteristic of the non-recursive filtering input video signal, the relative contributions of the recursively filtered signal, the non-recursively filtered signal and input video signal in the noise reduced signal and the relative contributions of the recursively filtered signal, the non-recursively filtered signal and input video signal in the noise corrected signal.

24. A process according to claim 22, comprising the further step of deriving a detail corrected signal and outputting a noise and detail corrected signal.

25. A process according to claim 24 wherein there is variation between frequency bands of the contribution of the detail corrected signal to the noise and detail corrected signal that is output.