Method of performing fast bilateral filtering and using the same for the display of high-dynamic-range images

• US 7,146,059 B1
• Filed: 03/05/2003
• Issued: 12/05/2006
• Est. Priority Date: 03/05/2003
• Status: Active Grant

• Current Assignee: Massachusetts Institute of Technology
• Original Assignee: Massachusetts Institute of Technology
• Inventors: Durand, Frédéric, Dorsey, Julie
• Primary Examiner(s): COUSO, YON JUNG
• Application Number:
  US10/382,174
• Time in Patent Office: 1,371 Days
• Field of Search: 382260-264, 382/266, 382/274, 382/254, 358/447, 345/611, 345/617
• US Class Current: 382/260
• CPC Class Codes: G06T 2207/20028 Bilateral filtering
• CPC Class Codes: G06T 2207/20056 Discrete and fast Fourier transform, [DFT, FFT]
• CPC Class Codes: G06T 5/40 using histogram techniques
• CPC Class Codes: G06T 5/50 using two or more images, e.g. averaging or subtraction
• CPC Class Codes: G06T 5/90 Dynamic range modification of images or parts thereof

Abstract

A method of performing bilateral filtering and using the method for displaying high-dynamic-range images is presented. The method reduces the contrast of the image while preserving detail of the image. The presently disclosed method incorporates a two-scale decomposition of the image into a base layer encoding large-scale variations, and a detail layer. The base layer has its contrast reduced, thereby preserving detail. The base layer is obtained using an edge-preserving bilateral filter. The bilateral filter is a non-linear filter, where the weight of each pixel is computed using a Gaussian in the spatial domain multiplied by an influence function in the intensity domain that decreases the weight of pixels with large intensity differences. The bilateral filtering is accelerated by using a piecewise-linear approximation in the intensity domain and appropriate subsampling.

Claims

1. A method of performing piece-wise linear bilateral filtering comprising:

computing a weight of each of a plurality of pixels of an image using a Gaussian in a spatial domain; and

multiplying said weight by an influence function in the intensity domain wherein a weight of a pixel with a large intensity difference from weights of other pixels of said plurality of pixels is reduced.

2. The method of claim 1 wherein said computing and said multiplying are done in accordance with the formula:

3. The method of claim 2 where k(s) is determined in accordance with the formula:

4. The method of claim 1 wherein said multiplying comprises utilizing a piecewise-linear approximation in the intensity domain.

5. The method of claim 1 wherein said piecewise-linear approximation comprises discretizing a set of signal intensities into segment values and computing a linear filter for each said segment value.

6. The method of claim 5 wherein said computing includes utilizing a Fast Fourier Transform(FFT).

7. The method of claim 1 wherein said computing comprises down-sampling in the spatial domain.

8. The method of claim 7 wherein said down-sampling is done in accordance with the formula:

9. The method of claim 8 wherein

10. The method of claim 9 wherein said down-sampling comprises dividing said image in sub-images and when a difference between a maximum intensity and a minimum intensity is more reduced in said sub-image than said image then using fewer segments for said sub-images.

11. The method of claim 10 wherein said down-sampled version of said image is obtained using nearest-neighbor down-sampling.

12. The method of claim 11 wherein the output of the linear filters on said down-sampled image are linearly recombined at the full resolution.

13. The method of claim 1 further comprising detecting dubious pixels and fixing said dubious pixels.

14. The method of claim 13 wherein said fixing comprises:

providing a low-pass version of the output of the bilateral filter; and

assigning a value of a linear interpretation to the pixel depending on the log of the uncertainty normalization value.

15. A method for reducing contrast while preserving detail comprising:

selecting a high dynamic range digital image;

decomposing said image into an intensity layer and a color layer;

running said intensity layer through a bilateral filter to obtain a base layer;

dividing said intensity layer by said base layer to obtain a detail layer;

reducing contrast in said base layer; and

recombining said base layer having reduced contrast with said detail layer and said color layer to obtain a reduced contrast image.

16. The method of claim 15 wherein said running said intensity layer through a bilateral filter comprises:

computing a weight of each of a plurality of pixels of an image using a Gaussian in a spatial domain; and

multiplying said weight by an influence function in the intensity domain wherein a weight of a pixel with a large intensity difference from weights of other pixels of said plurality of pixels is reduced.

17. The method of claim 16 wherein said computing and said multiplying are done in accordance with the formula:

18. The method of claim 17 where k(s) is determined in accordance with the formula:

19. The method of claim 16 wherein said computing includes utilizing a Fast Fourier Transform (FFT).

20. The method of claim 16 wherein said multiplying comprises utilizing a piecewise-linear approximation in the intensity domain.

21. The method of claim 16 wherein said computing comprises sub-sampling in the spatial domain.

22. The method of claim 16 wherein said sub-sampling comprises discretizing a set of signal intensities into segment values and computing a linear filter for each said segment value.

23. The method of claim 21 wherein said sub-sampling is done in accordance with the formula:

24. The method of claim 23 wherein

25. The method of claim 24 wherein said sub-sampling comprises dividing said image in sub-images and when a difference between a maximum intensity and a minimum intensity is more reduced in said sub-image than said image then using fewer segments for said sub-images.

26. The method of claim 16 wherein said computing is done using a down-sampled version of said image.

27. The method of claim 26 wherein said down-sampled version of said image is obtained using nearest-neighbor down-sampling.

28. The method of claim 16 further comprising detecting dubious pixels and fixing said dubious pixels using a normalization factor.

29. The method of claim 28 wherein said fixing comprises:

providing a low-pass version of the output of the bilateral filter; and

assigning a value of a linear interpretation to the pixel depending on the log of the uncertainty normalization value.