System and method for compressing the dynamic range of an image

• US 20050254722A1
• Filed: 01/15/2003
• Published: 11/17/2005
• Est. Priority Date: 01/15/2002
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Yissum Research Development Company of the Hebrew University of Jerusalem Ltd. (Hebrew University of Jerusalem)
• Inventors: Fattal, Raanan, Lischinski, Dani, Werman, Michael
• Granted Patent: US 7,305,144 B2
• Time in Patent Office: Days
• US Class Current: 382/274
• CPC Class Codes: G06T 5/40 using histogram techniques
• CPC Class Codes: G06T 5/50 using two or more images, e.g. averaging or subtraction
• CPC Class Codes: G06T 5/92 based on global image properties
• CPC Class Codes: H04N 1/4072 dependent on the contents of the original
• CPC Class Codes: H04N 19/117 Filters, e.g. for pre-processing or post-processing sub-band filter banks H04N19/635
• CPC Class Codes: H04N 19/14 Coding unit complexity, e.g. amount of activity or edge presence estimation H04N19/146 takes precedence
• CPC Class Codes: H04N 19/172 the region being a picture, frame or field
• CPC Class Codes: H04N 19/33 in the spatial domain

Abstract

A gradient domain compression system generates, from an input image having a high luminance dynamic range, an output image having a lower luminance dynamic range. The system comprises a gradient image generator module, a gradient compression module, and an output image generator module. The gradient image generator module is configured to generate, from the input image, a gradient image representing, for respective points of the input image, gradient values in the luminance of the input image. The gradient compression module is configured to receive the gradient image and generate a compressed range gradient image in which the range of gradient values are compressed. The output image generator module is configured to receive the compressed range gradient image and to generate therefrom an image, the image generated by the output image generator module comprising the output image.

Claims

1. A gradient domain compression system for generating, from an input image having a high luminance dynamic range, an output image having a lower luminance dynamic range, the system comprising:

A. a gradient image generator module configured to generate, from the input image, a gradient image representing, for respective points of the input image, gradient values in the luminance of the input image;

B. a gradient compression module configured to receive the gradient image and generate a compressed range gradient image in which the range of gradient values are compressed; and

C. an output image generator module configured to receive the compressed range gradient image and to generate therefrom an image, the image generated by the output image generator module comprising the output image.

2. A system as defined in claim 1 in which the gradient compression module comprises:

A. a gradient attenuation function generator module configured to generate, for respective points in the gradient image, a gradient attenuation function whose value for respective points in the gradient image is configured to reduce the range of gradient values in the gradient image; and

B. an attenuated image gradient generator module configured to generate, from the gradient image and the gradient attenuation function, the compressed range gradient image.

3. A system as defined in claim 2 in which the gradient attenuation function generator module is configured to generate the gradient attenuation function to provide values for respective points of the gradient image so as to reduce relatively high gradient values in a progressive manner, such that higher gradient values are reduced more than lower gradient values.

4. A system as defined in claim 2 in which the gradient attenuation function generator module is configured to generate the gradient attenuation function to provide values for respective points of the gradient image so as to increase relatively low gradient values in a progressive manner, such that lower gradient values are increased more than higher gradient values.

5. A system as defined in claim 2 in which the gradient attenuation function generator module is configured to generate the gradient attenuation function whose value for respective points in the gradient image is configured to reduce the range of gradient values in the gradient image around a selected gradient value in the gradient image.

6. A system as defined in claim 2 in which the gradient attenuation function generator comprises:

A. a Gaussian pyramid generator module configured to generate a Gaussian pyramid comprising a series of levels, each level of the Gaussian pyramid comprising a level gradient image having a reduced resolution than the level gradient image of the preceding level in the series;

B. a level scaling factor generator module configured to generate, for respective levels gradient images of the Gaussian pyramid, a respective level scaling factor representative of the gradient attenuation function at the particular level; and

C. a scaling factor propagator module configured to propagate the level scaling factors through the Gaussian pyramid, thereby to generate the gradient attenuation function for use by the attenuated image gradient generator module.

7. A system as defined in claim 1 in which output image generator module is configured to generate the output image as the image that is close to the compressed range gradient image in a least-squares sense.

8. A system as defined in claim 7 in which the output image generator module is configured to generate the output image in such that the Laplacian of the output image corresponds to the divergence of the compressed range gradient image.

9. A system as defined in claim 1 further comprising a preprocessor module configured to generate, in response to the input image, a preprocessed image comprising the logarithm of the input image, the gradient image generator module being configured to use the preprocessed image as its input image.

10. A system as defined in claim 1 further comprising a post-processor module configured to generate, in response to the output image generated by the output image generator module, a post-processed image comprising the exponential of the output image, the post-processed image comprising the output image of the system.

11. A gradient domain compression method of generating, from an input image having a high luminance dynamic range, an output image having a lower luminance dynamic range, the method comprising:

A. a gradient image generator step of generating, from the input image, a gradient image representing, for respective points of the input image, gradient values in the luminance of the input image;

B. a gradient compression step of receiving the gradient image and generating a compressed range gradient image in which the range of gradient values are compressed; and

C. an output image generator step of receiving the compressed range gradient image and generating therefrom an image, the image generated during the output image generator step comprising the output image.

12. A method as defined in claim 11 in which the gradient compression step comprises:

A. a gradient attenuation function generator step of generating, for respective points in the gradient image, a gradient attenuation function whose value for respective points in the gradient image is configured to reduce the range of gradient values in the gradient image; and

B. an attenuated image gradient generator step of generating, from the gradient image and the gradient attenuation function, the compressed range gradient image.

13. A method as defined in claim 12 in which the gradient attenuation function generator step includes the step of generating the gradient attenuation function to provide values for respective points of the gradient image so as to reduce relatively high gradient values in a progressive manner, such that higher gradient values are reduced more than lower gradient values.

14. A method as defined in claim 12 in which the gradient attenuation function generator step includes the step of generating the gradient attenuation function to provide values for respective points of the gradient image so as to increase relatively low gradient values in a progressive manner, such that lower gradient values are increased more than higher gradient values.

15. A method as defined in claim 12 in which the gradient attenuation function generator step includes the step of generating the gradient attenuation function whose value for respective points in the gradient image is configured to reduce the range of gradient values in the gradient image around a selected gradient value in the gradient image.

16. A method as defined in claim 12 in which the gradient attenuation function generator step comprises:

A. a Gaussian pyramid generator step of generating a Gaussian pyramid comprising a series of levels, each level of the Gaussian pyramid comprising a level gradient image having a reduced resolution than the level gradient image of the preceding level in the series;

B. a level scaling factor generator step of generating, for respective levels gradient images of the Gaussian pyramid, a respective level scaling factor representative of the gradient attenuation function at the particular level; and

C. a scaling factor propagator step of propagating module the level scaling factors through the Gaussian pyramid, thereby to generate the gradient attenuation function for use during the attenuated image gradient generator step.

17. A method as defined in claim 11 in which output image generator step includes the step of generating the output image as the image that is close to the compressed range gradient image in a least-squares sense.

18. A method as defined in claim 17 in which the output image generator step includes the step of generating the output image in such that the Laplacian of the output image corresponds to the divergence of the compressed range gradient image.

19. A method as defined in claim 11 further comprising a preprocessor step of generating, in response to the input image, a preprocessed image comprising the logarithm of the input image, the gradient image generator step making use of the preprocessed image as its input image.

20. A method as defined in claim 11 further comprising a post-processor configured configured to generate, in response to the output image generated by the output image generator module, a post-processed image comprising the exponential of the output image, the post-processed image comprising the output image of the method.

21. A computer program product for use in connection with a computer to provide a gradient domain compression system for generating, from an input image having a high luminance dynamic range, an output image having a lower luminance dynamic range, the computer program product comprising a computer-readable medium having encoded thereon:

A. a gradient image generator module configured to enable the computer to generate, from the input image, a gradient image representing, for respective points of the input image, gradient values in the luminance of the input image;

B. a gradient compression module configured to enable the computer to receive the gradient image and generate a compressed range gradient image in which the range of gradient values are compressed; and

C. an output image generator module configured to enable the computer to receive the compressed range gradient image and to generate therefrom an image, the image generated by the output image generator module comprising the output image.

22. A computer program product as defined in claim 21 in which the gradient compression module comprises:

A. a gradient attenuation function generator module configured to enable the computer to generate, for respective points in the gradient image, a gradient attenuation function whose value for respective points in the gradient image is configured to enable the computer to reduce the range of gradient values in the gradient image; and

B. an attenuated image gradient generator module configured to enable the computer to generate, from the gradient image and the gradient attenuation function, the compressed range gradient image.

23. A computer program product as defined in claim 22 in which the gradient attenuation function generator module is configured to enable the computer to generate the gradient attenuation function to provide values for respective points of the gradient image so as to reduce relatively high gradient values in a progressive manner, such that higher gradient values are reduced more than lower gradient values.

24. A computer program product as defined in claim 22 in which the gradient attenuation function generator module is configured to enable the computer to generate the gradient attenuation function to provide values for respective points of the gradient image so as to increase relatively low gradient values in a progressive manner, such that lower gradient values are increased more than higher gradient values.

25. A computer program product as defined in claim 22 in which the gradient attenuation function generator module is configured to enable the computer to generate the gradient attenuation function whose value for respective points in the gradient image is configured to enable the computer to reduce the range of gradient values in the gradient image around a selected gradient value in the gradient image.

26. A computer program product as defined in claim 22 in which the gradient attenuation function generator comprises:

A. a Gaussian pyramid generator module configured to enable the computer to generate a Gaussian pyramid comprising a series of levels, each level of the Gaussian pyramid comprising a level gradient image having a reduced resolution than the level gradient image of the preceding level in the series;

B. a level scaling factor generator module configured to enable the computer to generate, for respective levels gradient images of the Gaussian pyramid, a respective level scaling factor representative of the gradient attenuation function at the particular level; and

C. a scaling factor propagator module configured to enable the computer to propagate the level scaling factors through the Gaussian pyramid, thereby to generate the gradient attenuation function for use by the attenuated image gradient generator module.

27. A computer program product as defined in claim 21 in which output image generator module is configured to enable the computer to generate the output image as the image that is close to the compressed range gradient image in a least-squares sense.

28. A computer program product as defined in claim 27 in which the output image generator module is configured to enable the computer to generate the output image in such that the Laplacian of the output image corresponds to the divergence of the compressed range gradient image.

29. A computer program product as defined in claim 21 further comprising a preprocessor module configured to enable the computer to generate, in response to the input image, a preprocessed image comprising the logarithm of the input image, the gradient image generator module being configured to enable the computer to use the preprocessed image as its input image.

30. A computer program product as defined in claim 21 further comprising a post-processor module configured to enable the computer to generate, in response to the output image generated by the output image generator module, a post-processed image comprising the exponential of the output image, the post-processed image comprising the output image of the system.