System and methods for applying adaptive gamma in image processing for high brightness and high dynamic range displays

• US 8,681,189 B2
• Filed: 09/17/2009
• Issued: 03/25/2014
• Est. Priority Date: 09/30/2008
• Status: Active Grant

• Current Assignee: Dolby Laboratories Licensing Corporation (Dolby Laboratories Incorporated)
• Original Assignee: Dolby Laboratories Licensing Corporation (Dolby Laboratories Incorporated)
• Inventors: Wallener, Damir, Johnson, Lewis
• Primary Examiner(s): SPAR, ILANA L
• Application Number:
  US13/119,994
• Publication Number:
  US 20110169881A1
• Time in Patent Office: 1,650 Days
• Field of Search: 345/204, 345/690, 345 87- 89, 345/102, 345/4, 345/5
• US Class Current: 345/690
• CPC Class Codes: G09G 2320/0276 for the purpose of adaptation to the characteristics of a display device, i.e. gamma correction
• CPC Class Codes: G09G 2320/0646 Modulation of illumination source brightness and image signal correlated to each other
• CPC Class Codes: G09G 2360/16 Calculation or use of calculated indices related to luminance levels in display data
• CPC Class Codes: G09G 3/3426 the different display panel areas being distributed in two dimensions, e.g. matrix
• CPC Class Codes: G09G 3/3611 Control of matrices with row and column drivers

Abstract

Systems and methods of image processing are provided for a display having a light source modulation layer and a display modulation layer. A section of a perceptual curve, such as a DICOM curve, is extracted for each frame of image data, based on a profile of expected luminance on the display modulation layer from light emitted by the light source modulation layer. The section of the perceptual curve may be used to determine a desired-total response curve which maps display modulation layer input control values to corresponding output luminance values. The desired-total response curve and a display modulator-specific response curve may be applied to image data to generate control values for driving the display modulation layer.

Claims

1. A method for displaying an image on a display having a light source modulation layer and a display modulation layer, the method comprising:

receiving a frame of image data;

determining light source modulator control values for the light source modulation layer, based at least on the image data;

estimating a minimum and maximum luminance received at the display modulation layer;

extracting a section of a perceptual curve that maps luminance values to display modulator control values, the extracted section of the perceptual curve having luminance values extending between the estimated minimum and maximum luminance;

mapping the luminance values of the extracted section of the perceptual curve to an available range of display modulator control values for the display modulation layer to determine a desired-total response curve;

determining display modulator control values for the display modulation layer based at least on the image data and the desired-total response curve;

displaying the image by outputting the display modulator control values to the display modulation layer and the light source modulator control values to the light source modulation layer; and

obtaining calibration data which relates display modulator control values to corresponding output of the display modulation layer;

wherein determining display modulator control values is based at least on the calibration data; and

wherein determining display modulator control values comprises;

adjusting the desired-total response curve based on the calibration data to obtain an encoding curve which relates input image data values to output display modulator control values; and

applying the encoding curve to the image data to obtain the display modulator control values used to display the image.

2. A method according to claim 1 comprising representing the calibration data as a look up table in memory accessible to the display.

3. A method according to claim 1 comprising representing the encoding curve as a look up table in memory accessible to the display.

4. A method according to claim 1 wherein each of the estimated minimum and maximum luminance is an expected luminance based at least on the light source modulator control values.

5. A method according to claim 1 wherein each of the estimated minimum and maximum luminance is an ideal luminance based at least on the image data.

6. A method according to claim 5 wherein estimating the minimum and maximum ideal luminance involves assuming that the light source modulation layer and the display modulation layer have the same resolution.

7. A method according to claim 5 wherein estimating the minimum and maximum ideal luminance involves assuming that each element of the light source modulation layer is independent of the other elements of the light source modulation layer.

8. A method according to claim 5 comprising performing a validity check on at least one of the display modulator control values and the desired-total response curve to ensure that use of the minimum and maximum ideal luminance did not lead to any spurious results.

9. A method according to claim 1,

wherein the received frame of image data is divided into regions;

wherein the method is performed for each region; and

wherein the desired-total response curve is adjusted at boundaries between regions to reduce discontinuities between adjacent regions.

10. A method according to claim 1, the display further having a brightness control,

wherein each of the estimated minimum and maximum luminance is an expected luminance based at least on the brightness control.

11. A method for displaying an image on a display having a light source modulation layer and a display modulation layer, the method comprising:

receiving a frame of image data;

determining light source modulator control values for the light source modulation layer, based at least on the image data;

estimating a minimum and maximum luminance received at the display modulation layer;

extracting a section of a perceptual curve that maps luminance values to display modulator control values, the extracted section of the perceptual curve having luminance values extending between the estimated minimum and maximum luminance;

mapping the luminance values of the extracted section of the perceptual curve to an available range of display modulator control values for the display modulation layer to determine a desired-total response curve;

determining display modulator control values for the display modulation layer based at least on the image data and the desired-total response curve; and

displaying the image by outputting the display modulator control values to the display modulation layer and the light source modulator control values to the light source modulation layer;

wherein mapping the extracted section of the perceptual curve to the available range of display modulator control values comprises using interpolation to stretch the extracted section of the curve.

12. A method according to claim 11 wherein mapping the extracted section of the perceptual curve to the available range of display modulator control values comprises applying an offset to the extracted section of the perceptual curve.

13. A method according to claim 11 wherein the perceptual curve is pre-calibrated to take into account calibration data which relates display modulator control values to corresponding output of the display modulation layer.

14. A method according to claim 11 wherein estimating the minimum luminance received at the display modulation layer involves setting the minimum luminance to a constant value.

15. A method for displaying an image on a display having a light source modulation layer and a display modulation layer, the method comprising:

receiving a frame of image data;

determining light source modulator control values for the light source modulation layer, based at least on the image data;

estimating a minimum and maximum luminance received at the display modulation layer;

extracting a section of a perceptual curve that maps luminance values to display modulator control values, the extracted section of the perceptual curve having luminance values extending between the estimated minimum and maximum luminance;

mapping the luminance values of the extracted section of the perceptual curve to an available range of display modulator control values for the display modulation layer to determine a desired-total response curve;

determining display modulator control values for the display modulation layer based at least on the image data and the desired-total response curve; and

displaying the image by outputting the display modulator control values to the display modulation layer and the light source modulator control values to the light source modulation layer;

wherein mapping the extracted section of the perceptual curve to the available range of display modulator control values comprises using downsampling to compress the extracted section of the curve.

16. A method according to claim 15 wherein mapping the extracted section of the perceptual curve to the available range of display modulator control values comprises scaling the desired-total response curve to correspond to display modulator control values in a range of [0,1].

17. A method according to claim 15 comprising representing the perceptual curve as a look up table in memory accessible to the display.

18. A method according to claim 15 wherein the perceptual curve is a DICOM curve.

19. A method according to claim 15 wherein estimating the minimum and maximum luminance, extracting the section of the perceptual curve and mapping the extracted section of the perceptual curve are performed on a plurality of subsets of the frame of image data.

20. A dual modulator display system comprising:

a display having a light source modulation layer and a display modulation layer;

a data store for storing data for a perceptual curve;

a processor connected to receive image data from an image data source, receive data from the data store, and transmit driving control values to the display, the processor configured to display an image on a display having a light source modulation layer and a display modulation layer, the configuration operative to;

receive a frame of image data;

determine light source modulator control values for the light source modulation layer, based at least on the image data;

estimate a minimum and maximum luminance received at the display modulation layer;

extract a section of a perceptual curve that maps luminance values to display modulator control values, the extracted section of the perceptual curve having luminance values extending between the estimated minimum and maximum luminance;

map the luminance values of the extracted section of the perceptual curve to an available range of display modulator control values for the display modulation layer to determine a desired-total response curve;

determine display modulator control values for the display modulation layer based at least on the image data and the desired-total response curve;

display the image by outputting the display modulator control values to the display modulation layer and the light source modulator control values to the light source modulation layer; and

obtain calibration data which relates display modulator control values to corresponding output of the display modulation layer;

wherein determined display modulator control values are based at least on the calibration data; and

wherein determined display modulator control values comprise an adjusted desired-total response curve based on the calibration data used to obtain an encoding curve which relates input image data values to output display modulator control values; and

apply the encoding curve to the image data to obtain the display modulator control values used to display the image.