Systems and methods for selecting a display source light illumination level

• US 7,782,405 B2
• Filed: 08/17/2006
• Issued: 08/24/2010
• Est. Priority Date: 12/02/2004
• Status: Expired due to Fees

• Current Assignee: Sharp Kabushiki Kaisha (Hon Hai Precision Industry Co., Ltd.)
• Original Assignee: Sharp Laboratories of America Incorporated (Hon Hai Precision Industry Co., Ltd.)
• Inventors: Kerofsky, Louis Joseph
• Primary Examiner(s): Tran; Trang U
• Application Number:
  US11/465,436
• Publication Number:
  US 20060274026A1
• Time in Patent Office: 1,468 Days
• Field of Search: 348/671, 348/673, 348/739, 348/751, 348/761, 348/766, 348/790, 348/806, 345/102, 345/690, 359/242, 353/31
• US Class Current: 348/671
• CPC Class Codes: G09G 2320/02 Improving the quality of display appearance
• CPC Class Codes: G09G 2320/0233 Improving the luminance or brightness uniformity across the screen
• CPC Class Codes: G09G 2320/0242 Compensation of deficiencies in the appearance of colours
• CPC Class Codes: G09G 2320/0271 Adjustment of the gradation levels within the range of the gradation scale, e.g. by redistribution or clipping
• CPC Class Codes: G09G 2320/0285 using tables for spatial correction of display data
• CPC Class Codes: G09G 2320/0626 for control of overall brightness
• CPC Class Codes: G09G 2320/0633 by amplitude modulation of the brightness of the illumination source
• CPC Class Codes: G09G 2320/0646 Modulation of illumination source brightness and image signal correlated to each other
• CPC Class Codes: G09G 2320/0653 Controlling or limiting the speed of brightness adjustment of the illumination source
• CPC Class Codes: G09G 2320/0673 for control of gamma adjustment, e.g. selecting another gamma curve
• CPC Class Codes: G09G 2330/021 Power management, e.g. power saving
• CPC Class Codes: G09G 2340/0428 Gradation resolution change
• CPC Class Codes: G09G 2360/144 the light being ambient light
• CPC Class Codes: G09G 2360/16 Calculation or use of calculated indices related to luminance levels in display data
• CPC Class Codes: G09G 3/22 using controlled light sources
• CPC Class Codes: G09G 3/3406 Control of illumination source illumination devices structurally associated with liquid crystal cells G02F1/1336
• CPC Class Codes: G09G 3/3413 Details of control of colour illumination sources

Abstract

Embodiments of the present invention comprise systems and methods for selecting a display source light illumination level based on distortion parameters.

Claims

1. A method for selecting a display source light illumination level, said method comprising:

a) processing an image, I with a reference display model thereby creating a reference image, I_r;

b) selecting a first source light illumination level, P₁, that is less than a maximum source light illumination level, W;

c) estimating the dynamic range of a modified image, I′

created by modifying said image I, to compensate for said first source light illumination level using an actual display model wherein said modified image, I′

has a limited dynamic range bounded by a first minimum dynamic range limit and a first maximum dynamic range limit;

d) calculating a first distortion parameter by comparing the part of said reference image that falls below said first minimum dynamic range limit to said first minimum dynamic range limit and the part of said reference image that falls above said first maximum dynamic range limit to said first maximum dynamic range limit;

e) selecting a second source light illumination level, P₂;

f) estimating the dynamic range of a second modified image, I₂′

created by modifying said image I, to compensate for said second source light illumination level using said actual display model wherein said modified image, I₂′

has a limited dynamic range bounded by a second minimum dynamic range limit and a second maximum dynamic range limit;

g) calculating a second distortion parameter by comparing the part of said reference image that falls below said second minimum dynamic range limit to said second minimum dynamic range limit and the part of said reference image that falls above said second maximum dynamic range limit to said second maximum dynamic range limit; and

h) selecting one of said first source light illumination level, P₁ and said second source light illumination level, P₂ based on said first and second distortion parameters.

2. A method as described in claim 1 wherein said distortion is calculated by taking the mean squared error (MSE) between said reference image values and said dynamic range limits.

3. A method as described in claim 1 further comprising calculating a reference image histogram for said reference image, I_r, wherein said distortion is calculated by finding the sum of the errors between each reference image pixel values outside said dynamic range and the nearest of said dynamic range limits, said errors being weighted by histogram counts from said reference image histogram.

4. A method as described in claim 1 wherein said estimating the dynamic range of a display illuminated with said first source light illumination level comprises using an actual display model comprising a gain factor and a black level offset factor.

5. A method as described in claim 1 wherein said actual display model uses the following equations:

$Y_{\mathrm{actual}}<br><br>\left(P,\mathrm{cv}\right)=P·<br><br>{\left(\mathrm{Gain}·<br><br>\frac{\mathrm{cv}}{{\mathrm{cv}}_{\mathrm{Max}}}+\mathrm{Offset}\right)}^{\mathrm{\gamma <br><br>}}$ $\mathrm{Offset}=B^{\frac{1}{\mathrm{\gamma <br><br>}}}$ $\mathrm{Gain}=W^{\frac{1}{\mathrm{\gamma <br><br>}}}-B^{\frac{1}{\mathrm{\gamma <br><br>}}}$ $B<br><br>\left(P\right)=P·<br><br>B$ $W<br><br>\left(P\right)=P·<br><br>W$ $\mathrm{CR}=W/B$

wherein Y_actual is the output of the display model, P is one of a first or second source light illumination level, cv is an image code value, B is a display black level and W is a maximum display source light illumination level.

6. A method as described in claim 1 wherein said minimum dynamic range limits and said maximum dynamic range limits are clipping limits defined, respectively, by:

$x_{\mathrm{low}}<br><br>\left(P\right)=\mathrm{cvMax}·<br><br>{\left(\frac{P}{\mathrm{CR}}\right)}^{\frac{1}{\mathrm{\gamma <br><br>}}}$ $x_{\mathrm{high}}<br><br>\left(P\right)=\mathrm{cvMax}·<br><br>{\left(P\right)}^{\frac{1}{\mathrm{\gamma <br><br>}}}$

wherein P is one of a first or second source light illumination level, cvMax is a maximum image code value, B is a display black level, W is a maximum display source light illumination level, CR=W/B and γ

is a display gamma value.

7. A method as described in claim 1 wherein said minimum dynamic range limits and said maximum dynamic range limits are clipping points.

8. A method for selecting a display source light illumination level, said method comprising:

a) processing an image, I with a reference display model that relates image code values to luminance values thereby creating a reference image, I_r;

b) selecting a first source light illumination level, P₁, that is less than a maximum source light illumination level, W;

c) estimating the dynamic range of a modified image, I′

created by modifying said image I, to compensate for said first source light illumination level using an actual display model wherein said modified image, I′

has a limited dynamic range bounded by a first minimum dynamic range limit and a first maximum dynamic range limit;

d) calculating a histogram for said reference image, I_r, wherein said histogram comprises at least those reference image code values that are below said first minimum dynamic range limit and those reference image code values that are above said first maximum dynamic range limit;

e) calculating a first distortion parameter by comparing code values for which said histogram shows a non-zero bin count and which fall below said first minimum dynamic range limit to said first minimum dynamic range limit and weighting the result of said comparing by a corresponding histogram bin count and by comparing code values for which said histogram shows a non-zero bin count and which fall above said first maximum dynamic range limit to said first maximum dynamic range limit and weighting the result of said comparing by a corresponding histogram bin count;

f) selecting a second source light illumination level, P₂;

g) estimating the dynamic range of a modified image, I′

created by modifying said image I, to compensate for said second source light illumination level using said actual display model wherein said modified image, I′

has a limited dynamic range bounded by a second minimum dynamic range limit and a second maximum dynamic range limit;

h) calculating a second distortion parameter by comparing code values for which said histogram shows a non-zero bin count and which fall below said second minimum dynamic range limit to said second minimum dynamic range limit and weighting the result of said comparing by a corresponding histogram bin count, and by comparing code values for which said histogram shows a non-zero bin count and which fall above said second maximum dynamic range limit to said second maximum dynamic range limit and weighting the result of said comparing by a corresponding histogram bin count; and

i) selecting one of said first source light illumination level, P₁ and said second source light illumination level, P₂ based on said first and second distortion parameters.

9. A method as described in claim 8 wherein said processing an image, I, to create a reference image, I_r, comprises using the equation:

$Y_{\mathrm{ref}}<br><br>\left(\mathrm{cv}\right)=W·<br><br>{\left(\frac{\mathrm{cv}}{{\mathrm{cv}}_{\mathrm{Max}}}\right)}^{\mathrm{\gamma <br><br>}}$

wherein Y_ref is a luminance value for a reference image, W is a maximum display source light illumination level, cv is a code value for a pixel in said image, I, cv_Max is a maximum code value representing the maximum value of a range of possible values in said image, I, and γ

is a display gamma value.

10. A method as described in claim 8 wherein said actual display model uses the following equations:

$Y_{\mathrm{Actual}}<br><br>\left(P,\mathrm{cv}\right)=P·<br><br>{\left(\mathrm{Gain}·<br><br>\frac{\mathrm{cv}}{{\mathrm{cv}}_{\mathrm{Max}}}+\mathrm{Offset}\right)}^{\mathrm{\gamma <br><br>}}$ $\mathrm{Offset}=B^{\frac{1}{\mathrm{\gamma <br><br>}}}$ $\mathrm{Gain}=W^{\frac{1}{\mathrm{\gamma <br><br>}}}-B^{\frac{1}{\mathrm{\gamma <br><br>}}}$ $B<br><br>\left(P\right)=P·<br><br>B$ $W<br><br>\left(P\right)=P·<br><br>W$ $\mathrm{CR}=W/B$

wherein Y_actual is the output of the display model, P is one of a first or second source light illumination level, cv is an image code value, B is a display black level and W is a maximum display source light illumination level.

11. A method as described in claim 8 wherein said first minimum dynamic range limit and said first maximum dynamic range limit are clipping limits defined, respectively, by:

$x_{\mathrm{low}}<br><br>\left(P\right)=\mathrm{cv}<br><br><br><br>\mathrm{Max}·<br><br>{\left(\frac{P}{\mathrm{CR}}\right)}^{\frac{1}{\mathrm{\gamma <br><br>}}}$ $x_{\mathrm{high}}<br><br>\left(P\right)=\mathrm{cv}<br><br><br><br>\mathrm{Max}·<br><br>{\left(P\right)}^{\frac{1}{\mathrm{\gamma <br><br>}}}$

wherein P is one of a first or second source light illumination level, cvMax is a maximum image code value, B is a display black level, W is a maximum display source light illumination level, CR=W/B and γ

is a display gamma value.

12. A method as described in claim 8 wherein said histogram is calculated only for those reference image code values that are below said first minimum dynamic range limit and those reference image code values that are above said first maximum dynamic range limit.

13. A method as described in claim 8 wherein said histogram is calculated for a complete reference image.

14. A method as described in claim 8 wherein said calculating one of a first or a second distortion parameter by comparing code values comprises taking the mean square error (MSE) between code values for which said histogram shows a non-zero bin count and which fall below said first minimum dynamic range limit and said first minimum dynamic range limit and weighting said error values by a corresponding histogram bin count and by taking the MSE between code values for which said histogram shows a non-zero bin count and which fall above said first maximum dynamic range limit and said first maximum dynamic range limit and weighting the said error values by a corresponding histogram bin count.

15. A method as described in claim 8 wherein said calculating one of a first or a second distortion parameter comprises using the following equation:

$D<br><br>\left(I,P\right)=\underset{x<<br><br>{\mathrm{cv}}_{\mathrm{low}}<br><br>\left(P\right)}{\sum <br><br>}<br><br>\tilde{h}<br><br>\left(x\right)·<br><br>d<br><br>\left(x-{\mathrm{cv}}_{\mathrm{low}}<br><br>\left(P\right)\right)+\underset{x><br><br>{\mathrm{cv}}_{\mathrm{high}}<br><br>\left(P\right)}{\sum <br><br>}<br><br>\tilde{h}<br><br>\left(x\right)·<br><br>d<br><br>\left(x-{\mathrm{cv}}_{\mathrm{high}}<br><br>\left(P\right)\right)$

wherein D is a distortion parameter, {tilde over (h)} is a histogram bin count, x is an image code value, cv_low is a minimum dynamic range limit, cv_high is a maximum dynamic range limit and P is a selected display source light illumination level.

16. A method for selecting a display source light illumination level, said method comprising:

processing an image, I with a reference display model that relates image code values to luminance values according to;

$Y_{\mathrm{ref}}<br><br>\left(\mathrm{cv}\right)=W·<br><br>{\left(\frac{\mathrm{cv}}{{\mathrm{cv}}_{\mathrm{Max}}}\right)}^{\mathrm{\gamma <br><br>}}$

wherein Y_ref is a luminance value for a reference image, W is a maximum display source light illumination level, cv is a code value for a pixel in said image, I, cv_Max is a maximum code value representing the maximum value of a range of possible values in said image, I, and γ

is a display gamma value, wherein said processing of said image, I, results in a reference image, I_r;

selecting a first source light illumination level, P₁, that is less than a maximum source light illumination level, W;

creating of a modified image, I′

by modifying said image, I, to compensate for said first source light illumination level using an actual display model defined by;

$Y_{\mathrm{Actual}}<br><br>\left(P,\mathrm{cv}\right)=P·<br><br>{\left(\mathrm{Gain}·<br><br>\frac{\mathrm{cv}}{{\mathrm{cv}}_{\mathrm{Max}}}+\mathrm{Offset}\right)}^{\mathrm{\gamma <br><br>}}$ $\mathrm{Offset}=B^{\frac{1}{\mathrm{\gamma <br><br>}}}$ $\mathrm{Gain}=W^{\frac{1}{\mathrm{\gamma <br><br>}}}-B^{\frac{1}{\mathrm{\gamma <br><br>}}}$ $B<br><br>\left(P\right)=P·<br><br>B$ $W<br><br>\left(P\right)=P·<br><br>W$ $\mathrm{CR}=W/B$

wherein Y_actual is the output of the display model, P is one of a first or second source light illumination level, cv is an image code value, B is a display black level and W is a maximum display source light illumination level

wherein said modified image, I′

has a limited dynamic range bounded by a first minimum clipping point and a first maximum clipping point defined, respectively, by;

$x_{\mathrm{low}}<br><br>\left(P\right)=\mathrm{cv}<br><br><br><br>\mathrm{Max}·<br><br>{\left(\frac{P}{\mathrm{CR}}\right)}^{\frac{1}{\mathrm{\gamma <br><br>}}}$ $x_{\mathrm{high}}<br><br>\left(P\right)=\mathrm{cv}<br><br><br><br>\mathrm{Max}·<br><br>{\left(P\right)}^{\frac{1}{\mathrm{\gamma <br><br>}}};<br><br>$

calculating a histogram for said reference image, I_r wherein said histogram comprises at least those reference image code values that are below said first minimum clipping point and those reference image code values that are above said first maximum clipping point;

calculating a first distortion parameter by comparing code values for which said histogram shows a non-zero bin count and which fall below said first minimum clipping point to said first minimum clipping point and weighting the result of said comparing by a corresponding histogram bin count and by comparing code values for which said histogram shows a non-zero bin count and which fall above said first maximum clipping point to said first maximum clipping point and weighting the result of said comparing by a corresponding histogram bin count;

selecting a second source light illumination level, P₂;

creating of a modified image, I′

by modifying said image, I, to compensate for said second source light illumination level using an actual display model defined by;

$Y_{\mathrm{Actual}}<br><br>\left(P,\mathrm{cv}\right)=P·<br><br>{\left(\mathrm{Gain}·<br><br>\frac{\mathrm{cv}}{{\mathrm{cv}}_{\mathrm{Max}}}+\mathrm{Offset}\right)}^{\mathrm{\gamma <br><br>}}$ $\mathrm{Offset}=B^{\frac{1}{\mathrm{\gamma <br><br>}}}$ $\mathrm{Gain}=W^{\frac{1}{\mathrm{\gamma <br><br>}}}-B^{\frac{1}{\mathrm{\gamma <br><br>}}}$ $B<br><br>\left(P\right)=P·<br><br>B$ $W<br><br>\left(P\right)=P·<br><br>W$ $\mathrm{CR}=W/B$

wherein Y_actual is the output of the display model, P is one of a second or second source light illumination level, cv is an image code value, B is a display black level and W is a maximum display source light illumination level

wherein said modified image, I′

has a limited dynamic range bounded by a second minimum clipping point and a second maximum clipping point defined, respectively, by;

$x_{\mathrm{low}}<br><br>\left(P\right)=\mathrm{cv}<br><br><br><br>\mathrm{Max}·<br><br>{\left(\frac{P}{\mathrm{CR}}\right)}^{\frac{1}{\mathrm{\gamma <br><br>}}}$ $x_{\mathrm{high}}<br><br>\left(P\right)=\mathrm{cv}<br><br><br><br>\mathrm{Max}·<br><br>{\left(P\right)}^{\frac{1}{\mathrm{\gamma <br><br>}}};<br><br>$

calculating a histogram for said reference image, I_r wherein said histogram comprises at least those reference image code values that are below said second minimum clipping point and those reference image code values that are above said second maximum clipping point;

calculating a second distortion parameter by comparing code values for which said histogram shows a non-zero bin count and which fall below said second minimum clipping point to said second minimum clipping point and weighting the result of said comparing by a corresponding histogram bin count and by comparing code values for which said histogram shows a non-zero bin count and which fall above said second maximum clipping point to said second maximum clipping point and weighting the result of said comparing by a corresponding histogram bin count; and

selecting one of said first source light illumination level, P₁ and said second source light illumination level, P₂ based on said first and second distortion parameters.

17. A method as described in claim 16 wherein said histogram is calculated only for those reference image code values that are below said first minimum clipping point and those reference image code values that are above said first maximum clipping point.

18. A method as described in claim 16 wherein said histogram is calculated for a complete reference image.

19. A method as described in claim 16 wherein said calculating one of a first or a second distortion parameter by comparing code values comprises taking the mean square error (MSE) between code values for which said histogram shows a non-zero bin count and which fall below said first minimum clipping point and said first minimum clipping point and weighting said error values by a corresponding histogram bin count and by taking the MSE between code values for which said histogram shows a non-zero bin count and which fall above said first maximum clipping point and said first maximum clipping point and weighting said error values by a corresponding histogram bin count.

20. A method as described in claim 16 wherein said calculating one of a first or a second distortion parameter comprises using the following equation:

$D<br><br>\left(I,P\right)=\underset{x<<br><br>{\mathrm{cv}}_{\mathrm{low}}<br><br>\left(P\right)}{\sum <br><br>}<br><br>\tilde{h}<br><br>\left(x\right)·<br><br>d<br><br>\left(x-{\mathrm{cv}}_{\mathrm{low}}<br><br>\left(P\right)\right)+\underset{x><br><br>{\mathrm{cv}}_{\mathrm{high}}<br><br>\left(P\right)}{\sum <br><br>}<br><br>\tilde{h}<br><br>\left(x\right)·<br><br>d<br><br>\left(x-{\mathrm{cv}}_{\mathrm{high}}<br><br>\left(P\right)\right)$

wherein D is a distortion parameter, {tilde over (h)} is a histogram bin count, x is an image code value, cv_low is a minimum clipping point, cv_high is a maximum clipping point and P is a selected display source light illumination level.