Rapid image rendering on dual-modulator displays

• US 8,217,970 B2
• Filed: 01/26/2007
• Issued: 07/10/2012
• Est. Priority Date: 07/27/2004
• Status: Active Grant

• Current Assignee: Dolby Laboratories Licensing Corporation (Dolby Laboratories Incorporated)
• Original Assignee: Dolby Laboratories Licensing Corporation (Dolby Laboratories Incorporated)
• Inventors: Whitehead, Lorne A., Seetzen, Helge, WARD, Gregory John, Heidrich, Wolfgang
• Primary Examiner(s): Boddie, William
• Assistant Examiner(s): Said, Mansour M
• Application Number:
  US11/627,936
• Publication Number:
  US 20080180466A1
• Time in Patent Office: 1,992 Days
• Field of Search: 345/36, 345 38- 39, 345/42, 345 44- 48, 345 50- 51, 345/55, 345/64, 345/74.1, 345/76, 345 82- 84, 345 87- 92, 345/204, 345/694, 345698-699
• US Class Current: 345/698
• CPC Class Codes: G06T 3/4007 based on interpolation, e.g. bilinear interpolation image demosaicing G06T3/4015; edge-driven or edge-based scaling G06T3/403
• CPC Class Codes: G09G 2320/0238 Improving the black level
• CPC Class Codes: G09G 2340/0428 Gradation resolution change
• CPC Class Codes: G09G 3/3426 the different display panel areas being distributed in two dimensions, e.g. matrix
• CPC Class Codes: G09G 3/36 using liquid crystals

Abstract

Apparatus and methods are provided that employ one or more of a variety of techniques for reducing the time required to display high resolution images on a high dynamic range display having a light source layer and a display layer. In one technique, the image resolution is reduced, an effective luminance pattern is determined for the reduced resolution image, and the resolution of the effective luminance pattern is then increased to the resolution of the display layer. In another technique, the light source layer'"'"'s point spread function is decomposed into a plurality of components, and an effective luminance pattern is determined for each component. The effective luminance patterns are then combined to produce a total effective luminance pattern. Additional image display time reduction techniques are provided.

Claims

1. A method for displaying an image on a display comprising a light source layer and a display layer, the method comprising:

determining driving values for light sources of the light source layer;

determining an effective luminance pattern of the light source layer at a first spatial resolution lower than a spatial resolution of the display layer; and

,

increasing the spatial resolution of the effective luminance pattern to a second spatial resolution corresponding to the resolution of the display layer;

wherein determining the effective luminance pattern of the light source layer comprises;

determining a contribution to the effective luminance pattern for each of a plurality of components of a point spread function for light sources of the light source layer; and

,

combining the contributions to the effective luminance pattern of each of the components.

2. A method according to claim 1 wherein each of the components is a Gaussian component.

3. A method according to claim 1 wherein the point spread function is the sum of all of the components of the plurality of components.

4. A method according to claim 1 wherein each of the components is represented at the first spatial resolution.

5. A method according to claim 1 wherein two or more of the components are represented at spatial resolutions different from one another.

6. A method according to claim 4 comprising, before combining the contributions to the effective luminance pattern, increasing the spatial resolution of each of the components to the second spatial resolution.

7. A method according to claim 1 wherein combining the contributions to the effective luminance pattern comprises applying a mathematical inverse of an operation applied to decompose the point spread function into the plurality of components.

8. A method according to claim 1 wherein determining a contribution to the effective luminance pattern for each of a plurality of components of a point spread function is performed over a different support area for each of two of the components of the point spread function.

9. A non-transitory computer-readable medium carrying computer instructions that, when executed by a processor, cause the processor to execute a method according to claim 1.

10. A method for displaying an image on a display comprising a light source layer and a display layer, the method comprising:

determining driving values for light sources of the light source layer;

determining an effective luminance pattern of the light source layer at a first spatial resolution lower than a spatial resolution of the display layer; and

,

increasing the spatial resolution of the effective luminance pattern to a second spatial resolution corresponding to the resolution of the display layer;

wherein

determining the effective luminance pattern of the light source layer comprises;

for each of a plurality of light sources of the light source layer;

separately determining contributions to the effective luminance pattern of higher-order and lower-order parts of a set of point spread function values; and

,

combining the contributions to the effective luminance pattern of the higher-order and lower-order point spread function values.

11. A method according to claim 10 wherein the point spread function values comprise 16 bit words and the higher-order and lower-order parts of the set of point spread function values comprise 8-bit words.

12. A method according to claim 10 wherein determining contributions to the effective luminance pattern of higher-order and lower-order parts of the set of point spread function values is performed over a larger support area for the lower-order parts of the set of point spread function values than for the higher-order parts of the set of point spread function values.

13. A method according to claim 12 wherein determining contributions to the effective luminance pattern of the lower-order parts of the set of point spread function values comprises separately determining a contribution for each of:

the intersection of the support area of the higher-order and lower-order parts of the point spread function values; and

,

the part of the support area for the lower-order parts of the point spread function values that is outside of the support area for the higher-order parts of the point spread function values.

14. A method according to claim 10 comprising identifying a support area for the higher-order parts of the point spread function values by determining a radius R at which the point spread function of the higher-order part of the point spread function values is equal to zero.

15. A method according to 10 comprising determining the contribution to the effective luminance pattern of the lower-order parts of the set of point spread function values at different resolutions within and outside of the support area of the higher-order parts of the point spread function values.

16. A method according to claim 15 comprising determining the contribution to the effective luminance pattern of the lower-order parts of the set of point spread function values at a higher resolution within the support area of the higher-order parts of the point spread function values and at a lower resolution outside of the support area of the higher-order parts of the point spread function values.

17. Apparatus for controlling a display comprising a light source layer and a display layer, the apparatus comprising:

a controller configured to;

determine first driving values for light sources of the light source layer from image data;

determine an effective luminance pattern of the light source layer at a first spatial resolution lower than a spatial resolution of the display layer;

increase the spatial resolution of the effective luminance pattern to a second spatial resolution corresponding to the resolution of the display layer; and

,

determine second driving values for the display layer based on at least the image data and the effective luminance pattern;

a first interface connectable to the light source layer to apply the first driving values to the light source layer; and

,

a second interface connectable to the display layer to apply the second driving values to the display layer.

18. Apparatus according to claim 17 comprising a light source layer connected to the first interface and a display layer connected to the second interface.

19. Apparatus according to claim 18 wherein the light source layer comprises a plurality of individually-controllable light sources.

20. Apparatus according to claim 18 wherein the light source layer comprises an array of light-emitting diodes.

21. Apparatus according to claim 18 wherein the light source layer comprises a light source and a modulator disposed to modulate light emitted by the light source.

22. Apparatus according to claim 17 wherein the display layer comprises a transmission-type modulator having a plurality of individually-controllable pixels.

23. Apparatus according to claim 17 wherein the display layer comprises an LCD panel.

24. Apparatus according to claim 17 wherein a resolution of the display layer is at least 4 times greater than the first spatial resolution.

25. Apparatus according to claim 24 wherein the resolution of the display layer is at least 8 times greater than the first spatial resolution in each of two dimensions.

26. Apparatus according to claim 17 comprising a means for increasing the spatial resolution of the effective luminance pattern by performing interpolation on data defining the effective luminance pattern.

27. Apparatus according to claim 17 comprising a data store accessible to the controller and containing information defining a plurality of components of a point spread function for light sources of the light source layer wherein the controller is configured to separately evaluate and combine contributions to the effective luminance pattern corresponding to each of the components.

28. Apparatus according to claim 27 comprising an upsampler for increasing the spatial resolution of the contributions to the effective luminance pattern corresponding to each of the components to the second spatial resolution.

29. Apparatus according to claim 27 wherein each of the components is a Gaussian component.

30. Apparatus according to claim 29 comprising a hardware processor providing a function that operates directly on Gaussian components.

31. Apparatus according to claim 17 comprising a means for determining a component of the effective luminance pattern corresponding to higher-order parts of data and a component of the effective luminance pattern corresponding to lower-order parts of the data.

32. Apparatus according to claim 31 wherein the means for determining a component of the effective luminance pattern corresponding to higher-order parts of data comprises software instructions that cause a processor of the controller to perform operations primarily in the 8-bit domain.

33. Apparatus according to claim 31 wherein the means for determining a component of the effective luminance pattern corresponding to lower-order parts of data comprises software instructions that cause a processor of the controller to perform operations primarily in the 8-bit domain.

34. A method for displaying an image on a display comprising a light source layer and a display layer, the method comprising:

determining based at least in part on image data driving values for light sources of the light source layer;

determining an effective luminance pattern of the light source layer at a first spatial resolution lower than a spatial resolution of the display layer by a method including;

determining a contribution to the effective luminance pattern for each of a plurality of components of a point spread function for light sources of the light source layer; and

,

combining the contributions to the effective luminance pattern of each of the components to yield effective luminance pattern data;

increasing the spatial resolution of the effective luminance pattern to a second spatial resolution corresponding to the resolution of the display layer; and

,

determining driving values for the display layer based at least in part on the effective luminance pattern data and the image data.

35. Display apparatus comprising:

a light source layer

a display layer,

a controller configured to;

determine, based at least in part on image data, first driving values for light sources of the light source layer;

determine an effective luminance pattern of the light source layer at a first spatial resolution lower than a spatial resolution of the display layer by a method including;

determining a contribution to the effective luminance pattern for each of a plurality of components of a point spread function for light sources of the light source layer; and

,

combining the contributions to the effective luminance pattern of each of the components to yield effective luminance pattern data;

increase the spatial resolution of the effective luminance pattern to a second spatial resolution corresponding to the resolution of the display layer; and

,

determine second driving values for the display layer based at least in part on the effective luminance pattern data and the image data;

a first interface connected to the light source layer to apply the first driving values to the light source layer; and

,

a second interface connected to the display layer to apply the second driving values to the display layer.

36. A method for displaying an image on a display comprising a light source layer and a display layer, the method comprising:

determining based at least in part on image data driving values for light sources of the light source layer;

determining an effective luminance pattern of the light source layer at a first spatial resolution lower than a spatial resolution of the display layer by a method including;

for each of a plurality of light sources of the light source layer;

separately determining contributions to the effective luminance pattern of higher-order and lower-order parts of a set of point spread function values; and

,

combining the contributions to the effective luminance pattern of the higher-order and lower-order point spread function values to yield effective luminance pattern data;

increasing the spatial resolution of the effective luminance pattern to a second spatial resolution corresponding to the resolution of the display layer; and

,

determining driving values for the display layer based at least in part on the effective luminance pattern data and the image data.

37. Display apparatus comprising:

a light source layer

a display layer,

a controller configured to;

determine, based at least in part on image data, first driving values for light sources of the light source layer;

determine an effective luminance pattern of the light source layer at a first spatial resolution lower than a spatial resolution of the display layer by a method including;

for each of a plurality of light sources of the light source layer;

separately determining contributions to the effective luminance pattern of higher-order and lower-order parts of a set of point spread function values; and

,

combining the contributions to the effective luminance pattern of the higher-order and lower-order point spread function values to yield effective luminance pattern data;

increase the spatial resolution of the effective luminance pattern to a second spatial resolution corresponding to the resolution of the display layer; and

,

determine second driving values for the display layer based at least in part on the effective luminance pattern data and the image data;

a first interface connected to the light source layer to apply the first driving values to the light source layer; and

,

a second interface connected to the display layer to apply the second driving values to the display layer.