Display incorporating lossy dynamic saturation compensating gamut mapping

• US 9,583,035 B2
• Filed: 10/22/2014
• Issued: 02/28/2017
• Est. Priority Date: 10/22/2014
• Status: Active Grant

• Current Assignee: Snaptrack Incorporated (Qualcomm, Inc.)
• Original Assignee: Snaptrack Incorporated (Qualcomm, Inc.)
• Inventors: Buckley, Edward, Smith, Nathaniel
• Primary Examiner(s): Johnson, Gerald
• Application Number:
  US14/520,994
• Publication Number:
  US 20160117967A1
• Time in Patent Office: 860 Days
• US Class Current: 1/1
• CPC Class Codes: G09G 2300/02 Composition of display devices
• CPC Class Codes: G09G 2300/0469 Details of the physics of pixel operation
• CPC Class Codes: G09G 2320/0666 for control of colour parameters, e.g. colour temperature
• CPC Class Codes: G09G 2340/06 Colour space transformation
• CPC Class Codes: G09G 3/2003 Display of colours specific for liquid crystal displays G09G3/3607
• CPC Class Codes: G09G 3/3433 using light modulating elements actuated by an electric field and being other than liquid crystal devices and electrochromic devices using liquid crystal devices G09G3/36; using electrochromic devices G09G3/38
• CPC Class Codes: G09G 5/06 using colour palettes, e.g. look-up tables

Abstract

This disclosure provides systems, methods, and apparatus for generating images on a multi-primary display. A multi-primary display can include control logic that converts input image data into the multi-primary color space employed by the display by mapping the input pixel values into an intermediate color space according to a gamut mapping function and then decomposing the mapped pixel values into color subfields associated with the display'"'"'s primary colors. The control logic can be configured to identify a lossy gamut mapping saturation parameter value to use in the gamut mapping process which results in a power-saving desaturated image that is perceived by the Human Visual System (HVS) as substantially maintaining its color fidelity.

Claims

1. An apparatus comprising:

an array of display elements;

control logic configured to;

receive an input image frame, wherein the input image frame includes, for each of a plurality of pixels, a first set of color parameter values;

generate an output image frame by;

obtaining a gamut mapping saturation parameter;

for each pixel in the received image frame, using the gamut mapping saturation parameter, applying a content adaptive gamut mapping process to the first set of color parameter values associated with the pixel to map the first set of color parameter values to a second set of color parameter values;

decomposing the second set of color parameter values associated with the plurality of pixels to form pixel intensity values in respective color subfields associated with at least four different colors; and

generating display element state information for the display elements based on the color subfields;

output the output image frame to the array of display elements;

determine a color difference between the output image frame and a reference output image frame; and

update the gamut mapping saturation parameter based on the determined color difference.

2. The apparatus of claim 1, wherein updating the gamut mapping saturation parameter comprises:

comparing the determined color difference to a threshold color difference; and

in response to the color difference falling below the threshold color difference, adjusting the gamut mapping saturation parameter to increase the color difference in a subsequently generated output image frame.

3. The apparatus of claim 1, wherein updating the gamut mapping saturation parameter comprises:

comparing the determined color difference to a threshold color difference; and

in response to the color difference exceeding threshold color difference, adjusting the gamut mapping saturation parameter to decrease the color difference in a subsequently generated output image frame.

4. The apparatus of claim 1, wherein the reference output image frame includes an output image resulting from the application of the gamut mapping process to a reference input image frame using a gamut mapping saturation parameter that yields more desaturation to a reference image frame.

5. The apparatus of claim 4, wherein the reference input image frame includes an image in a same video scene as the received input image frame.

6. The apparatus of claim 4, wherein the received input image frame is a still image, and the reference input image frame includes the identical image data to the received input image frame.

7. The apparatus of claim 4, wherein the control logic further configured to generate the reference output image frame using a lossless gamut mapping saturation parameter.

8. The apparatus of claim 1, wherein the color difference includes a retinex measure indicating an average color difference between the output image frame and the reference output image frame.

9. The apparatus of claim 1, wherein obtaining the gamut mapping saturation parameter includes determining that the received image frame is associated with a scene change and identifying a lossless gamut mapping saturation parameter for the received image frame.

10. The apparatus of claim 1, wherein the first set of color parameter values include red, green, and blue pixel intensity values and the second sets of color parameter values comprise XYZ tristimulus values.

11. The apparatus of claim 1, wherein the color difference is indicative of a difference in at least one of chromaticity and luminance.

12. The apparatus of claim 1, wherein updating the gamut mapping saturation parameter includes applying a proportional-integral-derivative (PID) controller-based updating process.

13. The apparatus of claim 1, further comprising:

a display including the array of display elements;

a processor capable of communicating with the display, the processor being capable of processing image data; and

a memory device capable of communicating with the processor.

14. The apparatus of claim 13, further comprising:

a driver circuit capable of sending at least one signal to the display; and

a controller capable of sending at least a portion of the image data to the driver circuit.

15. The apparatus of claim 13, further including an image source module capable of sending the image data to the processor, wherein the image source module includes at least one of a receiver, transceiver, and transmitter.

16. The apparatus of claim 13, the display device further including an input device capable of receiving input data and to communicate the input data to the processor.

17. A non-transitory computer readable medium storing computer executable instructions, which when executed by a processor cause the processor to carry out a method of forming an image on a display, comprising:

receiving an input image frame, wherein the input image frame includes, for each of a plurality a pixels, a first set of color parameter values;

generating an output image frame by;

obtaining a gamut mapping saturation parameter;

for each pixel in the received image frame, using the gamut mapping saturation parameter, applying a content adaptive gamut mapping process to the first set of color parameter values associated with the pixel to map the first set of color parameter values to a second set of color parameter values;

decomposing the second set of color parameter values associated with the plurality of pixels to form pixel intensity values in respective color subfields associated with at least four different colors;

generating display element state information for display elements in an array of display elements of the display based on the color subfields; and

outputting the output image frame to the array of display elements;

determining a color difference between the output image frame and a reference output image frame; and

updating the gamut mapping saturation parameter based on the determined color difference.

18. The non-transitory computer readable medium of claim 17, wherein updating the gamut mapping saturation parameter comprises:

comparing the determined color difference to a threshold color difference; and

in response to the color difference falling below the threshold color difference, adjusting the gamut mapping saturation parameter to increase the color difference in a subsequently generated output image frame;

in response to the color difference exceeding the threshold color difference, adjusting the gamut mapping saturation parameter to decrease the color difference in a subsequently generated output image frame.

19. The non-transitory computer readable medium of claim 17, wherein the reference output image frame includes an output image resulting from the application of the gamut mapping process to a reference input image frame using a lossless gamut mapping saturation parameter.

20. The non-transitory computer readable medium of claim 19, wherein the reference input image frame includes one of an image in a same video scene as the received input image frame and an image frame including the identical image data to the received input image frame.

21. The non-transitory computer readable medium of claim 19, wherein the method further includes generating the reference output image frame using a lossless gamut mapping saturation parameter.

22. The non-transitory computer readable medium of claim 17, wherein the color difference includes a retinex measure indicating an average color difference between the output image frame and the reference output image frame.

23. The non-transitory computer readable medium of claim 17, wherein obtaining the gamut mapping saturation parameter comprises includes determining that the received image frame is associated with a scene change and identifying a lossless gamut mapping saturation parameter for the received image frame.

24. The non-transitory computer readable medium of claim 17, wherein the first set of color parameter values include red, green, and blue pixel intensity values and the second sets of color parameter values comprise XYZ tristimulus values.

25. The non-transitory computer readable medium of claim 17, wherein updating the gamut mapping saturation parameter includes applying a proportional-integral-derivative (PID) controller-based updating process.