System and method for color retargeting

• US 10,607,525 B2
• Filed: 05/19/2016
• Issued: 03/31/2020
• Est. Priority Date: 05/19/2015
• Status: Active Grant

• Current Assignee: IRYStec Software, Inc. (Forvia SE)
• Original Assignee: IRYStec Software, Inc. (Forvia SE)
• Inventors: Akhavan, Tara, Rezagholizadeh, Mehdi, Soudi, Afsoon
• Primary Examiner(s): Rosario, Nelson M
• Application Number:
  US15/575,562
• Publication Number:
  US 20180130393A1
• Time in Patent Office: 1,412 Days
• CPC Class Codes: G09G 2320/0606 Manual adjustment
• CPC Class Codes: G09G 2320/0626 for control of overall brightness
• CPC Class Codes: G09G 2320/066 for control of contrast
• CPC Class Codes: G09G 2320/0666 for control of colour parameters, e.g. colour temperature
• CPC Class Codes: G09G 2340/06 Colour space transformation
• CPC Class Codes: G09G 3/2003 Display of colours specific for liquid crystal displays G09G3/3607
• CPC Class Codes: G09G 3/3208 organic, e.g. using organic light-emitting diodes [OLED]

Abstract

A system and method for color retargeting of an image includes applying a color appearance model to the image to be displayed based in part on a first luminance level. The color appearance model outputs a first set of color responses representing a simulated version of the image at the first luminance level. A color compensation model is further applied to the first set of color responses based in part on a second luminance level. The color compensation model outputs a second set of color responses representing a compensated version of the image. The compensated version of the image may be displayed on a display device set at the second luminance level. At least one of the color appearance model and the color compensation model applies rod-intrusion correction.

Claims

1. A computer-implemented color system for color retargeting of an image, the system comprising:

at least one data storage device; and

at least one processor coupled to the at least one storage device, the at least one processor being configured for;

applying a color appearance model to the image to be displayed based in part on a first luminance level, the color appearance model outputting a first set of color responses representing a simulated version of the image at the first luminance level; and

applying a color compensation model to the first set of color responses based in part on a second luminance level, the color compensation model outputting a second set of color responses representing a compensated version of the image, at least one of the color appearance model and the color compensation model applying rod-intrusion correction.

2. The system of claim 1, wherein the color compensation model corresponds to an inverse of the color appearance model and wherein the color appearance model applies an estimate of rod intrusion.

3. The system of claim 1, wherein the simulated version of the image represented by the first set of color responses outputted by the color appearance model corresponds to a simulation of the image as perceived by a human at the first luminance level;

and wherein the compensated version of the image represented by the second set of color responses outputted by the color compensation model corresponds to a compensated image that when displayed at the second luminance level would be perceived by a human as having the first set of color responses.

4. The system of claim 1, wherein the compensated version of the image represented by the second set of color responses outputted by the color compensation model corresponds to a compensated image that when displayed at the second luminance level would be perceived by a human as having a color appearance closer to the first set of color responses than the inputted image being displayed at the second luminance level without applying the color appearance model and the color compensation model.

5. The system of claim 1, wherein the first set of color responses is representative of cone and rod-based human vision;

wherein the first set of color responses is a set of opponent responses;

wherein the second set of color responses is representative of cone and rod-based human vision; and

wherein the second set of color responses is represented in LMS space.

6. The system of claim 1, wherein the processor is further configured for:

transforming the second set of color responses to a color space suitable for display on an electronic display device; and

displaying the compensated version of the image on an electronic display device; and

wherein the electronic display device is set to emit an average luminance corresponding to the second luminance level while displaying the compensated version of the image.

7. The system of claim 1, wherein applying the color appearance model with rod-intrusion correction comprises applying a first set of rod-weighting coefficients determined based on the first luminance level;

and

wherein applying the color compensation model with rod-intrusion correction comprises applying a second a second set of rod-weighting coefficients determined based on the second luminance level.

8. The system of claim 1, wherein the first luminance level is substantially greater than the second luminance level;

and

wherein the first luminance level is greater than 10 cd/m².

9. The system of claim 1, wherein the color appearance model with rod intrusion correction is Shin'"'"'s color appearance model;

wherein the color compensation model with rod-intrusion correction is an inverse of Shin'"'"'s color appearance model.

10. The system of claim 9, wherein the first set of color responses outputted by Shin'"'"'s color appearance model is a set of opponent responses;

wherein the set of opponent responses is inputted to the color compensation model with rod-intrusion correction; and

wherein the second set of color responses is represented in LMS space and is determined according to;

11. The system of claim 1, wherein applying rod-intrusion comprises accounting for use of rods in human vision.

12. The system of claim 1, wherein the color appearance model characterizes perceptual attributes of human vision of the image displayed at the first luminance level;

and

wherein the color compensation model characterizes perceptual attributes of human vision of the compensated version of the image displayed at the second luminance level.

13. A method for color retargeting of an image, the method comprising

applying a color appearance model to the image to be displayed based in part on a first luminance level, the color appearance model outputting a first set of color responses representing a simulated version of the image at the first luminance level;

and

applying a color compensation model to the first set of color responses based in part on a second luminance level, the color compensation model outputting a second set of color responses representing a compensated version of the image, at least one of the color appearance model and the color compensation model applying rod-intrusion correction.

14. The method of claim 13, wherein the color compensation model corresponds to an inverse of the color appearance model and wherein the color appearance model applies an estimate of rod intrusion.

15. The method of claim 13, wherein the simulated version of the image represented by the first set of color responses outputted by the color appearance model corresponds to a simulation of the image as perceived by a human at the first luminance level;

and

wherein the compensated version of the image represented by the second set of color responses outputted by the color compensation model corresponds to a compensated image that when displayed at the second luminance level would be perceived by a human as having the first set of color responses.

16. The method of claim 13, wherein the compensated version of the image represented by the second set of color responses outputted by the color compensation model corresponds to a compensated image that when displayed at the second luminance level would be perceived by a human as having a color appearance closer to the first set of color responses than the inputted image being displayed at the second luminance level without applying the color appearance model and the color compensation model.

17. The method of claim 13, wherein the first set of color responses is representative of cone and rod-based human vision;

wherein the first set of color responses is a set of opponent responses;

wherein the second set of color responses is representative of cone and rod-based human vision;

wherein the second set of color responses is represented in LMS space.

18. The method of claim 13, further comprising:

transforming the second set of color responses to a color space suitable for display on an electronic display device; and

displaying the compensated version of the image on an electronic display device; and

wherein the electronic display device is set to emit an average luminance corresponding to the second luminance level while displaying the compensated version of the image.

19. The method of claim 13, wherein applying the color appearance model with rod-intrusion correction comprises applying a first set of rod-weighting coefficients determined based on the first luminance level;

and

wherein applying the color compensation model with rod-intrusion correction comprises applying a second a second set of rod-weighting coefficients determined based on the second luminance level.

20. The method of claim 13, wherein the first luminance level is substantially greater than the second luminance level;

and

wherein the first luminance level is greater than 10 cd/m².

21. The method of claim 13, wherein the color appearance model with rod intrusion correction is Shin'"'"'s color appearance model;

wherein the color compensation model with rod-intrusion correction is an inverse of Shin'"'"'s color appearance model.

22. The method of claim 21, wherein the first set of color responses outputted by Shin'"'"'s color appearance model is a set of opponent responses;

and

wherein the set of opponent responses is inputted to the color compensation model with rod-intrusion correction; and

wherein the second set of color responses is represented in LMS space and is determined according to;

23. The method of claim 13, wherein applying rod-intrusion comprises accounting for use of rods in human vision.

24. The method of claim 13, wherein the color appearance model characterizes perceptual attributes of human vision of the image displayed at the first luminance level;

and

wherein the color compensation model characterizes perceptual attributes of human vision of the compensated version of the image displayed at the second luminance level.

25. A method of processing images, the method comprising:

obtaining an image;

applying Shin'"'"'s model to the image to generate a set of luminance dependent parameters based at least in part on scene luminance associated with the image;

applying an inverse of Shin'"'"'s model to the luminance dependent parameters to approximate white point LMS values based at least in part on display luminance associated with a display onto which the image is to be shown;

transforming the LMS values to generate a target image; and

outputting the target image for display.

26. The method of claim 25, wherein the inverse of Shin'"'"'s model is generated by:

calculating the luminance dependent parameters of the display;

approximating the white point LMS values and scotopic luminance value of a backward model;

calculating LMS excitation values;

transforming the LMS excitation values to obtain the LMS values; and

applying a linear transform to convert the LMS values to XYZ values and RGB values.

27. The method of claim 26, wherein the white point LMS values are approximated by:

28. The method of claim 25, wherein the target image compensates for color deviations impose by the human visual system for perceptual rendering of dark images.