Method for rendering color images

• US 10,467,984 B2
• Filed: 03/02/2018
• Issued: 11/05/2019
• Est. Priority Date: 03/06/2017
• Status: Active Grant

• Current Assignee: E Ink Corporation (E Ink Holdings Incorporated)
• Original Assignee: E Ink Corporation (E Ink Holdings Incorporated)
• Inventors: Buckley, Edward, Crounse, Kenneth R., Telfer, Stephen J., Sainis, Sunil Krishna
• Primary Examiner(s): Sajous, Wesner
• Application Number:
  US15/910,081
• Publication Number:
  US 20180254020A1
• Time in Patent Office: 613 Days
• CPC Class Codes: G09G 2320/0209 Crosstalk reduction, i.e. to reduce direct or indirect influences of signals directed to a certain pixel of the displayed image on other pixels of said image, inclusive of influences affecting pixels in different frames or fields or sub-images which constitute a same image, e.g. left and right images of a stereoscopic display
• CPC Class Codes: G09G 2320/0214 with crosstalk due to leakage current of pixel switch in active matrix panels
• CPC Class Codes: G09G 2320/0242 Compensation of deficiencies in the appearance of colours
• CPC Class Codes: G09G 2320/0666 for control of colour parameters, e.g. colour temperature
• CPC Class Codes: G09G 2340/06 Colour space transformation
• CPC Class Codes: G09G 3/2003 Display of colours specific for liquid crystal displays G09G3/3607
• CPC Class Codes: G09G 3/2044 using dithering
• CPC Class Codes: G09G 3/2059 using error diffusion
• CPC Class Codes: G09G 3/344 based on particles moving in a fluid or in a gas, e.g. electrophoretic devices electrophoretic devices per se G02F1/167
• CPC Class Codes: G09G 3/38 using electrochromic devices
• CPC Class Codes: G09G 5/06 using colour palettes, e.g. look-up tables

Abstract

A system for rendering color images on an electro-optic display when the electro-optic display has a color gamut with a limited palette of primary colors, and/or the gamut is poorly structured (i.e., not a spheroid or obloid). The system uses an iterative process to identify the best color for a given pixel from a palette that is modified to diffuse the color error over the entire electro-optic display. The system additionally accounts for variations in color that are caused by cross-talk between nearby pixels.

Claims

1. A system for producing a color image, comprising:

an electro-optic display having pixels and a color gamut including a palette of primaries; and

a processor in communication with the electro-optic display, the processor being configured to render color images for the electro-optic device by;

a. receiving first and second sets of input values representing colors of first and second pixels of an image to be displayed on the electro-optic display;

b. equating the first set of input values to a first modified set of input values;

c. projecting the first modified set of input value on to the color gamut to produce a first projected modified set of input values when the first modified set of input values produced in step b is outside the color gamut;

d. comparing the first modified set of input values from step b or the first projected modified set of input values from step c to a set of primary values corresponding to the primaries of the palette, selecting the set of primary values corresponding to the primary with the smallest error, thereby defining a first best primary value set, and outputting the first best primary value set as the color of the first pixel;

e. replacing the first best primary value set in the palette with the first modified set of input values from step b or the first projected modified set of input values from step c to produce a modified palette;

f. calculating a difference between the first modified set of input values from step b or the first projected modified set of input values from step c and the first best primary value set from step e to derive a first error value;

g. adding to the second set of input values the first error value to create a second modified set of input values;

h. projecting the second modified set of input value on to the color gamut to produce a second projected modified set of input values when the second modified set of input values produced in step g is outside the color gamut;

i. comparing the second modified set of input values from step g or the second projected modified set of input values from step h to the set of primary values corresponding to the primaries of the modified palette, selecting the set of primary values corresponding to the primary from the modified palette with the smallest error, thereby defining a second best primary value set, and outputting the second best primary value set as the color of the second pixel.

2. The system of claim 1, wherein the processor additionally:

j. replaces the second best primary value set in the modified palette with the second modified set of input values from step g or the second projected modified set of input values from step h to produce a second modified palette.

3. The system of claim 1, wherein the projection in step c is effected along lines of constant brightness and hue in a linear RGB color space on to the nominal gamut.

4. The system of claim 1, wherein the comparison in step e is effected using a minimum Euclidean distance quantizer in a linear RGB space.

5. The system of claim 1, wherein the comparison in step f is effected using barycentric thresholding.

6. The system of claim 5, wherein the color gamut used in step h is that of the modified palette produced in step e.

7. The system of claim 1, wherein the processor is configured to render colors for a plurality of pixels, and the input values for each pixel are processed in an order corresponding to a raster scan of the pixels by the electro-optic display, and

in step e the modification of the palette allows for the set of output values corresponding to a pixel in the previously-processed row that shares an edge with the pixel corresponding to the set of input values being processed, and the previously-processed pixel in the same row which shares an edge with the pixel corresponding to the set of input values being processed.

8. The system of claim 1, wherein in step c the processor computes the intersection of the projection with the surface of the gamut, and in step d:

(i) when the output of step b is outside the gamut, the processor determines a triangle that encloses the intersection and subsequently determines the barycentric weight for each vertex of the triangle, and the output from step f is the triangle vertex having largest barycentric weight;

or

(ii) when the output of step b is within the gamut, the output from step d is the nearest primary calculated by Euclidean distance.

9. The system of claim 8, wherein the projection preserves the hue angle of the input to step c.

10. The system of claim 1, wherein in step c the processor computes the intersection of the projection with the surface of the gamut, and in step d:

(i) when the output of step b is outside the gamut, the processor;

determines a triangle that encloses the aforementioned intersection,

determines a barycentric weight for each vertex of the triangle, and

compares the barycentric weight for each vertex with the value of a blue-noise mask at the pixel location, wherein the cumulative sum of the barycentric weights exceeds the mask value at the output from step d, which is also the color of the triangle vertex;

or

(ii) when the output of step b is within the gamut, the processor;

determines that the output from step d is the nearest primary.

11. The system of claim 10, wherein the projection preserves the hue angle of the input to step c.

12. The system of claim 1, wherein in step c the processor determines the intersection of the projection with the surface of the gamut, and step d further comprises:

(i) when the output of step b is outside the gamut, the processor;

determines the triangle that encloses the intersection, and

determines the primary colors that lie on the convex hull of the gamut, wherein the output from step d is the closest primary color lying on the convex hull;

or

(ii) when the output of step b is within the gamut, the processor determines that the output from step d is the nearest primary.

13. The system of claim 12, wherein the projection preserves the hue angle of the input to step c.

14. The system of claim 1, wherein the processor additionally:

(i) identifies pixels of the display that fail to switch correctly, and identifies the colors presented by such defective pixels;

(ii) outputs from step d the color actually presented by each defective pixel; and

(iii) calculates in step f the difference between the modified or projected modified input value and the color actually presented by the defective pixel.

15. The system of claim 1, wherein the processor derives the color gamut by:

(1) receiving measured test patterns to derive information about cross-talk among adjacent primaries in neighboring pixels of the electro-optic display;

(2) converting the information from step (1) to a blooming model that predicts the displayed color of arbitrary patterns of primaries;

(3) using the blooming model derived in step (2) to predict actual display colors of patterns that would normally be used to produce colors on a convex hull of the gamut surface; and

(4) calculating a realizable gamut surface using the predictions made in step (3).

16. The system of claim 1, wherein the first and second sets of input values received in step (a) have been generated from a set of image data by, in this order, (i) a degamma operation (ii) HDR-type processing;

(iii) hue correction and (iv) gamut mapping.

17. A method for estimating an achievable gamut in a color electro-optic display, the method comprising:

(1) measuring a test pattern to derive information about cross-talk among adjacent primaries in a color electro-optic display;

(2) converting the measurements from step (1) to a blooming model that predicts the displayed color of arbitrary patterns of primaries on the color electro-optic display;

(3) predicting actual display colors of patterns that would normally be used to produce colors on the convex hull of the primaries using the blooming model derived in step (2) (i.e. the nominal gamut surface);

(4) describing the realizable gamut surface using the predictions made in step (3); and

(5) rendering a color set by mapping input (source) colors to device colors using the realizable gamut surface model derived in step (4).

18. A method of rendering a set of color image data on a color display device wherein the set of data are subjected to in this order, (i) a degamma operation (ii) HDR-type processing;

(iii) hue correction (iv) gamut mapping; and

(v) a spatial dithering operation.