Color calibration of color image rendering devices

• US 8,638,340 B2
• Filed: 05/05/2010
• Issued: 01/28/2014
• Est. Priority Date: 02/26/1996
• Status: Expired due to Fees

• Current Assignee: RAH Color Technologies LLC
• Original Assignee: RAH Color Technologies LLC
• Inventors: Holub, Richard A.
• Primary Examiner(s): NGUYEN, HAU H
• Application Number:
  US12/799,930
• Publication Number:
  US 20100289835A1
• Time in Patent Office: 1,364 Days
• Field of Search: 345589-594
• US Class Current: 345/589
• CPC Class Codes: G01J 2003/2866 Markers; Calibrating of scan
• CPC Class Codes: G01J 2003/466 Coded colour; Recognition of predetermined colour; Determining proximity to predetermined colour
• CPC Class Codes: G01J 3/02 Details
• CPC Class Codes: G01J 3/0202 Mechanical elements; Supports for optical elements
• CPC Class Codes: G01J 3/0218 using optical fibers
• CPC Class Codes: G01J 3/0262 Constructional arrangements for removing stray light
• CPC Class Codes: G01J 3/0264 Electrical interface; User interface
• CPC Class Codes: G01J 3/0272 Handheld
• CPC Class Codes: G01J 3/0289 Field-of-view determination; Aiming or pointing of a spectrometer; Adjusting alignment; Encoding angular position; Size of measurement area; Position tracking
• CPC Class Codes: G01J 3/0291 Housings; Spectrometer accessories; Spatial arrangement of elements, e.g. folded path arrangements
• CPC Class Codes: G01J 3/18 using diffraction elements, e.g. grating gratings per se G02B
• CPC Class Codes: G01J 3/28 Investigating the spectrum using colour filters G01J3/51
• CPC Class Codes: G01J 3/462 Computing operations in or between colour spaces; Colour management systems
• CPC Class Codes: G01J 3/463 Colour matching
• CPC Class Codes: G01J 3/50 using electric radiation detectors
• CPC Class Codes: G01J 3/506 measuring the colour produced by screens, monitors, displays or CRTs
• CPC Class Codes: G01N 21/274 Calibration, base line adjustment, drift correction
• CPC Class Codes: G03B 27/547 colour mixing heads
• CPC Class Codes: G06T 2207/10024 Color image
• CPC Class Codes: G06T 2207/20072 Graph-based image processing
• CPC Class Codes: G06T 7/80 : Analysis of captured images to determine intrinsic or extrinsic camera parameters, i.e. camera calibration
• CPC Class Codes: G06T 7/90 : Determination of colour characteristics
• CPC Class Codes: G09G 2320/0285 : using tables for spatial correction of display data
• CPC Class Codes: G09G 2320/0626 : for control of overall brightness
• CPC Class Codes: G09G 2320/0666 : for control of colour parameters, e.g. colour temperature
• CPC Class Codes: G09G 2320/0693 : Calibration of display systems
• CPC Class Codes: G09G 2330/021 : Power management, e.g. power saving
• CPC Class Codes: G09G 2360/144 : the light being ambient light
• CPC Class Codes: G09G 2360/147 : the originated light output being determined for each pixel
• CPC Class Codes: G09G 3/3413 : Details of control of colour illumination sources
• CPC Class Codes: G09G 5/02 : characterised by the way in which colour is displayed details of colour display specific for CRTs G09G1/28; specific for flat matrix panels other than liquid crystal displays G09G3/2003; specific for liquid crystal displays G09G3/3607
• CPC Class Codes: H04N 1/6033 : using test pattern analysis H04N1/6055 takes precedence
• CPC Class Codes: H04N 1/6052 : Matching two or more picture signal generators or two or more picture reproducers
• CPC Class Codes: H04N 17/02 : for colour television signals
• CPC Class Codes: H04N 17/045 : Self-contained testing apparatus
• CPC Class Codes: H04N 23/13 : with multiple sensors
• CPC Class Codes: H04N 23/88 : for colour balance, e.g. white-balance circuits or colour temperature control
• CPC Class Codes: H04N 9/12 : Picture reproducers H04N9/11 takes precedence
• CPC Class Codes: H04N 9/3182 : Colour adjustment, e.g. white balance, shading or gamut white balance per se H04N9/73; control of amplitude of colour signals H04N9/68; colour control circuits for displays in general G09G5/02, G09G3/2003, G09G3/3607
• CPC Class Codes: H04N 9/3194 : including sensor feedback
• CPC Class Codes: H04N 9/68 : for controlling the amplitude of colour signals, e.g. automatic chroma control circuits H04N9/71, H04N9/73 take precedence; camera processing pipelines for controlling the colour saturation of colour signals H04N23/86
• CPC Class Codes: H04N 9/73 : Colour balance circuits, e.g. white balance circuits or colour temperature control camera processing pipelines for colour balance H04N23/88

Abstract

Color calibration of color image rendering devices, such as large color displays, which operate by either projection or emission of images, utilize internal color measurement instrument or external color measurement modules locatable on a wall or speaker. A dual use camera is provided for a portable or laptop computer, or a cellular phone, handset, personal digital assistant or other handheld device with a digital camera, in which one of the camera or a display is movable with respect to the other to enable the camera in a first mode to capture images of the display for enabling calibration of the display, and in a second mode for capturing image other than of the display. The displays may represent rendering devices for enabling virtual proofing in a network, or may be part of stand-alone systems and apparatuses for color calibration. Improved calibration is also provided for sensing and correcting for non-uniformities of rendering devices, such as color displays, printer, presses, or other color image rendering device.

Claims

1. An apparatus for correcting errors of color reproduction due to non-uniform rendering upon a surface by an output device having a plurality of color channels, said apparatus comprising:

optics for forming an image of said surface;

an array sensor for converting said image into electrical signals, wherein said electrical signals are useable to produce digital image data that are corrected for spatial non-uniformity of image capture by said optics and said array sensor; and

a controller, or a plurality of processors operating in conjunction, which produces information from said digital image data from said electrical signals of said array sensor enabling said controller or said plurality of processors operating in conjunction to detect non-uniform rendering of brightness or color along said surface and to determine spatial correction functions for said color channels which enable rendering with uniformity of brightness and color along said surface in accordance with said information from said digital image data, wherein said apparatus is calibrated to enable colorimetric capture of said image of said surface, and said spatial correction functions are determined responsive to effects of interactions between color channels in said device on rendering brightness and color across said surface.

2. The apparatus according to claim 1 wherein said controller, or said plurality of processors operating in conjunction, executes one or more programs to determine said spatial correction functions by iterative adjustment of brightness and color to be rendered upon said surface.

3. The apparatus according to claim 2 wherein said one or more programs store said spatial correction functions in memory as tables whose inputs are spatial coordinates on said surface and whose outputs are useable to correct rendering through each color channel for improved uniformity, wherein said one or more programs are capable of storing output values in said tables that express a varying balance between said color channels at different spatial coordinates on said surface.

4. The apparatus according to claim 1 wherein said controller, or said plurality of processors operating in conjunction, executes one or more programs to determine said spatial correction functions by searching for at least one combination of brightness and color that is realizable across said surface.

5. The apparatus according to claim 4 wherein said one or more programs store said spatial correction functions in memory as tables whose inputs are spatial coordinates on said surface and whose outputs are useable to correct rendering through each color channel for improved uniformity, wherein said one or more programs are capable of storing output values in said tables that express a varying balance between said color channels at different spatial coordinates on said surface.

6. The apparatus according to claim 1 wherein said optics and said array sensor further comprise spectral imaging capability in which the spectral composition of light is detected for an array of points across said surface.

7. The apparatus according to claim 6 wherein said optics further comprise concentric optics and said sensor array is a two-dimensional area array upon which one axis represents a line upon said surface and the other represents a sampled spectrum of light from each point on said line, wherein said spectral imaging capability is realized by one of moving said surface with respect to at least part of said apparatus or moving at least the image capture portions of said apparatus with respect to said surface.

8. A method for improving color rendering comprising the steps of:

rendering by an output device having a plurality of color channels one or more digital images defined to be spatially uniform in brightness and color on a surface;

detecting non-uniformity in brightness or color between a plurality of regions on said one or more images rendered on said surface with the aid of an image capture device, wherein said image capture device is calibrated to provide approximately colorimetric data and to enable compensation for spatial non-uniformity of image capture by said image capture device; and

determining correction values corresponding to each of said regions in accordance with said detected non-uniformity, responsive to effects of interactions between color channels in said output device on rendering brightness and color across said surface, wherein said correction values are usable for compensating the effects of spatial non-uniformities of rendering to enable more accurate color image reproduction.

9. The method according to claim 8 further comprising the step of:

preparing, for each color channel, one or more tables whose inputs are at least two spatial coordinates and whose output at each spatial coordinate is a correction value, wherein outputs of a set of tables representing each of the color channels are capable of expressing a varying balance between said color channels at different spatial coordinates on said surface.

10. The method according to claim 9 wherein said preparing step employs one or more programs to determine said correction values by iterative adjustment of brightness and color to be rendered upon said surface.

11. The method according to claim 9 wherein said each of said regions comprise a plurality of pixels of digital image data and said correction values are applied with the aid of a spatial interpolation function.

12. The method according to claim 9 further comprising the step of:

storing said one or more tables for modifying image data in said output device for use by a controller in said output device.

13. The method according to claim 8 further comprising the steps of:

reproducing a digitally stored color image responsive to said correction values;

digitizing the rendered image from said reproducing step with the aid of said image capture device; and

cross-correlating three-dimensional color histograms of said digitally stored color image and the captured image from said digitizing step to compute color errors due to factors other than spatial non-uniformity of said output device.

14. The method according to claim 8 further comprising the steps of:

storing information related to said digital images in a database along with associated data of spatial errors of rendering of said digital images;

developing a model of device performance with respect to spatial dependencies of rendering based in part upon said information and said associated data; and

using said model of device performance to improve accuracy of color reproduction of images by said output device and of proofing of said color reproduction by one or more other output devices.

15. A color rendering device comprising:

a plurality of color channels employed in rendering upon a surface in which errors in reproduction of brightness and color are due partly to spatial non-uniformity in the balance between said color channels in rendering a spatially uniform digital image; and

a controller which drives each of said color channels in accordance with a color mixing transformation and which corrects said errors in reproduction of brightness and color that are due to said spatial non-uniformity of rendering responsive to one or more spatial non-uniformity correction tables for each of said color channels, wherein said one or more spatial non-uniformity correction tables are prepared with the aid of an image capture device that is calibrated for approximately colorimetric and uniform spatial response and that is used to measure rendered output of said device.

16. The output device according to claim 15 wherein said one or more spatial non-uniformity correction tables represent one or more spatial non-uniformity correction functions.

17. The output device according to claim 15 wherein said controller comprises electronics within said device.

18. The output device according to claim 17 wherein said controller corrects said rendering to be uniform in brightness and color within a tolerance across said display surface.

19. The output device according to claim 16 wherein said correction functions are produced by iteratively adjusting the brightness and color for spatial uniformity across the rendering surface within a tolerance.

20. The output device according to claim 15 wherein at least one of said one or more spatial non-uniformity correction tables for each of said color channels represents a two dimensional array whose inputs correspond to spatial coordinates upon said surface and whose output at each spatial coordinate is a correction value for the color channel.

21. The output device according to claim 20 wherein said one or more spatial non-uniformity correction tables for each of said color channels comprise a plurality of tables each associated with a different level of activity in each of said color channels.

22. The output device according to claim 20 wherein said one or more spatial non-uniformity correction tables comprise a plurality of tables corresponding to different white points.

23. The output device according to claim 20 wherein said one or more spatial non-uniformity correction tables comprise a plurality of tables corresponding to different ambient conditions.