Color calibration of color image rendering devices

• US 9,516,288 B2
• Filed: 11/05/2015
• Issued: 12/06/2016
• Est. Priority Date: 08/31/2005
• Status: Active Grant

• Current Assignee: RAH Color Technologies LLC
• Original Assignee: RAH Color Technologies LLC
• Inventors: Holub, Richard A.
• Primary Examiner(s): NGUYEN, HAU H
• Application Number:
  US14/933,781
• Publication Number:
  US 20160057399A1
• Time in Patent Office: 397 Days
• US Class Current: 1/1
• CPC Class Codes: G01J 2003/2866 Markers; Calibrating of scan
• CPC Class Codes: G01J 2003/466 Coded colour; Recognition of predetermined colour; Determining proximity to predetermined colour
• CPC Class Codes: G01J 3/02 Details
• CPC Class Codes: G01J 3/0202 Mechanical elements; Supports for optical elements
• CPC Class Codes: G01J 3/0218 using optical fibers
• CPC Class Codes: G01J 3/0262 Constructional arrangements for removing stray light
• CPC Class Codes: G01J 3/0264 Electrical interface; User interface
• CPC Class Codes: G01J 3/0272 Handheld
• CPC Class Codes: G01J 3/0289 Field-of-view determination; Aiming or pointing of a spectrometer; Adjusting alignment; Encoding angular position; Size of measurement area; Position tracking
• CPC Class Codes: G01J 3/0291 Housings; Spectrometer accessories; Spatial arrangement of elements, e.g. folded path arrangements
• CPC Class Codes: G01J 3/18 using diffraction elements, e.g. grating gratings per se G02B
• CPC Class Codes: G01J 3/28 Investigating the spectrum using colour filters G01J3/51
• CPC Class Codes: G01J 3/462 Computing operations in or between colour spaces; Colour management systems
• CPC Class Codes: G01J 3/463 Colour matching
• CPC Class Codes: G01J 3/50 using electric radiation detectors
• CPC Class Codes: G01J 3/506 measuring the colour produced by screens, monitors, displays or CRTs
• CPC Class Codes: G01N 21/274 Calibration, base line adjustment, drift correction
• CPC Class Codes: G03B 27/547 colour mixing heads
• CPC Class Codes: G06T 2207/10024 Color image
• CPC Class Codes: G06T 2207/20072 Graph-based image processing
• CPC Class Codes: G06T 7/80 : Analysis of captured images to determine intrinsic or extrinsic camera parameters, i.e. camera calibration
• CPC Class Codes: G06T 7/90 : Determination of colour characteristics
• CPC Class Codes: G09G 2320/0285 : using tables for spatial correction of display data
• CPC Class Codes: G09G 2320/0626 : for control of overall brightness
• CPC Class Codes: G09G 2320/0666 : for control of colour parameters, e.g. colour temperature
• CPC Class Codes: G09G 2320/0693 : Calibration of display systems
• CPC Class Codes: G09G 2330/021 : Power management, e.g. power saving
• CPC Class Codes: G09G 2360/144 : the light being ambient light
• CPC Class Codes: G09G 2360/147 : the originated light output being determined for each pixel
• CPC Class Codes: G09G 3/3413 : Details of control of colour illumination sources
• CPC Class Codes: G09G 5/02 : characterised by the way in which colour is displayed details of colour display specific for CRTs G09G1/28; specific for flat matrix panels other than liquid crystal displays G09G3/2003; specific for liquid crystal displays G09G3/3607
• CPC Class Codes: H04N 1/6033 : using test pattern analysis H04N1/6055 takes precedence
• CPC Class Codes: H04N 1/6052 : Matching two or more picture signal generators or two or more picture reproducers
• CPC Class Codes: H04N 17/02 : for colour television signals
• CPC Class Codes: H04N 17/045 : Self-contained testing apparatus
• CPC Class Codes: H04N 23/13 : with multiple sensors
• CPC Class Codes: H04N 23/88 : for colour balance, e.g. white-balance circuits or colour temperature control
• CPC Class Codes: H04N 9/12 : Picture reproducers H04N9/11 takes precedence
• CPC Class Codes: H04N 9/3182 : Colour adjustment, e.g. white balance, shading or gamut white balance per se H04N9/73; control of amplitude of colour signals H04N9/68; colour control circuits for displays in general G09G5/02, G09G3/2003, G09G3/3607
• CPC Class Codes: H04N 9/3194 : including sensor feedback
• CPC Class Codes: H04N 9/68 : for controlling the amplitude of colour signals, e.g. automatic chroma control circuits H04N9/71, H04N9/73 take precedence; camera processing pipelines for controlling the colour saturation of colour signals H04N23/86
• CPC Class Codes: H04N 9/73 : Colour balance circuits, e.g. white balance circuits or colour temperature control camera processing pipelines for colour balance H04N23/88

Abstract

Color calibration of color image rendering devices, such as large color displays, which operate by either projection or emission of images, utilize internal color measurement instrument or external color measurement modules locatable on a wall or speaker. A dual use camera is provided for a portable or laptop computer, or a cellular phone, handset, personal digital assistant or other handheld device with a digital camera, in which one of the camera or a display is movable with respect to the other to enable the camera in a first mode to capture images of the display for enabling calibration of the display, and in a second mode for capturing image other than of the display. The displays may represent rendering devices for enabling virtual proofing in a network, or may be part of stand-alone systems and apparatuses for color calibration. Improved calibration is also provided for sensing and correcting for non-uniformities of rendering devices, such as color displays, printer, presses, or other color image rendering device.

Claims

1. A hand-held multifunctional digital apparatus comprising:

a controller comprising at least one programmable processor;

a plurality of sensors, wherein one or more of said sensors comprise a camera enabling capture of images and video streams of said images in a plurality of color channels, said images captured by said one or more sensors represent different fields of view;

memory for storing control programs for operating said apparatus and enabling a user interface, application programs for providing multifunctional capability, at least location information, and images and audio data in digital form;

a color display having a screen, said color display being operable to present menus of said user interface, to provide a viewfinder for displaying one or more of said images, and to display one or more of text and graphics associated with execution of one or more of said application programs, wherein when a user faces said screen said different fields of view comprise at least a first field of view directed to the user and a second field of view directed away from the user;

an audio unit comprising one or more speakers and one or more microphones, said audio unit enabling the user to operate at least one of said application programs by speaking to the apparatus, wherein the apparatus confirms said operation by at least speaking to the user;

a transmitter a receiver for enabling, via an antenna, one or more of cellular telephony, or communication with an external system using one or more network protocols;

a connector for interfacing said apparatus with an external device;

software comprising at least;

an operating program that controls the functions of said apparatus responsive, in part, to inputs through the user interface;

one or more programs providing said user interface that renders on said color display graphic representations of functions for user selection and that employs speech recognition and computer generated speech to implement spoken interaction between the user and said apparatus using said audio unit, said apparatus assists the user in performing a task by guiding user performance through spoken directions by the apparatus; and

one or more programs for converting at least one of said images in a plurality of color channels into digital image data and for storing said digital image data in a file having a header and tags identifying fields of data that enable a receiver of said file to process said digital image data.

2. The apparatus according to claim 1 wherein said location information comprises at least GPS coordinates.

3. The apparatus according to claim 1 wherein said color display comprises an array of pixels that are not visually resolvable without the aid of a magnifier.

4. The apparatus according to claim 3 wherein said color display is operable in a first mode in which said pixels of said array are processed to reduce effective display resolution, and a second mode in which a magnifier comprising at least one lens enables rendering of higher resolution information in an enlarged format.

5. The apparatus according to claim 1 wherein said operating program controls said apparatus responsive to a comparison of features comprising one or more of lines or shapes detected in spatially or temporally varying patterns sensed by said apparatus to like features of a stored reference.

6. The apparatus according to claim 1 wherein said software further comprises a program that applies a correction for spatial non-uniformity of brightness and color across the surface of said color display.

7. The apparatus according to claim 6 wherein said program that applies a correction for spatial non-uniformity of rendering utilizes one or more spatial non-uniformity correction tables, wherein a single said table comprises a two-dimensional array whose inputs are spatial coordinates upon the surface of said color display and whose output for each input is a correction value for at least one color channel.

8. The apparatus according to claim 7 wherein said spatial non-uniformity correction tables are prepared with the aid of an image capture device that is calibrated for approximately colorimetric and uniform spatial response and that is used to measure the surface of said color display.

9. The apparatus according to claim 1 wherein said software further comprises one or more programs that alter rendering upon said color display, responsive to a measurement of ambient illumination by one of said plurality of sensors, in accord with user preferences expressed through said user interface.

10. The apparatus according to claim 1 wherein said one or more programs for converting said at least one of said images in a plurality of color channels into digital image data provide said digital image data in accordance with one or more color transformations that map colors of said at least one of said images to coordinates of a color space having a defined relationship to CIE colorimetric values and that compensate at least for differences between the illuminant of image capture and that for viewing of a rendering of said digital image data.

11. The apparatus according to claim 10 further comprising a program that transforms said digital image data for increased saturation of one or more colors in rendering upon an output device capable of rendering colors that are not representable in said color space having a defined relationship to CIE colorimetric values.

12. The apparatus according to claim 10 wherein said software further comprises one or more programs that enable the user to modify variables of color reproduction of said digital image data interactively through menu selections and to observe the results of said selections on display of said digital image data on said color display.

13. The apparatus according to claim 1 wherein said apparatus assists the user in performing said task by utilizing one or more measurements based upon at least said digital image data.

14. The apparatus according to claim 13 wherein said software further comprises a program that provides indications of progress in performing said task while comparing features of said digital image data with digital information of a reference image.

15. The apparatus according to claim 14 wherein said software further comprises a program that communicates with an external computer that provides one or both of data or computation to assist in said guiding of user performance.

16. The apparatus according to claim 1 wherein at least one of said one or more sensors comprising a camera is operable in a free run mode as the user is guided in said task performance by viewing a video stream of images captured by said camera on said color display.

17. The apparatus according to claim 1 wherein said software further comprises a program that operates at least one of said one or more sensors comprising a camera to enable a video conference with another system in which images of at least one conversant are displayed on said color display.

18. The apparatus according to claim 17 wherein said program that enables a video conference is operable to display common data to the user and said at least one conversant in said video conference, and said common data comprises at least one of a textual selection from a document, and numerical data from a spreadsheet.

19. The apparatus according to claim 1 wherein said software further comprises a program that communicates with an external computer that provides one or both of data or computation to assist in said guiding of user performance.

20. The apparatus according to claim 1 wherein said apparatus assists the user in performing said task by utilizing one or more measurements and guiding the user performance through spoken directions by the apparatus responsive, in part, to values of said one or more measurements.

21. The apparatus according to claim 1 further comprising one or more sources of light that are useable for one or both of providing illumination for image capture or enabling autofocus by said one or more of said sensors comprising a camera.

22. The apparatus according to claim 21 wherein one of said one or more sources comprises a laser diode, said apparatus further comprising a program that employs light of said laser diode to identify a point of focus within a field of view of said camera.

23. The apparatus according to claim 21 wherein one of said one or more sources comprises a laser, said laser providing a pointer to assist the user interacting with said apparatus.

24. A hand-held multifunctional digital apparatus comprising:

a controller comprising at least one programmable processor;

a plurality of sensors, wherein one or more of said sensors comprise a camera enabling capture of images and video streams of said images in a plurality of color channels, said images captured by said one or more sensors represent different fields of view;

memory for storing control programs for operating said apparatus and enabling a user interface, application programs for providing multifunctional capability, at least location information, and images and audio data in digital form;

a color display having a screen, said color display being operable to present menus of said user interface, to provide a viewfinder for displaying one or more of said images, and to display one or more of text and graphics associated with execution of one or more of said application programs, wherein when a user faces said screen said different fields of view comprise at least a first field of view directed to the user and a second field of view directed away from the user;

an audio unit comprising one or more speakers and one or more microphones, said audio unit enabling the user to operate at least one of said application programs by speaking to the apparatus, wherein the apparatus confirms said operation by at least speaking to the user;

a transmitter and a receiver for enabling communication with an external system using one or more network protocols;

a connector for interfacing said apparatus with an external device;

software comprising at least;

an operating program that controls the functions of said apparatus responsive, in part, to inputs through the user interface;

one or more programs providing said user interface that renders on said color display graphic representations of functions for user selection and that employs speech recognition and computer generated speech to implement spoken interaction between the user and said apparatus using said audio unit;

one or more programs for converting at least one of said images in a plurality of color channels into digital image data and for storing said digital image data in a file having a header and tags identifying fields of data that enable a receiver of said file to process said digital image data; and

one or more programs that operates said camera to enable a video conference with a conversant at another system and to display common data to the user and said conversant at said another system in which said common data comprises at least one of a textual selection from a document, and numerical data from a spreadsheet.

25. The apparatus according to claim 24 wherein said one or more programs for converting said at least one of said images in a plurality of color channels into digital image data provide said digital image data in accordance one or more color transformations that map colors of said at least one of said images to coordinates of a color space having a defined relationship to CIE colorimetric values and that compensate at least for differences between the illuminant of image capture and that for viewing of a rendering of said digital image data, wherein said software further comprises one or more programs that enable the user to modify variables of color reproduction of said digital image data interactively through menu selections and to observe the results of said selections on display of said digital image data on said color display.

26. The apparatus according to claim 24 wherein said software further comprises a program that communicates with an external computer that provides one or both of data or computation to assist in providing spoken responses to the user.

27. The apparatus according to claim 24 wherein said software further comprises one or more programs that alter rendering upon said color display, responsive to a measurement of a level of ambient illumination by one of said plurality of sensors, in accord with user preferences expressed through said user interface.

28. The apparatus according to claim 24 wherein said operating program controls said apparatus responsive to a comparison of features comprising one or more of lines or shapes detected in spatially or temporally varying patterns sensed by said apparatus to like features of a stored reference.

29. The apparatus according to claim 28 wherein one of said plurality of sensors records information in an infrared spectral region of light, said apparatus further comprising a virtual pencil useable to annotate documents for communication to one or more sites.