Color calibration of color image rendering devices

• US 10,560,676 B2
• Filed: 07/29/2018
• Issued: 02/11/2020
• Est. Priority Date: 08/31/2005
• Status: Active Grant

• Current Assignee: RAH Color Technologies LLC
• Original Assignee: RAH Color Technologies LLC
• Inventors: Holub, Richard A.
• Primary Examiner(s): Daniels, Anthony J
• Application Number:
  US16/048,295
• Publication Number:
  US 20180367773A1
• Time in Patent Office: 562 Days
• Field of Search: 348 1401- 1406, 34833301-33306
• CPC Class Codes: G01J 2003/2866 Markers; Calibrating of scan
• CPC Class Codes: G01J 2003/466 Coded colour; Recognition of predetermined colour; Determining proximity to predetermined colour
• CPC Class Codes: G01J 3/02 Details
• CPC Class Codes: G01J 3/0202 Mechanical elements; Supports for optical elements
• CPC Class Codes: G01J 3/0218 using optical fibers
• CPC Class Codes: G01J 3/0262 Constructional arrangements for removing stray light
• CPC Class Codes: G01J 3/0264 Electrical interface; User interface
• CPC Class Codes: G01J 3/0272 Handheld
• CPC Class Codes: G01J 3/0289 Field-of-view determination; Aiming or pointing of a spectrometer; Adjusting alignment; Encoding angular position; Size of measurement area; Position tracking
• CPC Class Codes: G01J 3/0291 Housings; Spectrometer accessories; Spatial arrangement of elements, e.g. folded path arrangements
• CPC Class Codes: G01J 3/18 using diffraction elements, e.g. grating gratings per se G02B
• CPC Class Codes: G01J 3/28 Investigating the spectrum using colour filters G01J3/51
• CPC Class Codes: G01J 3/462 Computing operations in or between colour spaces; Colour management systems
• CPC Class Codes: G01J 3/463 Colour matching
• CPC Class Codes: G01J 3/50 using electric radiation detectors
• CPC Class Codes: G01J 3/506 measuring the colour produced by screens, monitors, displays or CRTs
• CPC Class Codes: G01N 21/274 Calibration, base line adjustment, drift correction
• CPC Class Codes: G03B 27/547 colour mixing heads
• CPC Class Codes: G06T 2207/10024 Color image
• CPC Class Codes: G06T 2207/20072 Graph-based image processing
• CPC Class Codes: G06T 7/80 : Analysis of captured images to determine intrinsic or extrinsic camera parameters, i.e. camera calibration
• CPC Class Codes: G06T 7/90 : Determination of colour characteristics
• CPC Class Codes: G09G 2320/0285 : using tables for spatial correction of display data
• CPC Class Codes: G09G 2320/0626 : for control of overall brightness
• CPC Class Codes: G09G 2320/0666 : for control of colour parameters, e.g. colour temperature
• CPC Class Codes: G09G 2320/0693 : Calibration of display systems
• CPC Class Codes: G09G 2330/021 : Power management, e.g. power saving
• CPC Class Codes: G09G 2360/144 : the light being ambient light
• CPC Class Codes: G09G 2360/147 : the originated light output being determined for each pixel
• CPC Class Codes: G09G 3/3413 : Details of control of colour illumination sources
• CPC Class Codes: G09G 5/02 : characterised by the way in which colour is displayed details of colour display specific for CRTs G09G1/28; specific for flat matrix panels other than liquid crystal displays G09G3/2003; specific for liquid crystal displays G09G3/3607
• CPC Class Codes: H04N 1/6033 : using test pattern analysis H04N1/6055 takes precedence
• CPC Class Codes: H04N 1/6052 : Matching two or more picture signal generators or two or more picture reproducers
• CPC Class Codes: H04N 17/02 : for colour television signals
• CPC Class Codes: H04N 17/045 : Self-contained testing apparatus
• CPC Class Codes: H04N 23/13 : with multiple sensors
• CPC Class Codes: H04N 23/88 : for colour balance, e.g. white-balance circuits or colour temperature control
• CPC Class Codes: H04N 9/12 : Picture reproducers H04N9/11 takes precedence
• CPC Class Codes: H04N 9/3182 : Colour adjustment, e.g. white balance, shading or gamut white balance per se H04N9/73; control of amplitude of colour signals H04N9/68; colour control circuits for displays in general G09G5/02, G09G3/2003, G09G3/3607
• CPC Class Codes: H04N 9/3194 : including sensor feedback
• CPC Class Codes: H04N 9/68 : for controlling the amplitude of colour signals, e.g. automatic chroma control circuits H04N9/71, H04N9/73 take precedence; camera processing pipelines for controlling the colour saturation of colour signals H04N23/86
• CPC Class Codes: H04N 9/73 : Colour balance circuits, e.g. white balance circuits or colour temperature control camera processing pipelines for colour balance H04N23/88

Abstract

Color calibration of color image rendering devices, such as large color displays, which operate by either projection or emission of images, utilize internal color measurement instrument or external color measurement modules locatable on a wall or speaker. A dual use camera is provided for a portable or laptop computer, or a cellular phone, handset, personal digital assistant or other handheld device with a digital camera, in which one of the camera or a display is movable with respect to the other to enable the camera in a first mode to capture images of the display for enabling calibration of the display, and in a second mode for capturing image other than of the display. The displays may represent rendering devices for enabling virtual proofing in a network, or may be part of stand-alone systems and apparatuses for color calibration. Improved calibration is also provided for sensing and correcting for non-uniformities of rendering devices, such as color displays, printer, presses, or other color image rendering device.

Claims

1. A conferencing system comprising:

a computer server;

one or more first sites each having a rendering device with a color display and being associated with a programmable computer system, in which said rendering device comprises;

at least one camera;

one or more speakers;

a network interface enabling access to said computer server; and

one or more programs that operate the computer system associated with the rendering device and enable a user to assemble data communicated from said computer server upon said color display of the rendering device, said data comprising one or more of graphics, images, text, and numerical data that are a subject of an interactive conference along with annotations associated with said data by one or more users participating in said conference;

one or more second sites each having a hand-held device comprising;

a programmable computer system;

a plurality of sensors linked to said computer system of the hand-held device, wherein one or more of said sensors comprise a camera enabling capture of images, in which said images captured represent different fields of view;

a color display operable by said computer system of the hand-held device to present menus of a user interface, to display one or more of said images captured, and to display at least part of said data accessible from said computer server in said conference with at least said one or more of said first sites, wherein when a user faces a screen of the color display of the hand-held device said different fields of view comprise at least a first one of said fields of view directed to the user and a second one of said fields of view directed away from the user;

one or more microphones and one or more speakers enabling audio input and output;

a transmitter and receiver for enabling cellular telephony; and

one or more programs that operate the computer system of the hand-held device and enable at least communication with said computer server using one or more network protocols; and

said computer server having one or more programs for storing said data, and information of location or identity of said first and second sites, and enabling communication with the computer system at each of said one or more first sites, and the computer system at each of said one or more second sites.

2. The conferencing system according to claim 1 wherein said rendering device utilizes said hand-held device at one of said one or more second sites as a peripheral device.

3. The conferencing system according to claim 1 wherein said one or more programs that operate the computer system of said hand-held device further enable communication with said computer server to transmit one or more images comprising said first one or said second one of said fields of view to one or more other users in said conference.

4. The conferencing system according to claim 1 wherein at least said images or said graphics of said data displayed on the displays of said first and said second sites are stored in calibrated RGB coordinates, and said one or more programs operable at one or more of said computer system of said rendering device and said computer system of said hand-held device further comprise one or more programs utilizing one or more calibrated color transformations to convert said data stored in said calibrated RGB coordinates to digital codes for the color display of said rendering device or said hand-held device, respectively.

5. The conferencing system according to claim 1 wherein said one or more programs that operate said computer server or said computer system of at least said hand-held device further enable voice and speech recognition and spoken instructions by said hand-held device to a user for performing a task.

6. The conferencing system according to claim 1 wherein said one or more programs that operate said computer server or said computer system of at least said hand-held device further enable computer generation of spoken assistance to a user, including a least conversion of documentary information into audible instructions.

7. The conferencing system according to claim 1 wherein said one or more programs that operate at one or more of said computer system of said rendering device, said computer server, and said computer system of said hand-held device detect features in spatial patterns displayed in images on the color display of said rendering device or said hand-held device, respectively, and compares said features to stored geometric shapes.

8. The conferencing system according to claim 1 wherein said one or more programs that operate said computer system of the rendering device further enable a virtual pencil used with the color display of the rendering device to associate said annotations with elements of said displayed data, wherein said annotations are shared with other sites interactively.

9. The conferencing system according to claim 1 wherein the data assembled has results of processing at least said graphics and said images that are the subject of the interactive conference along with said annotations associated with said data, and at least said graphics are displayed on at least the color display of said rendering device as an a separable overlay upon one of the images of the data image.

10. A non-transitory, computer-readable medium encoding software executable by one or more computers for conferencing, said software comprising:

one or more programs operable on a first computer system at each of one or more first sites, said first computer system being associated with a rendering device having a color display, said one or more programs operable on said first computer enable a user to assemble data communicated from a computer server upon said color display, and utilize at least one camera, one or more speakers, and a network interface, which are associated with the rendering device, wherein said network interface enables access to said computer server, and said data comprises one or more of graphics, images, text, and numerical data that are a subject of an interactive conference along with annotations associated with said data by one or more users participating in said conference;

one or more programs operable on a second computer system of a hand-held device at each of one or more second sites, in which said hand-held device comprises a plurality of sensors, a color display, one or more microphones, one or more speakers enabling audio input and output, and a transmitter and receiver for enabling cellular telephony, said one or more programs operable on said second computer system utilize one or more of said plurality of sensors which comprise a camera for capturing images, in which said images captured represent different fields of view, wherein when a user faces a screen of the color display of the hand-held device said different fields of view comprise at least a first one of said fields of view directed to the user and a second one of said fields of view directed away from the user, and utilize said color display of the hand-held device for presenting menus of a user interface, displaying one or more of said images captured, and displaying at least part of said data accessible from said computer server in said conference with at least said one or more of said first sites, wherein said one or more programs operable on said second computer system further enable communication with the computer server using one or more network protocols; and

one or more programs operable on said computer server storing said data and information of location or identity of said first and second sites, and for enabling communication with said first computer system at each of said one or more first sites, and said second computer system at each of said one or more second sites.

11. The non-transitory, computer-readable medium according to claim 10 wherein said one or more programs operable on said first computer system utilize said hand-held device at one of said one or more second sites as a peripheral device.

12. The non-transitory, computer-readable medium according to claim 10 wherein said one or more programs operable on said second computer system further enable communication with said computer server to transmit one or more images comprising said first one or said second one of said fields of view to one or more other users in said conference.

13. The non-transitory, computer-readable medium according to claim 10 wherein at least said images or said graphics of said data displayed on the displays of said first and said second sites are stored in calibrated RGB coordinates, and said one or more programs operable at one or more of said first and second computer systems further comprise one or more programs utilizing one or more calibrated color transformations to convert said data stored in said calibrated RGB coordinates to digital codes for the color display of said rendering device or said hand-held device, respectively.

14. The non-transitory, computer-readable medium according to claim 10 wherein said one or more programs operable on said computer server or at least said second computer system further enable voice and speech recognition and spoken instructions by said hand-held device to a user for performing a task.

15. The non-transitory, computer-readable medium according to claim 10 wherein said one or more programs operable on said computer server or at least said second computer system further enable computer generation of spoken assistance to a user, including a least conversion of documentary information into audible instructions.

16. The non-transitory, computer-readable medium according to claim 10 wherein said one or more programs operable at one or more of said computer server and said first and second computer systems detect features in spatial patterns displayed in images on the color display of said rendering device or said hand-held device, respectively, and compares said features to stored geometric shapes.

17. The non-transitory, computer-readable medium according to claim 10 wherein said one or more programs that operate said first computer system further enable a virtual pencil used with the color display of the rendering device to associate said annotations with elements of said displayed data, wherein said annotations are shared with other sites interactively.

18. The non-transitory, computer-readable medium according to claim 10 wherein the data assembled has results of processing at least said graphics and said images that are the subject of the interactive conference along with said annotations associated with said data, and at least said graphics are displayed on at least the color display of said rendering device as an a separable overlay upon one of the images of the data image.