Strategy for pictorial digital image processing

• US 6,249,315 B1
• Filed: 03/24/1997
• Issued: 06/19/2001
• Est. Priority Date: 03/24/1997
• Status: Expired due to Term

• Current Assignee: RPX Corporation
• Original Assignee: Hewlett-Packard Company (HP Inc.)
• Inventors: Holm, Jack M.
• Primary Examiner(s): Au, Amelia
• Assistant Examiner(s): AHMED, SAMIR ANWAR
• Application Number:
  US08/822,053
• Time in Patent Office: 1,548 Days
• Field of Search: 382/167, 382/169, 382/298, 382/274, 382/275, 345/147, 358/455, 358/461, 348/251, 348/243
• US Class Current: 348/251
• CPC Class Codes: H04N 1/4072 dependent on the contents of the original
• CPC Class Codes: H04N 1/6027 Correction or control of colour gradation or colour contrast H04N1/6058 takes precedence
• CPC Class Codes: H04N 1/603 controlled by characteristics of the picture signal generator or the picture reproducer
• CPC Class Codes: H04N 1/6088 by viewing conditions, i.e. conditions at picture output
• CPC Class Codes: H04N 23/88 for colour balance, e.g. white-balance circuits or colour temperature control
• CPC Class Codes: H04N 9/64 Circuits for processing colour signals H04N9/77 takes precedence; camera processing pipelines for processing colour signals H04N23/84
• CPC Class Codes: H04N 9/69 for modifying the colour signals by gamma correction controlling camera response for colour signals H04N23/83

Abstract

Image-dependent tone and color reproduction processing of digital images is accomplished by creating a spatially blurred and sub-sampled version of the original image, and applying knowledge of the capture device physical characteristics to obtain statistics related to the scene or original captured. The statistics are used for image-dependent linearization of the captured image data based on an OECF model, and in conjunction with information about the output medium, to calculate image-specific preferred tone reproduction curves based on a preferred reproduction model. These curves may be applied to the red, green, and blue channels of RGB-type images to produce preferred tone and color reproduction, or to the luminance channel of luminance-chrominance type images to produce preferred tone reproduction. Alternately, the linearized image data may be reproduced directly. Also, if the original is assumed to already possess preferred reproduction, the preferred reproduction model may be used to undo the preferred reproduction on the original. The image data can then be processed for reproduction on output media with different density ranges and color gamuts. All the processing described can be accomplished automatically, but the access to accurate scene information afforded by the image-dependent linearization, and to the perceptually intuitive parameters controlling the calculation of the preferred reproduction curves, also allows for simple, intuitive manual adjustment.

Claims

1. A method of pictorial digital image processing comprising the steps of:

providing an original image;

gathering preliminary information;

constructing one or more of an image-dependent flare model, an image-dependent non-linearity model, an image-dependent preferred reproduction model, and an output-dependent preferred reproduction model in accordance with the preliminary information, wherein an image-dependent non-linearity model is constructed by the steps of;

constructing a scaled image based on the original image;

deriving image statistics from the scaled image, wherein the step of deriving image statistics from the scaled image comprises the sub-steps of;

transforming the scaled image using preliminary information about a capture device used to provide the original image to produce scaled image focal plane data;

determining significant statistical values of the scaled image focal plane data;

determining flare characteristics of the original image;

creating input linearization LUTs using the preliminary information and the flare characteristics of the original image;

transforming the scaled image into linear scene integrated channel radiance data using the input linearization LUTs;

normalizing the linear scene integrated channel radiance data using the preliminary information to produce normalized channel radiance data; and

transforming the normalized channel radiance data into a standard color space; and

processing the original image in accordance with the preliminary information and the one or more of an image-dependent flare model, an image-dependent non-linearity model, an image-dependent preferred reproduction model, and an output-dependent preferred reproduction model to produce a processed image from the original image, wherein the step of processing the original image further includes taking into account the image statistics derived from the scaled image.

2. The method of claim 1 further comprising the step of creating a luminance channel by combining all channels of the normalized channel radiance data.

3. The method of claim 1 wherein the preliminary information includes channel multipliers of the capture device, which channel multipliers are used to normalize the linear scene integrated channel radiance data.

4. The method of claim 1 further including the step of allowing a user to adjust parameters of the preferred reproduction model.