Brightness adjustment of images using digital scene analysis

• US 5,724,456 A
• Filed: 03/31/1995
• Issued: 03/03/1998
• Est. Priority Date: 03/31/1995
• Status: Expired due to Term

• Current Assignee: Intellectual Ventures I LLC (Intellectual Ventures LLC)
• Original Assignee: Polaroid Corporation (PLR IP Holdings LLC)
• Inventors: Juenger, Andrew K., Boyack, James R.
• Primary Examiner(s): Boudreau, Leo
• Assistant Examiner(s): Werner, Brian P.
• Application Number:
  US08/414,750
• Time in Patent Office: 1,068 Days
• Field of Search: 382/254, 382/274, 382/168, 382/169, 382/173, 382/239, 382/232, 382/167, 382/171, 382/172, 382/308, 348/672, 348/251, 348/254, 348/255, 348/256, 348/688, 396/233, 396/234, 395/126, 395/128, 345/147, 345/155, 345/214
• US Class Current: 382/274
• CPC Class Codes: G06T 2207/20021 Dividing image into blocks, subimages or windows
• CPC Class Codes: G06T 5/40 using histogram techniques
• CPC Class Codes: G06T 5/92 based on global image properties

Abstract

A system and method for processing a digital image signal which represents an image can be made to optimally map luminance values versus a tonal reproduction capability of a destination application. Specifically, the system includes a device for partitioning the image into blocks, then combining certain blocks into sectors. An average luminance block value is determined for each block and a difference is determined between the maximum and minimum average luminance block values for each sector. If the difference exceeds a predetermined threshold value, then the sector is labeled as an active sector and an average luminance sector value is obtained from maximum and minimum average luminance block values. All weighted counts of active sectors of the image are plotted versus the average luminance sector values in a histogram, then the histogram is shifted via some predetermined criterion so that the average luminance sector values of interest will fall within a destination window corresponding to the tonal reproduction capability of a destination application.

Claims

1. A system for processing a digital image signal representing an image, said image containing both luminance data and chrominance data, to map the luminance data to a tonal reproduction capability of a destination application, said system comprising:

means for acquiring the image signal and separating the luminance data from the image signal;

an input buffer for storing said luminance data;

means for reading and partitioning said luminance data from said input buffer into a plurality of image blocks of predetermined size;

means for determining an average luminance block value for each said image block;

means for selectively combining preselected ones of said image blocks of said luminance data into sectors;

means for determining a difference between a maximum said average luminance block value and a minimum said average luminance block value of each sector, and comparing said difference with a predetermined threshold value;

means for identifying an active sector as one where said difference exceeds said predetermined threshold value;

means for determining an average luminance sector value for each active sector as an average of the maximum and minimum average luminance block values of each sector;

means for weighting and counting a number of active sectors corresponding to each said average luminance sector value;

means for generating a histogram of said number of active sectors versus said average luminance sector values;

means for selecting a tonal reproduction range corresponding to the tonal reproduction capability of the destination application; and

means for mapping said average luminance sector values into said tonal reproduction range of said destination application and generating a digital output signal corresponding to said mapping.

2. The image processing system of claim 1 wherein the means for selecting a tonal reproduction range is selected from the group consisting of:

means for determining a midshift by setting a midpoint of a range of the histogram to a midpoint of the tonal reproduction capability of the destination application;

means for determining a meanshift by providing a weighted mean of the average luminance sector values within the tonal reproduction range using the number of active sectors as weights, then setting the weighted mean to the midpoint of the tonal reproduction capability of the destination application;

means for determining a maxshift by maximizing the number of active sectors within the tonal reproduction capability of the destination application;

means for determining an eqendshift by shifting the histogram so that an equal number of active sectors are excluded from the tonal reproduction capability of the destination application at either end of the histogram;

means for determining an average of the midshift, meanshift and eqendshift; and

means for determining an average of the midshift, meanshift, maxshift and eqendshift.

5. The system of claim 1 wherein said predetermined block size comprises one pixel.

6. The system of claim 1 wherein said predetermined block size comprises 8×

8 pixels.

7. The system of claim 1 wherein a sector size corresponds approximately to the maximum resolution of the human visual system.

11. The image processing system of claim 1, wherein the means for selecting a tonal reproduction range comprises means for generating adjusted data from said luminance data by subtracting a midpoint luminance value from said luminance data to produce a difference, determining a RangeRatio by dividing a range of said histogram by a width of a destination window, dividing the difference by the RangeRatio to generate a quotient, and adding the midpoint luminance value to the quotient, and wherein the means for mapping comprises means for shifting said adjusted data to coincide with said destination window and means for generating the digital output signal corresponding to said shifted adjusted data.

3. An image processing method for processing a digital image signal representing an image, said image containing both luminance data and chrominance data, to optimally map the luminance data to a tonal reproduction capability of a destination application, said method comprising the steps of:

acquiring the image signal and separating the luminance data from the image signal;

storing said luminance data in an input buffer;

reading and partitioning said luminance data from said input buffer into a plurality of image blocks of predetermined size;

determining an average luminance block value for each said image block;

combining preselected ones of said image blocks of said luminance data into sectors;

determining a difference between a maximum said average luminance block value and a minimum said average luminance block value of each sector, and comparing said difference with a predetermined threshold value;

identifying an active sector as one where said difference exceeds said predetermined threshold value;

determining an average luminance sector value for each active sector as an average of the maximum and minimum average luminance block values of each sector;

weighting and counting a number of active sectors corresponding to each said average luminance sector value;

generating a histogram of said number of active sectors versus said average luminance sector values;

selecting a tonal reproduction range corresponding to the tonal reproduction capability of the destination application; and

mapping said average luminance sector values into said tonal reproduction range of said destination application and generating a digital output signal corresponding to said mapping.

4. The image processing method of claim 3, wherein the tonal reproduction range is selected from the group consisting of:

providing a midshift by setting a midpoint of a range of the histogram to a midpoint of the tonal reproduction capability of the destination application;

providing a meanshift by determining a weighted mean of the average luminance sector values within the tonal reproduction capability of the destination application using the number of active sectors as weights, then setting the weighted mean to the midpoint of the tonal reproduction capability;

providing a maxshift by maximizing the number of active sectors within the tonal reproduction capability;

providing an eqendshift by shifting the histogram so that an equal number of active sectors are excluded from the tonal reproduction capability of the destination application at either end of the histogram;

providing an average of the midshift, meanshift and eqendshift; and

providing an average of the midshift, meanshift, maxshift and eqendshift.

8. The method of claim 3 wherein said predetermined block size comprises one pixel.

9. The method of claim 3 wherein said predetermined block size comprises 8×

8 pixels.

10. The method of claim 3 wherein a sector size corresponds approximately to the maximum resolution of the human visual system.

12. The image processing method of claim 3, wherein the step of selecting a tonal reproduction range is facilitated by generating adjusted data from said luminance data by subtracting a midpoint luminance value from said luminance data to produce a difference, determining a RangeRatio by dividing a range of said histogram by a width of a destination window, dividing the difference by the RangeRatio to generate a quotient, and adding the midpoint luminance value to the quotient, and wherein the step of mapping is facilitated by shifting said adjusted data to coincide with said destination window and generating the digital output signal corresponding to said shifted adjusted data.

13. A method for processing a digital input image and exporting the processed image to a downstream application having a given tonal reproduction range, said method comprising the steps of:

partitioning the input image into sectors of predetermined size;

determining for each said sector a luminance activity defined as a difference in luminance between at least two pixels within each said sector;

generating an average luminance value for each said sector having said luminance activity greater than a predetermined threshold value;

generating a count of sectors having each said average luminance value;

mapping said average luminance values, having counts falling within a predetermined selection criterion, into the tonal reproduction range; and

exporting the processed image to the downstream application in response to said mapped luminance values.

14. The method of claim 13, wherein said predetermined selection criterion is selected from the group consisting of:

(A) setting a midpoint of a range of said average luminance values to a midpoint of the tonal reproduction range;

(B) determining a weighted mean of said average luminance values, then setting said weighted mean to said midpoint of the tonal reproduction range;

(C) maximizing said average luminance values within the tonal reproduction range;

(D) excluding an equal number of low end and high end average luminance values from the tonal reproduction range;

(E) providing an average of (A), (B) and (C); and

(F) providing an average of (A), (B), (C) and (D).

15. A system for processing a digital input image and exporting the processed image to a destination application having a given tonal reproduction range, said system comprising:

means for partitioning the input image into sectors of predetermined size;

means for determining for each said sector a luminance activity defined as a difference in luminance between at least two pixels within each said sector;

means for generating an average luminance value for each said sector having said luminance activity greater than a predetermined threshold value;

means for generating a count of sectors having each said average luminance value;

means for mapping said average luminance values, having counts falling within a predetermined selection criterion, into the tonal reproduction range; and

means for exporting the processed image on the destination application in response to said mapped luminance values.

16. The system of claim 15, wherein said predetermined selection criterion is selected from the group consisting of:

(A) setting a midpoint of a range of said average luminance values to a midpoint of the tonal reproduction range;

(B) determining a weighted mean of said average luminance values, then setting said weighted mean to said midpoint of the tonal reproduction range;

(C) maximizing said average luminance values within the tonal reproduction range;

(D) excluding an equal number of low end and high end average luminance values from the tonal reproduction range;

(E) providing an average of (A), (B) and (C); and

(F) providing an average of (A), (B), (C) and (D).