System and method for enhancing document images

• US 6,771,838 B1
• Filed: 10/06/2000
• Issued: 08/03/2004
• Est. Priority Date: 10/06/2000
• Status: Expired due to Fees

• Current Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Original Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Inventors: Fan, Jian
• Primary Examiner(s): Mehta, Bhavesh M.
• Assistant Examiner(s): STREGE, JOHN B
• Application Number:
  US09/684,312
• Time in Patent Office: 1,397 Days
• Field of Search: 382/274, 382/168, 382/254, 382/199, 382/266, 382/167, 358/462, 358/519, 345/77
• US Class Current: 382/274
• CPC Class Codes: G06T 2207/10008 from scanner, fax or copier
• CPC Class Codes: G06T 2207/20021 Dividing image into blocks, subimages or windows
• CPC Class Codes: G06T 2207/20192 Edge enhancement; Edge preservation
• CPC Class Codes: G06T 2207/30176 Document
• CPC Class Codes: G06T 5/75 Unsharp masking
• CPC Class Codes: G06T 7/44 using image operators, e.g. filters, edge density metrics or local histograms
• CPC Class Codes: H04N 1/401 Compensating positionally unequal response of the pick-up or reproducing head H04N1/403 takes precedence
• CPC Class Codes: H04N 1/4092 Edge or detail enhancement
• CPC Class Codes: H04N 1/6072 adapting to different types of images, e.g. characters, graphs, black and white image portions

Abstract

A system and method for enhancing digital images containing both text and pictorial content (“mixed document images”) utilizes an estimated illumination surface for a given digital image to correct the undesirable effect of non-uniform illumination. The estimated illumination surface is based on the luminance values of the edge pixels of the given image that are on the dark side of text edges. In an alternative embodiment, the luminance values of the edge pixels that are on the lighter side of the detected text edges are used to generate the estimated illumination surface. The estimated illumination surface is applied to the digital image to compensate for illumination variations in the image due to non-uniform illumination. In addition to non-uniform illumination correction, the system and method enhances the mixed document images by sharpening and/or darkening edges of text contained in the images.

Claims

1. A method of enhancing a digital image comprising:

receiving an input digital image having a non-uniform illumination characteristic, said input digital image including at least one feature;

detecting edges of said feature of said input digital image;

generating an estimated illumination surface of said input digital image based on selected pixel luminance values of edge pixels associated with said feature of said input digital image, including collecting statistical values of said edge pixels for each predefined section of said input digital image, said statistical values including a value selected from the group consisting of;

the number of said edge pixels, the maximum luminance value for said edge pixels, the sum of luminance values of said edge pixels, and the sum of squared luminance values of said edge pixels; and

selectively adjusting pixel values of said input digital image using said estimated illumination surface to modify said non-uniform illumination characteristic of said input digital image.

2. The method of claim 1 wherein said edge pixels are on the dark side of said edges of said feature.

3. The method of claim 1 wherein said step of generating said estimated illumination surface further includes using a threshold T_i,j to generate said estimated illumination surface, said threshold T_i,j being defined by

4. The method of claim 1 wherein said step of selectively adjusting said pixel values of said input digital image includes modifying said pixel values of said input digital image by factoring in said estimated illumination surface to said pixel values.

5. The method of claim 4 wherein said step of modifying said pixel values of said input digital image includes controlling the contrast or the gamma.

6. The method of claim 1 wherein said edge pixels are on the lighter side of said edges of said feature.

7. The method of claim 1 wherein said step of selectively adjusting said pixel values of said input digital image includes modifying color component values of said input digital image by factoring in said estimated illumination surface to said color component values.

8. The method of claim 1 wherein said step of generating said estimated illumination surface includes applying a parametric surface fitting technique to generate said estimated illumination surface.

9. The method of claim 1 further comprising a step of enhancing said feature of said input digital image by sharpening or darkening said edges of said feature.

11. The system of claim 1 wherein said edge pixels are on the dark side of said edges of said feature.

12. The system of claim 11 wherein said generating means is configured to generate said estimated illumination surface using a threshold T_i,j for each predefined section of said input digital image to generate said estimated illumination surface, said threshold T_i,j being defined by

10. A system for enhancing at input digital image having a non-uniform illumination characteristic comprising:

means for detecting edges of a feature within said input digital image;

means for generating an estimated illumination surface of said input digital image based on selected pixel luminance values of edge pixels associated with said feature of said input digital image, said generating means being configured to collect statistical values of said edge pixels for each predefined section of said input digital image, said statistical values including a value selected from the group consisting of;

the number of said edge pixels, the maximum luminance value for said edge pixels, the sum of luminance values of said edge pixels, and the sum of squared luminance values of said edge pixels; and

means for selectively adjusting pixel values of said input digital image using said estimated illumination surface to modify said non-uniform illumination characteristic of said input digital image.

13. The system of claim 10 wherein said selectively adjusting means is configured to modify said pixel values of said input digital image by factoring in said estimated illumination surface to said pixel values.

14. The system of claim 13 wherein said selectively adjusting means is further configured to control the contrast or the gamma.

15. The system of claim 10 wherein said selectively adjusting means is configured to modify color component values of said input digital image by factoring in said estimated illumination surface to said color component values.

16. The system of claim 10 further comprising a means for enhancing said feature of said input digital image, said enhancing means being configured to perform edge sharpening or edge darkening of said feature.

17. The system of claim 10 wherein said generating means is configured to generate said estimated illumination surface using a parametric surface fitting technique.

18. A program storage medium readable by a computer, tangibly embodying a program of instructions executable by said computer to perform method steps for enhancing an input digital image having a non-uniform illumination characteristic, said method steps comprising:

detecting edges of a feature within said input digital image;

generating an estimated illumination surface of said input digital image based on selected pixel luminance values of edge pixels associated with said feature of said input digital image, including collecting statistical values of said edge pixels for each predefined section of said input digital image, said statistical values including a value selected from the group consisting of;

the number of said edge pixel, the maximum luminance value for said edge pixels, the sum of luminance values of said edge pixels, and the sum of squared luminance values of said edge pixels; and

selectively adjusting pixel values of said input digital image using said estimated illumination surface to modify said non-uniform illumination characteristic of said input digital image.

19. The storage medium of claim 18 wherein said edge pixels are on the dark side of said edges of said feature.

20. The storage medium of claim 19 wherein said method step of generating said estimated illumination surface further includes using a threshold T_i,j for each predefined window of said input digital image to generate said estimated illumination surface, said threshold T_i,j being defined by

21. The storage medium of claim 18 wherein said method step of selectively adjusting said pixel values of said input digital image includes modifying said pixel values of said input digital image by factoring in said estimated illumination surface to said pixel values.

22. The storage medium of claim 18 wherein said method step of generating said estimated illumination surface includes applying a parametric surface fitting technique to generate said estimated illumination surface.

23. The storage medium of claim 18 further comprising a method step of enhancing said feature of said input digital image by sharpening or darkening said edge of said feature.