IMAGE PROCESSING DEVICE CAPABLE OF SUPRESSING OVER-CORRECTION IN RETINEX PROCESS

• US 20080100858A1
• Filed: 10/31/2007
• Published: 05/01/2008
• Est. Priority Date: 10/31/2006
• Status: Active Grant

• Current Assignee: Brother Kogyo Kabushiki Kaisha
• Original Assignee: Brother Kogyo Kabushiki Kaisha
• Inventors: KONDO, Masaki
• Granted Patent: US 7,876,474 B2
• Time in Patent Office: Days
• US Class Current: 358/1.9
• CPC Class Codes: G06T 5/008 Local, e.g. shadow enhancement
• CPC Class Codes: G06T 5/40 using histogram techniques
• CPC Class Codes: G06T 5/94 based on local image properties, e.g. for local contrast enhancement
• CPC Class Codes: H04N 1/407 Control or modification of tonal gradation or of extreme levels, e.g. background level

Abstract

A first lower-range generating portion generates a pixel value of an output image based on a first nonlinear function in a first lower range where a pixel value of a subject pixel is lower than a predetermine value. The first upper-range generating portion generates the pixel value of the output image based on a first monotonically increasing function in a first upper range where the pixel value of the subject pixel is greater than or equal to the predetermine value. The pixel value of the output image increases toward a first maximum output luminance value as the pixel value of the subject pixel increases. The first maximum output luminance value is greater than a luminance value obtained by correcting a maximum pixel value of the original image based on the first nonlinear function. The first maximum output luminance value is proximate to the maximum pixel value of the original image.

Claims

1. An image processing device comprising:

a reflectance-component calculating portion that calculates a reflectance component based both on a pixel value of a subject pixel in an original image and on an average luminance of peripheral pixels around the subject pixel, the reflectance component being indicative of brightness of the subject pixel relative to the peripheral pixels; and

a first pixel-value generating portion that generates a pixel value of an output image when the reflectance component indicates that the subject pixel is darker than the peripheral pixels, the first pixel-value generating portion comprising;

a first lower-range generating portion that generates the pixel value of the output image based on a first nonlinear function in a first lower range where the pixel value of the subject pixel is lower than a first predetermine value; and

a first upper-range generating portion that generates the pixel value of the output image based on a first monotonically increasing function in a first upper range where the pixel value of the subject pixel is greater than or equal to the first predetermine value, the pixel value of the output image increasing toward a first maximum output luminance value as the pixel value of the subject pixel increases, the first maximum output luminance value being greater than a luminance value obtained by correcting a maximum pixel value of the original image based on the first nonlinear function, the first maximum output luminance value being proximate to the maximum pixel value of the original image.

2. The image processing device according to claim 1, wherein both the pixel value of the original image and the pixel value of the output image have a range between 0 and 255;

and

wherein the first maximum output luminance value equals to 240.

3. The image processing device according to claim 1, wherein the first predetermined value is greater than or equal to a value corresponding to an intersecting point between a curve for the first nonlinear function of a minimum reflectance component and a curve for a non-conversion function, the non-conversion function generating the pixel value of the output image that is identical with the pixel value of the subject pixel.

4. The image processing device according to claim 3, wherein the first predetermined value is a value where a difference between a pixel value derived from a nonlinear function of a maximum reflectance component and a pixel value derived from a nonlinear function of a minimum reflectance component is smaller than or equal to a predetermined difference.

5. The image processing device according to claim 3, wherein the first predetermined value is a value proximate to a midpoint of a range that the pixel value of the subject pixel takes.

6. The image processing device according to claim 1, further comprising a second pixel-value generating portion that generates the pixel value of the output image when the reflectance component indicates that the subject pixel has a same brightness as the peripheral pixels, the second pixel-value generating portion comprising:

a second lower-range generating portion that generates the pixel value of the output image based on a second nonlinear function in a second lower range where the pixel value of the subject pixel is lower than a second predetermine value; and

a second upper-range generating portion that generates the pixel value of the output image based on a second monotonically increasing function in a second upper range where the pixel value of the subject pixel is greater than or equal to the second predetermine value, the pixel value of the output image increasing toward a second maximum output luminance value as the pixel value of the subject pixel increases, the second maximum output luminance value being greater than a luminance value obtained by correcting a maximum pixel value of the original image based on the second nonlinear function, the second maximum output luminance value being proximate to the maximum pixel value of the original image.

7. The image processing device according to claim 6, wherein the second predetermined value is greater than or equal to a value corresponding to an intersecting point between a curve for the first nonlinear function of a minimum reflectance component and a curve for a non-conversion function, the non-conversion function generating the pixel value of the output image that is identical with the pixel value of the subject pixel.

8. The image processing device according to claim 7, wherein the second predetermined value is set in such a manner that a pixel value derived from the second nonlinear function or the second monotonically increasing function is greater than a pixel value derived from the first nonlinear function or the first monotonically increasing function for the same subject pixel.

9. The image processing device according to claim 1, further comprising a third pixel-value generating portion that generates the pixel value of the output image when the reflectance component indicates that the subject pixel is brighter than the peripheral pixels, the third pixel-value generating portion comprising:

a third lower-range generating portion that generates the pixel value of the output image based on a third nonlinear function in a third lower range where the pixel value of the subject pixel is lower than a third predetermine value; and

a third upper-range generating portion that generates the pixel value of the output image based on a third monotonically increasing function in a third upper range where the pixel value of the subject pixel is greater than or equal to the third predetermine value, the pixel value of the output image increasing toward a third maximum output luminance value as the pixel value of the subject pixel increases, the third maximum output luminance value being greater than a luminance value obtained by correcting a maximum pixel value of the original image based on the third nonlinear function, the third maximum output luminance value being proximate to the maximum pixel value of the original image.

10. The image processing device according to claim 9, wherein both the pixel value of the original image and the pixel value of the output image have a range between 0 and 255;

and

wherein the third maximum output luminance value equals to 255.

11. The image processing device according to claim 9, wherein the third predetermined value is greater than or equal to a value corresponding to an intersecting point between a curve for the first nonlinear function of a minimum reflectance component and a curve for a non-conversion function, the non-conversion function generating the pixel value of the output image that is identical with the pixel value of the subject pixel.

12. The image processing device according to claim 11, further comprising a second pixel-value generating portion that generates the pixel value of the output image when the reflectance component indicates that the subject pixel has a same brightness as the peripheral pixels, the second pixel-value generating portion comprising:

a second lower-range generating portion that generates the pixel value of the output image based on a second nonlinear function in a second lower range where the pixel value of the subject pixel is lower than a second predetermine value; and

a second upper-range generating portion that generates the pixel value of the output image based on a second monotonically increasing function in a second upper range where the pixel value of the subject pixel is greater than or equal to the second predetermine value, the pixel value of the output image increasing toward a second maximum output luminance value as the pixel value of the subject pixel increases, the second maximum output luminance value being greater than a luminance value obtained by correcting a maximum pixel value of the original image based on the second nonlinear function, the second maximum output luminance value being proximate to the maximum pixel value of the original image,

wherein the third predetermined value is set in such a manner that a pixel value derived from the third nonlinear function or the third monotonically increasing function is greater than a pixel value derived from the first nonlinear function or the first monotonically increasing function for the same subject pixel, and that the pixel value derived from the third nonlinear function or the third monotonically increasing function is greater than a pixel value derived from the second nonlinear function or the second monotonically increasing function for the same subject pixel.

13. The image processing device according to claim 1, further comprising a storage portion that stores, in association with first pixel values, table values including either gamma-corrected values obtained by performing gamma correction on the first pixel values using at least one predetermined reflectance component or second pixel values calculated based on both the gamma-corrected values and the first pixel values,

wherein the first pixel-value generating portion comprises:

an extracting portion that extracts at least one of the table values corresponding to the pixel value of the subject pixel; and

a determining portion that determines the pixel value of the output image based on the at least one of the table values extracted by the extracting portion.

14. The image processing device according to claim 1, wherein a single function is used for implementing both the first nonlinear function and the first monotonically increasing function.

15. A storage medium storing a set of program instructions executable on an image processing device, the set of program instructions comprising:

(a) calculating a reflectance component based both on a pixel value of a subject pixel in an original image and on an average luminance of peripheral pixels around the subject pixel, the reflectance component being indicative of brightness of the subject pixel relative to the peripheral pixels; and

(b) generating a pixel value of an output image when the reflectance component indicates that the subject pixel is darker than the peripheral pixels, the instructions (b) comprising;

(c) generating the pixel value of the output image based on a first nonlinear function in a first lower range where the pixel value of the subject pixel is lower than a first predetermine value; and

(d) generating the pixel value of the output image based on a first monotonically increasing function in a first upper range where the pixel value of the subject pixel is greater than or equal to the first predetermine value, the pixel value of the output image increasing toward a first maximum output luminance value as the pixel value of the subject pixel increases, the first maximum output luminance value being greater than a luminance value obtained by correcting a maximum pixel value of the original image based on the first nonlinear function, the first maximum output luminance value being proximate to the maximum pixel value of the original image.

16. The storage medium according to claim 15, wherein both the pixel value of the original image and the pixel value of the output image have a range between 0 and 255;

and

wherein the first maximum output luminance value equals to 240.

17. The storage medium according to claim 15, wherein the first predetermined value is greater than or equal to a value corresponding to an intersecting point between a curve for the first nonlinear function of a minimum reflectance component and a curve for a non-conversion function, the non-conversion function generating the pixel value of the output image that is identical with the pixel value of the subject pixel.

18. The storage medium according to claim 15, wherein the set of program instructions further comprises:

(e) generating the pixel value of the output image when the reflectance component indicates that the subject pixel has a same brightness as the peripheral pixels, the instructions (a) comprising;

(f) generating the pixel value of the output image based on a second nonlinear function in a second lower range where the pixel value of the subject pixel is lower than a second predetermine value; and

(g) generating the pixel value of the output image based on a second monotonically increasing function in a second upper range where the pixel value of the subject pixel is greater than or equal to the second predetermine value, the pixel value of the output image increasing toward a second maximum output luminance value as the pixel value of the subject pixel increases, the second maximum output luminance value being greater than a luminance value obtained by correcting a maximum pixel value of the original image based on the second nonlinear function, the second maximum output luminance value being proximate to the maximum pixel value of the original image.

19. The storage medium according to claim 18, wherein the second predetermined value is greater than or equal to a value corresponding to an intersecting point between a curve for the first nonlinear function of a minimum reflectance component and a curve for a non-conversion function, the non-conversion function generating the pixel value of the output image that is identical with the pixel value of the subject pixel.

20. The storage medium according to claim 19, wherein the second predetermined value is set in such a manner that a pixel value derived from the second nonlinear function or the second monotonically increasing function is greater than a pixel value derived from the first nonlinear function or the first monotonically increasing function for the same subject pixel.

21. The storage medium according to claim 15, wherein the set of program instructions further comprises:

(h) generating the pixel value of the output image when the reflectance component indicates that the subject pixel is brighter than the peripheral pixels, the instructions (h) comprising;

(i) generating the pixel value of the output image based on a third nonlinear function in a third lower range where the pixel value of the subject pixel is lower than a third predetermine value; and

(j) generating the pixel value of the output image based on a third monotonically increasing function in a third upper range where the pixel value of the subject pixel is greater than or equal to the third predetermine value, the pixel value of the output image increasing toward a third maximum output luminance value as the pixel value of the subject pixel increases, the third maximum output luminance value being greater than a luminance value obtained by correcting a maximum pixel value of the original image based on the third nonlinear function, the third maximum output luminance value being proximate to the maximum pixel value of the original image.

22. The storage medium according to claim 21, wherein both the pixel value of the original image and the pixel value of the output image have a range between 0 and 255;

and

wherein the third maximum output luminance value equals to 255.

23. The storage medium according to claim 21, wherein the third predetermined value is greater than or equal to a value corresponding to an intersecting point between a curve for the first nonlinear function of a minimum reflectance component and a curve for a non-conversion function, the non-conversion function generating the pixel value of the output image that is identical with the pixel value of the subject pixel.

24. The storage medium according to claim 23, wherein the set of program instructions further comprises:

(k) generating the pixel value of the output image when the reflectance component indicates that the subject pixel has a same brightness as the peripheral pixels, the instructions (k) comprising;

(l) generating the pixel value of the output image based on a second nonlinear function in a second lower range where the pixel value of the subject pixel is lower than a second predetermine value; and

(m) generating the pixel value of the output image based on a second monotonically increasing function in a second upper range where the pixel value of the subject pixel is greater than or equal to the second predetermine value, the pixel value of the output image increasing toward a second maximum output luminance value as the pixel value of the subject pixel increases, the second maximum output luminance value being greater than a luminance value obtained by correcting a maximum pixel value of the original image based on the second nonlinear function, the second maximum output luminance value being proximate to the maximum pixel value of the original image,

wherein the third predetermined value is set in such a manner that a pixel value derived from the third nonlinear function or the third monotonically increasing function is greater than a pixel value derived from the first nonlinear function or the first monotonically increasing function for the same subject pixel, and that the pixel value derived from the third nonlinear function or the third monotonically increasing function is greater than a pixel value derived from the second nonlinear function or the second monotonically increasing function for the same subject pixel.

25. The storage medium according to claim 15, wherein the instructions (b) further comprise:

(n) extracting at least one of table values corresponding to the pixel value of the subject pixel, the table values being stored in association with first pixel values in a storage portion, the table values including either gamma-corrected values obtained by performing gamma correction on the first pixel values using at least one predetermined reflectance component or second pixel values calculated based on both the gamma-corrected values and the first pixel values; and

(o) determining the pixel value of the output image based on the at least one of the table values extracted by the instructions (n).