Image processing apparatus and control method thereof detecting from a histogram a gradation level whose frequency is a peak value

• US 8,649,597 B2
• Filed: 06/23/2010
• Issued: 02/11/2014
• Est. Priority Date: 06/29/2009
• Status: Active Grant

• Current Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Original Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Inventors: Shindo, Yuuki, Kanai, Izumi, Saito, Tetsuji
• Primary Examiner(s): Chu, Randolph I
• Application Number:
  US12/821,699
• Publication Number:
  US 20100329559A1
• Time in Patent Office: 1,329 Days
• Field of Search: None
• US Class Current: 382/168
• CPC Class Codes: G06T 5/009 Global, i.e. based on properties of the image as a whole applied in cameras using an electronic image sensor H04N23/80, H04N23/70
• CPC Class Codes: G06T 5/40 using histogram techniques
• CPC Class Codes: G06T 5/92 based on global image properties

Abstract

An image processing apparatus includes a histogram creation unit that creates a histogram from an input image, a detection unit that detects a gradation level of interest from the histogram, a gradation correction parameter generation unit that generates a gradation correction parameter to improve a gradation characteristic in a gradation range around the gradation level of interest, and a correction unit that corrects the gradation of the image using the gradation correction parameter. The detection unit detects, as the gradation level of interest, a gradation level whose frequency is a peak value equal to or more than a predetermined threshold, and which has variation width of frequencies in a predetermined range including this gradation level to be smaller than a predetermined width in the histogram.

Claims

1. An image processing apparatus, comprising:

a histogram creation unit configured to create a histogram from an input image;

a detection unit configured to detect from the histogram, as a gradation level of interest, a gradation level whose frequency is a peak value, wherein a variation width of frequencies in a predetermined range including the gradation level of interest is smaller than a predetermined width;

a gradation correction parameter generation unit configured to generate a gradation correction parameter having an input-output gradation conversion characteristic that improves a gradation characteristic in a predetermined gradation range including the gradation level of interest compared to other gradation ranges on the bases of the detected result by the detection unit; and

a correction unit configured to correct the gradation of the image using the gradation correction parameter generated by the gradation correction parameter generation unit, wherein

the detection unit determines whether the variation width of frequencies in the predetermined range is smaller than the predetermined width or not based on (1) a frequency of a gradation level that is a target for which it is to be determined whether the gradation level is a gradation level of interest or not, and (2) a value obtained by multiplying a total of frequencies of a respective n number of gradation levels, where n is an integer of 1 or greater, at lower and higher sides of the gradation level that is the target, excluding the gradation level that is the target, by a predetermined value.

2. The image processing apparatus according to claim 1, wherein when the frequency of the gradation level that is the target for which it is to be determined whether the gradation level is a gradation level of interest or not, is lower than the value obtained by multiplying the total of frequencies of the respective n number of gradation levels, where n is an integer of 1 or greater, at lower and higher sides of the gradation level that is the target, excluding the gradation level that is the target, by the predetermined value, the detection unit regards the variation width of the frequencies in the predetermined range as smaller than the predetermined width.

3. The image processing apparatus according to claim 1, further comprising:

a histogram preprocessing unit configured to analyze a histogram created by the histogram creation unit, rewrite the frequency of a gradation level of a minimum gradation level plus n to a frequency of the minimum gradation level if the frequency of the minimum gradation level is higher than the frequency of the gradation level of the minimum gradation level plus n, and rewrite the frequency of a gradation level of a maximum gradation level minus n to a frequency of the maximum gradation level if the frequency of the maximum gradation level is higher than the frequency of the gradation level of the maximum gradation level minus n.

4. The image processing apparatus according to claim 1, wherein when a plurality of gradation levels, each of which has a frequency being a peak value, and has a variation width of frequencies in the predetermined range including the gradation level to be smaller than the predetermined width, exist in the histogram, the detection unit detects at least a gradation level in the lowest gradation level side, out of the plurality of gradation levels, as the gradation level of interest.

5. The image processing apparatus according to claim 1, wherein when a plurality of gradation levels, each of which has a frequency being a peak value, and has a variation width of frequencies in the predetermined range including the gradation level to be smaller than the predetermined width, exist in the histogram, the detection unit detects at least a gradation level in the highest gradation level side, out of the plurality of gradation levels, as the gradation level of interest.

11. The image processing apparatus according to claim 1, further comprising:

a storage unit configured to store a plurality of predetermined gradation correction parameters; and

a calculation unit configured to calculate the total of frequencies from a minimum gradation level to a predetermined gradation level of the histogram, as a frequency in a low gradation level side, wherein

when the gradation level of interest is not detected by the detection unit, the gradation correction parameter generation unit selects any of the plurality of predetermined gradation correction parameters depending on the frequency in the low gradation level side, and

the correction unit corrects the gradation of the image using the selected gradation correction parameter.

12. The image processing apparatus according to claim 1, further comprising:

a storage unit configured to store a plurality of predetermined gradation correction parameters; and

a calculation unit configured to calculate the total of frequencies from a predetermined gradation level to a maximum gradation level of the histogram, as a frequency in a high gradation level side, wherein

when the gradation level of interest is not detected by the detection unit, the gradation correction parameter generation unit selects any of the plurality of predetermined gradation correction parameters depending on the frequency in the high gradation level side, and

the correction unit corrects the gradation of the image using the selected gradation correction parameter.

13. The image processing apparatus according to claim 1, wherein the gradation correction parameter generation unit generates, as the gradation correction parameter, a γ

curve having an input-output gradation conversion characteristic that improves a gradation characteristic in the predetermined gradation range including the gradation level of interest compared to the other gradation ranges.

6. A controlling method of an image processing apparatus, comprising:

a histogram creation step of creating a histogram from an input image;

a detection step of detecting from the histogram, as a gradation level of interest, a gradation level whose frequency is a peak value, wherein a variation width of frequencies in a predetermined range including the gradation level of interest is smaller than a predetermined width;

a gradation correction parameter generation step of generating a gradation correction parameter having an input-output gradation conversion characteristic that improves a gradation characteristic in a predetermined gradation range including the gradation level of interest compared to other gradation ranges on the bases of the detected result by the detection step; and

a correction step of correcting the gradation of the image using the gradation correction parameter generated by the gradation correction parameter generation step, wherein

the detection step determines whether the variation width of frequencies in the predetermined range is smaller than the predetermined width or not based on (1) a frequency of a gradation level that is a target for which it is to be determined whether the gradation level is a gradation level of interest or not, and (2) a value obtained by multiplying a total of frequencies of a respective n number of gradation levels, where n is an integer of 1 or greater, at lower and higher sides of the gradation level that is the target, excluding the gradation level that is the target, by a predetermined value.

7. The controlling method of the image processing apparatus according to claim 6, wherein when the frequency of the gradation level that is the target for which it is determined whether the gradation level is the gradation level of interest or not, is lower than the value obtained by multiplying the total of frequencies of the respective n number of gradation levels, where n is an integer of 1 or greater, at lower and higher sides of the gradation level that is the target, excluding the gradation level that is the target, by the predetermined value, in the detection step, it is regarded that the variation width of the frequencies in the predetermined range is smaller than the predetermined width.

8. The controlling method of the image processing apparatus according to claim 6, further comprising:

a histogram preprocessing step of analyzing a histogram created by the histogram creation step, rewriting the frequency of a gradation level of a minimum gradation level plus n to a frequency of the minimum gradation level if the frequency of the minimum gradation level is higher than the frequency of the gradation level of the minimum gradation level plus n, and rewriting the frequency of a gradation level of a maximum gradation level minus n to a frequency of the maximum gradation level if the frequency of the maximum gradation level is higher than the frequency of the gradation level of the maximum gradation level minus n.

9. The controlling method of the image processing apparatus according to claim 6, wherein when a plurality of gradation levels, each of which has frequency being a peak value, and has a variation width of frequencies in the predetermined range including the gradation level to be smaller than the predetermined width, exist in the histogram, in the detection step, at least a gradation level in the lowest gradation level side out of the plurality of gradation levels is detected as the gradation level of interest.

10. The controlling method of the image processing apparatus according to claim 6, wherein when a plurality of gradation levels, each of which has frequency being a peak value, and has a variation width of frequencies in the predetermined range including the gradation level to be smaller than the predetermined width, exist in the histogram, in the detection step, at least a gradation level in the highest gradation level side out of the plurality of gradation levels is detected as the gradation level of interest.

14. The controlling method of the image processing apparatus according to claim 6, further comprising:

a storage step of storing a plurality of predetermined gradation correction parameters; and

a calculation step of calculating a total of frequencies from a minimum gradation level to a predetermined gradation level of the histogram, as a frequency in a low gradation level side, wherein

when the gradation level of interest is not detected by the detection step, in the gradation correction parameter generation step, any of the plurality of predetermined gradation correction parameters is selected depending on the frequency in the low gradation level side, and

in the correction step, the gradation of the image is corrected using the selected gradation correction parameter.

15. The controlling method of the image processing apparatus according to claim 6, further comprising:

a storage step of storing a plurality of predetermined gradation correction parameters; and

a calculation step of calculating a total of frequencies from a predetermined gradation level to a maximum gradation level of the histogram, as a frequency in a high gradation level side, wherein when the gradation level of interest is not detected by the detection step, in the gradation correction parameter generation step, any of the plurality of predetermined gradation correction parameters is selected depending on the frequency in the high gradation level side, and

in the correction step, the gradation of the image is corrected using the selected gradation correction parameter.

16. The controlling method of the image processing apparatus according to claim 6, wherein in the gradation correction parameter generation step, a γ

curve having an input-output gradation conversion characteristic that improves a gradation characteristic in the predetermined gradation range including the gradation level of interest compared to the other gradation ranges is generated as the gradation correction parameter.

17. An image processing apparatus, comprising:

a histogram creation unit configured to divide an input image into a plurality of areas, and create a histogram for each area;

a detection unit configured to detect from the histogram of each of the areas, as a gradation level of interest, a gradation level whose frequency is a peak value, wherein a variation width of frequencies in a predetermined range including the gradation level of interest is smaller than a predetermined width;

a gradation correction parameter generation unit configured to generate, for each of the areas, a gradation correction parameter having an input-output gradation conversion characteristic that improves a gradation characteristic in a predetermined gradation range including the gradation level of interest of the each area compared to other gradation ranges on the bases of the detected result by the detection unit; and

a correction unit configured to correct the gradation of the image by, for each pixel, using a gradation correction parameter generated for a first area to which the pixel belongs, a gradation correction parameter generated for a second area adjacent to the first area, and weights based on a positional relationship between the pixel and the first area and a positional relationship between the pixel and the second area.

18. The image processing apparatus according to claim 17, wherein the correction unit corrects the gradation of the image by combining, for each pixel, a pixel value which is calculated using the gradation correction parameter generated for the first area to which the pixel belongs, and a pixel value which is calculated using the gradation correction parameter generated for the second area adjacent to the first area, using weights based on the positional relationship between the pixel and the first area and the positional relationship between the pixel and the second area.

19. The image processing apparatus according to claim 17, wherein when a plurality of gradation levels, each of which has a frequency being a peak value, and has a variation width of frequencies in the predetermined range including the gradation level to be smaller than the predetermined width, exist in the histogram, the detection unit detects at least a gradation level in the lowest gradation level side, out of the plurality of gradation levels, as the gradation level of interest.

20. The image processing apparatus according to claim 17, wherein when a plurality of gradation levels, each of which has a frequency being a peak value, and has a variation width of frequencies in the predetermined range including the gradation level to be smaller than the predetermined width, exist in the histogram, the detection unit detects at least a gradation level in the highest gradation level side, out of the plurality of gradation levels, as the gradation level of interest.

21. The image processing apparatus according to claim 17, wherein the gradation correction parameter generation unit generates, as the gradation correction parameter, a γ

curve having an input-output gradation conversion characteristic that improves a gradation characteristic in the predetermined gradation range including the gradation level of interest compared to the other gradation ranges.

22. A controlling method of an image processing apparatus, comprising:

a histogram creation step of dividing an input image into a plurality of areas, and creating a histogram for each area;

a detection step of detecting from the histogram of each of the areas, as a gradation level of interest, a gradation level whose frequency is a peak value, wherein a variation width of frequencies in a predetermined range including the gradation level of interest is smaller than a predetermined width;

a gradation correction parameter generation step of generating, for each of the areas, a gradation correction parameter having an input-output gradation conversion characteristic that improves a gradation characteristic in a predetermined gradation range including the gradation level of interest of the each area compared to other gradation ranges on the bases of the detected result by the detection step; and

a correction step of correcting the gradation of the image by, for each pixel, using a gradation correction parameter generated for a first area to which the pixel belongs, a gradation correction parameter generated for a second area adjacent to the first area, and weights based on a positional relationship between the pixel and the first area and a positional relationship between the pixel and the second area.

23. The controlling method of the image processing apparatus according to claim 22, wherein in the correction step, the gradation of the image is corrected by combining, for each pixel, a pixel value which is calculated using the gradation correction parameter generated for the first area to which the pixel belongs, and a pixel value which is calculated using the gradation correction parameter generated for the second area adjacent to the first area, using weights based on the positional relationship between the pixel and the first area and the positional relationship between the pixel and the second area.

24. The controlling method of the image processing apparatus according to claim 22, wherein when a plurality of gradation levels, each of which has a frequency being a peak value, and has a variation width of frequencies in the predetermined range including the gradation level to be smaller than the predetermined width, exist in the histogram, in the detection step, at least a gradation level in the lowest gradation level side out of the plurality of gradation levels is detected as the gradation level of interest.

25. The controlling method of the image processing apparatus according to claim 22, wherein when a plurality of gradation levels, each of which has a frequency being a peak value, and has a variation width of frequencies in the predetermined range including the gradation level to be smaller than the predetermined width, exist in the histogram, in the detection step, at least a gradation level in the highest gradation level side out of the plurality of gradation levels is detected as the gradation level of interest.

26. The controlling method of the image processing apparatus according to claim 22, wherein in the gradation correction parameter generation step, a γ

curve having an input-output gradation conversion characteristic that improves a gradation characteristic in the predetermined gradation range including the gradation level of interest compared to the other gradation ranges is generated as the gradation correction parameter.