Image processing apparatus, image processing method, and computer-readable medium

• US 8,442,315 B2
• Filed: 12/08/2010
• Issued: 05/14/2013
• Est. Priority Date: 07/16/2010
• Status: Active Grant

• Current Assignee: Canon Ayutthaya Limited (Canon Inc.)
• Original Assignee: Canon Ayutthaya Limited (Canon Inc.)
• Inventors: Umeda, Kiyoshi, Sakai, Hiroyuki, Nakagawa, Junichi
• Primary Examiner(s): COUSO, JOSE L
• Application Number:
  US12/962,875
• Publication Number:
  US 20120013763A1
• Time in Patent Office: 888 Days
• Field of Search: 382162-168, 382/190, 382/254, 382/274, 382/275, 358/1.9, 358/3.27, 358/516, 358518-520, 358/523, 348/221.1, 348/223.1
• US Class Current: 382/167
• CPC Class Codes: G06K 15/1878 Adjusting colours image colour correction or control for documents in general H04N1/60
• CPC Class Codes: G06T 5/40 using histogram techniques
• CPC Class Codes: H04N 9/643 Hue control means, e.g. flesh tone control
• CPC Class Codes: H04N 9/73 Colour balance circuits, e.g. white balance circuits or colour temperature control camera processing pipelines for colour balance H04N23/88

Abstract

An image processing apparatus for applying a color balance correction to input image data, comprises a first highlight color calculation unit which estimates a light source at the time of shooting from pixel values of the image data, converts color values of the image data based on a condition of the estimated light source at the time of shooting, and calculates a first highlight color; a second highlight color calculation unit which calculates a second highlight color from the image data; a third highlight color calculation unit which calculates a third highlight color based on a positional relationship between the first highlight color and the second highlight color on a color space; and a correction unit which attains the color balance correction by converting the pixel values of the image data using the third highlight color.

Claims

1. An image processing apparatus for applying a color balance correction to input image data, comprising:

a first highlight color calculation unit which estimates a light source at the time of shooting from pixel values of the image data and calculates a first highlight color based on the estimated light source at the time of shooting;

a second highlight color calculation unit which calculates a second highlight color from the image data;

a third highlight color calculation unit which calculates a third highlight color based on a position between the first highlight color and the second highlight color on a color space; and

a correction unit which attains the color balance correction by converting the pixel values of the image data using the third highlight color.

2. The apparatus according to claim 1, wherein said first highlight color calculation unit further comprises:

an object detection unit which detects an object included in the image data;

an object color calculation unit which calculates an object color as a color value of the object; and

a first highlight color determination unit which estimates a color temperature of the light source at the time of shooting using a gray color value and the object color in the image data, and determines the first highlight color from a color value of the image data at the estimated color temperature.

3. The apparatus according to claim 1, wherein said second highlight color calculation unit further comprises:

a histogram calculation unit which calculates a histogram by accumulating luminance components of the image data; and

a second highlight color determination unit which determines the second highlight color using a luminance value, an accumulated frequency in the histogram of which exceeds a predetermined value.

4. The apparatus according to claim 1, wherein said third highlight color calculation unit calculates a value of the third highlight color by internally dividing a value of the first highlight color and a value of the second highlight color on the color space using weighting coefficients.

5. The apparatus according to claim 4, wherein the weighting coefficients assume predetermined values.

6. The apparatus according to claim 4, wherein the weighting coefficients are determined according to differences from a reference value in respective processes of said first highlight color calculation unit and said second highlight color calculation unit.

7. The apparatus according to claim 2, wherein said third highlight color calculation unit further comprises:

a highlight color candidate calculation unit which calculates a plurality of highlight color candidates using the first highlight color and the second highlight color;

a candidate correction unit which applies the color balance correction to the object color using each of the plurality of highlight color candidates;

a distance calculation unit which calculates a distance on the color space between each of the object colors after the color balance correction by said candidate correction unit and an ideal object color which is held in advance; and

a third highlight color determination unit which determines, as the third highlight color, a highlight color candidate corresponding to the shortest distance of the distances calculated by said distance calculation unit.

8. The apparatus according to claim 1, wherein the color balance correction by said correction unit is nonlinear processing.

9. The apparatus according to claim 1, wherein the color balance correction by said correction unit uses CIECAM02.

11. A non-transitory computer-readable medium storing a program for controlling a computer to function as an image processing apparatus according to claim 1.

10. An image processing method for applying a color balance correction to input image data, comprising:

using at least one processor to perform the following;

a first highlight color calculation step of estimating a light source at the time of shooting from pixel values of the image data and calculating a first highlight color based on the estimated light source at the time of shooting;

a second highlight color calculation step of calculating a second highlight color from the image data;

a third highlight color calculation step of calculating a third highlight color based on a position between the first highlight color and the second highlight color on a color space; and

a correction step of attaining the color balance correction by converting the pixel values of the image data using the third highlight color.

12. An image processing apparatus comprising:

a first highlight color calculation unit which estimates a light source at the time of shooting of an image and calculates a first highlight color based on the estimated light source at the time of shooting;

a second highlight color calculation unit which calculates a second highlight color from the image;

a third highlight color calculation unit which calculates a third highlight color using the first highlight color and the second highlight color; and

a correction unit which corrects a color balance of the image using the third highlight color.

13. The apparatus according to claim 12, wherein the first highlight color calculation unit calculates the first highlight color corresponding to a color temperature of the estimated light source at the time of shooting.

14. The apparatus according to claim 12, wherein the first highlight color calculation unit estimates the light source at the time of shooting using a color value of gray of the image and a color of an object included in the image.

15. The apparatus according to claim 12, wherein the second highlight color calculation unit calculates the second highlight color based on a histogram of luminance components of the image.

16. The apparatus according to claim 12, wherein the third highlight color calculation unit calculates a value of the third highlight color by internally dividing a value of the first highlight color and a value of the second highlight color using weighting coefficients.

17. The apparatus according to claim 12, wherein the third highlight color calculation unit calculates a value of the third highlight color by calculating a weighting coefficients using a color of an object included in the image and weighting a value of the first highlight color and a value of the second highlight color using the weighting coefficients.

18. The apparatus according to claim 12, wherein the third highlight color calculation unit further comprises:

a highlight color candidate calculation unit which calculates a plurality of highlight color candidates by weighting a value of the first highlight color and a value of the second highlight color using a plurality of weighting coefficients;

a candidate correction unit which applies the color balance correction to an object included in the image using each of the plurality of highlight color candidates; and

a calculation unit which calculates the third highlight color based on a plurality of colors of the object applied the color balance correction by the candidate correction unit and a color of the object held in advance.

19. The apparatus according to claim 12, wherein the color balance correction by said correction unit uses CIECAM02.

21. A non-transitory computer-readable medium storing a program for controlling a computer to function as an image processing apparatus according to claim 12.

20. An image processing method comprising:

using at least one processor to perform the following;

a first highlight color calculation step of estimating a light source at the time of shooting of an image and calculating a first highlight color based on the estimated light source at the time of shooting;

a second highlight color calculation step of calculating a second highlight color from the image;

a third highlight color calculation step of calculating a third highlight color using the first highlight color and the second highlight color; and

a correction step of correcting a color balance of the image using the third highlight color.