Image processing technology for identification of red eyes in image

• US 20030021478A1
• Filed: 07/23/2002
• Published: 01/30/2003
• Est. Priority Date: 07/25/2001
• Status: Abandoned Application

• Current Assignee: Minolta Corporation Limited (Konica Minolta Inc.)
• Original Assignee: Minolta Corporation Limited (Konica Minolta Inc.)
• Inventors: Yoshida, Hiroki
• Application Number:
  US10/200,219
• Publication Number:
  US 20030021478A1
• Time in Patent Office: Days
• US Class Current: 382/195
• CPC Class Codes: G06T 2207/10024 Color image
• CPC Class Codes: G06T 2207/30201 Face
• CPC Class Codes: G06T 2207/30216 Redeye defect
• CPC Class Codes: G06T 5/005 Retouching; Inpainting; Scratch removal detecting, correction, reducing or removing defects, e.g. non-responsive pixels of solid state image sensors H04N25/68, scratch removal for cinematographic films scanned by electronic image sensor H04N5/253
• CPC Class Codes: G06T 5/008 Local, e.g. shadow enhancement
• CPC Class Codes: G06T 5/77 Retouching; Inpainting; Scratch removal
• CPC Class Codes: G06T 5/94 based on local image properties, e.g. for local contrast enhancement
• CPC Class Codes: G06T 7/0002 Inspection of images, e.g. flaw detection
• CPC Class Codes: G06T 7/11 Region-based segmentation
• CPC Class Codes: G06T 7/90 Determination of colour characteristics
• CPC Class Codes: G06V 40/193 Preprocessing; Feature extraction

Abstract

A computer program capable of appropriately identifying red-eye regions that are generated under various conditions, by causing a computer to function as an image processing apparatus having a characteristic region extracting unit that, based on characteristic levels of a target region encompassing an eye region of a target image, extracts from the target region as candidate red-eye regions multiple characteristic regions that include iris regions, and a red-eye region identification unit for identifying a red-eye region based on existence of contact between the iris regions and other characteristic regions, tone characteristics regarding characteristic levels of each characteristic region, and area information regarding areas of each characteristic region.

Claims

1. A computer program that causes a computer to function as an image processing apparatus comprising:

a characteristic region extracting unit for, based on characteristic levels of a target region encompassing an eye region of a target image, extracting from the target region as candidate red-eye regions multiple characteristic regions that include iris regions; and

a red-eye region identification unit for identifying a red-eye region based on existence of contact between the iris regions and other characteristic regions, tone characteristics regarding characteristic levels of each characteristic region, and area information regarding areas of each characteristic region.

2. A computer program as claimed in claim 1, wherein the characteristic region extracting unit extracts the characteristic regions based on characteristic levels for at least two types of characteristics from among hue, saturation and brightness, which are calculated from pixel values of the target region.

3. A computer program as claimed in claim 1, wherein the characteristic regions include, in addition to the iris regions, pupil regions and iris periphery regions, the iris region being a region having a hue and saturation that fall within prescribed ranges, the pupil region being a region having a saturation and brightness that fall within prescribed ranges, and the iris periphery region being a region having the same hue range as the iris region and the same brightness range as the pupil region.

4. A computer program as claimed in claim 1, wherein, where the iris region is in contact with another characteristic region, the red-eye region identification unit establishes as a candidate red-eye region the entire region consisting of the iris region and the the characteristic region that is in contact with the iris region, but where the iris region is not in contact with any other characteristic regions, the iris region is excluded as a candidate red-eye region.

5. A computer program as claimed in claim 4, wherein the red-eye region identification unit identifies one of the region established as candidate red-eye regions as a red-eye region based on evaluation values calculated from the tone characteristics and the area information.

6. A computer program as claimed in claim 1, wherein the area information consist of information regarding an area comprising the sum of an area of the iris region and an area of the other characteristic region that is in contact with the iris region.

7. A computer program as, claimed in claim 1, wherein the tone characteristics include values calculated from histograms regarding the characteristic levels for the iris region.

8. A computer program as claimed in claim 1, wherein the tone characteristics include values calculated from the positional continuity of the characteristic levels for the iris region.

9. A computer, program as claimed in claim 1, wherein the image processing apparatus further comprises:

a skin color information obtaining unit for obtaining skin color information from colors of pixels in an area surrounding the target region; and

a characteristic region excluding unit for, where color of pixels included in the characteristic region matches the skin color information, excluding the characteristic region as a candidate red-eye region.

10. A computer program as claimed in claim 9, wherein the image processing apparatus further comprises a skin color retrieval region establishing unit for establishing a size of the surrounding area by which to obtain the skin color information, based on a size of the target image and a size of the target region.

11. A computer readable recording medium that stores therein a computer program as claimed in claim 1.

12. A computer program that causes a computer to function as an image processing apparatus comprising:

a characteristic region extracting unit for, based on characteristic levels regarding a target region encompassing an eye region in a target image, extracting as candidate red-eye regions from the target region multiple characteristic regions that include iris regions;

a contact relationship detecting unit for determining whether each iris region is in contact with another characteristic region; and

a red-eye region identification unit for, where the contact relationship detecting unit determines that the iris region is in contact with another characteristic region, establishing the entire region comprising the iris region and the characteristic region as a candidate red-eye region, and identifying one of the regions thus established as a red-eye region.

13. A computer readable recording medium that stores therein a computer program as claimed in claim 12.

14. An image processing apparatus comprising:

a characteristic region extracting unit for, based on characteristic levels regarding a target region encompassing an eye region in a target image, extracting as candidate red-eye regions from the target region multiple characteristic regions that include iris regions; and

a red-eye region identification unit for identifying a red-eye region based on existence of contact between the iris regions and other characteristic regions, tone characteristics regarding characteristic levels of each characteristic region, and area information regarding areas of each characteristic region.

15. An image processing method comprising the steps of:

extracting as candidate red-eye regions, based on the characteristic levels for a target region encompassing an eye region in the target image, multiple characteristic regions that include iris regions from the target region; and

identifying a red-eye region based on existence of contact between the iris regions and other characteristic regions, tone characteristics regarding characteristic levels of each characteristic region, and area information regarding areas of each characteristic region.