IMAGE PROCESSING DEVICE AND IMAGE PROCESSING METHOD

• US 20160063305A1
• Filed: 08/24/2015
• Published: 03/03/2016
• Est. Priority Date: 09/03/2014
• Status: Active Grant

• Current Assignee: Omron Corporation
• Original Assignee: Omron Corporation
• Inventors: Matsunaga, Jumpei, Kobayashi, Masayuki
• Granted Patent: US 9,542,599 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06T 11/001 Texturing; Colouring; Generation of texture or colour inpainting G06T5/77
• CPC Class Codes: G06T 2207/10024 Color image
• CPC Class Codes: G06T 2207/30201 Face
• CPC Class Codes: G06T 2207/30216 Redeye defect
• CPC Class Codes: G06T 5/77 Retouching; Inpainting; Scratch removal
• CPC Class Codes: G06T 7/11 Region-based segmentation
• CPC Class Codes: G06T 7/90 Determination of colour characteristics
• CPC Class Codes: G06V 40/161 Detection; Localisation; Normalisation
• CPC Class Codes: G06V 40/193 Preprocessing; Feature extraction
• CPC Class Codes: H04N 23/80 Camera processing pipelines; Components thereof

Abstract

An image processing device for correcting at least a portion of a face image containing a person'"'"'s face, includes an image acquisition unit that acquires a face image, a region extractor that extracts a pupil region containing a pupil from the face image, a determination unit that determines a presence or absence of halation in the pupil region, a first template acquisition unit that acquires a first template image which is a correction template image, a reference color acquisition unit that acquires a reference color corresponding to the person from the face image, a second template acquisition unit that generates a second template image using the first template image and the reference color, and a correction unit that composites the second template image with at least the region in the pupil region where the halation occurred to correct the halation.

Claims

1. An image processing device for correcting at least a portion of a face image containing a person'"'"'s face, the image processing device comprising:

an image acquisition unit that acquires a face image;

a region extractor that extracts a pupil region containing a pupil from the face image;

a determination unit that determines a presence or absence of halation in the pupil region;

a first template acquisition unit that acquires a first template image which is a correction template image;

a reference color acquisition unit that acquires a reference color corresponding to the person from the face image;

a second template acquisition unit that generates a second template image using the first template image and the reference color; and

a correction unit that composites the second template image with at least the region in the pupil region where the halation occurred to correct the halation.

2. The image processing device according to claim 1,

wherein the first template image is a grayscale image;

and

wherein the second template acquisition unit uses the reference color to convert the first template image into a color image and uses the color image as the second template image.

3. The image processing device according to claim 2, further comprising:

a correction value computing unit that computes a correction value on the basis of the reference color, the correction value used for matching the luminance of the first template image to the face image; and

wherein the second template acquisition unit uses the correction value to adjust the luminance of the first template image, and converts the first template image into a color image.

4. The image processing device according to claim 1, wherein the reference color acquisition unit extracts a region from the pupil region corresponding to the iris in which no halation occurred, and acquires a reference color from a pixel contained in the region.

5. The image processing device according to claim 2, wherein the reference color acquisition unit extracts a region from the pupil region corresponding to the iris in which no halation occurred, and acquires a reference color from a pixel contained in the region.

6. The image processing device according to claim 3, wherein the reference color acquisition unit extracts a region from the pupil region corresponding to the iris in which no halation occurred, and acquires a reference color from a pixel contained in the region.

7. The image processing device according to claim 4, wherein when there is no region within the pupil region that corresponds to the iris and in which no halation has occurred, the reference color acquisition unit extracts a region corresponding to the person'"'"'s skin from the face image, and acquires the reference color on the basis of the color of a pixel contained in the region.

8. An imaging device comprising:

an imaging unit that takes an image; and

an image processing device according to claim 1.

9. An image processing method performed in an image processing device for correcting at least a portion of a face image containing a person'"'"'s face, comprising:

acquiring a face image;

extracting a pupil region containing a pupil from the face image;

determining a presence or absence of halation in the pupil region;

acquiring a first template image which is a correction template image;

acquiring a reference color corresponding to the person from the face image;

generating a second template image using the first template image and the reference color; and

compositing the second template image with at least the region in the pupil region where the halation occurred to correct the halation.

10. A program stored on a non-transitory computer-readable medium that causes a computer to perform an image processing method for correcting at least a portion of a face image containing a person'"'"'s face, comprising:

acquiring a face image;

extracting a pupil region containing a pupil from the face image;

determining a presence or absence of halation in the pupil region;

acquiring a first template image which is a correction template image;

acquiring a reference color corresponding to the person from the face image;

generating a second template image using the first template image and the reference color; and

compositing the second template image with at least the region in the pupil region where the halation occurred to correct the halation.