Method, apparatus and recording medium for face extraction

• US 7,212,674 B1
• Filed: 11/15/2000
• Issued: 05/01/2007
• Est. Priority Date: 11/15/1999
• Status: Expired due to Fees

• Current Assignee: Fujifilm Corporation (Fujifilm Holdings Corporation)
• Original Assignee: Fujifilm Corporation (Fujifilm Holdings Corporation)
• Inventors: Takemoto, Fumito
• Primary Examiner(s): Bali; Vikkram
• Assistant Examiner(s): BHATNAGAR, ANAND P
• Application Number:
  US09/712,191
• Time in Patent Office: 2,358 Days
• Field of Search: 382/165, 382/195, 382/201, 382/209, 382/115, 382/118, 382/119, 382/154
• US Class Current: 382/209
• CPC Class Codes: G06T 2207/30201 Face
• CPC Class Codes: G06T 7/11 Region-based segmentation
• CPC Class Codes: G06V 40/162 using pixel segmentation or colour matching
• CPC Class Codes: H04N 1/628 Memory colours, e.g. skin or sky

Abstract

A human face is extracted easily from an image including the face. An image including a human face and a face template comprising data of outlines representing a face shape are displayed on a monitor. A user carries out position matching between the face template and a face area which is an image of the face to be extracted from the image, by moving, transforming and/or rotating the face template through an operation of input means, for example. Extraction means calculates a degree of matching between the face area and the template according to the position matching operation. When the degree of matching exceeds a predetermined threshold value, notice of extraction of the face area is displayed on the monitor. The extracted face area is subjected to processing for converting a color tone thereof.

Claims

1. A method of extracting a face area from an image including a human face, the face extraction method comprising the steps of:

displaying the image and a predetermined face template;

carrying out position matching between the face template and the face area to be extracted, by moving the face template and/or the image so that the face template is positioned on the face area to be extracted,

transforming and/or rotating the face template and/or the image on the face area position according to an input from input means by a user;

extracting the face area based on a result of position matching by generating unsharp images of the face template and an area corresponding to the face template in the image, calculating a degree of matching between the unsharp images in accordance with the position matching and extracting the face area based on the degree of matching.

2. A face extraction method as defined in claim 1, wherein the face template has a three-dimensional shape.

3. A face extraction method as defined in claim 2, wherein the three-dimensional shape is formed by a three-dimensional wire frame.

4. A face extraction method as defined in claim 1, wherein the face template has a color different from a skin color.

5. A face extraction method as defined in claim 4, wherein the color different from the skin color is a complementary color of the skin color.

6. A method of carrying out image processing on the face area extracted by using the face extraction method according to claim 1, the image processing method comprising the step of:

converting a color tone of a desired area including the face area to a color tone of a predetermined target image.

7. A face extraction apparatus for extracting a face area from an image including a human face, the apparatus comprising:

display means for displaying the image and a predetermined face template;

input means for receiving an input for moving and transforming the face template;

position matching means for carrying out position matching between the face template and the face area to be extracted, by moving the face template and/or the image so that the face template is positioned on the face area to be extracted, transforming and/or rotating the face template and/or the image on the face area position according to the input from the input means by a user; and

extraction means for extracting the face area based on a result of position matching by the position matching means,

wherein the extraction means extracts the face area by calculating a degree of matching according to the position matching by the position matching means by generating unsharp images of the face template and an area corresponding to the face template in the image and calculating the degree of matching between the unsharp images.

8. A face extraction apparatus as defined in claim 7, wherein the face template has a three-dimensional shape.

9. A face extraction apparatus as defined in claim 8, wherein the three-dimensional shape is formed by a three-dimensional wire frame.

10. A face extraction apparatus as defined in claim 7, wherein the face template has a color different from a skin color.

11. A face extraction apparatus as defined in claim 10, wherein the color different from the skin color is a complementary color to the skin color.

12. An image processing apparatus for carrying out image processing on the face area extracted by the face extraction apparatus according to claim 7, the image processing apparatus comprising:

conversion means for converting a color tone of a desired area including the face area to a color tone of a predetermined target image.

13. A computer-readable recording medium storing a program to cause a computer to execute a method of extracting a face area from an image including a human face, the program comprising the procedures of:

displaying the image and a predetermined face template;

carrying out position matching between the face template and the face area to be extracted, by moving the face template and/or the image so that the face template is positioned on the face area to be extracted, transforming and/or rotating the face template and/or the image on the face area position according to an input from input means by a user; and

extracting the face area based on a result of the position matching,

wherein the procedure of extracting the face area comprises the procedures of calculating a degree of matching between the face template and the face area in accordance with the position matching by generating unsharp images of the face template and an area corresponding to the face template in the image and calculating the degree of matching between the unsharp images and extracting the face area based on the degree of matching.

14. A computer-readable recording medium as defined in claim 13, wherein the face template has a three-dimensional shape.

15. A computer-readable recording medium as defined in claim 14, wherein the three-dimensional shape is formed by a three-dimensional wire frame.

16. A computer-readable recording medium as defined in claim 13, wherein the face template has a color different from a skin color.

17. A computer-readable recording medium as defined in claim 16, wherein the color different from the skin color is a complementary color to the skin color.

18. A computer-readable recording medium storing a program to cause a computer to execute a method of carrying out image processing on a face area extracted by the steps of:

displaying the image and a predetermined face template;

carrying out position matching between the face template and the face area to be extracted, by moving the face template and/or the image so that the face template is positioned on the face area to be extracted, transforming and/or rotating the face template and/or the image on the face area position according to an input from input means by a user; and

extracting the face area based on a result of position matching by generating unsharp images of the face template and an area corresponding to the face template in the image, calculating a degree of matching between the unsharp images in accordance with the position matching and extracting the face area based on the degree of matching; and

converting a color tone of a desired area including the face area to a color tone of a predetermined target image.