MAKEUP SIMULATION SYSTEM, MAKEUP SIMULATION APPARATUS, MAKEUP SIMULATION METHOD, AND MAKEUP SIMULATION PROGRAM

• US 20120044335A1
• Filed: 08/07/2008
• Published: 02/23/2012
• Est. Priority Date: 08/10/2007
• Status: Abandoned Application

• Current Assignee: Shiseido Company Limited
• Original Assignee: Shiseido Company Limited
• Inventors: Goto, Yasuo
• Application Number:
  US12/672,300
• Publication Number:
  US 20120044335A1
• Time in Patent Office: Days
• US Class Current: 348/77
• CPC Class Codes: A45D 44/005 for selecting or displaying personal cosmetic colours or hairstyle
• CPC Class Codes: G06T 11/00 2D [Two Dimensional] image generation
• CPC Class Codes: G06T 13/40 of characters, e.g. humans, animals or virtual beings
• CPC Class Codes: G06V 40/171 Local features and components; Facial parts eye characteristics G06V40/18; Occluding parts, e.g. glasses; Geometrical relationships

Abstract

The present invention relates to a makeup simulation system, a makeup simulation apparatus, a makeup simulation method and a makeup simulation program and, more particularly, to a makeup simulation apparatus, a makeup simulation method and a makeup simulation program for applying a make up to a face of a user contained in a dynamic picture image, and includes picture-taking means for outputting the dynamic image; control means for image-processing and outputting the output dynamic image; and display means for displaying the dynamic image output from the control means, and the control means includes: face recognition processing means for recognizing the face of the user from the dynamic image in accordance with predetermined tracking points; and makeup processing means for applying a predetermined makeup to the face of the user contained in the dynamic image in accordance with the tracking points, and outputting to the display means.

Claims

1. A makeup simulation system for applying a makeup to a dynamic image of a face of a user, comprising:

picture-taking means for taking a picture of the face of the user and outputting the dynamic image;

control means for receiving the dynamic image output from said picture-taking means, and image-processing and outputting said dynamic image; and

display means for displaying the dynamic image output from said control means,

wherein said control means includes;

face recognition processing means for recognizing the face of the user from said dynamic image in accordance with predetermined tracking points; and

makeup processing means for applying a predetermined makeup to the face of the user contained in said dynamic image in accordance with said tracking points, and outputting to said display means,

wherein lipstick processing means included in said makeup processing means applies a lipstick process to the face of the user contained in said dynamic image in accordance with positions of a peak and a trough of an upper lip, left and light ends of a mouth, a lower end of a lower lip, and a position at ⅓

of a width of the mouth from the left end in the lower lip and a position at ⅓

of the width of the mouth from the right end in the lower lip.

2. The makeup simulation system as claimed in claim 1, wherein the shadow processing means included in said makeup processing means applies a shadow process to the face of the user contained in said dynamic image in accordance with a position of an inner corner of an eye included in said tracking points, a position of an outer corner of the eye, and a contour of the eye detected from a portion near the eye of the face of the user contained in said dynamic image.

3. The makeup simulation system as claimed in claim 2, wherein said shadow processing means includes:

contour detecting means for detecting a contour of the eye from the portion near the eye of the face of the user contained in said dynamic image; and

eyeline drawing means for performing drawing at said contour of the eye detected and a vicinity thereof.

4. The makeup simulation system as claimed in claim 3, wherein said eyeline drawing means causes a concentration of eye shadow to be decreased as being more separated from a start point of an application within an area to be applied with said eyeline or eye shadow.

5. The makeup simulation system as claimed in claim 1, wherein cheek processing means included in said makeup processing means applies a cheek process to the face of the user contained in said dynamic image in accordance with a position of an inner corner of an eye included in said tracking points, a position of an outer corner of the eye, left and right ends of a nose, left and right ends of a mouth, and a position of a pupil.

6. The makeup simulation system as claimed in claim 5, wherein said cheek processing means causes a concentration of rouge to be decreased as being more separated from a start point of an application within an area to be applied with the rouge as said cheek process.

7. The makeup simulation system as claimed in claim 1, wherein eyebrow processing means included in said makeup processing means applies an eyebrow process to the face of the user contained in said dynamic image in accordance with a position of an inner corner of an eye included in said tracking points, a position of an outer corner of the eye, a position of a nostril, a position of an inner end of an eyebrow, an outer end of the eyebrow, a peak of the eyebrow, a lower portion of a jaw, and a lower end of a lower eyelid.

8. The makeup simulation system as claimed in claim 7, wherein said eyebrow processing means assumes a hypothetical square including sides in contact with a transverse line indicating a maximum transverse width of the face of the user contained in said dynamic image and a vertical line vertically extended from a lowermost point of the jaw and having a length equal to a length of said transverse line, determining the peak of the eye relative to an upper side of said square, setting a target line from the inner corner of the eye to the outer corner of the eye in accordance with a result of the determination, and applying the eyebrow process in accordance with said target line.

9. The makeup simulation system as claimed in claim 8, wherein said eyebrow processing means sets the target line at an angle of 10 degrees to an eyebrow base line connecting a lower portion of the inner corner of the eye and the outer corner of the eye in accordance with a determination that the peak of the eyebrow is higher than the upper side of said square.

10. A makeup simulation apparatus configured to apply a makeup to a dynamic image of a face of a user, comprising:

picture-taking means for taking a picture of the face of the user and outputting the dynamic image;

control means for receiving the dynamic image output from said picture-taking means, and image-processing and outputting said dynamic image; and

display means for displaying the dynamic image output from said control means,

wherein said control means includes;

face recognition processing means for recognizing the face of the user from said dynamic image in accordance with predetermined tracking points; and

makeup processing means for applying a predetermined makeup to the face of the user contained in said dynamic image in accordance with said tracking points, and outputting to said display means,

wherein lipstick processing means included in said makeup processing means applies a lipstick process to the face of the user contained in said dynamic image in accordance with positions of a peak and a trough of an upper lip, left and light ends of a mouth, a lower end of a lower lip, and a position at ⅓

of a width of the mouth from the left end in the lower lip and a position at ⅓

of the width of the mouth from the right end in the lower lip.

11. A makeup simulation method in a makeup simulation system for applying a makeup to a dynamic image of a face of a user, comprising:

a step in which control means recognizes the face of the user from the dynamic image taken by picture-taking means, and starts a makeup simulation;

a step in which said control means recognizes the face of the user contained in said dynamic image in accordance with predetermined tracking points; and

a step in which said control means applies a predetermined makeup to the face of the user contained in said dynamic image in accordance with said tracking points, and outputs to display means,

wherein said control means applies a lipstick process to the face of the user contained in said dynamic image in accordance with positions of a peak and a trough of an upper lip, left and light ends of a mouth, a lower end of a lower lip, and a position at ⅓

of a width of the mouth from the left end in the lower lip and a position at ⅓

of the width of the mouth from the right end in the lower lip.

12. A makeup simulation program executed by a computer having at least an operation processing device, a memory device and an output device to apply a makeup to a dynamic image of a face of a user, the makeup simulation program causing said operation processing device to perform:

a step of recognizing the face of the user from the dynamic image taken by picture-taking means, and starting a makeup simulation;

a step of recognizing the face of the user contained in said dynamic image in accordance with predetermined tracking points; and

a step of applying a predetermined makeup to the face of the user contained in said dynamic image in accordance with said tracking points, and outputting to said output device,

wherein said operation processing device is caused to apply a lipstick process to the face of the user contained in said dynamic image in accordance with positions of a peak and a trough of an upper lip, left and light ends of a mouth, a lower end of a lower lip, and a position at ⅓

of a width of the mouth from the left end in the lower lip and a position at ⅓

of the width of the mouth from the right end in the lower lip.