TRANSPARENCY EVALUATION DEVICE, TRANSPARENCY EVALUATION METHOD AND TRANSPARENCY EVALUATION PROGRAM

• US 20160106198A1
• Filed: 12/01/2015
• Published: 04/21/2016
• Est. Priority Date: 06/07/2013
• Status: Active Grant

• Current Assignee: Fujifilm Corporation (Fujifilm Holdings Corporation)
• Original Assignee: Fujifilm Corporation (Fujifilm Holdings Corporation)
• Inventors: YOSHIDA, Naoko, OHGARU, Ikuko
• Granted Patent: US 9,750,326 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: A45D 2044/007 Devices for determining the condition of hair or skin or for selecting the appropriate cosmetic or hair treatment
• CPC Class Codes: A45D 44/00 Other cosmetic or toiletry articles, e.g. for hairdressers' rooms
• CPC Class Codes: A61B 2576/00 Medical imaging apparatus involving image processing or analysis A61B1/00009, A61B6/52 and A61B8/52 take precedence; image processing per se G06T; details of algorithms for analysing medical images G06T7/0012
• CPC Class Codes: A61B 5/1032 Determining colour for diagnostic purposes measuring colour in general G01J3/46
• CPC Class Codes: A61B 5/441 Skin evaluation, e.g. for skin disorder diagnosis
• CPC Class Codes: A61B 5/743 Displaying an image simultaneously with additional graphical information, e.g. symbols, charts, function plots
• CPC Class Codes: G01J 2003/467 Colour computing
• CPC Class Codes: G01N 21/251 Colorimeters; Construction thereof
• CPC Class Codes: G01N 21/27 using photo-electric detection G01N21/31 takes precedence; circuits for computing concentration logarithmic circuits G06G7/24; photometric circuits in general G01J
• CPC Class Codes: G01N 21/57 Measuring gloss
• CPC Class Codes: G16H 30/40 for processing medical images, e.g. editing

Abstract

A transparency evaluation device includes a skin index calculation unit that calculates at least one of a luminance component in a captured image obtained by photographing a skin, a color component in the captured image, and an amount of generation of negative factors in which the luminance component or the color component in the captured image changes locally, as a first index, obtains at least one of an intensity distribution of the luminance component and an intensity distribution of the color component in the captured image, and calculates at least one of smoothness of a change in the luminance component and smoothness of a change in the color component as a second index based on the intensity distributions, and a transparency evaluation unit that evaluates transparency of the skin based on an overall index in which the first index and the second index are combined.

Claims

1. A transparency evaluation device comprising:

an image input unit that inputs a captured image obtained by photographing a skin of a subject;

a skin index calculation unit that calculates at least one of a representative value of a luminance component in the captured image, a representative value of a color component in the captured image, and an amount of generation of negative factors in which a value of the luminance component or a value of the color component in the captured image changes locally, as a first skin evaluation index, obtains at least one of an intensity distribution of the luminance component and an intensity distribution of the color component in the captured image, and calculates at least one of smoothness of a change in the luminance component and smoothness of a change in the color component as a second skin evaluation index based on the obtained intensity distributions;

an overall index calculation unit that combines a plurality of evaluation indexes including the first skin evaluation index and the second skin evaluation index calculated by the skin index calculation unit with one another to calculate an overall index for transparency of the skin; and

a transparency evaluation unit that evaluates transparency of the skin of the subject based on the overall index calculated by the overall index calculation unit.

2. The transparency evaluation device according to claim 1,

wherein the skin index calculation unit partitions the captured image according to the value of the luminance component and the value of the color component using a plurality of contour lines set stepwise with uniform intensity spacings in order to obtain the intensity distribution of the luminance component and the intensity distribution of the color component in the captured image.

3. The transparency evaluation device according to claim 2,

wherein the skin index calculation unit obtains respective spacings of the plurality of contour lines adjacent to each other, and calculates the second skin evaluation index based on uniformity of the obtained spacings of the plurality of contour lines.

4. The transparency evaluation device according to claim 2,

wherein the skin index calculation unit calculates the second skin evaluation index based on the number of the plurality of contour lines partitioning the captured image.

5. The transparency evaluation device according to claim 1,

wherein the skin index calculation unit sets the evaluation region for calculating the second skin evaluation index so that a linear connection from a cheek portion of the face of the subject to an outline portion of the face is made.

6. The transparency evaluation device according to claim 1,

wherein the skin index calculation unit calculates an average value of the luminance component in the captured image as a representative value of the luminance component, and calculates an average value of the color component in the captured image as a representative value of the color component.

7. The transparency evaluation device according to claim 1,

wherein the skin index calculation unit calculates the number, a total area, or an area proportion of the negative factors detected from the captured image as an amount of generation of the negative factors.

8. The transparency evaluation device according to claim 1,

wherein the skin index calculation unit detects a portion in which the value of the luminance component or the value of the color component in the captured image changes locally and that is larger than the negative factors as color unevenness, and calculates an amount of generation of the detected color unevenness as a third skin evaluation index, and

the overall index calculation unit combines a plurality of evaluation indexes further including the third skin evaluation index with one another to calculate the overall index.

9. The transparency evaluation device according to claim 8,

wherein the skin index calculation unit calculates a total area, an area proportion, or the number of instances of color unevenness detected from the captured image as an amount of generation of the color unevenness.

10. A transparency evaluation method comprising:

inputting a captured image obtained by photographing a skin of a subject;

calculating at least one of a representative value of a luminance component in the captured image, a representative value of a color component in the captured image, and an amount of generation of negative factors in which a value of the luminance component or a value of the color component in the captured image changes locally, as a first skin evaluation index, obtaining at least one of an intensity distribution of the luminance component and an intensity distribution of the color component in the captured image, and calculating at least one of smoothness of a change in the luminance component and smoothness of a change in the color component as a second skin evaluation index based on the obtained intensity distributions;

combining a plurality of evaluation indexes including the first skin evaluation index and the second skin evaluation index that have been calculated with one another to calculate an overall index for transparency of the skin; and

evaluating transparency of the skin of the subject based on the calculated overall index.

11. A non-transitory computer-readable medium storing a transparency evaluation program for causing a computer to execute the steps of:

acquiring a captured image obtained by photographing a skin of a subject;

calculating at least one of a representative value of a luminance component in the captured image, a representative value of a color component in the captured image, and an amount of generation of negative factors in which a value of the luminance component or a value of the color component in the captured image changes locally, as a first skin evaluation index, obtaining at least one of an intensity distribution of the luminance component and an intensity distribution of the color component in the captured image, and calculating at least one of smoothness of a change in the luminance component and smoothness of a change in the color component as a second skin evaluation index based on the obtained intensity distributions;

combining a plurality of evaluation indexes including the first skin evaluation index and the second skin evaluation index that have been calculated with one another to calculate an overall index for transparency of the skin; and

evaluating transparency of the skin of the subject based on the calculated overall index.

12. A transparency evaluation device comprising:

an image input unit that inputs a captured image obtained by photographing a face of a subject subjected to makeup;

a skin index calculation unit that calculates at least one of a representative value of a luminance component in the captured image, a representative value of a color component in the captured image, and an amount of generation of negative factors in which a value of the luminance component or a value of the color component in the captured image changes locally, as a first skin evaluation index;

a makeup index calculation unit that calculates an amount of a red component due to complexion in the captured image as a first makeup evaluation index;

an overall index calculation unit that combines a plurality of evaluation indexes including the first skin evaluation index and the first makeup evaluation index respectively calculated by the skin index calculation unit and the makeup index calculation unit with one another to calculate an overall index for transparency; and

a transparency evaluation unit that evaluates transparency of the face of the subject subjected to makeup based on the overall index calculated by the overall index calculation unit.

13. The transparency evaluation device according to claim 12,

wherein the makeup index calculation unit calculates an average value of the red component in the captured image, an area of a portion in which the red component is detected in the captured image, or an area proportion of the portion in which the red component is detected in the captured image as an amount of the red component.

14. The transparency evaluation device according to claim 12,

wherein the makeup index calculation unit sets a predetermined evaluation region in at least one of a glabella portion, a cheek portion, and a jaw portion of the face of the subject, and calculates an amount of the red component in the predetermined evaluation region.

15. The transparency evaluation device according to claim 12,

wherein the makeup index calculation unit detects a freckle portion in which a value of the luminance component or a value of the color component in the captured image changes locally, and calculates a color tone difference between the freckle portion and surroundings thereof as a second makeup evaluation index, and

the overall index calculation unit combines a plurality of evaluation indexes further including the second makeup evaluation index with one another to calculate the overall index.

16. The transparency evaluation device according to claim 12,

wherein the makeup index calculation unit detects a low luminance portion indicating a shadow generated in the face of the subject based on the value of the luminance component in the captured image as an irregularity portion, and calculates an amount of the irregularity portion as a third makeup evaluation index, and

the overall index calculation unit combines a plurality of evaluation indexes further including the third makeup evaluation index with one another to calculate the overall index.

17. The transparency evaluation device according to claim 16,

wherein the makeup index calculation unit calculates an area or an area proportion of the irregularity portion in the captured image as an amount of the irregularity portion.

18. The transparency evaluation device according to claim 16,

wherein the makeup index calculation unit sets a predetermined region in at least one of an eye portion and a portion extending from a nose to a mouth in the face of the subject, and calculates an amount of the irregularity portion in the predetermined region.

19. The transparency evaluation device according to claim 12,

wherein the makeup index calculation unit extracts the luminance component derived from the makeup or the color component derived from the makeup from the captured image based on values of luminance components or values of color components different from each other derived from the skin and the makeup, extracts a portion in which a value of the luminance component derived from the makeup or a value of the color component derived from the makeup changes non-uniformly, and calculates a non-uniformity of the makeup as a fourth makeup evaluation index, and

the overall index calculation unit combines a plurality of evaluation indexes further including the fourth makeup evaluation index with one another to calculate the overall index.

20. The transparency evaluation device according to claim 19,

wherein the makeup index calculation unit sets a predetermined region in a cheek portion of the subject, and calculates a non-uniformity of the makeup in the predetermined region.

21. The transparency evaluation device according to claim 12,

wherein the makeup index calculation unit detects an intermediate gloss portion indicating shine of the face of the subject based on the intensity of the luminance component in the captured image, and calculates an amount of the intermediate gloss portion as a fifth makeup evaluation index, and

the overall index calculation unit combines a plurality of evaluation indexes further including the fifth makeup evaluation index with one another to calculate the overall index.

22. The transparency evaluation device according to claim 21,

wherein the makeup index calculation unit sets a predetermined region in at least one of a cheekbone portion and a nose ridge portion of the face of the subject, and calculates an amount of the gloss portion in the predetermined region.

23. The transparency evaluation device according to claim 12,

wherein the skin index calculation unit obtains at least one of an intensity distribution of the luminance component and an intensity distribution of the color component in the captured image, and calculates at least one of smoothness of a change in the luminance component and smoothness of a change in the color component as a second skin evaluation index based on the obtained intensity distributions, and

the overall index calculation unit combines a plurality of evaluation indexes further including the second skin evaluation index with one another to calculate the overall index.

24. The transparency evaluation device according to claim 12,

wherein the skin index calculation unit detects a portion in which the value of the luminance component or the value of the color component in the captured image changes locally and that is larger than the negative factors as color unevenness, and calculates an amount of generation of the detected color unevenness as a third skin evaluation index, and

the overall index calculation unit combines a plurality of evaluation indexes further including the third skin evaluation index with one another to calculate the overall index.

25. A transparency evaluation method comprising:

inputting a captured image obtained by photographing a face of a subject subjected to makeup;

calculating at least one of a representative value of a luminance component in the captured image, a representative value of a color component in the captured image, and an amount of generation of negative factors in which a value of the luminance component or a value of the color component in the captured image changes locally, as a first skin evaluation index;

calculating an amount of a red component due to complexion in the captured image as a first makeup evaluation index;

combining a plurality of evaluation indexes including the first skin evaluation index and the first makeup evaluation index that have been calculated with one another to calculate an overall index for transparency; and

evaluating transparency of the face of the subject subjected to makeup based on the calculated overall index.

26. A non-transitory computer-readable medium storing a transparency evaluation program for causing a computer to execute the steps of:

acquiring a captured image obtained by photographing a face of a subject subjected to makeup;

calculating at least one of a representative value of a luminance component in the captured image, a representative value of a color component in the captured image, and an amount of generation of negative factors in which a value of the luminance component or a value of the color component in the captured image changes locally, as a first skin evaluation index;

calculating an amount of a red component due to complexion in the captured image as a first makeup evaluation index;

combining a plurality of evaluation indexes including the first skin evaluation index and the first makeup evaluation index that have been calculated with one another to calculate an overall index for transparency; and

evaluating transparency of the face of the subject subjected to makeup based on the calculated overall index.