Analysis using a three-dimensional facial image

• US 7,634,103 B2
• Filed: 12/21/2001
• Issued: 12/15/2009
• Est. Priority Date: 10/01/2001
• Status: Active Grant

• Current Assignee: L'Oreal SA
• Original Assignee: L'Oreal SA
• Inventors: Giacchetti, Daniela, Pruche, Francis, Rubinstenn, Gilles
• Primary Examiner(s): Strege; John B
• Application Number:
  US10/024,615
• Publication Number:
  US 20030063794A1
• Time in Patent Office: 2,916 Days
• Field of Search: 382/100, 382/128, 382/154, 382/118, 703/6, 345/619, 348/77
• US Class Current: 382/100
• CPC Class Codes: A45D 44/005 for selecting or displaying personal cosmetic colours or hairstyle
• CPC Class Codes: A61B 5/0059 using light, e.g. diagnosis by transillumination, diascopy, fluorescence A61B5/0093, A61B5/1455, A61B5/02416 and A61B5/0261 take precedence
• CPC Class Codes: A61B 5/1034 by means of colour cards
• CPC Class Codes: A61B 5/411 Detecting or monitoring allergy or intolerance reactions to an allergenic agent or substance
• CPC Class Codes: A61B 5/442 Evaluating skin mechanical properties, e.g. elasticity, hardness, texture, wrinkle assessment
• CPC Class Codes: A61B 5/444 Evaluating skin marks, e.g. mole, nevi, tumour, scar
• CPC Class Codes: A61B 5/445 Evaluating skin irritation or skin trauma, e.g. rash, eczema, wound, bed sore
• CPC Class Codes: A61B 5/446 Scalp evaluation or scalp disorder diagnosis, e.g. dandruff
• CPC Class Codes: A61B 5/4519 Muscles A61B5/389, A61B5/224 take precedence
• CPC Class Codes: A61B 5/7267 involving training the classification device
• CPC Class Codes: A61B 5/7475 User input or interface means, e.g. keyboard, pointing device, joystick
• CPC Class Codes: G01J 3/463 Colour matching
• CPC Class Codes: G01J 3/52 using colour charts
• CPC Class Codes: G01J 3/524 Calibration of colorimeters
• CPC Class Codes: G06T 11/00 2D [Two Dimensional] image generation
• CPC Class Codes: G16H 50/50 for simulation or modelling of medical disorders
• CPC Class Codes: H04N 23/61 based on recognised objects
• CPC Class Codes: H04N 23/661 Transmitting camera control signals through networks, e.g. control via the Internet

Abstract

Disclosed methods and systems related to enabling an analysis using a three-dimensional facial image. One of the methods involves facilitating construction of a three-dimensional facial image using at least captured image of a subject'"'"'s face. The method also involves facilitating a simulation of use of an aesthetic feature on the three-dimensional facial image and/or processing of the three-dimensional facial image to enable a beauty analysis.

Claims

1. A method of analyzing an external body condition using a three-dimensional facial image, the method comprising:

providing a computer system, wherein the computer system comprises a computer-readable medium containing instructions for execution by at least one processor;

constructing a three-dimensional facial image based on at least one captured image of a subject'"'"'s face, wherein the at least one captured image reflects at least one external body condition;

processing the three-dimensional facial image to enable a beauty analysis;

analyzing the at least one external body condition via the three-dimensional facial image;

selecting a beauty product for affecting the at least one external body condition based on the analyzing; and

displaying, on a display device, simulated effect of the beauty product on the external body condition via the three-dimensional facial image.

2. The method of claim 1, wherein the processor facilitates a computer graphics technique, and wherein constructing a three-dimensional facial image comprises constructing a three-dimensional facial image based on the computer graphics technique.

3. The method of claim 2, wherein providing a computer system comprises maintaining the computer system as a server, and providing the subject with an access to the server.

4. The method of claim 1, wherein the processor facilitates an image processing technique, and wherein processing the three-dimensional facial image comprises processing the three-dimensional facial image based on the image processing technique.

5. The method of claim 4, wherein the image processing technique comprises at least one of binarization, image partitioning, Fourier transforms, fast Fourier transforms (FFTs), and discrete cosine transforms.

6. The method of claim 4, wherein the image processing technique is applied to enable a beauty analysis.

7. The method of claim 1, wherein processing the three-dimensional facial image comprises identifying the at least one external body condition in the three-dimensional facial image.

8. The method of claim 1, wherein the beauty product comprises a make-up product.

9. The method of claim 1, further comprising displaying the three-dimensional facial image in a plurality of differing virtual perspectives.

10. The method of claim 1, wherein constructing a three-dimensional facial image further comprises:

transmitting the at least one captured image to a location remote from the subject, and

constructing a three-dimensional facial image at the remote location.

11. The method of claim 1, further comprising capturing on an image capturing device the at least one image of the subject'"'"'s face.

12. The method of claim 1, wherein processing the three-dimensional facial image comprises processing the three-dimensional facial image at a location remote from the subject.

13. The method of claim 1, wherein constructing a three-dimensional facial image comprises constructing a three-dimensional facial image using a plurality of facial images of the subject.

14. The method of claim 1, wherein constructing a three-dimensional facial image comprises constructing a three-dimensional facial image using the at least one image of the subject'"'"'s face and a three-dimensional frame.

15. The method of claim 1, wherein the analyzing the at least one external body condition comprises analyzing the at least one external body condition at a location remote from a location of the subject.

16. The method of claim 1, wherein displaying simulated effect of the beauty product comprises displaying a time-lapsed simulation of the three-dimensional facial image.

17. The method of claim 1, wherein constructing a three-dimensional facial image using at least one captured image of a subject'"'"'s face comprises applying the at least one captured image in a virtual manner on a three-dimensional frame.

18. The method of claim 17, wherein applying the at least one captured image comprises applying the at least one captured image in a virtual manner on a three-dimensional frame that is in the form of a virtual wire mesh.

19. The method of claim 17, further comprising generating the three-dimensional frame based on stored information.

20. The method of claim 17, further comprising generating the three-dimensional frame based on inputted information.

21. The method of claim 1, wherein the three-dimensional facial image reflects the at least one external body condition using a facial model.

22. The method of claim 1, further comprising calibrating the three-dimensional facial image to address a perceived difference between the three-dimensional facial image and the subject'"'"'s face.

23. The method of claim 1, further comprising color-calibrating the three-dimensional facial image to simulate the subject'"'"'s actual face.

24. The method of claim 23, wherein displaying simulated effect of the beauty product on the external body condition via the three-dimensional facial image comprises displaying simulated effect of the beauty product on the color-calibrated three-dimensional facial image.

25. The method of claim 23, wherein color-calibrating further comprises comparing a displayed color of the three-dimensional facial image with an actual color of an actual body region to color-calibrate the three-dimensional facial image.

26. The method of claim 1, wherein analyzing the external body condition via the three-dimensional facial image includes determining an extent and severity of the at least one external body condition.

27. The method of claim 1, wherein constructing a three-dimensional facial image further comprises adding a dimensional effect to the three-dimensional facial image.

28. The method of claim 1, wherein constructing a three-dimensional facial image further comprises adding a lighting effect to the three-dimensional facial image.

29. The method of claim 28, wherein adding a lighting effect comprises applying color homogenously to the facial image while modifying at least one of hue, tint, and shade based on a position of a virtual lighting source.

30. The method of claim 1, wherein constructing a three-dimensional facial image comprises constructing a three-dimensional facial image that includes selectable portions that, when selected, are displayed in two-dimensional form.

31. The method of claim 1, wherein constructing a three-dimensional facial image comprises constructing a two-dimensional facial image that includes selectable portions that, when selected, are displayed in three-dimensional form.

32. The method of claim 1, wherein the processor facilitates a computer graphics technique, and wherein processing the three-dimensional facial image comprises modifying, using the computer graphic technique, the three-dimensional facial image to reflect evolution of the external body condition over time.

33. The method of claim 1, further comprising receiving, using the processor, a feedback from the subject on the beauty product.

34. The method of claim 33, further comprising selecting, using the processor, a second beauty product based on the feedback.

35. The method of claim 34, further comprising displaying, on the display device, simulated effect of the beauty product and the second beauty product via the three-dimensional facial image.

36. The method of claim 1, further comprising providing, using the processor, the subject with information related to purchasing the beauty product.

37. The method of claim 1, wherein the processor facilitates an analytic technique, and wherein analyzing the at least one external body condition comprises analyzing the at least one external body condition based on the analytic technique.

38. The method of claim 37, wherein the analytic technique comprises at least one of statistical analysis, modeling, textual analysis, collaborative filtering, and artificial intelligence.

39. The method of claim 1, wherein selecting a beauty product comprises selecting a beauty product based on personal information of the subject, wherein the personal information comprises at least one of physical attributes, lifestyle information, type of look, and personal preferences.

40. A computer-readable medium containing instructions for causing a computer to perform a method of analyzing an external body condition using a three-dimensional facial image, the method comprising:

constructing a three-dimensional facial image based on at least one captured image of a subiect'"'"'s face, wherein the at least one captured image reflects at least one external body condition;

processing the three-dimensional facial image to enable a beauty analysis;

analyzing the at least one external body condition via the three-dimensional facial image;

selecting a beauty product for affecting the at least one external body condition based on the analyzing; and

displaying, on a display device, simulated effect of the beauty product on the external body condition via the three-dimensional facial image.

41. A computer system for use in analyzing an external body condition using a three-dimensional facial image, the system comprising:

a processor; and

a memory for storing instructions for the processor to perform a method comprising;

constructing a three-dimensional facial image based on at least one captured image of a subiect'"'"'s face, wherein the at least one captured image reflects at least one external body condition;

processing the three-dimensional facial image to enable a beauty analysis;

analyzing the at least one external body condition via the three-dimensional facial image;

selecting a beauty product for affecting the at least one external body condition based on the analyzing; and

displaying, on a display device, simulated effect of the beauty product on the external body condition via the three-dimensional facial image.