System and method for applying a reflectance modifying agent to change a person's appearance based on a digital image

• US 10,163,230 B2
• Filed: 07/06/2018
• Issued: 12/25/2018
• Est. Priority Date: 02/12/2007
• Status: Expired due to Fees

• Current Assignee: TCMS Transparent Beauty, LLC
• Original Assignee: TCMS Transparent Beauty, LLC
• Inventors: Edgar, Albert D., Iglehart, David C., Yeager, Rick B.
• Primary Examiner(s): Thomas, Mia M
• Application Number:
  US16/028,948
• Publication Number:
  US 20180315219A1
• Time in Patent Office: 172 Days
• CPC Class Codes: G06T 11/001 Texturing; Colouring; Generation of texture or colour inpainting G06T5/77
• CPC Class Codes: G06T 2207/10024 Color image
• CPC Class Codes: G06T 2207/30196 Human being; Person
• CPC Class Codes: G06T 7/0012 Biomedical image inspection
• CPC Class Codes: G06T 7/11 Region-based segmentation
• CPC Class Codes: G06T 7/90 Determination of colour characteristics
• CPC Class Codes: H04N 1/622 with simulation on a subsidiary picture reproducer
• CPC Class Codes: H04N 1/628 Memory colours, e.g. skin or sky

Abstract

A computer-controlled system determines attributes of a frexel, which is an area of human skin, and applies a reflectance modifying agent (RMA) at the pixel level to automatically change the appearance of human features based on one or more digital images. The change may be based on a digital image of the same frexel, for as seen in a prior digital photograph captured previously by the computer-controlled system. The system scans the frexel and uses feature recognition software to compare the person'"'"'s current features in the frexel with that person'"'"'s features in the digital image. It then calculates enhancements to the make the current features appear more like the features in the digital image, and it applies the RMA to the frexel to accomplish the enhancements. Or the change may be based on a digital image of another person, through the application of RMAs.

Claims

1. A system to change an appearance of a region of skin of a person, the system comprising:

at least one reflectance modifying agent application element, the reflectance modifying agent application element being operable to apply one or more reflectance modifying agents to frexels of the skin of the person; and

a computing device in communication with the at least one reflectance modifying agent application element, the computing device being operable to perform operations comprising;

receiving a desired image associated with the region of the skin, the desired image depicting one or more model features of skin,

receiving a first image depicting features of the region of the skin, the features being associated with a current appearance of the region of the skin,

comparing the desired image to the first image to determine a difference between a plurality of frexels within the first image and the desired image, and

providing the difference between the plurality of frexels, to the at least one reflectance modifying agent application element to apply the reflectance modifying agents to at least one of the plurality of frexels based on the difference, the reflectance modifying agents being applied to emulate the one or more model features of the desired image within the region of the skin of the person.

2. The system of claim 1, wherein the computing device is further operable to provide a digital image feature map based on the first image.

3. The system of claim 1, wherein the first image comprises a digital image of the person.

4. The system of claim 1, wherein the first image comprises a digital image of a region of human skin of a second person.

5. The system of claim 1, wherein the first image comprises reflectance and topographical data.

6. The system of claim 1, wherein the computing device is further operable to compare a digital feature map to a frexel feature map in order to generate a reconstruction image, the digital feature map being provided based on the desired image, the frexel feature map being provided based on the first image, the reconstruction image being generated by:

using the digital feature map as a model to derive enhancement values; and

generating the reconstruction image as an enhancement image based on the derived enhancement values.

7. The system of claim 1, wherein the computing device is further operable to perform operations comprising:

recognizing features in digital images;

creating a digital image feature map from each of the digital images;

creating a frexel feature map; and

generating a reconstruction image as an enhancement image based on a difference between values in the digital image feature map and values in the frexel feature map.

8. The system of claim 7, wherein generating the reconstruction image comprises applying a filtering ratio to the digital image feature map.

9. The system of claim 1, wherein a digital image feature map is provided based on a plurality of digital images, the reflectance modifying agent being applied to one or more frexels of the plurality of frexels based on the digital image feature map.

10. The system of claim 9, wherein the digital image feature map comprises data provided as an average of data across the plurality of digital images.

11. A computer-implemented method to change an appearance of a region of skin of a person, the method being executed using one or more processors and comprising:

receiving, by the one or more processors, a desired image associated with the region of the skin, the desired image depicting one or more model features of;

receiving a first image depicting features of the region of the skin, the features being associated with a current appearance of the region of the skin;

comparing, by the one or more processors, the desired image to the first image to determine a difference between a plurality of frexels within the first image and the desired image; and

providing, by the one or more processors, the difference between the plurality of frexels, to at least one reflectance modifying agent application element to apply reflectance modifying agents to at least one of the plurality of frexels based on the difference, the reflectance modifying agents being applied to emulate the one or more model features of the desired image within the region of the skin of the person.

12. The method of claim 11, further comprising providing a digital image feature map based on the first image.

13. The method of claim 11, wherein the first image comprises a digital image of the person.

14. The method of claim 11, wherein the first image comprises a digital image of a region of human skin of a second person.

15. The method of claim 11, wherein the first image comprises reflectance and topographical data.

16. The method of claim 11, further comprising comparing a digital feature map to a frexel feature map in order to generate a reconstruction image, the digital feature map being provided based on the desired image, the frexel feature map being provided based on the first image, the reconstruction image being generated by:

using the digital feature map as a model to derive enhancement values; and

generating the reconstruction image as an enhancement image based on the derived enhancement values.

17. The method of claim 11, further comprising:

recognizing features in digital images;

creating a digital image feature map from each of the digital images;

creating a frexel feature map; and

generating a reconstruction image as an enhancement image based on a difference between values in the digital image feature map and values in the frexel feature map.

18. The method of claim 17, wherein generating the reconstruction image comprises applying a filtering ratio to the digital image feature map.

19. The method of claim 11, wherein a digital image feature map is provided based on a plurality of digital images, the reflectance modifying agent being applied to one or more frexels of the plurality of frexels based on the digital image feature map.

20. A non-transitory computer-readable storage medium coupled to one or more processors and having instructions stored thereon which when executed by the one or more processors, cause the one or more processors to perform operations comprising:

receiving a desired image associated with the region of the skin, the desired image depicting one or more model features of skin;

receiving a first image depicting features of the region of the skin, the features being associated with a current appearance of the region of the skin;

comparing the desired image to the first image to determine a difference between a plurality of frexels within the first image and the desired image; and

providing the difference between the plurality of frexels to at least one reflectance modifying agent application element to apply reflectance modifying agents to at least one of the plurality of frexels based on the difference, the reflectance modifying agents being applied to emulate the one or more model features of the desired image within the region of the skin of the person.