System and method for applying a reflectance modifying agent to change a person's appearance based on a digital image

• US 10,043,292 B2
• Filed: 09/19/2016
• Issued: 08/07/2018
• Est. Priority Date: 08/14/2006
• Status: Expired due to Fees

• Current Assignee: TCMS Transparent Beauty, LLC
• Original Assignee: TCMS Transparent Beauty, LLC
• Inventors: Edgar, Albert D., Iglehart, David C., Yeager, Rick B.
• Primary Examiner(s): Thomas, Mia M
• Application Number:
  US15/269,091
• Publication Number:
  US 20170004635A1
• Time in Patent Office: 687 Days
• CPC Class Codes: G06T 11/001 Texturing; Colouring; Generation of texture or colour inpainting G06T5/77
• CPC Class Codes: G06T 2207/10024 Color image
• CPC Class Codes: G06T 2207/30196 Human being; Person
• CPC Class Codes: G06T 7/0012 Biomedical image inspection
• CPC Class Codes: G06T 7/11 Region-based segmentation
• CPC Class Codes: G06T 7/90 Determination of colour characteristics
• CPC Class Codes: H04N 1/622 with simulation on a subsidiary picture reproducer
• CPC Class Codes: H04N 1/628 Memory colours, e.g. skin or sky

Abstract

A computer-controlled system determines attributes of a frexel, which is an area of human skin, and applies a reflectance modifying agent (RMA) at the pixel level to automatically change the appearance of human features based on one or more digital images. The change may be based on a digital image of the same frexel, for as seen in a prior digital photograph captured previously by the computer-controlled system. The system scans the frexel and uses feature recognition software to compare the person'"'"'s current features in the frexel with that person'"'"'s features in the digital image. It then calculates enhancements to the make the current features appear more like the features in the digital image, and it applies the RMA to the frexel to accomplish the enhancements. Or the change may be based on a digital image of another person, through the application of RMAs.

Claims

1. A system to change an appearance of a region of skin of a person, the system comprising:

at least one image generating element configured to scan the region of the skin to generate digital images of the region of the skin;

at least one reflectance modifying agent application element, the reflectance modifying agent application element being operable to apply one or more reflectance modifying agents to frexels of the region of the skin of the person; and

a computing device that is coupled to the at least one image generating element and to the at least one reflectance modifying agent application element, the computing device being operable to perform operations comprising;

obtaining a desired image associated with the region of the skin depicting one or more model features of the region of the skin of the person,

instructing the at least one image generating element to scan the region of the skin to generate a first image depicting current features of the region of the skin,

retrieving from the at least one image generating element the first image,

comparing the desired image to the first image to determine a difference between a plurality of frexels within the first image and the desired image, and

instructing the at least one reflectance modifying agent application element, to apply the reflectance modifying agents to at least one of the plurality of frexels based on the difference, to emulate the one or more model features of the desired image within the region of the skin of the person.

2. The system of claim 1, further comprising providing a digital image feature map based on the first image.

3. The system of claim 1, wherein the first image comprises a digital image of the person.

4. The system of claim 1, wherein the first image comprises a digital image of a region of human skin of a second person.

5. The system of claim 1, wherein the first image comprises reflectance and topographical data.

6. The system of claim 1, further comprising comparing a digital feature map, which is provided based on the first image, and a frexel feature map to generate a reconstruction image by:

using the digital feature map as a model to derive enhancement values; and

generating the reconstruction image as an enhancement image based on the derived enhancement values.

7. The system of claim 1, wherein the computing device is further operable to perform operations comprising:

recognizing features in the digital images;

creating a digital image feature map from each of the digital images;

creating a frexel feature map; and

generating a reconstruction image as an enhancement image based on a difference between values in the digital image feature map and values in the frexel feature map.

8. The system of claim 7, wherein generating the reconstruction image comprises applying a filtering ratio to the digital image feature map.

9. The system of claim 1, wherein a digital image feature map is provided and is based on a plurality of digital images, the reflectance modifying agent being applied based on the digital image feature map.

10. The system of claim 9, wherein the digital image feature map comprises data provided as an average of data across the plurality of digital images.

11. A computer-implemented method to change an appearance of a region of skin of a person, the method being executed using one or more processors and comprising:

obtaining, by the one or more processors, a desired image associated with the region of the skin of depicting one or more model features of the region of the skin of the person;

instructing, by the one or more processors, at least one image generating element to scan the region of the skin to generate a first image depicting current features of the region of the skin;

retrieving, by the one or more processors, from the at least one image generating element the first image;

comparing, by the one or more processors, the desired image to the first image to determine a difference between a plurality of frexels within the first image and the desired image; and

instructing, by the one or more processors, at least one reflectance modifying agent application element, to apply reflectance modifying agents to at least one of the plurality of frexels based on the difference, to emulate the one or more model features of the desired image within the region of the skin of the person.

12. A non-transitory computer-readable storage device coupled to one or more processors and having instructions stored thereon which, when executed by the one or more processors, cause the one or more processors to perform operations comprising:

obtaining a desired image associated with a region of skin of a person depicting one or more model features of the region of the skin of the person;

instructing at least one image generating element to scan the region of the skin to generate a first image depicting current features of the region of the skin;

retrieving from the at least one image generating element the first image;

comparing the desired image to the first image to determine a difference between a plurality of frexels within the first image and the desired image; and

instructing at least one reflectance modifying agent application element, to apply reflectance modifying agents to at least one of the plurality of frexels based on the difference, to emulate the one or more model features of the desired image within the region of the skin of the person.