System and method for applying a reflectance modifying agent to change a person's appearance based on a digital image

• US 10,467,779 B2
• Filed: 12/04/2018
• Issued: 11/05/2019
• Est. Priority Date: 02/12/2007
• Status: Active Grant

• Current Assignee: TCMS Transparent Beauty, LLC
• Original Assignee: TCMS Transparent Beauty, LLC
• Inventors: Edgar, Albert D., Iglehart, David C., Yeager, Rick B.
• Primary Examiner(s): Thomas, Mia M
• Application Number:
  US16/209,475
• Publication Number:
  US 20190096097A1
• Time in Patent Office: 336 Days
• CPC Class Codes: G06T 11/001 Texturing; Colouring; Generation of texture or colour inpainting G06T5/77
• CPC Class Codes: G06T 2207/10024 Color image
• CPC Class Codes: G06T 2207/30196 Human being; Person
• CPC Class Codes: G06T 7/0012 Biomedical image inspection
• CPC Class Codes: G06T 7/11 Region-based segmentation
• CPC Class Codes: G06T 7/90 Determination of colour characteristics
• CPC Class Codes: H04N 1/622 with simulation on a subsidiary picture reproducer
• CPC Class Codes: H04N 1/628 Memory colours, e.g. skin or sky

Abstract

A computer-controlled system determines attributes of a frexel, which is an area of human skin, and applies a reflectance modifying agent (RMA) at the pixel level to automatically change the appearance of human features based on one or more digital images. The change may be based on a digital image of the same frexel, for as seen in a prior digital photograph captured previously by the computer-controlled system. The system scans the frexel and uses feature recognition software to compare the person'"'"'s current features in the frexel with that person'"'"'s features in the digital image. It then calculates enhancements to the make the current features appear more like the features in the digital image, and it applies the RMA to the frexel to accomplish the enhancements. Or the change may be based on a digital image of another person, through the application of RMAs.

Claims

1. A system for changing an appearance of a region of human skin of a first person, the system comprising:

at least one reflectance modifying agent application element, the reflectance modifying agent application element being operable to selectively apply one or more reflectance modifying agents to frexels of the human skin; and

a computing environment that is coupled to the at least one reflectance modifying agent application element and that is operable to perform operations comprising;

receiving an input comprising one or more features desired for the region of the human skin,

scanning a plurality of frexels of the human skin,

generating a feature map based on the plurality of frexels,

generating enhancement data based on the input and the feature map,

generating an enhancement image based on the enhancement data, and

instructing the at least one reflectance modifying agent application element to apply the one or more reflectance modifying agents to at least one of the plurality of frexels based on the enhancement image.

2. The system of claim 1, wherein the input comprises a digital image of the region of human skin and includes desired features.

3. The system of claim 1, wherein the input comprises a digital image of a corresponding region of human skin of a second person.

4. The system of claim 3, wherein the computing environment is further operable to perform operations comprising:

comparing the digital image with a second image of the first person, the second image having been generated after the digital image;

using the digital image as a model to derive enhancement values based on the second image; and

generating the enhancement image based on the enhancement values.

5. The system of claim 1, wherein the computing environment is further operable to perform operations comprising:

recognizing features in digital images;

creating a digital image feature map;

creating a frexel feature map; and

generating the enhancement image based on a difference between values in the digital image feature map and values in the frexel feature-map, reduced by a filtering ratio.

6. A method for changing an appearance of a region of human skin of a first person, the method comprising

receiving an input comprising one or more features desired for the region of the human skin;

scanning a plurality of frexels of the human skin to generate a feature map;

generating enhancement data based on the input and the feature map;

generating an enhancement image based on the enhancement data; and

applying one or more reflectance modifying agents to at least one of the plurality of frexels based on the enhancement image.

7. The method of claim 6, wherein obtaining the input comprises retrieving the input from computer-readable memory.

8. The method of claim 6, wherein obtaining the input comprises generating a plurality of values for features by averaging a plurality of digital images of the first person.

9. The method of claim 6, wherein the input comprises a digital image of a second person.

10. The method of claim 6, wherein the reflectance modifying agent application element is operable to selectively apply the one or more reflectance modifying agents to frexels of the human skin.

11. The method of claim 6, wherein obtaining the input comprises obtaining the input in a data format that comprises reflectance and topographical data.

12. The method of claim 11, wherein the feature map further comprises scan data in a format that comprises reflectance and topographical data.

13. The method of claim 11, wherein generating enhancement data comprises comparing the reflectance and topographical data of the input and the feature map.

14. The method of claim 6, wherein generating enhancement data comprises applying a filter to a difference between the input and the feature map.