Method and device for processing virtual fitting model image

• US 9,792,700 B2
• Filed: 05/09/2014
• Issued: 10/17/2017
• Est. Priority Date: 08/19/2013
• Status: Active Grant

• Current Assignee: Beijing Jingdong Shangke Information Technology Co., Ltd. (JD.com, Inc.)
• Original Assignee: Beijing Jingdong Shangke Information Technology Co., Ltd. (JD.com, Inc.)
• Inventors: Zhao, Gang
• Primary Examiner(s): Sajous, Wesner
• Application Number:
  US14/913,198
• Publication Number:
  US 20160196668A1
• Time in Patent Office: 1,257 Days
• CPC Class Codes: G06T 11/001 Texturing; Colouring; Generation of texture or colour inpainting G06T5/77
• CPC Class Codes: G06T 19/20 Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
• CPC Class Codes: G06T 2207/30196 Human being; Person
• CPC Class Codes: G06T 2210/16 Cloth
• CPC Class Codes: G06T 2215/16 Using real world measurements to influence rendering
• CPC Class Codes: G06T 2219/2004 Aligning objects, relative positioning of parts
• CPC Class Codes: G06T 2219/2012 Colour editing, changing, or manipulating; Use of colour codes
• CPC Class Codes: G06T 7/40 Analysis of texture depth or shape recovery from texture G06T7/529
• CPC Class Codes: G06T 7/90 Determination of colour characteristics

Abstract

Provided in the present invention are a method and device for processing a virtual fitting model image, which help enable the fitting effect of a virtual fitting model to better approximate the fitting effect of a user. The method comprises: determining a human body skin color average value of a pre-selected area in a reference image, and calculating a ratio by dividing the human body skin color average value by a skin color average value of the virtual fitting model image; multiplying the various pixel values of the body area in the virtual fitting model image by the ratio, and using the results of multiplication as the various pixel values of the body area in the virtual fitting model image.

Claims

1. A computer-implemented method for processing an image of virtual fitting model using a computing device, the method comprising:

determining, with a processing device included in the computing device, an average value of skin tones of a human body in a pre-selected region of a reference image;

calculating, with the processing device, a ratio which is obtained from dividing the average value of skin tones of the human body by an average value of skin tones of an image of a virtual fitting model;

multiplying, with the processing device, each one of pixel values of a body region in the image of the virtual fitting model by said ratio; and

setting, with the processing device, the pixel values of the body region in the image of the virtual fitting model to the results of the multiplication to create a modified version of the image of the virtual fitting model.

2. The method of claim 1, wherein,

the pre-selected region is a facial region;

the step of determining an average value of skin tones of a human body in a pre-selected region of a reference image comprising;

determining a set of pixels of which colors fall within the skin tone range in the facial region;

taking an average value of colors of all pixels in the set of pixels, as the average value of skin tones of human body in the pre-selected region of the reference image.

3. The method of claim 2, wherein, the pixels of which colors fall within the skin tone range in the facial region are determined according to the following conditions:

Y>

0.35, R>

0.39G>

0.15, B>

0.09, V1-V2>

0.07, R/G<

1.8, R/B<

3.0, G/B<

3.0, R>

G and R>

B, wherein

Y=R×

0.299+G×

0.587+B×

0.114, V1=max(R,G,B), V2=min(R,G,B);

R, G and B represent values of red, green and blue components of each pixel.

4. The method of claim 3, wherein, before the step of calculating a ratio which is obtained from dividing the average value of skin tones of the human body by the average value of skin tones of the image of the virtual fitting model, the method further comprising calculating an average value of skin tones of the image of the virtual fitting model.

5. The method of claim 2, wherein, before the step of calculating a ratio which is obtained from dividing the average value of skin tones of the human body by the average value of skin tones of the image of the virtual fitting model, the method further comprising calculating an average value of skin tones of the image of the virtual fitting model.

6. The method of claim 1, wherein, before the step of calculating a ratio which is obtained from dividing the average value of skin tones of the human body by the average value of skin tones of the image of the virtual fitting model, the method further comprising calculating an average value of skin tones of the image of the virtual fitting model.

7. The method of claim 3, characterized in that, before the step of determining an average value of skin tones of the human body in a pre-selected region of a reference image, the method further comprising receiving information about determining the pre-selected region in the reference image.

8. The method of claim 2, characterized in that, before the step of determining an average value of skin tones of the human body in a pre-selected region of a reference image, the method further comprising receiving information about determining the pre-selected region in the reference image.

9. The method of claim 1, characterized in that, before the step of determining an average value of skin tones of the human body in a pre-selected region of a reference image, the method further comprising receiving information about determining the pre-selected region in the reference image.

10. A computing device for processing an image of virtual fitting model, characterized in that, the computing device comprising:

a processing device configured to

determine an average value of skin tones of a human body in a pre-selected region of a reference image;

calculate a ratio which is obtained from dividing the average value of skin tones of the human body by an average value of skin tones of an image of a virtual fitting model;

multiply each one of pixel values of a body region in the image of the virtual fitting model by said ratio;

set the pixel values of the body region in the image of the virtual fitting model to the results of the multiplication to generate a processed image of the virtual fitting model; and

output the processed image of the virtual fitting model.

11. The computing device of claim 10, characterized in that, the processing device is further configured to:

determine a set of pixels of which colors fall within the skin tone range in the facial region;

take an average value of colors of all pixels in the set of pixels, as the average value of skin tones of human body in the pre-selected region of the reference image.

12. The computing device of claim 11, characterized in that, the processing device is further configured to determine pixels of which colors fall within the skin tone range in the facial region according to the following conditions:

Y>

0.35, R>

0.39G>

0.15, B>

0.09, V1-V2>

0.07, R/G<

1.8, R/B<

3.0, G/B<

3.0, R>

G and R>

B, wherein

Y=R×

0.299+G×

0.587+B×

0.114, V1=max(R,G,B), V2=min(R,G,B);

R, G and B represent values of red, green and blue components of each pixel.

13. The computing device of claim 12, wherein, the processing device is further configured to calculate an average value of skin tones of the image of the virtual fitting model.

14. The computing device of claim 11, wherein, the processing device is further configured to calculate an average value of skin tones of the image of the virtual fitting model.

15. The computing device of claim 10, wherein, the processing device is further configured to calculate an average value of skin tones of the image of the virtual fitting model.

16. The computing device of claim 12, wherein, the processing device is further configured to receive information about determining the pre-selected region in the reference image.

17. The computing device of claim 11, wherein, the processing device is further configured to receive information about determining the pre-selected region in the reference image.

18. The computing device of claim 10, wherein, the processing device is further configured to receive information about determining the pre-selected region in the reference image.

19. Non-transitory computer readable medium storing instructions that, when executed by a processing device included in a computing device, perform a set of functions, the set of functions comprising:

determining an average value of skin tones of a human body in a pre-selected region of a reference image;

calculating a ratio which is obtained from dividing the average value of skin tones of the human body by an average value of skin tones of an image of a virtual fitting model;

multiplying each one of pixel values of a body region in the image of the virtual fitting model by said ratio;

setting the pixel values of the body region in the image of the virtual fitting model to the results of the multiplication to create a modified version of the image of the virtual fitting model; and

outputting the modified version of the image of the virtual fitting model for display on a terminal device.