Image morphing processing using confidence levels based on captured images

• US 9,704,296 B2
• Filed: 07/22/2014
• Issued: 07/11/2017
• Est. Priority Date: 07/22/2013
• Status: Active Grant

• Current Assignee: Trupik, Inc.
• Original Assignee: Trupik, Inc.
• Inventors: Tirumala, Sridhar, Inumpudi, Aravind, Harmon, David Joseph, Katpally Reddy, Vikranth
• Primary Examiner(s): Faulk, Devona
• Assistant Examiner(s): Wu, Kevin
• Application Number:
  US14/338,093
• Publication Number:
  US 20150022550A1
• Time in Patent Office: 1,085 Days
• Field of Search: 345419, 345473, 705 2661, 382173, 702 272, 700132
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06T 19/20 Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
• CPC Class Codes: G06T 2210/16 Cloth
• CPC Class Codes: G06T 2219/2016 Rotation, translation, scaling

Abstract

Embodiments of the present disclosure can be used to generate an image replica of a person wearing various outfits to help the person visualize how clothes and accessories will look without actually having to try them on. Images can be generated from various angles to provide the person an experience as close as possible to actually wearing the clothes, accessories and looking at themselves in the mirror. Among other things, embodiments of the present disclosure can help remove much of the current uncertainty involved in buying clothing and accessories online.

Claims

1. A computer-implemented method comprising:

receiving, by a computer system over a network, a first image of a human subject from an image creation device, the first image including a portion of the subject'"'"'s body;

determining, based on the first image, dimensions of the subject'"'"'s body;

determining, based on the first image, a first fit of clothing to the subject'"'"'s body for a first portion of the subject'"'"'s body covered in the clothing;

determining, based on the first image, that a second fit for a second portion of the subject'"'"'s body covered in the clothing is more tight-fitting than the first fit;

receiving, by the computer system over the network, a second image of the subject from the image creation device, the second image including the subject'"'"'s head;

generating a third image by the computer system, the third image including an image of the subject'"'"'s body based on the determined dimensions, and an image of the subject'"'"'s head based on the second image, the generating including merging the image of the subject'"'"'s body and the image of the subject'"'"'s head using a morphing technique between a lower portion of the subject'"'"'s head and an upper portion of the subject'"'"'s body, and the generating further including;

determining a first confidence level for the first portion of the subject'"'"'s body, the first confidence level based on the first fit, and

determining a second confidence level for the second portion of the subject'"'"'s body, the second confidence level based on the second fit,

wherein the second confidence level is greater than the first confidence level, and the third image is generated based on the first confidence level and the second confidence level;

storing one or more of the first image, the second image, or the third image in a database in communication with the computer system; and

presenting the third image via a display device in communication with the computer system.

2. The method of claim 1, wherein the lower portion of the subject'"'"'s head includes the subject'"'"'s chin, and wherein the upper portion of the subject'"'"'s body includes the subject'"'"'s chest.

3. The method of claim 1, wherein the subject is wearing clothes in one or more of the first image or the second image.

4. The method of claim 1, wherein the image creation device comprises a three-dimensional camera.

5. The method of claim 1, wherein determining the dimensions of the subject'"'"'s body is based on a first plurality of received images, and the subject is in different poses in at least two of the images.

6. The method of claim 1, wherein the image of the subject'"'"'s head is based on a second plurality of received images.

7. The method of claim 1, wherein generating the image of the subject'"'"'s body based on the determined dimensions includes adjusting the image of the subject'"'"'s body based on a known gender for the subject.

8. The method of claim 1, wherein generating the image of the subject'"'"'s body based on the determined dimensions includes determining one or more of a curve, an ellipse, an parabola, or a cardioid for representing at least a portion of the subject'"'"'s body.

9. The method of claim 1, wherein generating the image of the subject'"'"'s body based on the determined dimensions includes determining a characteristic for a portion of the subject'"'"'s body that is covered by clothing in the first received image.

10. The method of claim 1, wherein generating the third image includes applying a color gradient present on the subject'"'"'s head in the second image to a portion of the third image where the image of the subject'"'"'s body and the image of the subject'"'"'s head interface.

11. The method of claim 1, wherein generating the third image includes applying an error correction factor to the generated image of the subject'"'"'s body, and the error correction factor is determined based on an interaction of the subject'"'"'s clothing and the subject'"'"'s body from the first image.

12. The method of claim 1, further comprising providing one or more of an audible alert or a visual alert via a user interface in communication with the computer system in response to a determination that a size of garment selected by the user is not likely to fit the subject, based on the determined dimensions of the subject.

13. A tangible, non-transitory, computer-readable medium storing instructions that, when executed by a computer system, cause the computer system to:

receive, over a network, a first image of a human subject from an image creation device, the first image including a portion of the subject'"'"'s body;

determine, based on the first image, dimensions of the subject'"'"'s body;

determine, based on the first image, a first fit of clothing to the subject'"'"'s body for a first portion of the subject'"'"'s body covered in the clothing;

determine, based on the first image, that a second fit for a second portion of the subject'"'"'s body covered in the clothing is more tight-fitting than the first fit;

receive, over the network, a second image of the subject from the image creation device, the second image including the subject'"'"'s head;

generate a third image, the third image including an image of the subject'"'"'s body based on the determined dimensions, and an image of the subject'"'"'s head based on the second image, the generating including merging the image of the subject'"'"'s body and the image of the subject'"'"'s head using a morphing technique between a lower portion of the subject'"'"'s head and an upper portion of the subject'"'"'s body, and the generating further including;

determining a first confidence level for the first portion of the subject'"'"'s body, the first confidence level based on the first fit, and

determining a second confidence level for the second portion of the subject'"'"'s body, the second confidence level based on the second fit,

wherein the second confidence level is greater than the first confidence level, and the third image is generated based on the first confidence level and the second confidence level;

store one or more of the first image, the second image, or the third image in a database in communication with the computer system; and

present the third image via a display device in communication with the computer system.

14. A system comprising:

a database configured to store images;

a display device;

a processor; and

memory in communication with the processor and storing instructions that, when executed by the processor, cause the system to;

receive, over a network, a first image of a human subject from an image creation device, the first image including a portion of the subject'"'"'s body;

determine, based on the first image, dimensions of the subject'"'"'s body;

determine, based on the first image, a first fit of clothing to the subject'"'"'s body for a first portion of the subject'"'"'s body covered in the clothing;

determine, based on the first image, that a second fit for a second portion of the subject'"'"'s body covered in the clothing is more tight-fitting than the first fit;

receive, over the network, a second image of the subject from the image creation device, the second image including the subject'"'"'s head;

generate a third image, the third image including an image of the subject'"'"'s body based on the determined dimensions, and an image of the subject'"'"'s head based on the second image, the generating including merging the image of the subject'"'"'s body and the image of the subject'"'"'s head using a morphing technique between a lower portion of the subject'"'"'s head and an upper portion of the subject'"'"'s body, and the generating further including;

determining a first confidence level for the first portion of the subject'"'"'s body, the confidence level based on the first fit, and

determining a second confidence level for the second portion of the subject'"'"'s body, the second confidence level based on the second fit,

wherein the second confidence level is greater than the first confidence level, and the third image is generated based on the first confidence level and the second confidence level;

store one or more of the first image, the second image, or the third image in the database; and

present the third image via the display device.