Systems and methods for adjusting a virtual try-on

• US 9,286,715 B2
• Filed: 02/25/2013
• Issued: 03/15/2016
• Est. Priority Date: 05/23/2012
• Status: Active Grant

• Current Assignee: Luxottica Retail North America Incorporated (EssilorLuxottica SA)
• Original Assignee: Glasses com Inc (EssilorLuxottica SA)
• Inventors: Coon, Jonathan, Engle, Ryan
• Primary Examiner(s): Wu, Xiao
• Assistant Examiner(s): Wu, Chong
• Application Number:
  US13/775,785
• Publication Number:
  US 20130321412A1
• Time in Patent Office: 1,114 Days
• US Class Current: 1/1
• CPC Class Codes: G02C 13/003 Measuring during assembly or fitting of spectacles
• CPC Class Codes: G06T 17/00 Three dimensional [3D] modelling, e.g. data description of 3D objects
• CPC Class Codes: G06T 19/20 Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
• CPC Class Codes: G06T 2219/2004 Aligning objects, relative positioning of parts

Abstract

According to at least one embodiment, a computer-implemented method for generating a virtual try-on is described. A first model is obtained. The first model includes a first set of attachment points. A second model is obtained. The second model includes a first set of connection points. The first model and the second model are combined. Combining the first and second models includes matching the first set of attachment points with the first set of connection points. An image is rendered based on at least a portion of the combined first and second models.

Claims

1. A computer-implemented method for generating a virtual try-on, the method comprising:

obtaining, by a processor, a first model, the first model comprising a first set of two or more attachment points and a second set of one or more attachment points, wherein the first model comprises a three-dimensional model of a user'"'"'s face;

wherein the first set of attachment points includes at least an attachment point on a first facial feature on the model of a user'"'"'s face and an attachment point on a second facial feature on the model of a user'"'"'s face, and wherein the second set of attachment points includes a second attachment point on the first facial feature or on the second facial feature;

obtaining, by the processor, a second model, the second model comprising a first set of connection points;

combining, by the processor, the first model and the second model, wherein combining the first and second models comprises matching at least one of the first set of attachment points with at least one of the first set of connection points; and

rendering, by the processor, an image based on at least a portion of the combined first and second models.

2. The method of claim 1, further comprising:

receiving an adjustment command; and

adjusting the combined first and second models based on the adjustment command.

3. The method of claim 2, wherein:

adjusting the combined first and second models comprises matching the second set of attachment points with the first set of connection points.

4. The method of claim 2, wherein:

the second model further comprises a second set of connection points; and

adjusting the combined first and second models comprises matching the first set of attachment points with the second set of connection points.

5. The method of claim 2, wherein:

the second model further comprises a second set of connection points; and

adjusting the combined first and second models comprises matching the second set of attachment points with the second set of connection points.

6. The method of claim 2, wherein receiving the adjustment command comprises receiving a touch input.

7. The method of claim 6, wherein the three-dimensional model of the user comprises a morphable model.

8. The method of claim 6, wherein the first set of connection points comprises a nosepiece connection point and at least one earpiece connection point;

and

wherein the first set of attachment points comprises a nose attachment point and an ear attachment point.

9. The method of claim 6, wherein the second model comprises a three-dimensional model of glasses.

10. The method of claim 9, wherein the first set of connection points comprises a nosepiece connection point and at least one temple point.

11. The method of claim 9, wherein the combined first and second models comprises a modeled virtual try-on.

12. The method of claim 1, wherein the first facial feature is an ear of the model of a user'"'"'s face and the second facial feature is the nose of the model of a user'"'"'s face;

wherein the first set of attachment points includes at least a first ear attachment point and at least a first nose attachment point; and

wherein the second set of attachment points includes at least one of a second nose attachment point relative to said nose or a second ear attachment point relative to said ear.

13. The method of claim 12, wherein the first set of attachment points includes at least a first left ear attachment point, at least a first right ear attachment point, and at least a first nose attachment point;

and

wherein the second set of attachment points includes at least a second nose attachment point.

14. The method of claim 13, wherein the first and second sets of attachment points together comprise two or more left ear attachment points, two or more right ear attachment points, and two or more nose attachment points.

15. A computing device configured to generate a virtual try-on, comprising:

a processor;

memory in electronic communication with the processor;

instructions stored in the memory, the instructions being executable by the processor to;

obtain a first model, the first model comprising a first set of two or more attachment points and a second set of one or more attachment points, wherein the first model comprises a three-dimensional model of a user'"'"'s face;

wherein the first set of attachment points includes at least an attachment point on a first facial feature on the model of a user'"'"'s face and an attachment point on a second facial feature on the model of a user'"'"'s face, and wherein the second set of attachment points includes a second attachment point on the first facial feature or on the second facial feature;

obtain a second model, the second model comprising a first set of connection points;

combine the first model and the second model, wherein combining the first and second models comprises matching at least one of the first set of attachment points with at least one of the first set of connection points; and

render an image based on at least a portion of the combined first and second models.

16. The computing device of claim 15, wherein the instructions are further executable by the processor to:

receive an adjustment command; and

adjust the combined first and second models based on the adjustment command.

17. The computing device of claim 16, wherein:

the instructions to adjust the combined first and second models are further executable by the processor to match the second set of attachment points with the first set of connection points.

18. The computing device of claim 16, wherein:

the second model further comprises a second set of connection points; and

the instructions to adjust the combined first and second models are further executable by the processor to match the first set of attachment points with the second set of connection points.

19. The computing device of claim 16, wherein:

the second model further comprises a second set of connection points; and

the instructions to adjust the combined first and second models are further executable by the processor to match the second set of attachment points with the second set of connection points.

20. The computing device of claim 16, wherein the instructions to receive the adjustment command are further executable by the processor to receive a touch input.

21. A computer-program product for generating a virtual try-on, the computer-program product comprising a non-transitory computer-readable medium storing instructions thereon, the instructions being executable by a processor to:

obtain a first model, the first model comprising a first set of two or more attachment points and a second set of one or more attachment points, wherein the first model comprises a three-dimensional model of a user'"'"'s face;

wherein the first set of attachment points includes at least an attachment point on a first facial feature on the model of a user'"'"'s face and an attachment point on a second facial feature on the model of a user'"'"'s face, and wherein the second set of attachment points includes a second attachment point on the first facial feature or on the second facial feature;

obtain a second model, the second model comprising a first set of connection points;

combine the first model and the second model, wherein combining the first and second models comprises matching at least one of the first set of attachment points with at least one of the first set of connection points; and

render an image based on at least a portion of the combined first and second models.

22. The computer-program product of claim 21, wherein the instructions are further executable by the processor to:

receive an adjustment command; and

adjust the combined first and second models based on the adjustment command.