2D IMAGE-BASED 3D GLASSES VIRTUAL TRY-ON SYSTEM
First Claim
1. A method to create real-time try-on experience of wearing virtual 3D eyeglasses by a wearer, comprising:
- obtaining a plurality of 2D images for a plurality of pairs of eyeglasses, the pairs of eyeglasses are organized into a group of 2D images, each pair of eyeglasses has a set of 2D images;
when one designed pair of eyeglasses from the group of 2D images is selected by the wearer, constructing a pair of virtual 3D eyeglasses using the set of 2D images for the designed pair of eyeglasses;
constructing a 3D face or head model of the wearer based upon one or more facial or head images of the wearer; and
fitting the pair of virtual 3D eyeglasses onto the 3D face or head model of the wearer, with the pair of virtual 3D eyeglasses being simulated as being worn by the wearer;
wherein each set of the 2D images for each pair of eyeglasses comprises a frontal frame image and at least one side frame image.
1 Assignment
0 Petitions
Accused Products
Abstract
Method to create try-on experience wearing virtual 3D eyeglasses is provided using 2D image data of eyeglasses. Virtual 3D eyeglasses are constructed using set of 2D images for eyeglasses. Virtual 3D eyeglasses is configured onto 3D face or head model and being simulated as being fittingly worn by the wearer. Each set of 2D images for eyeglasses includes a pair of 2D lens images, a frontal frame image, and at least one side frame image. Upon detection of a movement of the face and head of wearer in real-time, the 3D face or head model and the configuration and alignment of virtual 3D eyeglasses are modified or adjusted accordingly. Features such as trimming off of portion of the glasses frame, shadow creating and environment mapping are provided to the virtual 3D eyeglasses in response to translation, scaling, and posture changes made to the head and face of the wearer in real-time.
-
Citations
20 Claims
-
1. A method to create real-time try-on experience of wearing virtual 3D eyeglasses by a wearer, comprising:
-
obtaining a plurality of 2D images for a plurality of pairs of eyeglasses, the pairs of eyeglasses are organized into a group of 2D images, each pair of eyeglasses has a set of 2D images; when one designed pair of eyeglasses from the group of 2D images is selected by the wearer, constructing a pair of virtual 3D eyeglasses using the set of 2D images for the designed pair of eyeglasses; constructing a 3D face or head model of the wearer based upon one or more facial or head images of the wearer; and fitting the pair of virtual 3D eyeglasses onto the 3D face or head model of the wearer, with the pair of virtual 3D eyeglasses being simulated as being worn by the wearer; wherein each set of the 2D images for each pair of eyeglasses comprises a frontal frame image and at least one side frame image. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9)
-
-
10. An augmented reality system for real-time try-on of 3D virtual eyeglasses by a wearer, comprising:
-
a server, the server having a first memory, a plurality of 2D images for a plurality of pairs of eyeglasses are organized into a group of 2D images, the group of 2D images are stored in the first memory; and a host, the host comprising a 3D virtual eyeglasses try-on simulation program, a processor, a camera, a display device and a second memory, wherein each pair of eyeglasses has a set of 2D images in the group of 2D images, the set of 2D images is stored in the second memory;
the processor is configured to run the 3D virtual eyeglasses try-on simulation program for constructing a pair of virtual 3D eyeglasses using the set of 2D images for one designed pair of eyeglasses retrieved from the second memory when the designed pair of eyeglasses from the group of 2D images is selected by the wearer, constructing a 3D face or head model of the wearer based upon one or more facial and head images of the wearer captured by the camera in real-time, configuring the pair of virtual 3D eyeglasses onto the 3D face or head model of the wearer, with the pair of virtual 3D eyeglasses being simulated as being fittingly worn by the wearer;
the display device is configured to display the wearer trying-on the virtual 3D eyeglasses in real-time; and
each set of the 2D images for each pair of eyeglasses stored in the first memory and in the second memory, respectively, comprising a frontal frame image and at least one side frame image. - View Dependent Claims (11, 12, 13, 14, 15, 16, 17, 18, 19, 20)
-
Specification