Systems and methods for generating a 3-D model of a virtual try-on product

• US 9,311,746 B2
• Filed: 02/22/2013
• Issued: 04/12/2016
• Est. Priority Date: 05/23/2012
• Status: Active Grant

• Current Assignee: Luxottica Retail North America Incorporated (EssilorLuxottica SA)
• Original Assignee: Glasses com Inc (EssilorLuxottica SA)
• Inventors: Gravois, Adam, Engle, Ryan
• Primary Examiner(s): Hon, Ming
• Assistant Examiner(s): DOAN, PHUC N
• Application Number:
  US13/774,985
• Publication Number:
  US 20130314412A1
• Time in Patent Office: 1,145 Days
• Field of Search: 345/419, 345/420
• US Class Current: 1/1
• CPC Class Codes: G02C 13/003 Measuring during assembly or fitting of spectacles
• CPC Class Codes: G06T 15/04 Texture mapping
• CPC Class Codes: G06T 15/08 Volume rendering
• CPC Class Codes: G06T 17/00 Three dimensional [3D] modelling, e.g. data description of 3D objects
• CPC Class Codes: G06T 17/30 Polynomial surface description
• CPC Class Codes: G06T 19/00 Manipulating 3D models or images for computer graphics
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06T 2200/04 involving 3D image data
• CPC Class Codes: G06T 2210/16 Cloth
• CPC Class Codes: G06T 2210/61 Scene description
• CPC Class Codes: G06V 40/16 Human faces, e.g. facial parts, sketches or expressions

Abstract

A computer-implemented method for generating a three-dimensional (3-D) model of a virtual try-on product. At least a portion of an object is scanned. The object includes at least first and second surfaces. An aspect of the first surface is detected. An aspect of the second surface is detected, the aspect of the second surface being different from the aspect of the first surface. A polygon mesh of the first and second surfaces is generated from the scan of the object.

Claims

1. A computer-implemented method for generating a three-dimensional (3-D) model of an object, the method comprising:

scanning, by a processor, at least a portion of an object, wherein the object includes at least first and second surfaces, the object comprising a pair of glasses, the first surface comprising at least a portion of a lens of the pair of glasses, and the second surface comprising at least a portion of a frame of the pair of glasses;

detecting, by the processor, an aspect of the first surface;

detecting, by the processor, an aspect of the second surface, the aspect of the second surface being different from the aspect of the first surface;

wherein detecting an aspect of the first or second surfaces comprises distinguishing, by the processor, between two or more surface finishes based on the scan of the object;

generating, by the processor, a polygon mesh of the first and second surfaces from the scan of the object to create a graphical representation of the scanned object;

adding, by the processor, a plurality of vertices to at least a portion of the polygon mesh corresponding to the first surface; and

performing, by the processor, a decimation algorithm on at least a portion of the polygon mesh corresponding to the second surface, wherein adding the plurality of vertices and performing the decimation algorithm are performed simultaneously or sequentially as part of a single process;

wherein adding the plurality of vertices includes adding the vertices to the first surface and not adding vertices to the second surface, and wherein performing the decimation algorithm includes removing vertices from the second surface and not removing vertices from the first surface.

2. The method of claim 1, further comprising:

positioning the polygon mesh in relation to a 3-D fitting object in a virtual 3-D space, wherein the 3-D fitting object comprises a predetermined shape and size; and

determining at least one point of intersection between the polygon mesh and the 3-D fitting object.

3. The method of claim 1, further comprising:

modifying one or more vertices of the polygon mesh corresponding to the first surface to simulate the first surface, wherein distinguishing between two or more surface finishes based on the scan of the object includes detecting at least one of a matte finish, a glossy finish, an opacity, a transparency, and a texture.

4. The method of claim 1, further comprising:

determining at least one symmetrical aspect of the object;

upon determining the symmetrical aspect of the object, scanning the portion of the object based on the determined symmetrical aspect; and

mirroring a result of the scan of the object in order to generate a portion of the polygon mesh that corresponds to a portion of the object not scanned.

5. The method of claim 1, further comprising:

applying a texture map generated from the scan of the object to the polygon mesh, wherein the texture map includes a plurality of images depicting the first and second surfaces of the object, and wherein the texture map maps a two-dimensional (2-D) coordinate of one of the plurality of images depicting the first and second surfaces of the object to a 3-D coordinate of the generated polygon mesh of the object.

6. The method of claim 1, wherein scanning at least a portion of the object further comprises:

scanning the object at a plurality of predetermined viewing angles.

7. The method of claim 6, further comprising:

rendering the polygon mesh at the predetermined viewing angles.

8. A computing device configured to generate a three-dimensional (3-D) model of an object, comprising:

processor;

memory in electronic communication with the processor;

instructions stored in the memory, the instructions being executable by the processor to;

scan at least a portion of an object, wherein the object includes at least first and second surfaces, the object comprising a pair of glasses, the first surface comprising at least a portion of a lens of the pair of glasses, and the second surface comprising at least a portion of a frame of the pair of glasses;

detect an aspect of the first surface;

detect an aspect of the second surface, the aspect of the second surface being different from the aspect of the first surface;

wherein detecting an aspect of the first or second surfaces comprises distinguishing between two or more surface finishes based on the scan of the object;

generate a polygon mesh of the first and second surfaces from the scan of the object to create a graphical representation of the scanned object;

add a plurality of vertices to at least a portion of the polygon mesh corresponding to the first surface;

perform a decimation algorithm on at least a portion of the polygon mesh corresponding to the second surface, wherein adding the plurality of vertices and performing the decimation algorithm are performed simultaneously or sequentially as part of a single process; and

wherein adding the plurality of vertices includes adding the vertices to the first surface and not adding vertices to the second surface, and wherein performing the decimation algorithm includes removing vertices from the second surface and not removing vertices from the first surface.

9. The computing device of claim 8, wherein the instructions are executable by the processor to:

position the polygon mesh in relation to a 3-D fitting object in a virtual 3-D space, wherein the 3-D fitting object comprises a predetermined shape and size; and

determine at least one point of intersection between the polygon mesh and the 3-D fitting object.

10. The computing device of claim 8, wherein the instructions are executable by the processor to:

modify one or more vertices of the polygon mesh corresponding to the first surface to simulate the first surface, wherein distinguishing between two or more surface finishes based on the scan of the object includes detecting at least one of a matte finish, a glossy finish, an opacity, a transparency, and a texture.

11. The computing device of claim 8, wherein the instructions are executable by the processor to:

determine at least one symmetrical aspect of the object;

upon determining the symmetrical aspect of the object, scan the portion of the object based on the determined symmetrical aspect; and

mirror a result of the scan of the object in order to generate a portion of the polygon mesh that corresponds to a portion of the object not scanned.

12. The computing device of claim 8, wherein the instructions are executable by the processor to:

apply a texture map generated from the scan of the object to the polygon mesh, wherein the texture map includes a plurality of images depicting the first and second surfaces of the object, and wherein the texture map maps a two-dimensional (2-D) coordinate of one of the plurality of images depicting the first and second surfaces of the object to a 3-D coordinate of the generated polygon mesh of the object.

13. The computing device of claim 8, wherein the instructions are executable by the processor to:

scan the object at a plurality of predetermined viewing angles.

14. The computing device of claim 13, wherein the instructions are executable by the processor to:

render the polygon mesh at the predetermined viewing angles.

15. A computer-program product for generating a three-dimensional (3-D) model of an object, the computer-program product comprising a non-transitory computer-readable medium storing instructions thereon, the instructions being executable by a processor to:

scan at least a portion of an object, wherein the object includes at least first and second surfaces, the object comprising a pair of glasses, the first surface comprising at least a portion of a lens of the pair of glasses, and the second surface comprising at least a portion of a frame of the pair of glasses;

detect an aspect of the first surface;

detect an aspect of the second surface, the aspect of the second surface being different from the aspect of the first surface;

wherein detecting an aspect of the first or second surfaces comprises distinguishing between two or more surface finishes based on the scan of the object;

generate a polygon mesh of the first and second surfaces from the scan of the object to create a graphical representation of the scanned object;

add a plurality of vertices to at least a portion of the polygon mesh corresponding to the first surface;

perform a decimation algorithm on at least a portion of the polygon mesh corresponding to the second surface, wherein adding the plurality of vertices and performing the decimation algorithm are performed simultaneously or sequentially as part of a single process; and

wherein adding the plurality of vertices includes adding the vertices to the first surface and not adding vertices to the second surface, and wherein performing the decimation algorithm includes removing vertices from the second surface and not removing vertices from the first surface.

16. The computer-program product of claim 15, wherein the instructions are executable by the processor to:

position the polygon mesh in relation to a 3-D fitting object in a virtual 3-D space, wherein the 3-D fitting object comprises a predetermined shape and size;

determine at least one point of intersection between the polygon mesh and the 3-D fitting object; and

render the polygon mesh at predetermined viewing angles.