Systems and methods for efficiently processing virtual 3-D data

• US 9,235,929 B2
• Filed: 02/22/2013
• Issued: 01/12/2016
• Est. Priority Date: 05/23/2012
• Status: Active Grant

• Current Assignee: Luxottica Retail North America Incorporated (EssilorLuxottica SA)
• Original Assignee: Glasses com Inc (EssilorLuxottica SA)
• Inventors: Turetzkey, Darren, Engle, Ryan Travis
• Primary Examiner(s): Hon, Ming
• Assistant Examiner(s): DOAN, PHUC N
• Application Number:
  US13/774,978
• Publication Number:
  US 20130314411A1
• Time in Patent Office: 1,054 Days
• US Class Current: 1/1
• CPC Class Codes: G02C 13/003 Measuring during assembly or fitting of spectacles
• CPC Class Codes: G06T 15/04 Texture mapping
• CPC Class Codes: G06T 15/08 Volume rendering
• CPC Class Codes: G06T 17/00 Three dimensional [3D] modelling, e.g. data description of 3D objects
• CPC Class Codes: G06T 17/30 Polynomial surface description
• CPC Class Codes: G06T 19/00 Manipulating 3D models or images for computer graphics
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06T 2200/04 involving 3D image data
• CPC Class Codes: G06T 2210/16 Cloth
• CPC Class Codes: G06T 2210/61 Scene description
• CPC Class Codes: G06V 40/16 Human faces, e.g. facial parts, sketches or expressions

Abstract

A computer-implemented method for processing virtual 3-D data efficiently is described. An object image data is generated from a scan of an object. Object polygon model data and object texture map data is generated from the object image data. The object polygon model data is saved in a first object file. The object texture map data is encoded. The encoded object texture map data is saved in a second object file. The data format of the second object file is different than the data format of the first object file.

Claims

1. A computer-implemented method for processing virtual 3-D data efficiently, the method comprising:

generating, via a processor of a mobile computing device, user image data from a scan of a user, wherein the scan includes a plurality of images including a portion of a user, the scan being from a first area of the user to a second area of the user captured by relative movement between a camera of the mobile computing device and the portion of the user;

generating, via the processor, object polygon model data and object texture map data from the user image data;

saving, via the processor, the object polygon model data in a first object file;

encoding, via the processor, the object texture map data;

saving, via the processor, the encoded object texture map data in a second object file, wherein a data format of the second object file is different than a data format of the first object file;

encoding the user image data and saving the encoded user image data in a third file;

transferring the encoded user image data file from the mobile computing device to a second computing device;

calculating user polygon model data from the encoded user image data file and generating a plurality of coefficients from the calculated user polygon model data on the second computing device; and

transferring the generated plurality of coefficients from the second computing device to the mobile computing device.

2. The method of claim 1, further comprising:

creating a black and white version of the user image data; and

processing an image of the black and white version of the user image data.

3. The method of claim 2, further comprising:

comparing a timestamp of the processed image of the black and white version of the user image data to a timestamp of an image from the encoded user image data;

merging a result of processing the image of the black and white version of the user image data with a corresponding image of the encoded user image data; and

encoding the merged user image data and saving the encoded merged user image data into a user data file.

4. The method of claim 3, wherein the first object file includes a binary-encoded file, and wherein the second object file and the encoded user data file include compressed video files.

5. The method of claim 1, further comprising:

saving vertices of a plurality of 3-D models as half-floats in a plurality of vertex files.

6. The method of claim 5, further comprising:

saving a predetermined order of the vertices of the plurality of 3-D models as half-floats in a single vertex order file.

15. The computer-implemented method of claim 1, further comprising:

generating, via the processor of the mobile computing device, a 3-D model of the user with the object polygon model data and the object texture map data;

receiving, via the processor of the mobile computing device, a 3-D model of a product; and

displaying, via the processor of the mobile computing device, the 3-D model of a product on the 3-D model of the user.

7. A computing device configured to process virtual 3-D data efficiently, comprising:

a processor of a mobile computing device;

memory in electronic communication with the processor;

instructions stored in the memory, the instructions being executable by the processor to;

generate user image data from a scan of a user, wherein the scan includes a plurality of images including a portion of a user, the scan being from a first area of the user to a second area of the user captured by relative movement between a camera of the mobile computing device and the portion of the user;

generate object polygon model data and object texture map data from the user image data;

save the object polygon model data in a first object file;

encode the object texture map data; and

save the encoded object texture map data in a second object file, wherein a data format of the second object file is different than a data format of the first object file;

encode the user image data and saving the encoded user image data in a third object file;

transfer the encoded user image data file from the mobile computing device to a remote computing device;

calculate user polygon model data from the encoded user image data file and generating a plurality of coefficients from the calculated user polygon model data on the remote computing device; and

transfer the generated plurality of coefficients from the remote computing device to the mobile computing device.

8. The computing device of claim 7, wherein the instructions are executable by the processor to:

create a black and white version of the user image data; and

process an image of the black and white version of the user image data.

9. The computing device of claim 8, wherein the instructions are executable by the processor to:

compare a timestamp of the processed image of the black and white version of the user image data to a timestamp of an image from the encoded user image data;

merge a result of processing the image of the black and white version of the user image data with a corresponding image of the encoded user image data; and

encode the merged user image data and save the encoded merged user image data into a user data file.

10. The computing device of claim 9, wherein the first object file includes a binary-encoded file, and wherein the second object file and the encoded user data file include compressed video files.

11. The computing device of claim 7, wherein the instructions are executable by the processor to:

save vertices of a plurality of 3-D models as half-floats in a plurality of vertex files.

12. The computing device of claim 7, wherein the instructions are executable by the processor to:

save a predetermined order of the vertices of the plurality of 3-D models as half-floats in a single vertex order file.

16. The computing device of claim 8, wherein the instructions are executable by the processor to:

generate a 3-D model of the user with the object polygon model data and the object texture map data;

receive a 3-D model of a product; and

display the 3-D model of a product on the 3-D model of the user.

13. A computer-program product for processing virtual 3-D data efficiently, the computer-program product comprising a non-transitory computer-readable medium storing instructions thereon, the instructions being executable by a processor of a mobile computing device to:

generate user image data from a scan of a user, wherein the scan includes a plurality of images including a portion of a user, the scan being from a first area of the user to a second area of the user captured by relative movement between a camera of the mobile computing device and the portion of the user;

generate object polygon model data and object texture map data from the user image data;

save the object polygon model data in a first object file;

encode the object texture map data; and

save the encoded object texture map data in a second object file, wherein a data format of the second object file is different than a data format of the first object file;

encode the user image data and saving the encoded user image data in a third object file;

transfer the encoded user image data file from the computing device to a remote computing device;

calculate user polygon model data from the encoded user image data file and generating a plurality of coefficients from the calculated user polygon model data on the remote computing device; and

transfer the generated plurality of coefficients from the remote computing device to the first computing device.

14. The computer-program product of claim 13, wherein the instructions are executable by the processor to:

create a black and white version of the user image data;

process an image of the black and white version of the user image data;

compare a timestamp of the processed image of the black and white version of the user image data to a timestamp of an image from the encoded user image data;

merge a result of processing the image of the black and white version of the user image data with a corresponding image of the encoded user image data; and

encode the merged user image data and save the encoded merged user image data into a user data file.