Cloud server body scan data system

• US 10,628,666 B2
• Filed: 11/13/2015
• Issued: 04/21/2020
• Est. Priority Date: 06/08/2010
• Status: Active Grant

• Current Assignee: Styku, LLC
• Original Assignee: Styku, LLC
• Inventors: Sareen, Raj, Delevan, Jason, Smith, III, Stephen Randolph, Parkinson, Jr., Bobby H.
• Primary Examiner(s): Perungavoor, Sath V
• Assistant Examiner(s): Dobbs, Kristin
• Application Number:
  US14/941,144
• Publication Number:
  US 20160078663A1
• Time in Patent Office: 1,621 Days
• Field of Search: 348 47
• CPC Class Codes: G06T 19/00 Manipulating 3D models or images for computer graphics
• CPC Class Codes: G06T 2200/08 involving all processing steps from image acquisition to 3D model generation
• CPC Class Codes: G06V 40/103 Static body considered as a whole, e.g. static pedestrian or occupant recognition

Abstract

A system for scanning a body to create scan data comprises a processor, a range camera capable of capturing at least a first set of depth images of the body rotated to 0 degrees, and at least a second set of depth images of the body rotated to x degrees, wherein x is >0 degrees, and x<360 degrees. a set of computer instructions are executable on a processor capable of synchronizing scan data and body measurements with a server.

Claims

1. A system for scanning a body to create scan data, comprising:

a processor;

an infrared camera comprising an infrared light emitter that emits infrared light and at least an infrared sensor that reads reflected infrared light, the infrared camera capable of illuminating the surface of the body with infrared light and causing the infrared sensor to capture the infrared light reflected off the surface of the body including any clothing worn, the infrared camera capable of capturing at least a first depth image of a surface of the body from at least a first point of view, and at least a second image of the surface of body from at least a second point of view while the body is posed;

a first set of computer instructions executable on the processor capable of calculating a first set of three dimensional points from the first set of depth images and a second set of three dimensional points from the second set of depth images;

a second set of computer instructions executable on the processor capable of applying rotational and translational matrix transformations on the first set of three dimensional points to align said first set of three dimensional points with the second set of three dimensional points and then calculating and storing a square of the sum of the differences between the first set of three dimensional points with the second set of three dimensional points as an error;

a third set of computer instructions executable on a processor capable of reconstructing the surface of the body by minimizing an error between the first and second set of three dimensional points by repeatedly making iterative and small changes to the matrix transformations and then re-calculating the error until the error is minimized;

a fourth set of computer instructions executable on the processor capable of applying poisson surface reconstruction to construct a mesh;

a fifth set of computer instructions executable on the processor capable of rigging the mesh with biped bone structure, scaled and sized to appropriately fit the mesh;

a sixth set of computer instructions executable on the processor capable of utilizing the bone structure from within the mesh to identify one or more anthropometric points of measure;

a seventh set of computer instructions executable on the processor capable of extracting anthropometric body circumferences by calculating the convex hull associated with points around a specific region of the body'"'"'s surface; and

an eighth set of computer instructions executable on a processor capable of synchronizing the scan data and anthropometric body circumferences with a server.

2. The system of claim 1, comprising avatar processing software capable of creating an avatar from the final combined set of three dimensional points.

3. The system of claim 2, further comprising a display capable of displaying the avatar with the anthropometric body circumferences.

4. The system of claim 1, wherein the scan data includes data of the type selected from the group consisting of:

scan data collected by the range camera, 3D geometry data created from raw scan data, body measurement data determined by analyzing raw scan data and 3D mesh data, 3D geometry data created to display measurements in 3D, and scan subject information including name, email address and demographic data including height, weight, age and gender.

5. A method for scanning a body to create scan data, comprising:

capturing, using an infrared camera comprising an infrared light emitter that emits infrared light and at least an infrared sensor that reads reflected infrared light, the infrared camera capable of illuminating the surface of the body with infrared light and causing the infrared sensor to capture the infrared light reflected off the surface of the body including any clothing worn, at least a first depth image of a surface of a body, from at least a first point of view, and at least a second depth image of the surface of the body, from at least a second point of view, while the body is posed;

calculating a first set of three dimensional points from the first set of depth images and a second set of three dimensional points from the second set of depth images;

applying rotational and translational matrix transformations on the first set of three dimensional points to align said first set of three dimensional points with the second set of three dimensional points and then calculating and storing a square of the sum of the differences between the first set of three dimensional points with the second set of three dimensional points as an error;

reconstructing the surface of the body by minimizing an error between the first and second set of three dimensional points by repeatedly making iterative and small changes to the matrix transformations and then re-calculating the error until the error is minimized;

applying poisson surface reconstruction to construct a mesh;

rigging the mesh with biped bone structure, scaled and sized to appropriately fit the mesh;

utilizing the bone structure from within the mesh to identify one or more anthropometric points of measure;

extracting anthropometric body circumferences by calculating the convex hull associated with points around a specific region of the body'"'"'s surface; and

synchronizing the scan data with a server.

6. The method of claim 5, comprising creating an avatar from the combined set of three dimensional points.

7. The method of claim 6, further comprising displaying the avatar with the anthropometric body circumferences.

8. The method of claim 5, wherein the scan data includes data of the type selected from the group consisting of:

scan data collected by the range camera, 3D geometry data created from raw scan data, body measurement data determined by analyzing raw scan data and 3D mesh data, 3D geometry data created to display measurements in 3D, and scan subject information including name, email address and demographic data including height, weight, age and gender.