SYSTEMS AND METHODS FOR DETERMINING THE SCALE OF HUMAN ANATOMY FROM IMAGES

• US 20180336737A1
• Filed: 05/16/2018
• Published: 11/22/2018
• Est. Priority Date: 05/17/2017
• Status: Active Grant

• Current Assignee: Bespoke Inc.
• Original Assignee: Bespoke Inc.
• Inventors: VARADY, Eric J., KANAUJIA, Atul
• Granted Patent: US 10,777,018 B2
• Time in Patent Office: Days
• CPC Class Codes: G06T 19/20 Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
• CPC Class Codes: G06T 2207/10028 Range image; Depth image; 3D point clouds
• CPC Class Codes: G06T 2207/30201 Face
• CPC Class Codes: G06T 2207/30204 Marker
• CPC Class Codes: G06T 2219/2016 Rotation, translation, scaling
• CPC Class Codes: G06T 3/14 Transformations for image registration, e.g. adjusting or mapping for alignment of images
• CPC Class Codes: G06T 7/50 Depth or shape recovery
• CPC Class Codes: G06T 7/536 from perspective effects, e.g. by using vanishing points
• CPC Class Codes: G06T 7/62 of area, perimeter, diameter or volume
• CPC Class Codes: G06T 7/74 involving reference images or patches
• CPC Class Codes: G06T 7/80 Analysis of captured images to determine intrinsic or extrinsic camera parameters, i.e. camera calibration

Abstract

Systems and methods are disclosed for generating a scaled reconstruction for a consumer product. One method includes receiving digital input comprising a calibration target and an object; defining a three-dimensional coordinate system; positioning the calibration target in the three-dimensional coordinate system; based on the digital input, aligning the object to the calibration target in the three-dimensional coordinate system; and generating a scaled reconstruction of the object based on the alignment of the object to the calibration target in the three-dimensional coordinate system.

Claims

1. A computer-implemented method for generating a scaled reconstruction for a consumer product, using a computer system, the method comprising:

receiving digital input comprising a calibration target and an object;

defining a three-dimensional coordinate system;

positioning the calibration target in the three-dimensional coordinate system;

based on the digital input, aligning the object to the calibration target in the three-dimensional coordinate system; and

generating a scaled reconstruction of the object based on the alignment of the object to the calibration target in the three-dimensional coordinate system.

2. The method of claim 1, further comprising:

determining three-dimensional measurements of the calibration target in the three-dimensional coordinate system; and

further generating the scaled reconstruction of the object based on the three-dimensional measurements of the calibration target.

3. The method of claim 1, wherein the calibration target is comprised of a parameterized three-dimensional reconstruction.

4. The method of claim 1, further comprising:

receiving a three-dimensional reconstruction of the object;

aligning the calibration target to the three-dimensional reconstruction of the object; and

generating the scaled reconstruction based on the alignment of the calibration target to the three-dimensional reconstruction of the object.

5. The method of claim 4, further comprising:

generating the three-dimensional reconstruction of the object.

6. The method of claim 1, further comprising:

determining, from the digital input, an image including the calibration target and the object;

determining, from the image, a three-dimensional location of the calibration target and a three-dimensional location of the object; and

positioning the calibration target in the three-dimensional coordinate system and positioning the object in the three-dimensional coordinate system, based on the three-dimensional location of the calibration target and the three-dimensional location of the object.

7. The method of claim 1, further comprising:

determining a scaling measurement based on aligning the object to the calibration target in the three-dimensional coordinate system; and

generating the scaled reconstruction of the object based on the scaling measurement.

8. The method of claim 1, wherein the digital input includes one or more of a series of images from a singular image sensor taken from different camera positions, a video taken from different camera positions, a series of images or a video taken from different perspectives with depth information included, a 3D point cloud captured from a depth or 3D sensor, a series of images from multiple 2D sensors, a video captured from multiple 2D sensors, or a combination thereof.

9. A system for generating a scaled reconstruction for a consumer product, the system comprising:

a data storage device storing instructions for generating a scaled reconstruction for a consumer product; and

a processor configured to execute the instructions to perform a method including;

receiving digital input comprising a calibration target and an object;

defining a three-dimensional coordinate system;

positioning the calibration target in the three-dimensional coordinate system;

based on the digital input, aligning the object to the calibration target in the three-dimensional coordinate system; and

generating a scaled reconstruction of the object based on the alignment of the object to the calibration target in the three-dimensional coordinate system.

10. The system of claim 9, wherein the system is further configured for:

determining three-dimensional measurements of the calibration target in the three-dimensional coordinate system; and

further generating the scaled reconstruction of the object based on the three-dimensional measurements of the calibration target.

11. The system of claim 9, wherein the calibration target is comprised of a parameterized three-dimensional reconstruction.

12. The system of claim 11, wherein the system is further configured for:

receiving a three-dimensional reconstruction of the object;

aligning the calibration target to the three-dimensional reconstruction of the object; and

generating the scaled reconstruction based on the alignment of the calibration target to the three-dimensional reconstruction of the object.

13. The system of claim 12, wherein the system is further configured for:

generating the three-dimensional reconstruction of the object.

14. The system of claim 9, wherein the system is further configured for:

determining, from the digital input, an image including the calibration target and the object;

determining, from the image, a three-dimensional location of the calibration target and a three-dimensional location of the object; and

positioning the calibration target in the three-dimensional coordinate system and positioning the object in the three-dimensional coordinate system, based on the three-dimensional location of the calibration target and the three-dimensional location of the object.

15. The system of claim 9, wherein the system is further configured for:

determining a scaling measurement based on aligning the object to the calibration target in the three-dimensional coordinate system; and

generating the scaled reconstruction of the object based on the scaling measurement.

16. The system of claim 9, wherein the digital input includes one or more of a series of images from a singular image sensor taken from different camera positions, a video taken from different camera positions, a series of images or a video taken from different perspectives with depth information included, a 3D point cloud captured from a depth or 3D sensor, a series of images from multiple 2D sensors, a video captured from multiple 2D sensors, or a combination thereof.

17. A non-transitory computer readable medium for use on a computer system containing computer-executable programming instructions for generating a scaled reconstruction for a consumer product, the method comprising:

receiving digital input comprising a calibration target and an object;

defining a three-dimensional coordinate system;

positioning the calibration target in the three-dimensional coordinate system;

based on the digital input, aligning the object to the calibration target in the three-dimensional coordinate system; and

generating a scaled reconstruction of the object based on the alignment of the object to the calibration target in the three-dimensional coordinate system.

18. The non-transitory computer readable medium of claim 17, the method further comprising:

determining three-dimensional measurements of the calibration target in the three-dimensional coordinate system; and

further generating the scaled reconstruction of the object based on the three-dimensional measurements of the calibration target.

19. The non-transitory computer readable medium of claim 17, wherein the calibration target is comprised of a parameterized three-dimensional reconstruction.

20. The non-transitory computer readable medium of claim 17, wherein the digital input includes one or more of a series of images from a singular image sensor taken from different camera positions, a video taken from different camera positions, a series of images or a video taken from different perspectives with depth information included, a 3D point cloud captured from a depth or 3D sensor, a series of images from multiple 2D sensors, a video captured from multiple 2D sensors, or a combination thereof.