System and method of 3D modeling and virtual fitting of 3D objects
First Claim
1. A method of virtual fitting of a foot with a shoe, the method comprising, by a processor:
- obtaining data informative of a first 3D model associated with the foot, the first 3D model having a first point cloud comprising a plurality of data points representing the surface of the first 3D model;
obtaining data informative of a second 3D model associated with an interior cavity of the shoe, the second 3D model having a second point cloud comprising a plurality of data points representing the surface of the second 3D model;
aligning the first and second point clouds such that the heel extreme point of the second point cloud aligns with the heel extreme point of the first point cloud and the ankle back extreme point of the first point cloud aligns with the top back point of the second point cloud;
calculating for at least one point p in the first point cloud a value of at least one fit indicator indicative of a fit between the foot and the shoe at the point p, the value of fit indicator determined based on a distance between the at least one point p and a corresponding point q in the aligned second point cloud; and
outputting, to a display device, a graphical representation of the first 3D model colored in accordance with the calculated at least one fit indicator, wherein the color at p is indicative of the fit calculated at p,wherein aligning the first and second point clouds comprises calculating a Principal Component Analysis (PCA) of each point cloud, aligning the centers and the axes of each point cloud, detecting the plane of each point cloud, calculating the residual rigid transformation to make the two planes coincide, and refining the results of the transformation to make the heel extreme point of the second point cloud align with the heel extreme point of the first point cloud and the ankle back extreme point of the first point cloud align with the top back point of the second point cloud.
1 Assignment
0 Petitions
Accused Products
Abstract
Method and system of virtual fitting a foot with a shoe by obtaining a first and second 3D model associated with the surface of the foot and interior cavity of the shoe, respectively, each 3D model comprising a point cloud; aligning the point clouds such that the heel extreme point of the two point clouds align and the ankle back extreme point of the first point cloud aligns with the top back point of the second point cloud; calculating for at least one point p in the first point cloud a value of at least one fit indicator determined based on a distance between p and a corresponding point q in the aligned second point cloud; and outputting, to a display device, a graphical representation of the first 3D model colored in accordance with the fit calculated at p.
52 Citations
18 Claims
-
1. A method of virtual fitting of a foot with a shoe, the method comprising, by a processor:
-
obtaining data informative of a first 3D model associated with the foot, the first 3D model having a first point cloud comprising a plurality of data points representing the surface of the first 3D model; obtaining data informative of a second 3D model associated with an interior cavity of the shoe, the second 3D model having a second point cloud comprising a plurality of data points representing the surface of the second 3D model; aligning the first and second point clouds such that the heel extreme point of the second point cloud aligns with the heel extreme point of the first point cloud and the ankle back extreme point of the first point cloud aligns with the top back point of the second point cloud; calculating for at least one point p in the first point cloud a value of at least one fit indicator indicative of a fit between the foot and the shoe at the point p, the value of fit indicator determined based on a distance between the at least one point p and a corresponding point q in the aligned second point cloud; and outputting, to a display device, a graphical representation of the first 3D model colored in accordance with the calculated at least one fit indicator, wherein the color at p is indicative of the fit calculated at p, wherein aligning the first and second point clouds comprises calculating a Principal Component Analysis (PCA) of each point cloud, aligning the centers and the axes of each point cloud, detecting the plane of each point cloud, calculating the residual rigid transformation to make the two planes coincide, and refining the results of the transformation to make the heel extreme point of the second point cloud align with the heel extreme point of the first point cloud and the ankle back extreme point of the first point cloud align with the top back point of the second point cloud. - View Dependent Claims (2, 3, 4, 5, 6, 7)
-
-
8. A method of virtual fitting of a foot with a shoe, the method comprising, by a processor:
-
obtaining data informative of a first 3D model associated with the foot, the first 3D model having a first point cloud comprising a plurality of data points representing the surface of the first 3D model; obtaining data informative of a second 3D model associated with an interior cavity of the shoe, the second 3D model having a second point cloud comprising a plurality of data points representing the surface of the second 3D model; aligning the first and second point clouds such that the heel extreme point of the second point cloud aligns with the heel extreme point of the first point cloud and the ankle back extreme point of the first point cloud aligns with the top back point of the second point cloud; calculating for at least one point p in the first point cloud a value of at least one fit indicator indicative of a fit between the foot and the shoe at the point p, the value of fit indicator determined based on a distance between the at least one point p and a corresponding point q in the aligned second point cloud; and outputting, to a display device, a graphical representation of the first 3D model colored in accordance with the calculated at least one fit indicator, wherein the color at p is indicative of the fit calculated at p, wherein aligning the first and second point clouds further comprises at least one of; applying an articulated motion to the toe region of the first point cloud at an articulation axis detected as the front point where the interior arc of the foot is tangent to the ground; simulating an articulated motion of the ankle with respect to the foot.
-
-
9. A method of virtual fitting of a foot with a shoe, the method comprising, by a processor:
-
obtaining data informative of a first 3D model associated with the foot, the first 3D model having a first point cloud comprising a plurality of data points representing the surface of the first 3D model; obtaining data informative of a second 3D model associated with an interior cavity of the shoe, the second 3D model having a second point cloud comprising a plurality of data points representing the surface of the second 3D model; aligning the first and second point clouds such that the heel extreme point of the second point cloud aligns with the heel extreme point of the first point cloud and the ankle back extreme point of the first point cloud aligns with the top back point of the second point cloud; calculating for at least one point p in the first point cloud a value of at least one fit indicator indicative of a fit between the foot and the shoe at the point p, the value of fit indicator determined based on a distance between the at least one point p and a corresponding point q in the aligned second point cloud; and outputting, to a display device, a graphical representation of the first 3D model colored in accordance with the calculated at least one fit indicator, wherein the color at p is indicative of the fit calculated at p, wherein calculating the value for the at least one fit indicator comprises calculating the normal np of the first point cloud surface at p, considering the line lp passing through p and parallel to the normal np, calculating the intersection point q between the line lp and the second point cloud, and calculating the distance between p and q, the distance being indicative of a fit indicator.
-
-
10. A system for virtual fitting of a foot with a shoe, comprising:
-
a memory configured to store data informative of first 3D model associated with the foot, the first 3D model having a first point cloud comprising a plurality of data points representing the surface of the first 3D model, and to store data informative of a second 3D model associated with an interior cavity of the shoe, the second 3D model having a second point cloud comprising a plurality of data points representing the surface of the second 3D model; and a processor operatively coupled to the memory and configured to process the first and second point clouds by; aligning the first and second point clouds such that the heel extreme point of the second point cloud aligns with the heel extreme point of the first point cloud and the ankle back extreme point of the first point cloud aligns with the top back point of the second point cloud; calculating for at least one point p in the first point cloud a value of at least one fit indicator indicative of a fit between the foot and the shoe at the point p, the value of the at least one fit indicator determined based on a distance between the at least one point p and a corresponding point q in the aligned second point cloud; and outputting, to a display device, a graphical representation of the first 3D model colored in accordance with the calculated at least one fit indicator, wherein the color at p is indicative of the fit calculated at p, wherein aligning the first and second point clouds comprises calculating a Principal Component Analysis (PCA) of each point cloud, aligning the centers and the axes of each point cloud, detecting the plane of each point cloud, calculating the residual rigid transformation to make the two planes coincide, and refining the results of the transformation to make the heel extreme point of the second point cloud align with the heel extreme point of the first point cloud and the ankle back extreme point of the first point cloud align with the top back point of the second point cloud. - View Dependent Claims (11, 12, 13, 14, 15, 16, 17)
-
-
18. A non-transitory storage medium comprising instructions executable by a computer for executing a method of virtual fitting of a foot with a shoe, the method comprising:
-
obtaining data informative of a first 3D model associated with the foot, the first 3D model having a first point cloud comprising a plurality of data points representing the surface of the first 3D model; obtaining data informative of a second 3D model associated with an interior cavity of the shoe, the second 3D model having a second point cloud comprising a plurality of data points representing the surface of the second 3D model; aligning the first and second point clouds such that the heel extreme point of the second point cloud aligns with the heel extreme point of the first point cloud and the ankle back extreme point of the first point cloud aligns with the top back point of the second point cloud; calculating for at least one point p in the first point cloud a value of at least one fit indicator indicative of a fit between the foot and the shoe at the point p, the value of the at least one fit indicator determined based on a distance between the at least one point p and a corresponding point q in the aligned second point cloud; and outputting, to a display device, a graphical representation of the first 3D model colored in accordance with the calculated at least one fit indicator, wherein the color at p is indicative of the fit calculated at p, wherein aligning the first and second point clouds comprises calculating a Principal Component Analysis (PCA) of each point cloud, aligning the centers and the axes of each point cloud, detecting the plane of each point cloud, calculating the residual rigid transformation to make the two planes coincide, and refining the results of the transformation to make the heel extreme point of the second point cloud align with the heel extreme point of the first point cloud and the ankle back extreme point of the first point cloud align with the top back point of the second point cloud.
-
Specification