Geometry tracking
First Claim
1. A computer implemented method of motion capture, the method comprising:
- receiving a first frame captured from a real 3D space, the first frame including a first 2D image of a motion capture subject in the real 3D space;
deforming a 3D model into a first deformation and placing the deformed 3D model in a virtual 3D space in a first location so that the deformed 3D model corresponds to the first 2D image, the 3D model having at least one deformation constraint that restricts how the 3D model can be deformed;
receiving a second frame captured from the real 3D space, the second frame including a second 2D image of the motion capture subject in the real 3D space;
tracking 2D changes in the second 2D image relative to the first 2D image;
projecting the 2D changes on the virtual 3D space as 3D constraints; and
based on the second 2D image, again deforming the 3D model into a second deformation and placing the 3D model in the virtual 3D space in a second location in conformance with the 3D constraints.
1 Assignment
0 Petitions
Accused Products
Abstract
A first frame includes a first 2D image of a motion capture subject in the real 3D space. A 3D model is deformed into a first deformation and placing the deformed 3D model in a virtual 3D space in a first location so that the deformed 3D model corresponds to the first 2D image. A second frame includes a second 2D image of the motion capture subject in the real 3D space. 2D changes in the second 2D image relative to the first 2D image are tracked. The 2D changes are projected on the virtual 3D space as 3D constraints. Based on the second 2D image, the 3D model is again deformed into a second deformation and placing the 3D model in the virtual 3D space in a second location in conformance with the 3D constraints.
38 Citations
20 Claims
-
1. A computer implemented method of motion capture, the method comprising:
-
receiving a first frame captured from a real 3D space, the first frame including a first 2D image of a motion capture subject in the real 3D space; deforming a 3D model into a first deformation and placing the deformed 3D model in a virtual 3D space in a first location so that the deformed 3D model corresponds to the first 2D image, the 3D model having at least one deformation constraint that restricts how the 3D model can be deformed; receiving a second frame captured from the real 3D space, the second frame including a second 2D image of the motion capture subject in the real 3D space; tracking 2D changes in the second 2D image relative to the first 2D image; projecting the 2D changes on the virtual 3D space as 3D constraints; and based on the second 2D image, again deforming the 3D model into a second deformation and placing the 3D model in the virtual 3D space in a second location in conformance with the 3D constraints. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14)
-
-
15. A motion capture system, the system comprising:
-
a geometry tracker configured to; receive a first frame captured from a real 3D space, the first frame including a first 2D image of a motion capture subject in the real 3D space; deform a 3D model into a first deformation and placing the deformed 3D model in a virtual 3D space in a first location so that the deformed 3D model corresponds to the first 2D image, the 3D model having at least one deformation constraint that restricts how the 3D model can be deformed; receive a second frame captured from the real 3D space, the second frame including a second 2D image of the motion capture subject in the real 3D space; project, after tracking, 2D changes on the virtual 3D space as 3D constraints; and based on the second 2D image, again deform the 3D model into a second deformation and place the 3D model in the virtual 3D space in a second location in conformance with the 3D constraints a texture tracker configured to; track, after receiving the second frame, the 2D changes in the second 2D image relative to the first 2D image. - View Dependent Claims (16, 17, 18)
-
-
19. A non-transitory computer readable medium storing instructions that, when executed by one or more processing devices, cause the one or more processing devices to perform operations including:
-
receiving a first flame captured from a real 3D space, the first flame including a first 2D image of a motion capture subject in the real 3D space; deforming a 3D model into a first deformation and placing the deformed 3D model in a virtual 3D space in a first location so that the deformed 3D model corresponds to the first 2D image, the 3D model having at least one deformation constraint that restricts how the 3D model can be deformed; receiving a second flame captured from the real 3D space, the second flame including a second 2D image of the motion capture subject in the real 3D space; tracking 2D changes in the second 2D image relative to the first 2D image; projecting the 2D changes on the virtual 3D space as 3D constraints; and based on the second 2D image, again deforming the 3D model into a second deformation and placing the 3D model in the virtual 3D space in a second location in conformance with the 3D constraints. - View Dependent Claims (20)
-
Specification