Apparatus and method for high-speed marker-free motion capture
First Claim
1. An apparatus for a high-speed marker-free motion capture comprising:
- a 2-dimensional feature point extraction module for obtaining an image with respect to a background with no actor by using a plurality of cameras having different viewing angles from each other to store the obtained image as RGB color space having a characteristic which easily emphasizes color difference and HSI color space having a characteristic which easily emphasizes color similarity, obtaining an image with respect to an initial posture of the actor to make blob models with respect to a head, hands, feet, trunk, arms and legs, extracting an adjacent connection relationship between the blob models and storing the extracted relationship, receiving the photographed image of the movement of the actor to extract pixels having the color different from the background, detecting pixels having color and topology similar to the stored blob models with respect to the respective parts of the body to make the detected pixels into the blobs, distinguishing the blobs corresponding to the parts of the body from the correlation of the adjacent blobs with respect to the detected blob, and determining the distinguished blobs as 2-dimensional body feature points;
a 3-dimensional feature point tracking module for performing 3-dimensionla matching with respect to the 2-dimensional feature points corresponding to the body'"'"'s end portions extracted by the 2-dimensional feature point extraction module, restoring 3-dimensional coordinates, and performing a tracking operation by predicting topology changes of the feature points and the body'"'"'s center of gravity; and
a 3-dimensional motion restoration module for predicting a position of a middle joint using the 3-dimensional coordinates of the 2-dimensional feature points tracked by the 3-dimensional feature point tracking module, generating 3-dimensional motion data, and restoring the 3-dimensional motion data to a human model.
2 Assignments
0 Petitions
Accused Products
Abstract
The present invention relates to an apparatus and method for a high-speed marker-free motion capture, which is capable of powerfully detecting a body'"'"'s feature points corresponding to a body'"'"'s end portions such as a head, hands, feet, trunk, arms and legs at a high speed in an illumination change or background or noises of cameras. The extracted feature points of the body can be directly tracked stably in a 3-dimensional space. The position errors of the feature points due to the change of the illumination conditions or a shadow can be automatically corrected and the feature points can be stably tracked with respect to overlapping and disappearance of the feature points. Further, when coordinates of the middle joints are estimated using 3-dimensional coordinates of the extracted feature points of the body, the apparatus and method of the present invention restores a human model by estimating the positions of the middle joints of the actor with high reality without using motion database, thereby securing the stability and reality of the 3-dimensional motion data required in the motion capture.
-
Citations
11 Claims
-
1. An apparatus for a high-speed marker-free motion capture comprising:
-
a 2-dimensional feature point extraction module for obtaining an image with respect to a background with no actor by using a plurality of cameras having different viewing angles from each other to store the obtained image as RGB color space having a characteristic which easily emphasizes color difference and HSI color space having a characteristic which easily emphasizes color similarity, obtaining an image with respect to an initial posture of the actor to make blob models with respect to a head, hands, feet, trunk, arms and legs, extracting an adjacent connection relationship between the blob models and storing the extracted relationship, receiving the photographed image of the movement of the actor to extract pixels having the color different from the background, detecting pixels having color and topology similar to the stored blob models with respect to the respective parts of the body to make the detected pixels into the blobs, distinguishing the blobs corresponding to the parts of the body from the correlation of the adjacent blobs with respect to the detected blob, and determining the distinguished blobs as 2-dimensional body feature points;
a 3-dimensional feature point tracking module for performing 3-dimensionla matching with respect to the 2-dimensional feature points corresponding to the body'"'"'s end portions extracted by the 2-dimensional feature point extraction module, restoring 3-dimensional coordinates, and performing a tracking operation by predicting topology changes of the feature points and the body'"'"'s center of gravity; and
a 3-dimensional motion restoration module for predicting a position of a middle joint using the 3-dimensional coordinates of the 2-dimensional feature points tracked by the 3-dimensional feature point tracking module, generating 3-dimensional motion data, and restoring the 3-dimensional motion data to a human model. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10)
-
-
11. A method for a high-speed marker-free motion capture, comprising the steps of:
-
obtaining an image with respect to a background with no actor and storing the obtained image as two color spaces whose characteristics are different from each other using a plurality of cameras having different viewing angles from each other by a 2-dimensional feature point extraction module;
obtaining an image with respect to an initial posture of the actor using the cameras to make blob models with respect to a head, hands, feet, trunk, arms and legs, extracting an adjacent connection relationship between the blob models, and storing the extracted relationship by the 2-dimensional feature point extraction module;
receiving the photographed image of the movement of the actor to extract pixels having the color different from the background, detecting pixels having color and topology similar to the stored blob models with respect to the respective parts of the body, and making the detected pixels into the blob by the 2-dimensional feature point extraction module;
distinguishing the blobs corresponding to the parts of the body from the correlation of the adjacent blobs with respect to the detected blobs and determining the distinguished blobs as the 2-dimensional body feature points by the 2-dimensional feature point extraction module;
performing 3-dimensionla matching with respect to the 2-dimensional feature points corresponding to the body'"'"'s end portions extracted by the 2-dimensional feature point extraction module to restore 3-dimensional coordinates, and performing a tracking operation by predicting topology changes of the feature points and the body'"'"'s center of gravity by a 3-dimensional feature point tracking module; and
estimating the position of a middle joint using the 3-dimensional coordinates of the 2-dimensional feature points tracked by the 3-dimensional feature point tracking module to generate 3-dimensional motion data, and restoring the 3-dimensional motion data to a human model by a 3-dimensional motion restoration module.
-
Specification