Apparatus and method for high-speed marker-free motion capture
First Claim
1. An apparatus for a high-speed marker-free motion capture comprising:
- a 2-dimensional feature point extraction module for obtaining an image with respect to a background with no actor by using a plurality of cameras having different viewing angles from each other to store the obtained image as RGB color space and HSI color space, obtaining an image with respect to an initial posture of the actor to make blob models with respect to a head, hands, feet, trunk, arms and legs, extracting an adjacent connection relationship between the blob models and storing the extracted relationship, receiving the photographed image of the movement of the actor to extract pixels having the color different from the background, detecting pixels having color and shape similar to the stored blob models with respect to the respective parts of the body to make the detected pixels into the blobs, distinguishing the blobs corresponding to the parts of the body from the correlation of the adjacent blobs with respect to the detected blob, and determining the distinguished blobs as 2-dimensional body feature points;
a 3-dimensional feature point tracking module for performing 3-dimensional matching with respect to the 2-dimensional feature points corresponding to the body'"'"'s end portions extracted by the 2-dimensional feature point extraction module, restoring 3-dimensional coordinates, and performing a tracking operation by predicting shape changes of the feature points and the body'"'"'s center of gravity; and
a 3-dimensional motion restoration module for predicting a position of a middle joint using the 3-dimensional coordinates of the 2-dimensional feature points tracked by the 3-dimensional feature point tracking module, generating 3-dimensional motion data, and restoring the 3-dimensional motion data to a human model;
wherein if the 2-dimensional feature point extraction module receives the photographed image of the movement of the actor and extracts the pixels having the color different from the background, the 2-dimensional feature point extraction module extracts candidate pixels having the color different from the background through a comparison of the color components in the RGB color space; and
wherein the 2-dimensional feature point extraction module first carries out a comparison sequence with respect to the RGB color space to select candidate pixels, and transforms the candidate pixels into the HSI color space to find pixels having color similar to the models of the respective parts of the body.
2 Assignments
0 Petitions
Accused Products
Abstract
A high-speed marker-free motion capture, which is capable of powerfully detecting a body'"'"'s feature points corresponding to a body'"'"'s end portions such as a head, hands, feet, trunk, arms and legs at a high speed in an illumination change or background or noises of cameras. The extracted feature points of the body can be directly tracked stably in a 3-dimensional space. The position errors of the feature points due to the change of the illumination conditions or a shadow can be automatically corrected and the feature points can be stably tracked with respect to overlapping and disappearance of the feature points. Further, when coordinates of the middle joints are estimated using 3-dimensional coordinates of the extracted feature points of the body, the present invention restores a human model by estimating the positions of the middle joints of the actor with high accuracy without using a motion database, thereby securing the stability and reality of the 3-dimensional motion data required in the motion capture.
-
Citations
7 Claims
-
1. An apparatus for a high-speed marker-free motion capture comprising:
-
a 2-dimensional feature point extraction module for obtaining an image with respect to a background with no actor by using a plurality of cameras having different viewing angles from each other to store the obtained image as RGB color space and HSI color space, obtaining an image with respect to an initial posture of the actor to make blob models with respect to a head, hands, feet, trunk, arms and legs, extracting an adjacent connection relationship between the blob models and storing the extracted relationship, receiving the photographed image of the movement of the actor to extract pixels having the color different from the background, detecting pixels having color and shape similar to the stored blob models with respect to the respective parts of the body to make the detected pixels into the blobs, distinguishing the blobs corresponding to the parts of the body from the correlation of the adjacent blobs with respect to the detected blob, and determining the distinguished blobs as 2-dimensional body feature points; a 3-dimensional feature point tracking module for performing 3-dimensional matching with respect to the 2-dimensional feature points corresponding to the body'"'"'s end portions extracted by the 2-dimensional feature point extraction module, restoring 3-dimensional coordinates, and performing a tracking operation by predicting shape changes of the feature points and the body'"'"'s center of gravity; and a 3-dimensional motion restoration module for predicting a position of a middle joint using the 3-dimensional coordinates of the 2-dimensional feature points tracked by the 3-dimensional feature point tracking module, generating 3-dimensional motion data, and restoring the 3-dimensional motion data to a human model; wherein if the 2-dimensional feature point extraction module receives the photographed image of the movement of the actor and extracts the pixels having the color different from the background, the 2-dimensional feature point extraction module extracts candidate pixels having the color different from the background through a comparison of the color components in the RGB color space; and wherein the 2-dimensional feature point extraction module first carries out a comparison sequence with respect to the RGB color space to select candidate pixels, and transforms the candidate pixels into the HSI color space to find pixels having color similar to the models of the respective parts of the body. - View Dependent Claims (2, 3, 4, 5, 6, 7)
-
Specification