Motion capture apparatus and method, and motion capture program
First Claim
1. A motion capture apparatus for tracking three-dimensional positions and postures of joints, and limbs of an objective person, said motion capture apparatus comprising:
- generating means for generating a kinematics model having joints connected to one another from an observation image of said objective person;
predicting means for hierarchically calculating predicted positions at a current time of the joints of said objective person in accordance with a constraint of coupling among the joints and predicted positions at a preceding time of the joints in said kinematics model, and predicting three-dimensional positions and pastures of the joints and said limbs of said objective person at the current time;
projecting means for projecting the three-dimensional positions and postures of the joints and the limbs of objective person at the current time on a two-dimensional image plane, the three-dimensional positions and postures being predicted by said predicting means;
evaluating means for evaluating reliability about projection positions projected by said projecting means in accordance with the observation image of said objective person; and
estimating means for estimating the three-dimensional positions and postures of the joints and the limbs of objective person at said current time in accordance with an evaluation result about said reliability.
1 Assignment
0 Petitions
Accused Products
Abstract
A motion capture apparatus includes: generating means; predicting means; projecting means; evaluating means; and estimating means. The generating means generates a kinematics model having joints connected to one another. The predicting means hierarchically calculates predicted positions at a current time of the joints of the objective person, and predicts three-dimensional positions and postures of the joints and the limbs. The projecting means projects the three-dimensional positions and postures of the joints and the limbs of the objective person on a two-dimensional image plane, the three-dimensional positions and the postures being predicted by predicting means. The evaluating means evaluates reliability about projection positions projected by the projecting means based on the observation image of the objective person. The estimating means estimates the three-dimensional positions and postures of the joints and the limbs of the objective person at the current time based on an evaluation result about the reliability.
-
Citations
11 Claims
-
1. A motion capture apparatus for tracking three-dimensional positions and postures of joints, and limbs of an objective person, said motion capture apparatus comprising:
-
generating means for generating a kinematics model having joints connected to one another from an observation image of said objective person; predicting means for hierarchically calculating predicted positions at a current time of the joints of said objective person in accordance with a constraint of coupling among the joints and predicted positions at a preceding time of the joints in said kinematics model, and predicting three-dimensional positions and pastures of the joints and said limbs of said objective person at the current time; projecting means for projecting the three-dimensional positions and postures of the joints and the limbs of objective person at the current time on a two-dimensional image plane, the three-dimensional positions and postures being predicted by said predicting means; evaluating means for evaluating reliability about projection positions projected by said projecting means in accordance with the observation image of said objective person; and estimating means for estimating the three-dimensional positions and postures of the joints and the limbs of objective person at said current time in accordance with an evaluation result about said reliability. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8)
-
-
9. A motion capture method of tracking three-dimensional positions and postures of joints and limbs of an objective person, said motion capture method comprising the steps of:
-
generating a kinematics model having joints connected to one another from an observation image of said objective person; hierarchically calculating predicted positions at a current time of the joints of said objective person in accordance with a constraint of coupling among the joints and predicted positions at a preceding time of the joints in said kinematics model, and predicting three-dimensional positions and postures of the joints and the limbs of said objective person at the current time; projecting the three-dimensional positions and postures of the joints and the limbs of objective person at the current time on a two-dimensional image plane, the three-dimensional, positions and postures being predicted, in said predicting step; evaluating reliability about projection positions projected in said projecting step in accordance with the observation image ox said objective person; and estimating the three-dimensional positions and postures of the joints and the limbs of said objective person at said current time in accordance with an evaluation result about said reliability.
-
-
10. A non-transitory computer-readable medium storing a motion capture program for executing processing for tracking three-dimensional positions and postures of joints and limbs of an objective person, said motion capture program comprising the steps of:
-
generating a kinematics model having joints connected to one another from an observation image of said objective person; hierarchically calculating predicted positions at a current time of the joints of said objective person in accordance with a constraint of coupling among the joints and predicted positions at a preceding time of the joints in said kinematics model, and predicting three-dimensional positions and postures of the joints and the limbs of said objective person at the current time; projecting the three-dimensional positions and postures of the joints and the limbs of objective person at the current time on a two-dimensional image plane, the three-dimensional positions and postures being predicted in said predicting step; evaluating reliability about projection positions projected in said projecting step in accordance with the observation image of said objective person; and estimating the three-dimensional positions and postures of the joints and the limbs of said objective person at said current time in accordance with an evaluation result about said reliability.
-
-
11. A motion capture apparatus for tracking three-dimensional positions and postures of joints, and limbs of an objective person, said motion capture apparatus comprising:
-
a generating portion configured to generate a kinematics model having joints connected to one another from art observation image of said objective person; a predicting portion configured to hierarchically calculate predicted positions at a current time of the joints of said objective person in accordance with a constraint of coupling among the joints and predicted positions at a preceding time of the joints in said kinematics model, and predict three-dimensional positions and postures of the joints and said limbs of said objective person at the current time; a projecting portion configured to project the three-dimensional positions and postures of the joints and the limbs of objective person at the current time on a two-dimensional, image plane, the three-dimensional positions and postures being predicted by said predicting portion; an evaluating portion configured to evaluate reliability about projection positions projected by said projecting portion in accordance with the observation image of said objective person; and an estimating portion configured to estimate the three-dimensional positions and postures of the joints and the limbs of objective person at said current time in accordance with an evaluation result about said reliability.
-
Specification