MOTION CAPTURE FROM BODY MOUNTED CAMERAS
First Claim
Patent Images
1. A method for capturing motion of a subject having a body with a plurality of articulating members movable about a plurality of joints, the method comprising:
- attaching a plurality of cameras to the body of the subject, wherein at least some of the cameras are attached to the articulating members and wherein at least some of the cameras are oriented toward an external environment surrounding the subject;
recording an image sequence from each of the cameras while the subject performs an action;
analyzing, using a computer system, the image sequences recorded by each of the cameras to determine correlations between the images; and
based at least in part on the analysis of the image sequences, computing, using the computer system, a sequence of articulated poses of the body of the subject, the sequence of articulated poses being representative of the action.
2 Assignments
0 Petitions
Accused Products
Abstract
Body-mounted cameras are used to accurately reconstruct the motion of a subject. Outward-looking cameras are attached to the limbs of the subject, and the joint angles and root pose that define the subject'"'"'s configuration are estimated through a non-linear optimization, which can incorporate image matching error and temporal continuity of motion. Instrumentation of the environment is not required, allowing for motion capture over extended areas and in outdoor settings.
-
Citations
20 Claims
-
1. A method for capturing motion of a subject having a body with a plurality of articulating members movable about a plurality of joints, the method comprising:
-
attaching a plurality of cameras to the body of the subject, wherein at least some of the cameras are attached to the articulating members and wherein at least some of the cameras are oriented toward an external environment surrounding the subject; recording an image sequence from each of the cameras while the subject performs an action; analyzing, using a computer system, the image sequences recorded by each of the cameras to determine correlations between the images; and based at least in part on the analysis of the image sequences, computing, using the computer system, a sequence of articulated poses of the body of the subject, the sequence of articulated poses being representative of the action. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14)
-
-
15. A system for capturing motion of a subject having a body with a plurality of articulating members, the system comprising:
-
a data input port configured to receive a plurality of image sequences captured by a plurality of cameras worn by a subject while performing an action; and a processor configured to; analyze the image sequences received from each of the plurality of cameras to determine correlations between the images; and compute, based at least in part on the analysis of the image sequences, a sequence of articulated poses of the body of the subject, the sequence of articulated poses being representative of the action. - View Dependent Claims (16, 17)
-
-
18. A system for capturing motion of a subject having a body with a plurality of articulating members, the system comprising:
-
a plurality of cameras adapted to be wearable by a subject while performing an activity, the plurality of cameras being orientable toward an external environment surrounding the subject; a storage medium configured to receive and store a plurality of image sequences captured by the plurality of cameras, the image sequences including images captured while the subject performed the activity; and a processor coupled to the storage medium and configured to; analyze the image sequences to determine correlations between the images; and compute, based at least in part on the analysis of the image sequences, a sequence of articulated poses of the body of the subject, the sequence of articulated poses being representative of the action. - View Dependent Claims (19, 20)
-
Specification