PROXY TRAINING DATA FOR HUMAN BODY TRACKING
First Claim
1. A processor-implemented method for generating proxy training data for human body tracking, comprising the processor-implemented steps of:
- accessing at least one motion capture sequence which identifies poses of an actor'"'"'s body during a time period in which the actor performs a movement;
performing retargeting to a plurality of body types and dissimilar pose selection, based on the at least one motion capture sequence, to provide a plurality of dissimilar poses; and
rendering each of the dissimilar poses according to a 3-D body model for a respective body type of the plurality of body types, to provide a respective depth image of the dissimilar pose, and to provide a respective classification image which identifies body parts of the dissimilar pose, where a plurality of 3-D body models are used, one for each body type, and the respective depth image and the respective classification image comprise pixel data which is usable by a machine learning algorithm for human body tracking.
2 Assignments
0 Petitions
Accused Products
Abstract
Synthesized body images are generated for a machine learning algorithm of a body joint tracking system. Frames from motion capture sequences are retargeted to several different body types, to leverage the motion capture sequences. To avoid providing redundant or similar frames to the machine learning algorithm, and to provide a compact yet highly variegated set of images, dissimilar frames can be identified using a similarity metric. The similarity metric is used to locate frames which are sufficiently distinct, according to a threshold distance. For realism, noise is added to the depth images based on noise sources which a real world depth camera would often experience. Other random variations can be introduced as well. For example, a degree of randomness can be added to retargeting. For each frame, the depth image and a corresponding classification image, with labeled body parts, are provided. 3-D scene elements can also be provided.
-
Citations
20 Claims
-
1. A processor-implemented method for generating proxy training data for human body tracking, comprising the processor-implemented steps of:
-
accessing at least one motion capture sequence which identifies poses of an actor'"'"'s body during a time period in which the actor performs a movement; performing retargeting to a plurality of body types and dissimilar pose selection, based on the at least one motion capture sequence, to provide a plurality of dissimilar poses; and rendering each of the dissimilar poses according to a 3-D body model for a respective body type of the plurality of body types, to provide a respective depth image of the dissimilar pose, and to provide a respective classification image which identifies body parts of the dissimilar pose, where a plurality of 3-D body models are used, one for each body type, and the respective depth image and the respective classification image comprise pixel data which is usable by a machine learning algorithm for human body tracking. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11)
-
-
12. Tangible computer readable storage having computer readable software embodied thereon for programming at least one processor to perform a method for generating proxy training data for human body tracking, the method comprising:
-
accessing at least one motion capture sequence which identifies poses of an actor'"'"'s body during a time period in which the actor performs a movement; performing retargeting to a plurality of body types and dissimilar pose selection, based on the at least one motion capture sequence, to provide a plurality of dissimilar poses; and rendering each of the dissimilar poses according to a 3-D body model for a respective body type of the plurality of body types, to provide a respective depth image of the dissimilar pose, and to provide a respective classification image which identifies body parts of the dissimilar pose, where a plurality of 3-D body models are used, one for each body type, the respective depth image and the respective classification image comprise pixel data which is usable by a machine learning algorithm for human body tracking, and the rendering adds 3-D scene elements to at least one of the dissimilar poses. - View Dependent Claims (13, 14)
-
-
15. A processor-implemented method for generating proxy training data for human body tracking, comprising the processor-implemented steps of:
-
accessing at least one motion capture sequence which identifies poses of an actor'"'"'s body during a time period in which the actor performs a movement; performing dissimilar pose selection and retargeting to a plurality of body types, based on the at least one motion capture sequence, to provide a plurality of dissimilar poses; and rendering each of the dissimilar poses according to a 3-D body model for a respective body type of the plurality of body types, to provide a respective depth image of the dissimilar pose, and to provide a respective classification image which identifies body parts of the dissimilar pose, where a plurality of 3-D body models are used, one for each body type, the respective depth image and the respective classification image comprise pixel data which is usable by a machine learning algorithm for human body tracking, and the rendering adds noise to at least one of the dissimilar poses. - View Dependent Claims (16, 17, 18, 19, 20)
-
Specification