GENERATING AN AVATAR FROM REAL TIME IMAGE DATA
2 Assignments
0 Petitions
Accused Products
Abstract
Technology is disclosed for automatically generating a facial avatar resembling a user in a defined art style. One or more processors generate a user 3D head model for the user based on captured 3D image data from a communicatively coupled 3D image capture device. A set of user transferable head features from the user 3D head model are automatically represented by the one or more processors in the facial avatar in accordance with rules governing transferable user 3D head features. In some embodiments, a base or reference head model of the avatar is remapped to include the set of user head features. In other embodiments, an avatar head shape model is selected based on the user 3D head model, and the transferable user 3D head features are represented in the avatar head shape model.
29 Citations
34 Claims
-
1-20. -20. (canceled)
-
21. One or more processor readable storage devices having encoded thereon instructions for causing one or more processors to perform a method for automatically generating a facial avatar resembling a user in a defined art style, the method comprising:
-
generating a user head model for the user based on captured image data by one or more processors communicatively coupled to a capture device; identifying a set of transferable user head features from the user head model which can be represented in the facial avatar based on transferable head feature rules for the defined art style; identifying a set of avatar character head features to represent the set of transferable user head features based on the transferable head feature rules for the defined art style by; identifying one or more user head features which can be represented by one or more symbol features in the defined art style of the avatar based on transferable head feature rules for the defined art style; and representing the one or more user head features by the one or more symbol features into a model for the selected avatar head shape; generating the facial avatar in the defined art style including the set of avatar character head features; displaying the facial avatar by a display communicatively coupled to the one or more processors; updating a facial expression of the facial avatar responsive to changes detected in user facial features; and updating display of the facial avatar with the updated facial expression.
-
-
27. A method for automatically generating a facial avatar resembling a user in a defined art style comprising:
-
capturing image data of user head features including facial features by a capture device; generating a user head model for the user based on the captured image data by one or more processors communicatively coupled to the capture device; identifying a set of transferable user head features from the user head model which can be represented in the facial avatar based on transferable head feature rules for the defined art style; identifying a set of avatar character head features to represent the set of transferable user head features based on the transferable head feature rules for the defined art style by; identifying one or more user head features which can be represented by one or more symbol features in the defined art style of the avatar based on transferable head feature rules for the defined art style, representing the one or more user head features by the one or more symbol features into the 3D model for the selected avatar head shape, and wherein the transferable head feature rules directing which of the facial features are transferable to the facial avatar for the defined art style; generating the facial avatar in the defined art style including the set of avatar character head features; and displaying the facial avatar by a display communicatively coupled to the one or more processors.
-
-
34. A system for automatically generating a facial avatar resembling a user in a defined art style comprising:
-
one or more image capture devices including one or more depth sensors; one or more displays; one or more memories for storing measurement metrics for user head model data and rules identifying a set of transferable user head features which can be represented by the facial avatar; one or more processors having access to the one or more memories and being communicatively coupled to the one or more image capture devices for receiving image data including a depth value for user head features including facial features and being communicatively coupled to the one or more displays; the one or more processors generating the user head model for the user based on the image data communicatively coupled to the one or more capture devices; the one or more processors identifying a set of transferable user head features from the user head model which can be represented in the facial avatar based on transferable head feature rules for the defined art style; the one or more processors identifying a set of avatar character head features to represent the set of transferable user head features based on the transferable head feature rules for the defined art style, the transferable head feature rules directing which of the facial features are transferable to the facial avatar for the defined art style; the one or more processors iteratively performing a morph target animation technique operating on shape units of a human head reference mesh model until a matching criteria with a tracking mesh is satisfied, the one or more processors storing a set of measurements relating the head features and the tracking mesh as a user head model, including storing as coefficient data of the user head model the coefficients data for each point in each respective shape unit which satisfied the matching criteria; the one or more processors generating the facial avatar in the defined art style including the set of avatar character head features; and the one or more processors displaying the facial avatar by the one or more displays.
-
Specification