Robust attribute transfer for character animation

• US 10,489,956 B2
• Filed: 07/21/2016
• Issued: 11/26/2019
• Est. Priority Date: 07/27/2015
• Status: Active Grant

• Current Assignee: Autodesk, Inc.
• Original Assignee: Autodesk, Inc.
• Inventors: Dionne, Olivier, De Lasa, Martin, Ramachandran, Srinivasan, Fallhdoust, Sahel, Paquette, Eric, Ghafourzadeh, Donya, Avril, Quentin
• Primary Examiner(s): Du, Haixia
• Application Number:
  US14/999,985
• Publication Number:
  US 20170032560A1
• Time in Patent Office: 1,223 Days
• CPC Class Codes: G06T 13/40 of characters, e.g. humans, animals or virtual beings
• CPC Class Codes: G06T 17/20 Finite element generation, e.g. wire-frame surface description, tesselation
• CPC Class Codes: G06T 19/20 Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
• CPC Class Codes: G06T 2219/2016 Rotation, translation, scaling

Abstract

One embodiment of the invention disclosed herein provides techniques for transferring attributes from a source animated character to a target character. A character attribute transfer system identifies a first set of markers corresponding to the source animated character. The character attribute transfer system identifies a second set of markers corresponding to the target character. The character attribute transfer system generates a geometric correspondence between the source animated character and the target character based on the first set of markers and the second set of markers independent of differences in geometry between the source animated character and the target character. The character attribute transfer system transfers a first attribute from the source animated character to the target character based on the geometric correspondence.

Claims

1. A method for transferring attributes from a source animated character to a target character, comprising:

identifying a first set of markers on a source mesh representation of the source animated character;

identifying a second set of markers on a target mesh representation of the target character;

determining a first joint-vertices relationship between a portion of the first set of markers and a first location of a first joint included in a first joint hierarchy associated with the source animated character;

generating a geometric correspondence between the first set of markers and the second set of markers, wherein the geometric correspondence is independent of differences in geometry between the source animated character and the target character; and

transferring, based on both the geometric correspondence and the first joint-vertices relationship, the first location of the first joint from the source animated character to the target character.

2. The method of claim 1, further comprising performing a pose normalization process on the source animated character to align the first joint hierarchy with a second joint hierarchy associated with the target character.

3. The method of claim 1, wherein transferring the first location comprises:

determining the first location;

computing a second location for a second joint included in a second joint hierarchy associated with the target character based on both the first location and the geometric correspondence; and

placing the second joint at the second location.

4. The method of claim 1, further comprising:

determining a first rotation angle of the first joint; and

computing, based on the first rotation angle, a second rotation angle for a second joint included in a second joint hierarchy associated with the target character.

5. The method of claim 1, further comprising:

determining a first set of one or more skinning weights associated with the source mesh representation;

computing, based on both the first set of one or more skinning weights and the geometric correspondence, a second set of one or more skinning weights associated with the target mesh representation; and

attaching, based on the second set of one or more skinning weights, a first vertex included in the target mesh representation to a second joint hierarchy associated with the target character.

6. The method of claim 1, further comprising:

determining that a first resolution of the source mesh representation is less than a second resolution of the target mesh representation;

performing a linear interpolation on a first subset of skinning weights included in a first set of skinning weights associated with the source mesh representation to generate a set of resampled source skinning weights; and

determining a first target skinning weight associated with the target character, based on at least one of the set of resampled source skinning weights.

7. The method of claim 1, further comprising:

determining that a first resolution of the source mesh representation is greater than a second resolution of the target mesh representation;

selecting one or more vertices included in the source mesh representation;

applying a filter to a plurality of source skinning weights associated with the one or more vertices to generate a filtered skinning weight; and

assigning the filtered skinning weight to a first vertex included in the target mesh representation.

8. The method of claim 1, and further comprising:

after transferring a first set of one or more skinning weights associated with the source animated character to the target character, determining that a first skinning weight included in the first set of one or more skinning weights has changed; and

transferring the first skinning weight from the source animated character to the target character based on the geometric correspondence.

9. The method of claim 1, further comprising transferring a rig control from the source animated character to the target character, wherein the rig control includes a set of controllers and one or more constraints that define how the source animated character can pose and move.

10. The method of claim 1, further comprising transferring a set of (u, v) coordinates from the source animated character to the target character, wherein the set of (u, v) coordinates defines positions of one or more textures that are projected onto the source mesh representation.

11. One or more non-transitory computer-readable storage media including instructions that, when executed by one or more processors, cause the one or more processors to transfer attributes from a source animated character to a target character by performing the steps of:

identifying a first set of markers on a source mesh representation of the source animated character;

identifying a second set of markers on a target mesh representation of the target character;

determining a first joint-vertices relationship between a portion of the first set of makers and a first location of a first joint included in a first joint hierarchy associated with the source animated character;

generating a geometric correspondence between the first set of markers and the second set of markers, wherein the geometric correspondence is independent of differences in geometry between the source animated character and the target character; and

transferring, based on both the geometric correspondence and the first joint-vertices relationship, the first location of the first joint from the source animated character to the target character.

12. The non-transitory computer-readable storage media of claim 11, further comprising performing a pose normalization process on the source animated character to align the first joint hierarchy with a second joint hierarchy associated with the target character.

13. The non-transitory computer-readable storage media of claim 11, wherein transferring the first location comprises:

determining the first location;

computing a second location for a second joint included in a second joint hierarchy associated with the target character based on the first location and the geometric correspondence; and

placing the second joint at the second location.

14. The non-transitory computer-readable storage media of claim 11, further comprising:

determining a first rotation angle of the first joint; and

computing, based on the first rotation angle, a second rotation angle for a second joint included in a second joint hierarchy associated with the target character.

15. The non-transitory computer-readable storage media of claim 11, wherein generating the geometric correspondence further comprises deforming the source mesh representation to generate a deformed source mesh representation that matches the target mesh representation.

16. The non-transitory computer-readable storage media of claim 15, wherein generating the geometric correspondence further comprises extracting a dense correspondence based on closest locations between the deformed source mesh representation and the target mesh representation.

17. The non-transitory computer-readable storage media of claim 15, wherein each vertex included in the deformed source mesh representation is bijectively linked to a barycentric coordinate on a polygon of the target mesh representation.

18. The non-transitory computer-readable storage media of claim 15, wherein each vertex included in the target mesh representation is bijectively linked to a barycentric coordinate on a polygon of the deformed source mesh representation.

19. A system, comprising:

a processor; and

a memory coupled to the processor and including a geometric correspondence engine and a transfer engine;

wherein, when executing the geometric correspondence engine, the processor is configured to;

identify a first set of markers on a source mesh representation of a source animated character,

identify a second set of markers on a target mesh representation of a target character, and

determine a first joint-vertices relationship between a portion of the first set of markers and a first location of a first joint included in a first joint hierarchy associated with the source animated character;

generate a geometric correspondence between the first set of markers and the second set of markers, wherein the geometric correspondence is independent of differences in geometry between the source animated character and the target character; and

wherein, when executing the transfer engine, the processor is configured to transfer, based on both the geometric correspondence and a first joint-vertices relationship, the first location of the first joint from the source animated character to the target character.

20. The system of claim 19, wherein the geometric correspondence is generated independent of a first number of geometry primitives included in the source mesh representation relative to a second number of geometry primitives included in the target mesh representation.