AUTOMATICALLY DETERMINING CORRESPONDENCES BETWEEN THREE-DIMENSIONAL MODELS

• US 20160027200A1
• Filed: 07/28/2015
• Published: 01/28/2016
• Est. Priority Date: 07/28/2014
• Status: Active Grant

• Current Assignee: Adobe Inc.
• Original Assignee: Adobe Systems Incorporated (Adobe Inc.)
• Inventors: Corazza, Stefano, Gambaretto, Emiliano, Pia, Charles, Babcock, Daniel
• Granted Patent: US 9,911,220 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06T 13/40 of characters, e.g. humans, animals or virtual beings
• CPC Class Codes: G06T 15/04 Texture mapping
• CPC Class Codes: G06V 40/10 Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands

Abstract

The present disclosure is directed to integrating external 3D models into a character creation system. In general, a character creation system imports an external 3D model by determining correspondence values for each vertex within the 3D model. Once imported, a user can customize the 3D character by adding texture to the character, adjusting character features, swapping out one or more character features, adding clothes and accessories to the character, automatically rigging the character, and/or animating the character.

Claims

1. A method for integrating an external three-dimensional character into a character creation system, comprising:

importing a three-dimensional model of a character, the three-dimensional model comprising a three-dimensional character mesh having a plurality of vertices;

identifying, by at least one processor, a vertex of the three-dimensional character mesh that does not have a one-to-one match with a vertex of a predefined three-dimensional template mesh;

identifying, based on the vertex of the character mesh, a plurality of related vertices within the predefined three-dimensional template mesh;

determining, for the vertex of the character mesh, a correspondence value based on the plurality of identified related vertices from the template mesh; and

associating the vertex of the character mesh with the correspondence value.

2. The method of claim 1, further comprising:

identifying a polygon or edge in the of the three-dimensional character mesh that corresponds to the vertex;

identifying a related polygon or edge within the predefined three-dimensional template mesh that corresponds to the plurality of related vertices within the predefined three-dimensional template mesh;

and wherein determining a correspondence value based on the plurality of identified related vertices from the template mesh comprises deriving a correspondence value for the polygon or edge of the three-dimensional character mesh based on the related polygon or edge within the predefined three-dimensional template mesh.

3. The method of claim 1, wherein determining the correspondence value for the vertex comprises identifying a value of one or more nearest neighbors from among the plurality of related vertices of the template mesh.

4. The method of claim 1, wherein determining the correspondence value for the vertex comprises averaging values of the plurality of vertices from the template mesh.

5. The method of claim 1, wherein determining the correspondence value for the vertex comprises determining a barycenter value using the plurality of vertices from the template mesh.

6. The method of claim 1, further comprising projecting vertices of the three-dimensional character mesh onto a UV map of the predefined three-dimensional template mesh.

7. The method of claim 6, wherein the predefined three-dimensional template mesh and the three-dimensional character mesh use similar UV mappings.

8. The method of claim 7, wherein determining, for the vertex of the character mesh, a correspondence value based on the plurality of identified related vertices from the template mesh comprises determining the correspondence value in UV map space.

9. The method of claim 6, wherein the vertex of the character mesh is related to the plurality of vertices of the template mesh when the vertex of the character mesh projects next to the plurality of vertices on the UV map of the predefined three-dimensional template mesh in UV map space.

10. The method of claim 1, further comprising:

detecting an edge vertex within the plurality of related vertices from the template mesh;

based on detecting the edge vertex, identifying a mesh portion in the template mesh that corresponds to the vertex of the character mesh; and

wherein determining the correspondence value for the vertex comprises determining, within the identified mesh portion, the correspondence value based on the edge vertex.

11. The method of claim 1, further comprising identifying one or more mapped values for the vertex of the character mesh from a lookup table using the correspondence value.

12. The method of claim 11, wherein the lookup table comprises mapped values of a texture map, a color map, or a detail overlay map.

13. The method of claim 1, further comprising leveraging the correspondence value to apply texture, clothing, or an accessory to the three-dimensional model.

14. The method of claim 1, further comprising rigging the three-dimensional model with a bone structure based on the correspondence value.

15. The method of claim 1, further comprising:

identifying a feature within the template mesh that corresponds to the correspondence value;

associating the feature with the vertex of the character mesh;

identifying additional vertices from the character mesh that share the identified feature; and

replacing the vertex and the additional vertices on the character mesh with a set of replacement vertices that provides an alternative structure of the feature.

16. A method for importing an external object into a 3D character creation system, comprising:

detecting an object from one or more images;

identifying, by at least one processor, a predefined three-dimensional template mesh that corresponds to the object;

generating an object mesh for the object by transforming the template mesh to match the object;

identifying a vertex from the object mesh;

determining, for the vertex from the object mesh, a value corresponding to the template mesh; and

associating the vertex of the object mesh with the corresponding value.

17. The method of claim 16, further comprising texturing the object mesh with texture from a texture map based on the correspondence value.

18. The method of claim 16, wherein texturing the object mesh comprises:

using the correspondence value to look up a texture value in a texture map lookup table; and

applying the texture value to the vertex in the object mesh.

19. The method of claim 18, wherein the model of the imported character is a non-human object.

20. A system for integrating an external three-dimensional character into a character creation system, comprising:

at least one processor; and

at least one non-transitory computer readable storage medium storing instructions that, when executed by the at least one processor, cause the system to;

import a three-dimensional model of a character, the three-dimensional model comprising a three-dimensional character mesh having a plurality of vertices;

identify a vertex of the three-dimensional character mesh that does not have a one-to-one match with a vertex of a predefined three-dimensional template mesh;

identify, based on the vertex of the character mesh, a plurality of related vertices within the predefined three-dimensional template mesh;

determine, for the vertex of the character mesh, a correspondence value based on the plurality of identified related vertices from the template mesh; and

associate the vertex of the character mesh with the correspondence value.