Mesh Quilting for Geometric Texture Synthesis

• US 20080303840A1
• Filed: 06/08/2007
• Published: 12/11/2008
• Est. Priority Date: 06/08/2007
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Zhou, Kun, Wang, Xi, Huang, Xin, Shum, Heung-Yeung, Guo, Baining
• Granted Patent: US 7,800,627 B2
• Time in Patent Office: Days
• US Class Current: 345/585
• CPC Class Codes: G06T 15/04 Texture mapping

Abstract

Mesh quilting for geometric texture synthesis involves synthesizing a geometric texture by quilting a mesh texture swatch. In an example embodiment, geometry is matched between a mesh texture swatch and a portion of a synthesized geometric texture. Correspondences are ascertained between elements of the mesh texture swatch and the portion of the synthesized geometric texture. The ascertained corresponding elements of the mesh texture swatch and the portion of the synthesized geometric texture are aligned via local deformation to create a new patch. The new patch is merged into an output texture space to grow the synthesized geometric texture.

Claims

1. A method comprising:

matching geometry between a mesh texture swatch and a portion of a synthesized geometric texture;

ascertaining correspondences between elements of the mesh texture swatch and the portion of the synthesized geometric texture;

aligning ascertained corresponding elements of the mesh texture swatch and the portion of the synthesized geometric texture via local deformation to create a new patch; and

merging the new patch into an output texture space to grow the synthesized geometric texture.

2. The method as recited in claim 1, wherein the portion of the synthesized geometric texture comprises a seed region;

and wherein the method further comprises;

finding the seed region in the synthesized geometric texture responsive to a cell of a grid with the cell having at least one adjacent cell in which the synthesized geometric texture has already been grown using the mesh texture swatch.

3. The method as recited in claim 1, wherein the mesh texture swatch comprises a set of vertex positions and a set of triangles.

4. The method as recited in claim 1, wherein the matching comprises:

determining multiple matching costs that are respectively associated with multiple translations of the mesh texture swatch; and

selecting a translation of the multiple translations that is associated with a lowest matching cost of the multiple matching costs.

5. The method as recited in claim 4, wherein the determining comprises:

determining a distance between an output vertex of the synthesized geometric texture and an input face of the mesh texture swatch for each input face of the mesh texture swatch, the distance comprising a combination of geometric distance and normal distance.

6. The method as recited in claim 1, wherein the ascertaining comprises:

determining if input elements of the mesh texture swatch are related to output elements of the synthesized geometric texture based on an analysis involving at least one criterion.

7. The method as recited in claim 6, wherein the at least one criterion involves vertex-face pairs with vertices being from the synthesized geometric texture and faces being from the mesh texture swatch.

8. The method as recited in claim 6, wherein the determining comprises:

determining a nearest input face of the mesh texture swatch for each output vertex of the synthesized geometric texture within an overlapping region to collect a set of vertex-face pairs; and

tagging a given output element of the synthesized geometric texture as being related to a particular input element of the mesh texture swatch if there exists a vertex-face pair in the collected set of vertex-face pairs such that an output vertex of the vertex-face pair is part of the given output element and an input face of the vertex-face pair is part of the particular input element.

9. The method as recited in claim 1, wherein the aligning comprises:

deforming an input element of the mesh texture swatch and a corresponding output element of the synthesized geometric texture while attempting to satisfy position constraints and attempting to preserve local geometry details.

10. The method as recited in claim 9, wherein the position constraints are reflected responsive to average points of vertex-face pairs, and the local geometry details are reflected responsive to Laplacian coordinates.

11. The method as recited in claim 1, wherein the merging comprises:

for each input element of the mesh texture swatch or output element of the synthesized geometric texture that lacks a corresponding output element or input element, respectively, adding the input element and the output element to the synthesized geometric texture.

12. The method as recited in claim 1, wherein the merging comprises:

for each input element of the mesh texture swatch or output element of the synthesized geometric texture that has a corresponding output element or input element, respectively;

adding the input element to the synthesized geometric texture if its corresponding output element is entirely within an overlapping region; and

adding the output element to the synthesized geometric texture if its corresponding input element is entirely within the overlapping region.

13. The method as recited in claim 1, wherein the merging comprises:

for each input element of the mesh texture swatch and its corresponding output element of the synthesized geometric texture that are both partially within an overlapping region;

stitching the input element and the corresponding output element together into a combined element; and

adding the combined element to the synthesized geometric texture.

14. The method as recited in claim 13, wherein the stitching comprises:

using a graph cut algorithm on an undirected flow network graph representing a dual graph adjacency between triangles.

15. The method as recited in claim 1, wherein the output texture space is associated with a three-dimensional (3D) base mesh over which the synthesized geometric texture is grown.

16. The method as recited in claim 15, further comprising:

building a texture atlas for the 3D base mesh; and

converting local representations of vertex positions for the synthesized geometric texture into locations in a geometry texture space.

17. The method as recited in claim 15, further comprising:

reducing a stretching of the synthesized geometric texture, which is induced from a shell mapping between a shell space around the 3D base mesh and the output texture space, responsive to a stretch metric on tetrahedra.

18. The method as recited in claim 17, wherein the reducing comprises:

minimizing a value of the stretch metric that is derived from a tetrahedron associated with the shell space and a tetrahedron associated with the output texture space.

19. A device comprising:

a geometry matcher to match geometry between a mesh texture swatch and a portion of a synthesized geometric texture;

a corresponding elements ascertainer to ascertain correspondences between elements of the mesh texture swatch and the portion of the synthesized geometric texture;

a corresponding elements aligner to align ascertained corresponding elements of the mesh texture swatch and the portion of the synthesized geometric texture via local deformation to create a new patch; and

a patch merger to merge the new patch into an output texture space to grow the synthesized geometric texture.

20. One or more processor-accessible media comprising processor-executable instructions that, when executed, direct a device to perform acts comprising:

matching geometry between a mesh texture swatch and a portion of a synthesized geometric texture;

ascertaining correspondences between elements of the mesh texture swatch and the portion of the synthesized geometric texture;

aligning ascertained corresponding elements of the mesh texture swatch and the portion of the synthesized geometric texture via local deformation to create a new patch; and

merging the new patch into an output texture space to grow the synthesized geometric texture.