Methods and apparatus for directional texture generation using image warping

• US 8,787,698 B2
• Filed: 08/18/2010
• Issued: 07/22/2014
• Est. Priority Date: 09/04/2009
• Status: Active Grant

• Current Assignee: Adobe Inc.
• Original Assignee: Adobe Systems Incorporated (Adobe Inc.)
• Inventors: Winnemoeller, Holger, Breslav, Simon
• Primary Examiner(s): Chu, Randolph I
• Assistant Examiner(s): BLOOM, NATHAN J
• Application Number:
  US12/858,558
• Publication Number:
  US 20130121613A1
• Time in Patent Office: 1,434 Days
• Field of Search: 382/100, 382/162, 382/195, 382275-276, 382/282, 345418-419, 345473-474, 345581-582, 345/619, 345646-650, 345660-661, 345/672, 345/676
• US Class Current: 382/284
• CPC Class Codes: G06F 3/0354 with detection of 2D relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
• CPC Class Codes: G06F 3/0484 for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
• CPC Class Codes: G06T 11/001 Texturing; Colouring; Generation of texture or colour inpainting G06T5/77
• CPC Class Codes: G06T 11/40 Filling a planar surface by adding surface attributes, e.g. colour or texture
• CPC Class Codes: G06T 2200/24 involving graphical user interfaces [GUIs]

Abstract

Methods and apparatus for directional texture generation using image warping. An image warping directional texture generation method may, for example, be used to design hair or hairstyles. The method may obtain one or more user strokes via a provided brush or other user interface element to paint directional texture, such as hair, onto a target image. Primitives, such as strands, wisps, partings, etc., may be used to paint the directional texture. After the user applies a stroke to paint a primitive or a portion of a primitive onto the target image, the primitive may be automatically adjusted to fit the primitive to the stroke, handle distortion artifacts, and blend the primitive into the existing image. The user may continue to apply strokes until satisfied with the overall result.

Claims

1. A method, comprising:

obtaining input selecting one of a plurality of directional texture element primitives, a directional texture element comprising a texture that has a directional flow characteristic, and the plurality of directional texture element primitives including images of real examples of directional texture elements;

obtaining a stroke adding the selected primitive to a target image, the stroke indicating a location in the target image and an intended direction of flow for the selected primitive in the target image;

automatically adjusting the selected primitive according to the stroke; and

applying the adjusted selected primitive to the indicated location of the target image.

2. The method as recited in claim 1, wherein the directional texture element is hair, and wherein the plurality of directional texture element primitives are hair primitives.

3. The method as recited in claim 1, wherein the plurality of directional texture element primitives further include synthesized examples of the directional texture element.

4. The method as recited in claim 1, wherein each directional texture element primitive in the plurality of directional texture element primitives comprises multiple atomic texture elements or two or more other directional texture element primitives.

5. The method as recited in claim 1, further comprising applying a blending technique to at least a portion of the target image to blend the adjusted selected primitive with image data in the target image.

6. The method as recited in claim 1, wherein said automatically adjusting the selected primitive according to the stroke comprises:

generating a grid representing the selected primitive; and

distorting the grid according to the direction of flow indicated by the stroke.

7. The method as recited in claim 1, wherein said automatically adjusting the selected primitive according to the stroke comprises:

obtaining two or more markers along a primary axis of the selected primitive;

obtaining two or more corresponding markers along the stroke; and

deforming the primary axis of the selected primitive so that the two or more markers along the primary axis align with corresponding markers along the stroke.

8. The method as recited in claim 1, further comprising stretching the selected primitive in at least one direction prior to said applying.

9. The method as recited in claim 1, further comprising:

identifying one or more regions of the adjusted selected primitive that include distortion artifacts; and

replacing at least some content of the identified one or more regions with directional texture content that does not include distortion artifacts.

10. The method as recited in claim 9, wherein said identifying one or more regions of the adjusted selected primitive that include distortion artifacts comprises determining that the one or more regions have been adjusted beyond at least one distortion threshold.

11. A system, comprising:

at least one processor; and

a memory comprising program instructions, wherein the program instructions are executable by the at least one processor to;

obtain input selecting one of a plurality of directional texture element primitives, a directional texture element comprising a texture that has a directional flow characteristic, and the plurality of directional texture element primitives including images of real examples of directional texture elements;

obtain a stroke adding the selected primitive to a target image, the stroke indicating a location in the target image and an intended direction of flow for the selected primitive in the target image;

automatically adjust the selected primitive according to the stroke; and

apply the adjusted selected primitive to the indicated location of the target image.

12. The system as recited in claim 11, wherein the directional texture element is hair, and wherein each directional texture element primitive in the plurality of directional texture element primitives comprises multiple hairs or two or more other directional texture element primitives.

13. The system as recited in claim 11, wherein, to automatically adjust the selected primitive according to the stroke, the program instructions are executable by the at least one processor to:

generate a grid representing the selected primitive; and

distort the grid according to the direction of flow indicated by the stroke.

14. The system as recited in claim 11, wherein, to automatically adjust the selected primitive according to the stroke, the program instructions are executable by the at least one processor to:

obtain two or more markers along a primary axis of the selected primitive;

obtain two or more corresponding markers along the stroke; and

deform the primary axis of the selected primitive so that the two or more markers along the primary axis align with corresponding markers along the stroke.

15. The system as recited in claim 11, wherein the program instructions are executable by the at least one processor to:

identify one or more regions of the adjusted selected primitive that include distortion artifacts; and

replace at least some content of the identified one or more regions with directional texture content that does not include distortion artifacts.

16. A computer-readable storage device comprising program instructions stored thereon that, responsive to execution, perform operations comprising:

obtaining input selecting one of a plurality of directional texture element primitives, a directional texture element comprising a texture that has a directional flow characteristic, and the plurality of directional texture element primitives including images of real examples of directional texture elements;

obtaining a stroke adding the selected primitive to a target image, the stroke indicating a location in the target image and an intended direction of flow for the selected primitive in the target image;

automatically adjusting the selected primitive according to the stroke; and

applying the adjusted selected primitive to the indicated location of the target image.

17. The computer-readable storage device as recited in claim 16, wherein the directional texture element is hair, and wherein each directional texture element primitive in the plurality of directional texture element primitives comprises multiple hairs or two or more other directional texture element primitives.

18. The computer-readable storage device as recited in claim 16, wherein, in said automatically adjusting the selected primitive according to the stroke further comprises:

generating a grid representing the selected primitive; and

distorting the grid according to the direction of flow indicated by the stroke.

19. The computer-readable storage device as recited in claim 16, wherein, in said automatically adjusting the selected primitive according to the stroke further comprises:

obtaining two or more markers along a primary axis of the selected primitive;

obtaining two or more corresponding markers along the stroke; and

deforming the primary axis of the selected primitive so that the two or more markers along the primary axis align with corresponding markers along the stroke.

20. The computer-readable storage device as recited in claim 16, wherein said automatically adjusting the selected primitive according to the stroke further comprises:

identifying one or more regions of the adjusted selected primitive that include distortion artifacts; and

replacing at least some content of the identified one or more regions with directional texture content that does not include distortion artifacts.