Methods and Apparatus for Deformation of Virtual Brush Marks via Texture Projection

• US 20130229390A1
• Filed: 07/31/2012
• Published: 09/05/2013
• Est. Priority Date: 03/02/2012
• Status: Active Grant

• Current Assignee: Adobe Inc.
• Original Assignee: Adobe Systems Incorporated (Adobe Inc.)
• Inventors: DiVerdi, Stephen J.
• Granted Patent: US 8,896,579 B2
• Time in Patent Office: Days
• US Class Current: 345/179
• CPC Class Codes: G06F 3/03545 Pens or stylus
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures

Abstract

A graphics application for simulating natural media drawing and painting may model a tablet stylus as if it were a virtual projector, and as if a 2D brush tip image were projected on a virtual canvas. The application may compute a texture projection based on the values of configurable parameters of the application and/or 6DOF data collected from the tablet stylus and/or the tablet. This texture projection (i.e., the mark resulting from deformation of the 2D brush tip image due to the stylus pose) may be used as a 2D stamp to create a mark on the virtual canvas in response to contact between the stylus and tablet. This may create a more natural mapping between tablet stylus poses and the resulting marks for artists accustomed to the behavior of pencils, felt tip pens, airbrushes, or another natural media, compared to those employed in previous digital painting applications.

Claims

1. A method, comprising:

performing, by a computer;

determining a pose of a stylus that is in contact with or in proximity of a tablet device;

modeling the stylus as a virtual projector that projects painting or drawing media onto a virtual canvas;

determining an image that would appear on the virtual canvas as projected by the virtual projector, wherein said determining an image is dependent on the determined pose;

producing a virtual brush mark on the virtual canvas using the determined image as a two-dimensional stamp; and

storing data representing an image that includes the virtual brush mark.

2. The method of claim 1, wherein said determining an image comprises interpolating a pre-determined stamp texture for perspective dependent on the determined pose.

3. The method of claim 1, wherein said determining an image is further dependent on a value of a perspective distortion parameter.

4. The method of claim 1, wherein said determining an image comprises determining the boundaries of an area of the virtual canvas onto which the virtual projector projects painting or drawing media dependent on the determined pose.

5. The method of claim 1, wherein said determining the pose comprises collecting information about the orientation of the stylus with respect to the tablet device.

6. The method of claim 1, further comprising:

detecting that the position of the stylus has changed, but that the stylus remains in the determined pose; and

in response to said detecting, producing another virtual brush mark on the virtual canvas using the determined image as a two-dimensional stamp, wherein the area of the virtual canvas on which the other virtual brush mark is made is dependent on the changed position.

7. The method of claim 1, further comprising:

detecting a change in the pose of the stylus; and

in response to said detecting, repeating said determining an image and producing a virtual brush mark on the virtual canvas dependent on the detected change in the pose of the stylus.

8. The method of claim 7, wherein the detected change in the pose of the stylus comprises one or more of:

a change in the orientation of the stylus, a tilting of the stylus, a twisting of the stylus, or a rotation of the stylus.

9. A system, comprising:

at least one processor; and

a memory coupled to the at least one processor, wherein the memory stores program instructions that when executed by the at least one processor to cause the at least one processor to perform;

determining a pose of a stylus that is in contact with or in proximity of a tablet device;

modeling the stylus as a virtual projector that projects painting or drawing media onto a virtual canvas;

determining an image that would appear on the virtual canvas as projected by the virtual projector, wherein said determining an image is dependent on the determined pose;

producing a virtual brush mark on the virtual canvas using the determined image as a two-dimensional stamp; and

storing data representing an image that includes the virtual brush mark.

10. The system of claim 9, wherein said determining an image comprises interpolating a pre-determined stamp texture for perspective dependent on the determined pose.

11. The system of claim 9, wherein said determining an image is further dependent on a value of a perspective distortion parameter.

12. The system of claim 9, wherein said determining an image comprises determining the boundaries of an area of the virtual canvas onto which the virtual projector projects painting or drawing media dependent on the determined pose.

13. The system of claim 9, wherein when executed by the at least one processor the program instructions further cause the at least one processor to perform:

detecting that the position of the stylus has changed, but that the stylus remains in the determined pose; and

in response to said detecting, producing another virtual brush mark on the virtual canvas using the determined image as a two-dimensional stamp, wherein the area of the virtual canvas on which the other virtual brush mark is made is dependent on the changed position.

14. The system of claim 9, wherein when executed by the at least one processor the program instructions further cause the at least one processor to perform:

detecting a change in the pose of the stylus; and

in response to said detecting, repeating said determining an image and producing a virtual brush mark on the virtual canvas dependent on the detected change in the pose of the stylus.

15. A non-transitory, computer-readable storage medium storing program instructions that when executed on one or more computers cause the one or more computers to perform:

determining a pose of a stylus that is in contact with or in proximity of a tablet device;

modeling the stylus as a virtual projector that projects painting or drawing media onto a virtual canvas;

determining an image that would appear on the virtual canvas as projected by the virtual projector, wherein said determining an image is dependent on the determined pose;

producing a virtual brush mark on the virtual canvas using the determined image as a two-dimensional stamp; and

storing data representing an image that includes the virtual brush mark.

16. The non-transitory, computer-readable storage medium of claim 15, wherein said determining an image comprises interpolating a pre-determined stamp texture for perspective dependent on the determined pose.

17. The non-transitory, computer-readable storage medium of claim 15, wherein said determining an image is further dependent on a value of a perspective distortion parameter.

18. The non-transitory, computer-readable storage medium of claim 15, wherein said determining an image comprises determining the boundaries of an area of the virtual canvas onto which the virtual projector projects painting or drawing media dependent on the determined pose.

19. The non-transitory, computer-readable storage medium of claim 15, wherein when executed on the one or more computers the program instructions further cause the one or more computers to perform:

detecting that the position of the stylus has changed, but that the stylus remains in the determined pose; and

in response to said detecting, producing another virtual brush mark on the virtual canvas using the determined image as a two-dimensional stamp, wherein the area of the virtual canvas on which the other virtual brush mark is made is dependent on the changed position.

20. The non-transitory, computer-readable storage medium of claim 15, wherein when executed on the one or more computers the program instructions further cause the one or more computers to perform:

detecting a change in the pose of the stylus; and

in response to said detecting, repeating said determining an image and producing a virtual brush mark on the virtual canvas dependent on the detected change in the pose of the stylus.