Natural Media Painting using Proximity-based Tablet Stylus Gestures

• US 20140104211A1
• Filed: 10/16/2013
• Published: 04/17/2014
• Est. Priority Date: 07/10/2009
• Status: Active Grant

• Current Assignee: Adobe Inc.
• Original Assignee: Adobe Systems Incorporated (Adobe Inc.)
• Inventors: Harris, Jerry G.
• Granted Patent: US 9,645,664 B2
• Time in Patent Office: Days
• US Class Current: 345/173
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/03545 Pens or stylus
• CPC Class Codes: G06F 3/0416 Control or interface arrangements specially adapted for digitisers
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 9/451 Execution arrangements for user interfaces

Abstract

Techniques for natural media painting using proximity-based tablet stylus gestures are described. A stylus is implemented for user manipulation to simulate a brush stroke of a paint brush, where the stylus includes an application tip formed from individual virtual bristles that simulate the paint brush. A graphics application is implemented to receive an input of the brush stroke, compute an effect of each individual virtual bristle of the brush stroke to determine simulated paint application on a virtual canvas, and initiate a display of the simulated paint application on the virtual canvas based on the computed effect of each individual virtual bristle of the brush stroke.

Claims

1-20. -20. (canceled)

21. A system, comprising:

a stylus configured for user manipulation to simulate a brush stroke of a paint brush, the stylus including an application tip formed from individual virtual bristles that simulate the paint brush;

a processing system to implement a graphics application that is configured to;

receive an input of the brush stroke;

compute an effect of each individual virtual bristle of the brush stroke to determine simulated paint application on a virtual canvas; and

initiate a display of the simulated paint application on the virtual canvas based on the computed effect of each individual virtual bristle of the brush stroke.

22. The system as recited in claim 21, wherein the graphics application is configured to simulate the change of shape of each individual virtual bristle during the brush stroke.

23. The system as recited in claim 22, wherein the graphics application is further configured to said compute the effect of each individual virtual bristle of the brush stroke based on the change of shape of each individual virtual bristle during the brush stroke.

24. The system as recited in claim 21, wherein the application tip of the stylus includes a representative number of the individual virtual bristles effective to represent the behavior of paint brush bristles.

25. The system as recited in claim 21, wherein:

a computing device that comprises the processing system to implement the graphics application;

a tablet device configured as a representation of the virtual canvas and as a stylus input interface to the computing device; and

a display device configured to display the virtual canvas and the simulated paint application, the display device configured as one of an integrated display device of the computing device, or as a peripheral display device of the computing device.

26. A system, comprising:

a stylus configured for user manipulation to simulate a brush stroke of a paint brush on a virtual canvas;

a tablet device configured as a representation of the virtual canvas and as a stylus input interface, the tablet device including a touch surface configured to detect stylus contact and user contact on the touch surface;

a processing system to implement a graphics application that is configured to;

receive the user contact on the touch surface of the tablet device;

receive the brush stroke as the stylus contact on the touch surface of the tablet device;

determine a user and stylus gesture based on a combination of the user contact and the stylus contact on the touch surface of the tablet device; and

initiate a user assist mode of the graphics application effective to assist completion of the brush stroke.

27. The system as recited in claim 26, wherein the user assist mode includes a damping factor configured to dampen user input of the brush stroke effective to assist for a steadier brush stroke input.

28. The system as recited in claim 26, wherein the graphics application is configured to:

receive the brush stroke as a line motion that corresponds to the detected stylus contact; and

initiate the user assist mode as a straight-line mode effective to assist creating a straight line with the brush stroke on the virtual canvas.

29. The system as recited in claim 26, wherein the graphics application is configured to:

receive the brush stroke as an arc motion that corresponds to the detected stylus contact; and

initiate the user assist mode as an arc mode effective to assist creating an arc with the brush stroke on the virtual canvas.

30. The system as recited in claim 26, wherein the graphics application is configured to:

receive the brush stroke as an image tracing motion that corresponds to the detected stylus contact; and

initiate the user assist mode as an edge detection mode effective to assist tracing an edge of an image with the brush stroke on the virtual canvas.

31. A method, comprising:

receiving an input of a brush stroke from a stylus configured for user manipulation to simulate the brush stroke of a paint brush, the stylus including an application tip formed from individual virtual bristles that simulate the paint brush;

computing an effect of each individual virtual bristle of the brush stroke to determine simulated paint application on a virtual canvas; and

displaying the simulated paint application on the virtual canvas based on the computed effect of each individual virtual bristle of the brush stroke.

32. The method as recited in claim 31, further comprising simulating the change of shape of each individual virtual bristle during the brush stroke.

33. The method as recited in claim 32, wherein said computing the effect of each individual virtual bristle of the brush stroke is based on the change of shape of each individual virtual bristle during the brush stroke.

34. The method as recited in claim 31, wherein the application tip of the stylus includes a representative number of the individual virtual bristles effective to represent the behavior of paint brush bristles.

35. The method as recited in claim 31, further comprising:

executing a graphics application with a processing system of a computing device to implement the method, wherein;

a tablet device is configured as a representation of the virtual canvas and as a stylus input interface to the computing device; and

a display device associated with the computing device displays the virtual canvas and the simulated paint application.

36. The method as recited in claim 35, further comprising:

receiving user contact on a touch surface of the tablet device;

detecting stylus contact on the touch surface of the tablet device as said receiving the input of the brush stroke;

determining a user and stylus gesture based on a combination of the user contact and the stylus contact on the touch surface of the tablet device; and

initiating a user assist mode of the graphics application effective to assist completion of the brush stroke.

37. The method as recited in claim 36, further comprising dampening the input of the brush stroke effective to assist for a steadier brush stroke input in the user assist mode.

38. The method as recited in claim 36, further comprising:

said receiving the input of the brush stroke as a line motion that corresponds to the detected stylus contact; and

said initiating the user assist mode as a straight-line mode effective to assist creating a straight line with the brush stroke on the virtual canvas.

39. The method as recited in claim 36, further comprising:

said receiving the input of the brush stroke as an arc motion that corresponds to the detected stylus contact; and

said initiating the user assist mode as an arc mode effective to assist creating an arc with the brush stroke on the virtual canvas.

40. The method as recited in claim 36, further comprising:

said receiving the input of the brush stroke as an image tracing motion that corresponds to the detected stylus contact; and

said initiating the user assist mode as an edge detection mode effective to assist tracing an edge of an image with the brush stroke on the virtual canvas.