Natural media painting using a realistic brush and tablet stylus gestures
First Claim
1. A method, comprising:
- using a computer to perform;
collecting information about a user manipulation of a stylus in relation to a tablet device associated with the computer;
recognizing, from the collected information, a stylus gesture performed by the user via manipulation of the stylus, such that;
the stylus gesture is one of a plurality of stylus gestures that are recognized by the computer to perform at least one of a plurality of actions in a graphics application that comprises a natural media painting application,at least some of the stylus gestures are mapped to user manipulation of the stylus at a distance from the tablet device,at least some of the stylus gestures involve contact of the stylus with the tablet device, andthe stylus gestures include a brush switching gesture in which a proximity of the stylus to the tablet changes from a first position relative to the tablet to a second position that is further away from the tablet and with at least a rate of change that corresponds to the brush switching gesture, the first position being within a first pre-defined distance threshold relative the tablet and the second position being beyond a second pre-defined distance threshold, and switching between paintbrushes of a brush tool being performed responsive to recognition of the brush switching gesture;
determining which of the plurality of actions to perform based on the recognized stylus gesture; and
performing a painting function for a digital image in the graphics application including performing the determined actions.
2 Assignments
0 Petitions
Accused Products
Abstract
Systems and methods for providing a natural media painting application may receive user inputs through tablet stylus gestures. A user interface may detect stylus gestures that mimic real-world actions of artists based on information collected during user manipulation of the stylus, and may map the gestures to various digital painting and image editing tasks that may be invoked and/or controlled using the gesture-based inputs. The collected information may include spatial and/or directional information, acceleration data, an initial and/or ending position of the stylus, an initial and/or ending orientation of the stylus, and/or pressure data. The stylus gestures may include translations, rotations, twisting motions, mashing gestures, or jerking motions. The application may perform appropriate painting and image editing actions in response to detecting and recognizing the stylus gestures, and the actions taken may be dependent on the work mode and/or context of the graphics application in which stylus gesture was performed.
47 Citations
20 Claims
-
1. A method, comprising:
-
using a computer to perform; collecting information about a user manipulation of a stylus in relation to a tablet device associated with the computer; recognizing, from the collected information, a stylus gesture performed by the user via manipulation of the stylus, such that; the stylus gesture is one of a plurality of stylus gestures that are recognized by the computer to perform at least one of a plurality of actions in a graphics application that comprises a natural media painting application, at least some of the stylus gestures are mapped to user manipulation of the stylus at a distance from the tablet device, at least some of the stylus gestures involve contact of the stylus with the tablet device, and the stylus gestures include a brush switching gesture in which a proximity of the stylus to the tablet changes from a first position relative to the tablet to a second position that is further away from the tablet and with at least a rate of change that corresponds to the brush switching gesture, the first position being within a first pre-defined distance threshold relative the tablet and the second position being beyond a second pre-defined distance threshold, and switching between paintbrushes of a brush tool being performed responsive to recognition of the brush switching gesture; determining which of the plurality of actions to perform based on the recognized stylus gesture; and performing a painting function for a digital image in the graphics application including performing the determined actions. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10)
-
-
11. A system, comprising:
-
a stylus input module; a display device; and a computer device that during operation executes the stylus input module to perform operations comprising; collecting information about a user manipulation of a stylus in relation to the computer device for both manipulation at a distance from the computer device and manipulation to provide touch input, the information including at least information regarding motion, orientation, and position of the stylus and an amount of pressure applied with the stylus; recognizing, from the collected information, a stylus gesture performed by the user via manipulation of the stylus, wherein the stylus gesture is one of a plurality of stylus gestures that are recognized by the computer device to perform at least one of a plurality of actions in a graphics application, including changing a brush type; determining which of the plurality of actions to perform based on the recognized stylus gesture; wherein the changing the brush type is determined in response to recognition of a brush switching stylus gesture in which a proximity of the stylus changes from a first position relative to the display device to a second position that is further away from the display device and with at least a rate of change that corresponds to the brush switching stylus gesture, the rate of change determined using acceleration data that is collected from an accelerometer of the stylus to augment the collected information and indicates acceleration that results from jerking the stylus to change the proximity; and performing a painting function for a digital image displayed on the display device by the graphics application including performing the determined actions. - View Dependent Claims (12, 13, 14, 15)
-
-
16. A non-transitory computer-readable storage medium storing program instructions that when executed on one or more computers cause the one or more computers to perform acts comprising:
-
collecting information about a user manipulation of a stylus indicative of six degrees of freedom movement of the stylus relative to an initial position of the stylus in three-dimensional space relative to a touch input surface and information regarding touch or pressure input applied to the touch input surface; recognizing, from the collected information, a stylus gesture performed by the user via manipulation of the stylus, wherein the stylus gesture is one of a plurality of stylus gestures that are recognized by the one or more computers to perform at least one of a plurality of actions in a graphics application, and the plurality of stylus gestures includes a twisting motion, a waving motion above the touch input surface, a brush switching gesture in which a proximity of the stylus relative the touch input surface is changed with at least a rate of change that corresponds to the brush switching gesture and changes from the initial position relative the touch input surface that is within a first pre-defined distance threshold of the touch input surface to an ending position that is further away from the touch input surface and beyond a second pre-defined distance threshold, a quick motion toward the touch input surface, shaking the stylus directed away from the touch input surface, or shaking the stylus directed towards the touch input surface; determining which of the plurality of actions to perform based on the recognized stylus gesture, wherein an action of switching between paintbrushes of a brush tool is performed in response to recognition of the brush switching gesture; and performing a painting function for a digital image in the graphics application including performing the determined actions. - View Dependent Claims (17, 18, 19, 20)
-
Specification