Methods and apparatus for natural media painting using proximity-based tablet stylus gestures

• US 8,610,744 B2
• Filed: 07/08/2010
• Issued: 12/17/2013
• Est. Priority Date: 07/10/2009
• Status: Active Grant

• Current Assignee: Adobe Inc.
• Original Assignee: Adobe Systems Incorporated (Adobe Inc.)
• Inventors: Harris, Jerry G.
• Primary Examiner(s): McDowell, Jr., Maurice L
• Assistant Examiner(s): RICKS, DONNA J
• Application Number:
  US12/832,961
• Publication Number:
  US 20130120463A1
• Time in Patent Office: 1,258 Days
• Field of Search: None
• US Class Current: 345/661
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/03545 Pens or stylus
• CPC Class Codes: G06F 3/0416 Control or interface arrangements specially adapted for digitisers
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 9/451 Execution arrangements for user interfaces

Abstract

Systems and methods for providing a natural media painting application may receive user inputs through tablet stylus gestures. Various digital painting and image editing tasks may be invoked and/or controlled using such gesture-based inputs. The application may detect stylus gestures that mimic real-world actions of artists, and may perform appropriate painting and image editing actions in response to detecting and recognizing the stylus gestures. The system may provide an automatic zoom mode in which, as the stylus is moved into proximity of the tablet, the application zooms into a displayed image to focus on an area of interest. The system may also provide an automatic panning mode that allows the user to pan an image when the stylus is in proximity to, but not touching, the tablet. One or more thresholds for determining whether the stylus is in proximity with the tablet may be pre-defined or may be user configurable.

Claims

1. A method, comprising:

receiving a position input as motion data communicated from a stylus to a tablet device, the motion data indicating an initial position of the stylus with respect to the tablet device, the initial position above a surface of the tablet device;

determining a perpendicular motion combined with a parallel motion as a change in position of the stylus with respect to the surface of the tablet device, the perpendicular motion correlating to a zoom function as the stylus moves one of closer to or away from the surface of the tablet device, and the parallel motion correlating to a pan function as the stylus moves parallel above the surface of the tablet device; and

initiating a combined zoom and pan display of a digital image responsive to said determining the combined perpendicular and parallel motions of the change in position of the stylus with respect to the surface of the tablet device.

2. The method of claim 1, wherein:

said determining the combined perpendicular and parallel motions of the change in position of the stylus comprises determining the stylus moving closer to the surface of the tablet device while moving parallel above the surface of the tablet device; and

said initiating the combined zoom and pan display comprises zooming in on a portion of the digital image while panning the digital image in a direction of the parallel motion.

3. The method of claim 2, wherein said initiating the combined zoom and pan display comprises zooming in on the portion of the digital image that was most recently edited.

4. The method of claim 2, wherein said initiating the combined zoom and pan display comprises zooming in on the portion of the digital image over which the stylus was positioned when the stylus moved closer to the tablet device.

5. The method of claim 1, wherein:

said determining the combined perpendicular and parallel motions of the change in position of the stylus comprises determining the stylus moving away from the surface of the tablet device while said moving parallel above the surface of the tablet device; and

said initiating the combined zoom and pan display comprises zooming out on the digital image while panning the digital image in a direction of the parallel motion.

6. The method of claim 1, further comprising:

receiving a speed input indicating a speed at which the stylus changed position with respect to the tablet device; and

wherein the combined zoom and pan display of the digital image is dependent on the speed at which the stylus changed position with respect to the surface of the tablet device.

7. The method of claim 1, further comprising:

determining whether the stylus is within a given threshold distance of the surface of the tablet device; and

wherein the combined zoom and pan display of the digital image is dependent on whether the stylus is within the given threshold distance of the surface of the tablet device.

8. The method of claim 7, wherein the given threshold distance is one of a plurality of threshold distances that define parameters for work mode changes of a graphics application.

9. The method of claim 1, further comprising:

determining that the stylus is in proximity to the surface of the tablet device within a given threshold distance; and

initiating an automatic panning mode of the graphics application based on the initial position of the stylus being within the given threshold distance.

10. The method of claim 9, further comprising:

initiating an automatic zooming mode of the graphics application based on the initial position of the stylus being within the given threshold distance.

11. One or more non-transitory computer-readable storage media comprising stored instructions that, when executed by a processor of a computing device, perform operations comprising to:

receive a position input as motion data communicated from a stylus to a tablet device, the motion data indicating an initial position of the stylus above a surface of the tablet device;

determine a perpendicular motion combined with a parallel motion as a change in position of the stylus with respect to the surface of the tablet device, the perpendicular motion correlating to a zoom function as the stylus moves one of closer to or away from the surface of the tablet device, and the parallel motion correlating to a pan function as the stylus moves parallel above the surface of the tablet device; and

initiate a zoom and pan display of a digital image based on the determination of the combined perpendicular and parallel motions of the change in position of the stylus with respect to the surface of the tablet device.

12. The non-transitory computer-readable storage media as recited in claim 11, wherein the computing device performs the operations further comprising to:

determine the combined perpendicular and parallel motions of the change in position of the stylus as the stylus moves closer to the surface of the tablet device while the stylus moves parallel above the surface of the tablet device; and

initiate the zoom and pan display to zoom in on a portion of the digital image while panning the digital image in a direction of the parallel motion.

13. The non-transitory computer-readable storage media as recited in claim 11, wherein the computing device performs the operations further comprising to:

determine whether the stylus is within a given threshold distance of the surface of the tablet device, wherein the zoom and pan display of the digital image is dependent on whether the stylus is within the given threshold distance of the surface of the tablet device.

14. The non-transitory computer-readable storage media as recited in claim 13, wherein the given threshold distance is one of a plurality of threshold distances that define parameters for work mode changes of a graphics application.

15. The non-transitory computer-readable storage media of claim 11, wherein the computing device performs the operations further comprising to:

determine that the stylus is in proximity to the surface of the tablet device within a given threshold distance; and

initiate an automatic panning mode of a graphics application based on the initial position of the stylus being within the given threshold distance.

16. A system, comprising:

a stylus configured for user manipulation to zoom and pan a digital image displayed on a tablet device;

a memory and processing system of the tablet device to implement a graphics application that is configured to;

receive a position input as motion data communicated from the stylus to the tablet device, the motion data indicating an initial position of the stylus above a surface of the tablet device;

determine a perpendicular motion combined with a parallel motion as a change in position of the stylus with respect to the surface of the tablet device, the perpendicular motion correlating to a zoom function as the stylus moves one of closer to or away from the surface of the tablet device, and the parallel motion correlating to a pan function as the stylus moves parallel above the surface of the tablet device; and

initiate a zoom and pan display of the digital image based on the determination of the combined perpendicular and parallel motions of the change in position of the stylus with respect to the surface of the tablet device.

17. The system as recited in claim 16, wherein the graphics application is configured to:

determine the perpendicular and parallel motions of the change in position of the stylus as the stylus moves closer to the surface of the tablet device while the stylus moves parallel above the surface of the tablet device; and

initiate the zoom and pan display to zoom in on a portion of the digital image while panning the digital image in a direction of the parallel motion.

18. The system as recited in claim 16, wherein:

the graphics application is configured to determine whether the stylus is within a given threshold distance of the surface of the tablet device; and

the zoom and pan display of the digital image is dependent on whether the stylus is within the given threshold distance of the surface of the tablet device.

19. The system as recited in claim 18, wherein the given threshold distance is one of a plurality of threshold distances that define parameters for work mode changes of the graphics application.

20. The system as recited in claim 16, the method further comprising wherein the graphics application is configured to:

determine that the stylus is in proximity to the surface of the tablet device within a given threshold distance; and

initiate an automatic panning mode of the graphics application based on the initial position of the stylus being within the given threshold distance.