Touch-based annotation system with temporary modes

• US 9,377,950 B2
• Filed: 11/01/2011
• Issued: 06/28/2016
• Est. Priority Date: 11/02/2010
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Perceptive Pixel Incorporated (Microsoft Corporation)
• Inventors: Rosenfeld, Daniel Allen, Hsiao, Walter
• Primary Examiner(s): Zuberi, Mohammed-Ibrahim
• Application Number:
  US13/287,017
• Publication Number:
  US 20120110431A1
• Time in Patent Office: 1,701 Days
• Field of Search: 715/863, 715/764, 715/810, 715/828, 345/173
• US Class Current: 1/1
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
• CPC Class Codes: G06F 40/169 Annotation, e.g. comment data or footnotes

Abstract

One embodiment provides a system for processing gesture inputs on a touch screen display. The system receives a gesture input on the touch screen display. When the gesture is recognized as invoking an annotation canvas, the system determines the height, width and location of an annotation canvas, and displays the annotation canvas on the touch screen display. Then, in response to an input gesture within the annotation canvas, the system recognizes the gesture as an annotation gesture, and executes the annotation gesture. In response to receiving an input gesture outside of the annotation canvas, the gesture is interpreted by the system as a navigation input.

Claims

1. A computer implemented method of processing a gesture input on a touch screen display device, the method comprising:

in response to receiving an invocation gesture on a touch screen display of the touch screen display device, displaying the annotation canvas as at least a partially transparent overlay on the touch screen display;

receiving an input gesture on the touch screen display;

when the input gesture is detected within the annotation canvas, interpreting the input gesture as an annotation gesture for inputting an annotation, and executing an annotation function associated with the input gesture within the annotation canvas based on the received annotation gesture;

when the same input gesture is detected outside of the annotation canvas, interpreting the input gesture as a navigation gesture for moving an underlying graphical space to relocate the annotation canvas, and moving the underlying graphical space to relocate the annotation canvas, and

displaying the annotation canvas on the touch screen display so long as the user'"'"'s touch associated with the invocation gesture is maintained on the touch screen display, and stopping the display of the annotation canvas when the user'"'"'s touch associated with the invocation gesture is removed from the touch screen display.

2. A computer implemented method of claim 1, further comprising:

determining a first location on the touch screen display at which the gesture invoking the annotation canvas is received by one hand of the user;

determining a second location corresponding to the location of the other hand of the user on the touch screen display; and

determining the width of the annotation canvas based on a distance between the first location and the second location.

3. A computer implemented method of claim 1, wherein responsive to receiving the input gesture outside of the annotation canvas, interpreting the gesture outside of the annotation canvas as a navigation input further comprises:

blocking execution of the navigation input while the annotation gesture is being received and executed within the annotation canvas.

4. A computer implemented method of claim 1, wherein responsive to receiving the input gesture within the annotation canvas, the method further comprises:

expanding an area of the annotation canvas towards the input gesture in response to the gesture being near a border of the canvas.

5. A computer implemented method of claim 1, further comprising:

displaying an annotation control panel comprising a plurality of annotation controls, each annotation control for configuring a parameter of an annotation to be input into the annotation canvas.

6. A touch screen display apparatus, comprising:

a touch screen display configured to receive multiple concurrent touch inputs;

a memory configured to store application data and gesture data;

a processor configured to perform a method comprising;

in response to receiving an invocation gesture on a touch screen display of the touch screen display device, displaying the annotation canvas as at least a partially transparent overlay on the touch screen display;

receiving an input gesture on the touch screen display;

when the input gesture is detected within the annotation canvas,

interpreting the input gesture as an annotation gesture for inputting an annotation, and executing an annotation function associated with the input gesture within the annotation canvas based on the received annotation gesture;

when the same input gesture is detected outside of the annotation canvas, interpreting the input gesture as a navigation gesture for moving an underlying graphical space to relocate the annotation canvas, and moving the underlying graphical space to relocate the annotation canvas, and

displaying the annotation canvas on the touch screen display so long as the user'"'"'s touch associated with the invocation gesture is maintained on the touch screen display, and stopping the display of the annotation canvas when the user'"'"'s touch associated with the invocation gesture is removed from the touch screen display.

7. A touch screen display apparatus of claim 6, further comprising:

determining a first location on the touch screen display at which the gesture invoking the annotation canvas is received by one hand of the user;

determining a second location corresponding to the location of the other hand of the user on the touch screen display; and

determining the width of the annotation canvas based on a distance between the first location and the second location.

8. A touch screen display apparatus of claim 6, wherein responsive to receiving the input gesture outside of the annotation canvas, interpreting the gesture outside of the annotation canvas as the navigation input further comprises:

blocking execution of the navigation input while the annotation gesture is being received and executed within the annotation canvas.

9. A touch screen display apparatus of claim 6, wherein responsive to receiving the input gesture within the annotation canvas, the method further comprises:

expanding an area of the annotation canvas towards the input gesture in response to the gesture being near a border of the canvas.

10. A touch screen display apparatus of claim 6, wherein the method further comprises:

displaying an annotation control panel comprising a plurality of annotation controls, each annotation control for configuring a parameter of an annotation to be input into the annotation canvas.

11. A computer implemented method of processing a gesture input on a touch screen display device, the method comprising:

in response to receiving an invocation gesture on a touch screen display of the touch screen display device, displaying a local region associated with an input mode as at least a partially transparent overlay on a touch screen display of the touch screen display device;

receiving an input gesture on the touch screen display;

when the input gesture is detected within the local region, interpreting the input gesture as an input for the input mode and executing an annotation function associated with the input gesture within the local region based on the received input for the input mode;

when the same input gesture is detected outside of the local region, interpreting the input gesture as a navigation gesture for moving an underlying graphical space to relocate the local region, and moving the underlying graphical space to relocate the local region, and

displaying the local region on the touch screen display so long as the user'"'"'s touch associated with the invocation gesture is maintained on the touch screen display, and stopping the display of the local region when the user'"'"'s touch associated with the invocation gesture is removed from the touch screen display.

12. A touch screen display apparatus, comprising:

a touch screen display configured to receive multiple concurrent touch inputs;

a memory configured to store an application data and gesture data;

a processor configured to perform a method comprising;

in response to receiving an invocation gesture on the touch screen display, displaying a local region associated with an input mode as at least a partially transparent overlay on the touch screen display;

receiving an input gesture on the touch screen display;

when the input gesture is detected within the local region,

interpreting the input gesture as an input for the input mode and

executing an annotation function associated with the input gesture within the local region based on the received input for the input mode;

when the same input gesture is detected outside of the local region,

interpreting the input gesture as a navigation gesture for moving an underlying graphical space to relocate the local region, and moving the underlying graphical space to relocate the local region, and

displaying the local region on the touch screen display so long as the user'"'"'s touch associated with the invocation gesture is maintained on the touch screen display, and stopping the display of the local region when the user'"'"'s touch associated with the invocation gesture is removed from the touch screen display.