User interface for stylus-based user input

• US 20030107607A1
• Filed: 11/30/2001
• Published: 06/12/2003
• Est. Priority Date: 11/30/2001
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Nguyen, Vu
• Granted Patent: US 6,938,221 B2
• Time in Patent Office: Days
• US Class Current: 345/863
• CPC Class Codes: A63F 2300/1075 using a touch screen
• CPC Class Codes: G06F 2203/04807 Pen manipulated menu
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text

Abstract

A stylus user interface for a computer system having a display is disclosed. The user interface receives stylus-based user input. Responsive to receiving the user input, the user interface displays a menu that includes selectable items. By selecting one of the selectable items, the user directs the computer system to generate right-mouse button input or to interpret one or more subsequent stylus-based user inputs as hover cursor input, keyboard-like input, or handwriting input.

Claims

1. In a computer system, a method for providing a user interface for use with a stylus, the method comprising:

receiving a stylus-based user input; and

responsive to receiving the input, displaying a menu comprising selectable items to allow a user, by selecting one of the selectable items, to direct the computer system to generate right-mouse button input or to interpret one or more subsequent stylus-based user inputs as hover cursor input, keyboard-like input, or handwriting input.

2. A method as recited in claim 1, further comprising:

determining whether an item of the selectable items has been selected within a predetermined amount of time since presenting the menu; and

responsive to determining that the item has not been selected within the predetermined amount, dismissing the menu.

3. A method as recited in claim 1, wherein the menu comprises an action area that is receptive to stylus-based input, and wherein the method further comprises:

identifying stylus input outside of the action area; and

responsive to identifying stylus input outside of the action area, dismissing the menu.

4. A method as recited in claim 1, wherein responsive to receiving the input further comprises:

detecting selection of an item of the selectable items; and

responsive to detection the selection;

(a) hiding the menu; and

(b) performing a task corresponding to the item.

5. A method as recited in claim 1, wherein the task comprises:

(a) generating right-mouse-button input;

(b) moving a cursor over a display screen;

(c) generating keyboard-like data;

or (d) generating handwritten data.

6. A method as recited in claim 1, further comprising:

detecting user selection of an item of the selectable items; and

responsive to detecting the user selection;

(a) hiding the menu;

(b) performing a task corresponding to the item, the task having a result; and

(c) communicating the result as input to a program.

7. A computer-readable medium comprising computer-executable instructions for providing a user interface for use with a stylus, the computer-executable instructions comprising instructions for:

re-routing stylus-based user input to a first application that is executing under an operating system (OS), the input being re-routed such that the input is not received by the operating system for distribution to any second application that is executing under the OS;

analyzing the input to determine whether the input should be treated as a mouse-like input; and

responsive to determining that the input should not be treated as a mouse-like input, displaying a menu comprising selectable items to allow a user to direct the computer system to interpret one or more subsequent stylus-based user inputs as right-mouse button input, hover cursor input, keyboard-like input, or handwriting input by selecting one of the selectable items.

8. A computer-readable medium as recited in claim 7, wherein the second application is designed to receive user input from the operating system.

9. A computer-readable medium as recited in claim 7, wherein the instructions for analyzing the input further comprise instructions for determining that the input should be treated as a mouse-like event when the event is a single quick touch or a double quick touch.

10. A computer-readable medium as recited in claim 7, wherein analyzing the input further comprise instructions for determining that the input should not be treated as a mouse-like event when the input is a continuous touch input.

11. A computer-readable medium as recited in claim 7, further comprising instructions responsive to determining that the event should be treated as a mouse-like event, the instructions communicating the input to the operating system for subsequent distribution to any other applications such as the second application.

12. A computer-readable medium as recited in claim 7, further comprising instructions for:

determining whether an item of the selectable items has been selected within a predetermined amount of time since presenting the menu; and

responsive to determining that the item has not been selected within the predetermined amount, dismissing the menu.

13. A computer-readable medium as recited in claim 7, wherein the selectable items are displayed in an action area, and wherein the computer-executable instructions further comprise instructions for:

identifying stylus-based user input outside of the action area; and

responsive to identifying the stylus-based user input, dismissing the menu.

14. A computer-readable medium as recited in claim 7, further comprising instructions for:

detecting selection of an item of the selectable items; and

responsive to detection the selection;

(a) hiding the menu; and

(b) performing a task corresponding to the item.

15. A computer-readable medium as recited in claim 14, wherein the task comprises:

(a) communicating right mouse click input to the second application;

(b) moving a cursor over a display screen;

(c) generating keyboard-like input;

or (d) generating and interpreting handwritten data.

16. A computer-readable medium as recited in claim 7, wherein the instructions for allowing a user to specify that the computer system is to interpret a subsequent stylus-based user input event as a mouse-right-button click event, a hover cursor event, a keyboard-like event, or a handwriting event further comprise instructions for:

detecting selection of an item of the selectable items; and

responsive to detecting the selection;

(a) hiding the menu;

(b) performing a task that corresponds to the item, the task having a result; and

(c) communicating the result as input to the second application.

17. A computing device comprising:

a processor;

a memory that is operatively coupled to the processor, the memory comprising computer-executable instructions, the processor being configured to fetch and execute the computer-executable instructions for;

receiving a stylus-based user input; and

responsive to receiving the input, displaying a menu comprising selectable items to allow a user to direct the computer system to interpret one or more subsequent stylus-based user inputs as right-mouse button input, hover cursor input, keyboard-like input, or handwriting input by selecting one of the selectable items.

18. A computing device as recited in claim 17, further comprising instructions for:

determining whether an item of the selectable items has been selected within a predetermined amount of time since presenting the menu; and

responsive to determining that the item has not been selected within the predetermined amount, dismissing the menu.

19. A computing device as recited in claim 17, wherein the menu comprises an action area that is receptive to stylus-based input, and wherein the computing device further comprises instructions for:

identifying stylus-based user input outside of the action area; and

responsive to identifying the stylus-based user input, dismissing the menu.

20. A computing device as recited in claim 17, further comprising instructions for:

detecting selection of an item of the selectable items; and

responsive to detection the selection;

(a) hiding the menu; and

(b) performing a task corresponding to the item.

21. A computing device as recited in claim 20, wherein the task comprises instructions for:

(a) communicating a right mouse click event to a computer program;

(b) moving a cursor over a display screen;

(c) generating keyboard-like data;

or (d) generating and interpreting handwritten data.

22. A computing device as recited in claim 17, wherein responsive to receiving the input, the instructions further comprise instructions for:

detecting selection of an item of the selectable items; and

responsive to detecting the selection;

(a) hiding the menu;

(b) performing a task that corresponds to the item, the task having a result; and

(c) communicating the result as input to the second application.

23. A computing device comprising:

processing means for;

receiving a stylus-based user input; and

responsive to receiving the input, displaying a menu comprising selectable items to allow a user to direct the computer system to interpret one or more subsequent stylus-based user inputs as right-mouse button input, hover cursor input, keyboard-like input, or handwriting input by selecting one of the selectable items.

24. A computing device as recited in claim 23, further comprising means for:

if one of the selectable items is selected;

(a) hiding the menu;

(b) performing a task corresponding to the one selected item, the task having a result; and

(c) communicating the result as input to a program.

25. A computing device as recited in claim 23, further comprising means for if an item of the selectable items has not been selected for a predetermined amount of time since displaying the menu, dismissing the menu.

26. A computing device as recited in claim 23, wherein the menu comprises an action area that is receptive to stylus-based input, and wherein the computing device further comprises means for if stylus input is identified outside of the action area, dismissing the control.

27. A computing device as recited in claim 23, further comprising means for:

if an item of the selectable items is selected;

(a) hiding the menu; and

(

b) performing a task corresponding to the item.

28. A computing device as recited in claim 23, wherein the task comprises means for:

(a) communicating a right mouse click event to a computer program;

(b) moving a cursor over a display screen;

(c) generating keyboard-like data;

or (d) generating and interpreting handwritten data.

29. A user interface comprising:

an action area comprising at least one helper icon, the action area being displayed responsive to receiving a stylus-based user input, the at least one helper icon being selectable to allow a user to specify that a computer system is to interpret one or more subsequent stylus-based user inputs as mouse-right-button input, hover cursor input, keyboard-like input, or handwriting input.

30. A user interface as recited in claim 29, wherein the input is not a single quick touch or a double quick touch input.

31. A user interface as recited in claim 29, wherein the event is a continuous touch event.

32. A user interface as recited in claim 29, wherein the action area is displayed responsive to receiving a first stylus-based user input, and wherein the user specifies that a computer system is to interpret one or more subsequent stylus-based user inputs as mouse-right-button input, hover cursor input, keyboard-like input, or handwriting input by generating a second stylus-based user input over a corresponding helper icon of the at least one helper icon, the second stylus-based user input being different from the first stylus-based user input.

33. A user interface as recited in claim 29 wherein the user interface, responsive to selection of the at least one helper icon:

(a) hides the action area;

(b) performs a task that corresponds to the at least one helper icon; and

(c) communicates the result as input to another computer program.

34. A user interface as recited in claim 29, wherein if the at least one helper icon has not been selected for a predetermined amount of time since displaying the action area, the user interface dismisses the control.

35. A user interface as recited in claim 29, wherein if the user has moved a stylus beyond a perimeter of the action area, the user interface dismisses the action area and the at least one helper icon.

36. A user interface as recited in claim 29 wherein selection of the at least one helper icon causes the user interface to (a) hide the action area;

and (b) perform a task that corresponds to the at least one helper icon.

37. A user interface as recited in claim 35, wherein the task comprises:

(a) communicating right mouse click input to another program;

(b) moving a cursor over a display screen;

(c) generating keyboard-like data;

or (d) generating and interpreting handwritten data.

38. A method for providing a user interface for use with a stylus in a computing device having a display, the method comprising:

receiving stylus-based user input at a location on the display, the location corresponding to a previously displayed user interface object with a corresponding context of operation; and

responsive to receiving the user input, presenting a menu on the display, the menu being independent of the corresponding context of operation.

39. A method as recited in claim 38, wherein the menu further comprises one or more selectable items, wherein the stylus based user input is a first user input, and wherein the method further comprises:

receiving a second stylus-based user input that indicates user selection of an item of the selectable items; and

responsive to receiving the second user input, generating a mouse-right-button input event.

40. A method as recited in claim 38, wherein the menu further comprises one or more selectable items, wherein the stylus based user input is a first user input, and wherein the method further comprises:

receiving a second stylus-based user input that indicates user selection of an item of the selectable items; and

responsive to receiving the second user input, directing the computing device to interpret one or more subsequent stylus-based user inputs as hover cursor input, keyboard-like input, or handwriting input.

41. A method as recited in claim 38, wherein the menu further comprises one or more selectable items, and wherein if an item of the selectable items has not been selected for a predetermined amount of time since presenting the menu, dismissing the menu.

42. A method as recited in claim 38, wherein the menu further comprises one or more selectable items in an action area, and wherein the method further comprises:

identifying stylus input outside of the action area; and

responsive to identifying stylus input outside of the action area, dismissing the control.

43. A method as recited in claim 38, wherein the menu further comprises one or more selectable items, wherein the stylus based user input is a first user input, and wherein the method further comprises:

receiving a second stylus-based user input that indicates user selection of an item of the selectable items; and

responsive to receiving the second user input,

(a) hiding the menu; and

(b) performing a task corresponding to the item.

44. A method as recited in claim 38, wherein the menu further comprises one or more selectable items, wherein the stylus based user input is a first user input, and wherein the method further comprises:

receiving a second stylus-based user input that indicates user selection of an item of the selectable items; and

responsive to receiving the second user input,

(a) hiding the menu; and

(b) performing a task corresponding to the item, the task having a result; and

(c) communicating the result as input to a program.

45. A method as recited in claim 44, wherein the task comprises:

(a) generating right-mouse-button data;

(b) moving a cursor over the display;

(c) generating keyboard-like data;

or (d) generating handwriting data.

46. A computer-readable medium comprising computer-executable instructions for providing a user interface for use with a stylus in a computing device having a display, the computer-executable instructions comprising instructions for:

receiving stylus-based user input at a location on the display, the location corresponding to a previously displayed user interface object with a corresponding context of operation; and

responsive to receiving the user input, presenting a menu on the display, the menu being independent of the corresponding context of operation.

47. A computer-readable medium as recited in claim 46, wherein the menu further comprises one or more selectable items, wherein the stylus based user input is a first user input, and wherein the instructions further comprise instructions for:

receiving a second stylus-based user input that indicates user selection of an item of the selectable items; and

responsive to receiving the second user input, generating a mouse-right-button input event.

48. A computer-readable medium as recited in claim 46, wherein the menu further comprises one or more selectable items, wherein the stylus based user input is a first user input, and wherein the instructions further comprise instructions for:

receiving a second stylus-based user input that indicates user selection of an item of the selectable items; and

responsive to receiving the second user input, directing the computing device to interpret one or more subsequent stylus-based user inputs as hover cursor input, keyboard-like input, or handwriting input.

49. A computer-readable medium as recited in claim 46, wherein the menu further comprises one or more selectable items, and wherein the instructions further comprise instructions for:

determining whether an item of the selectable items has been selected within a predetermined amount of time since presenting the menu; and

responsive to determining that the item has not been selected within the predetermined amount, dismissing the menu.

50. A computer-readable medium as recited in claim 46, wherein the menu further comprises one or more selectable items in an action area, and wherein the instructions further comprise instructions for:

identifying stylus input outside of the action area; and

responsive to identifying stylus input outside of the action area, dismissing the control.

51. A computer-readable medium as recited in claim 46, wherein the menu further comprises one or more selectable items, wherein the stylus based user input is a first user input, and wherein the instructions further comprise instructions for:

receiving a second stylus-based user input that indicates user selection of an item of the selectable items; and

responsive to receiving the second user input,

(a) hiding the menu; and

(b) performing a task corresponding to the item.

52. A computer-readable medium as recited in claim 46, wherein the menu further comprises one or more selectable items, wherein the stylus based user input is a first user input, and wherein the instructions further comprise instructions for:

receiving a second stylus-based user input that indicates user selection of an item of the selectable items; and

responsive to receiving the second user input,

(a) hiding the menu; and

(b) performing a task corresponding to the item, the task having a result; and

(c) communicating the result as input to a program.

53. A computer-readable medium as recited in claim 52, wherein the task comprises:

(a) generating right-mouse-button data;

(b) moving a cursor over the display;

(c) generating keyboard-like data;

or (d) generating handwriting data.

55. A computing device as recited in claim 53, wherein the menu further comprises one or more selectable items, wherein the stylus based user input is a first user input, and wherein the instructions further comprise instructions for:

receiving a second stylus-based user input that indicates user selection of an item of the selectable items; and

responsive to receiving the second user input, generating a mouse-right-button input event.

56. A computing device as recited in claim 53, wherein the menu further comprises one or more selectable items, wherein the stylus based user input is a first user input, and wherein the instructions further comprise instructions for:

receiving a second stylus-based user input that indicates user selection of an item of the selectable items; and

responsive to receiving the second user input, directing the computing device to interpret one or more subsequent stylus-based user inputs as hover cursor input, keyboard-like input, or handwriting input.

57. A computing device as recited in claim 53, wherein the menu further comprises one or more selectable items, and wherein the instructions further comprise instructions for:

determining whether an item of the selectable items has been selected within a predetermined amount of time since presenting the menu; and

responsive to determining that the item has not been selected within the predetermined amount, dismissing the menu.

58. A computing device as recited in claim 53, wherein the menu further comprises one or more selectable items in an action area, and wherein the instructions further comprise instructions for:

identifying stylus input outside of the action area; and

responsive to identifying stylus input outside of the action area, dismissing the control.

59. A computing device as recited in claim 53, wherein the menu further comprises one or more selectable items, wherein the stylus based user input is a first user input, and wherein the instructions further comprise instructions for:

receiving a second stylus-based user input that indicates user selection of an item of the selectable items; and

responsive to receiving the second user input,

(a) hiding the menu; and

(b) performing a task corresponding to the item.

60. A computing device as recited in claim 53, wherein the menu further comprises one or more selectable items, wherein the stylus based user input is a first user input, and wherein the instructions further comprise instructions for:

receiving a second stylus-based user input that indicates user selection of an item of the selectable items; and

responsive to receiving the second user input,

(a) hiding the menu; and

(b) performing a task corresponding to the item, the task having a result; and

(c) communicating the result as input to a program.

61. A computing device as recited in claim 60, wherein the task comprises:

(a) generating right-mouse-button data;

(b) moving a cursor over the display;

(c) generating keyboard-like data;

or (d) generating handwriting data.

63. A computing device as recited in claim 53, wherein the menu further comprises one or more selectable items, wherein the stylus based user input is a first user input, and wherein the computing device further comprises means for:

receiving a second stylus-based user input that indicates user selection of an item of the selectable items; and

responsive to receiving the second user input, generating a mouse-right-button input event.

64. A computing device as recited in claim 53, wherein the menu further comprises one or more selectable items, wherein the stylus based user input is a first user input, and wherein the computing device further comprises means for:

receiving a second stylus-based user input that indicates user selection of an item of the selectable items; and

responsive to receiving the second user input, directing the computing device to interpret one or more subsequent stylus-based user inputs as hover cursor input, keyboard-like input, or handwriting input.

65. A computing device as recited in claim 53, wherein the menu further comprises one or more selectable items, and wherein the computing device further comprises means for:

determining whether an item of the selectable items has been selected within a predetermined amount of time since presenting the menu; and

responsive to determining that the item has not been selected within the predetermined amount, dismissing the menu.

66. A computing device as recited in claim 53, wherein the menu further comprises one or more selectable items in an action area, and wherein the computing device further comprises means for:

identifying stylus input outside of the action area; and

responsive to identifying stylus input outside of the action area, dismissing the control.

67. A computing device as recited in claim 53, wherein the menu further comprises one or more selectable items, wherein the stylus based user input is a first user input, and wherein the computing device further comprises means for:

receiving a second stylus-based user input that indicates user selection of an item of the selectable items; and

responsive to receiving the second user input,

(a) hiding the menu; and

(b) performing a task corresponding to the item.

68. A computing device as recited in claim 53, wherein the menu further comprises one or more selectable items, wherein the stylus based user input is a first user input, and wherein the computing device further comprises means for:

receiving a second stylus-based user input that indicates user selection of an item of the selectable items; and

responsive to receiving the second user input,

(a) hiding the menu; and

(b) performing a task corresponding to the item, the task having a result; and

(c) communicating the result as input to a program.

69. A computing device as recited in claim 68, wherein the task comprises:

(a) generating right-mouse-button data;

(b) moving a cursor over the display;

(c) generating keyboard-like data;

or (d) generating handwriting data.

54. A computing device having a display, the computing device for providing a user interface for use with a stylus, the computing device comprising:

a processor; and

a memory coupled to the processor, the memory comprising computer-executable instructions, the processor being configured to fetch and execute the computer-executable instructions for;

receiving stylus-based user input at a location on the display, the location corresponding to a previously displayed user interface object with a corresponding context of operation; and

responsive to receiving the user input, presenting a menu on the display, the menu being independent of the corresponding context of operation.

62. A computing device having a display, the computing device for providing a user interface for use with a stylus, the computing device comprising processing means for:

receiving stylus-based user input at a location on the display, the location corresponding to a previously displayed user interface object with a corresponding context of operation; and

responsive to receiving the user input, presenting a menu on the display, the menu being independent of the corresponding context of operation.