Methods and apparatus for interacting with data objects using action handles

• US 5,760,773 A
• Filed: 01/06/1995
• Issued: 06/02/1998
• Est. Priority Date: 01/06/1995
• Status: Expired due to Term

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Mills, Edward Low, Bhalerao, Vinayak A., Berman, Eric Robert, Van Kleeck, Michael Hinkley
• Primary Examiner(s): Kim, Matthew M.
• Assistant Examiner(s): dela Torre, Crescelle N.
• Application Number:
  US08/369,688
• Time in Patent Office: 1,243 Days
• Field of Search: 395/155, 395/159, 395/156, 395/161, 395/146, 395/133, 395/347, 395/339, 395/348, 395/354, 395/352, 395/334, 395/335, 345/145, 345/146, 345/121, 345/347, 345/339, 345/348, 345/354, 345/352, 345/334, 345/335, 345/433
• US Class Current: 715/808
• CPC Class Codes: G06F 1/1626 with a single-body enclosure integrating a flat display, e.g. Personal Digital Assistants [PDAs]
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G06F 3/04812 Interaction techniques based on cursor appearance or behaviour, e.g. being affected by the presence of displayed objects
• CPC Class Codes: G06F 3/04817 using icons graphical or visual programming using iconic symbols G06F8/34
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/0486 Drag-and-drop
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 40/106 Display of layout of documents; Previewing

Abstract

A central processing unit (CPU) is coupled to a computer display for displaying graphic and other information. The CPU is further coupled to a pointer control device such as a pen, stylus or mouse that permits the user to selectively position a pointer and activate an action handle on the display associated with a data object. Activation of the action handle signals the CPU of selections associated with the data object. Tapping or clicking on the action handle causes display of a context menu containing at least one command that may be invoked with respect to the data object. Dragging the action handle indicates movement or dragging of the action handle and the corresponding data object for an operation associated with dragging such as drag-and-drop. The use of action handles in association with data objects eliminates ambiguity between actions intended to create digital ink with respect to a pen-based computer system and actions intended to invoke a command or other interaction with the computer system.

Claims

1. In a computer controlled display system having a display coupled to a central processing unit (CPU) for displaying images, a method for displaying and controlling actions relating to a data object displayed on the display, comprising the steps of:

generating a graphic image associated with the data object on the display;

generating a graphic image of an action handle proximate to the data object;

providing an activatable region on the display associated with the action handle graphic image;

in response to the user'"'"'s positioning of a pointer on the display with a pointing control device operatively associated with the CPU, providing a signal to the CPU upon correspondence of the pointer with the activatable region of the action handle;

in response to a signal indicative of a first type of interaction between the pointer and the activatable region associated with the action handle, displaying at least one selectable command relating to the data object in a context menu including the at least one selectable command; and

in response to signal indicative of a second type of interaction between the pointer and the activatable region associated with the action handle, moving the graphic image of the data object on the display.

2. The method of claim 1, wherein the first type of interaction is a tap.

3. The method of claim 1, wherein the second type of interaction is a drag.

4. The method of claim 1, wherein the step of displaying at least one selectable command comprises:

displaying a plurality of selectable commands in the context menu.

5. The method of claim 1, further comprising the steps of:

providing an activatable second region in the context menu on the display associated with the selectable command; and

in response to interaction between the second region and the pointer, executing a computer command corresponding to the selectable command.

6. The method of claim 5, wherein the interaction between the pointer and the second region comprises a tap.

7. The method of claim 1, wherein the step of moving the graphic image of the data object on the display comprises a drag-and-drop operation.

8. The method of claim 1, wherein the step of moving the graphic image of the data object on the display comprises:

moving the graphic image of the action handle on the display during a dragging operation from a first position to a second position on the display;

in response to a release command provided at the second position on the display, moving the graphic image of the data object to a new position on the display associated with the second position.

9. The method of claim 1, wherein the data object is a data item associated with a predetermined application program.

10. The method of claim 9, wherein the data item is a selected string of text associated with a text processing application program.

11. The method of claim 1, wherein the display system includes a direct pointing device for providing signals to the CPU.

12. A computer controlled display system, comprising:

a central processing unit (CPU);

a memory coupled to said CPU for storing programs and data;

a graphic display coupled to said CPU for displaying information;

a pointing device coupled to said CPU for allowing an operator to point to items displayed on said display and for providing signals to said CPU indicative of predetermined actions;

said CPU being operative to;

store data corresponding to a data object in said memory;

display a data object graphic image associated with said data object on said display;

display an action handle proximate to said data object graphic image on said display, said action handle comprising a predetermined activatable region on said display associated with said action handle;

in response to a signal from said pointing device indicative of a first type of interaction between said pointing device and said activatable region of said action handle, display at least one selectable command operatively associated with said data object in a context menu including the at least one selectable command; and

in response to a signal from said pointing device indicative of a second type of interaction between said pointing device and said activatable region of said action handle, reposition said data object graphic image on said display.

13. The system of claim 12, wherein said first type of interaction between said pointing device and said activatable region comprises a tap.

14. The system of claim 12, wherein said second type of interaction is a drag.

15. The system of claim 12, wherein the

context menu on the display includes a plurality of selectable commands.

16. The system of claim 12, wherein said CPU is further operative for:

providing an activatable second region on the display associated with said selectable command; and

in response to interaction between the second region and said pointing device, executing instructions corresponding to said selectable command.

17. The system of claim 16, wherein said interaction between said pointing device and said activatable second region comprises a tap.

18. The system of claim 12, wherein said CPU operation of repositioning said data object graphic image on said display comprises a drag-and-drop operation.

19. The system of claim 12, wherein said CPU operation of repositioning said data object graphic image on said display comprises:

moving said graphic image of said action handle on said display during a dragging operation from a first position to a second position on said display;

in response to a release command provided at said second position, moving said graphic image of said data object to a new position on said display associated with said second position.

20. The system of claim 12, wherein said data object is a data item associated with a predetermined application program.

21. The method of claim 20, wherein said data item is a selected string of text associated with a text processing application program.

22. The method of claim 20, wherein said data item comprises a calendar entry associated with a calendar application program.

23. In a computer controlled display system having a display coupled to a central processing unit (CPU) for displaying images, a method for displaying and controlling actions relating to a selected text string displayed on the display, comprising the steps of:

generating a graphic image of a string of text on the display;

in response to selection of predetermined selected text within the string of text, generating a graphic image of an action handle in a region proximate to the predetermined selected text;

providing an activatable region on the display associated with the action handle;

in response to a user'"'"'s positioning of a pointer on the display to the activatable region associated with the action handle using a pointing control device operatively associated with the CPU, providing signals to the CPU indicative of correspondence of the pointer with the action handle;

in response to a signal indicative of a first type of interaction between the pointer and the activatable region associated with the action handle, displaying at least one selectable command relating to the predetermined selected text in a context menu including the at least one selectable command; and

in response to a signal indicative of a second type of interaction between the pointer and the activatable region associated with the action handle, moving the predetermined selected text on the display.

24. The method of claim 23, wherein the step of displaying at least one selectable command comprises:

displaying a plurality of selectable commands in the context menu.

25. The method of claim 24, wherein the context menu comprises a list of a predetermined plurality of selectable commands, and wherein the selectable commands at the beginning of the list are of a first, application specific type and wherein the commands at the end of the list are of a second, operating system specific type.

26. The method of claim 23, further comprising the steps of:

providing an activatable second region on the display associated with the selectable command; and

in response to interaction between the second region and the pointer, executing a computer command corresponding to a particular selectable command.

27. The method of claim 26, wherein the interaction between the pointer and the second region comprises a tap.

28. The method of claim 23, wherein the step of moving the predetermined selected text on the display comprises a drag-and-drop operation.

29. The method of claim 23, wherein the step of moving the predetermined selected text on the display comprises:

moving the action handle on the display during a dragging operation from a first position to a second position on the display;

in response to a release command provided at the second position on the display, moving the predetermined selected text to a new position on the display associated with the second position.

30. The method of claim 23, wherein the string of text is displayed on the display in a scrollable window, and further comprising the steps of

in response to a signal indicative of the second type of interaction between the pointer and the action handle and movement of the action handle to a boundary of the scrollable window, scrolling the text in the scrollable window;

and

continuing to display the action handle pinned to the boundary of the window during scrolling of the text.