Tracking menus, system and method

• US 7,770,135 B2
• Filed: 10/15/2003
• Issued: 08/03/2010
• Est. Priority Date: 10/18/2002
• Status: Active Grant

• Current Assignee: Autodesk, Inc.
• Original Assignee: Autodesk, Inc.
• Inventors: Fitzmaurice, George William
• Primary Examiner(s): Theriault; Steven B
• Assistant Examiner(s): Tran; Tuyetlien T
• Application Number:
  US10/684,580
• Publication Number:
  US 20040135824A1
• Time in Patent Office: 2,484 Days
• Field of Search: 715/856, 715/711, 715/808, 715/810, 715/840, 715/861, 715/864
• US Class Current: 715/856
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
• CPC Class Codes: G09G 5/08 Cursor circuits
• CPC Class Codes: G09G 5/14 Display of multiple viewports

Abstract

The present invention is a system that includes a tracking menu that tracks the movement of a position transducer, such as a stylus or a mouse, as the transducer is moved about in association with a display. The menu is typically displayed on top of other objects in the display. The menu includes a tracking symbol, such as an arrow or cursor, positioned corresponding to inputs from the transducer as it is moved by a user. A mobile tracking region is also included. This tracking region has a tracking boundary or edge enclosing the tracking symbol where the tracking symbol is movable within the boundary or hits without the menu moving. The tracking region or entire menu moves in correspondence to the tracking symbol when the tracking symbol encounters the boundary or hits while the symbol is moving. The tracking region also has menu controls or buttons that are activatable when the tracking symbol corresponds to the controls.

Claims

1. A graphical user interface display, comprising:

a tracking symbol positioned corresponding to an input transducer movable by a user when the input transducer is in a tracking state; and

a menu, on the graphical user interface display, having a menu boundary and comprising a mobile tracking region having a region boundary coincident with the menu boundary and enclosing the tracking symbol with the tracking symbol being movable within the region boundary when the input transducer is in the tracking state, the mobile tracking region moving in correspondence to the tracking symbol when the input transducer is in the tracking state and when the tracking symbol encounters the region boundary while moving, the mobile tracking region having controls with boundaries and activatable when the input transducer is in a down state and the tracking symbol is over the controls, and the menu is always visible when one of the controls is not activated and always not visible when one of the controls is activated.

2. A graphical user interface display as recited in claim 1, wherein the mobile tracking region comprises the menu having a visible menu edge.

3. A graphical user interface display as recited in claim 1, wherein the mobile tracking region comprises one of a linear menu, the menu with an embedded marking menu, a tool palette, a color palette, a pan-zoom tool, a pen-mouse, a keyboard, a numeric pad, one or more buttons, sliders, checkboxes, pull-down menu, a dialog box, and an alternative view.

4. A graphical user interface display as recited in claim 1, wherein the controls of the mobile tracking region further comprise a control changed in appearance when the tracking symbol is in the down state over the control.

5. A graphical user interface display as recited in claim 1, wherein the mobile tracking region is semi-transparent when the tracking symbol is inactive and transparent when the tracking symbol is active.

6. A graphical user interface display as recited in claim 1, wherein the tracking symbol can be activated by the user and performs a selected function when active.

7. A graphical user interface display as recited in claim 6, wherein the selected function is performed when the tracking symbol is active.

8. A graphical user interface display as recited in claim 6, wherein the input transducer corresponds to a stylus, the tracking symbol and mobile tracking region are displayed on a tablet display, and the tracking symbol is in the down state when the stylus touches the tablet display.

9. A graphical user interface display as recited in claim 8, wherein the tracking symbol is inactive when the stylus is not touching the tablet display.

10. A graphical user interface display as recited in claim 6, wherein the input transducer corresponds to a mouse having a mouse button, the tracking symbol and mobile tracking region are displayed on a tablet display, and the tracking symbol is in the tracking state when the mouse is one of moved and in the down state.

11. A graphical user interface display as recited in claim 1, wherein the positioning corresponding to the motion of the input transducer stops under a predetermined condition and the mobile tracking region is repositioned corresponding to the tracking symbol when the predetermined condition no longer exists.

12. A graphical user interface display as recited in claim 11, wherein the repositioning positions the menu a least Euclidean distance from a prior position.

13. A graphical user interface display as recited in claim 11, wherein the predetermined condition is a stylus out-of-range condition.

14. A graphical user interface display as recited in claim 1, wherein the region boundary is maintained around the tracking symbol.

15. A graphical user interface display as recited in claim 1, wherein the tracking symbol is allowed to cross the region boundary while moving and the region boundary surrounds the tracking symbol when the tracking symbol is not moving.

16. A graphical user interface display as recited in claim 1, wherein the user designates that the mobile tracking region be held in place when the tracking symbol crosses the region boundary.

17. A graphical user interface display as recited in claim 16, wherein the graphical user interface display comprises an outline of the mobile tracking region when the tracking symbol is over a persistent object.

18. A graphical user interface display as recited in claim 17, wherein the graphical user interface display is clipped when the tracking symbol exits the persistent object.

19. A graphical user interface display as recited in claim 1, wherein the mobile tracking region deforms corresponding to a shape of a persistent object when the tracking symbol comes in a vicinity of a persistent object or display edge.

20. A graphical user interface display as recited in claim 1, further comprising an interior tracking boundary interior to the region boundary and the mobile tracking region moving in correspondence to the tracking symbol when the tracking symbol encounters the interior tracking boundary.

21. A graphical user interface display as recited in claim 20, wherein the interior tracking boundary comprises a jutting wall.

22. A graphical user interface display as recited in claim 1, wherein the graphical user interface display has a visible edge and the region boundary corresponds to one of the visible edge, outside the visible edge, inside the visible edge and overlaps the visible edge.

23. A graphical user interface display as recited in claim 1, wherein control activation requires a dwell by the tracking symbol.

24. A graphical user interface display as recited in claim 1, wherein control functionality is context sensitive.

25. An interface display, comprising:

a first tracking symbol having a first tracking symbol position controllable by a user when in a tracking state; and

a second tracking symbol containing the first tracking symbol, having a second tracking symbol position controlled by the first tracking symbol and having objects selectable by the first tracking symbol when in the tracking state and a down state, the second tracking symbol having a menu containing the selectable objects with the menu having a menu boundary and comprising a mobile tracking region having a region boundary coincident with the menu boundary, and the menu is always visible when one of the selectable objects is not activated and always not visible when one of the selectable objects is selected by the first tracking symbol.

26. An interface display as recited in claim 25, wherein the first and second tracking symbol positions correspond.

27. An interface display as recited in claim 25, wherein the objects comprise controls.

28. An interface, comprising:

a display;

a tracking menu positioned on the display, having an edge and having controls positioned in the tracking menu with the tracking menu having a menu boundary and comprising a mobile tracking region having a region boundary coincident with the menu boundary, and the tracking menu is always visible when one of the controls is not activated and always not visible when one of the controls is activated;

a tracking symbol positioned above the tracking menu, encountering the edge of the region boundary when moved and moving the tracking menu when the tracking symbol is in a tracking state when the edge of the region boundary is encountered.

29. An interface as recited in claim 28, further comprising a graphic object positioned between the tracking menu and the display.

30. An interface as recited in claim 28, further comprising a persistent graphic object positioned between the tracking symbol and the tracking menu.

31. A graphical user interface display, comprising:

a tracking symbol positioned corresponding to a stylus input transducer movable by a user; and

a mobile tracking menu region, on the graphical user interface display, having a region boundary enclosing the tracking symbol with the tracking symbol being movable within the region boundary with the mobile tracking menu region moving in correspondence to the tracking symbol when the tracking symbol encounters the region boundary while moving, the mobile tracking menu region having a visible menu edge coincident with the region boundary, the mobile tracking menu region having button controls activatable when the tracking symbol corresponds to the button controls with a control changed in appearance when the tracking symbol is over the control and is active, the mobile tracking menu region being semi-transparent when the tracking symbol is inactive and transparent when the tracking symbol is active, where the tracking symbol can be activated by the user selecting one of the button controls and performs a selected function when active, and the mobile tracking menu region is always visible when one of the button controls is not activated and always not visible when one of the button controls is activated,

wherein the tracking symbol and region are displayed on a tablet display, and the tracking symbol is activated when the stylus touches the tablet display,

wherein the positioning corresponding to the motion of the input transducer stops when the stylus is out of range of the tablet display and the mobile tracking menu region is repositioned a least Euclidean distance from a prior position corresponding to the tracking symbol when a condition no longer exists,

wherein the graphical user interface display comprises an outline of the mobile tracking region when the tracking symbol is over a persistent object and the graphical user interface display is clipped as the tracking symbol exits the persistent object, and

wherein the mobile tracking region deforms corresponding to a shape of the persistent object when the tracking symbol comes in a vicinity of a persistent object or display edge.

32. A method, comprising:

allowing a user to move a tracking symbol on a display; and

moving a tracking menu having controls in correspondence to the tracking symbol when the tracking symbol is in a tracking state and the tracking symbol encounters an edge of the tracking menu with the tracking menu always being visible when one of the controls is not activated and always being not visible when one of the controls is activated when the tracking symbol is in a down state over one of the controls.

33. A method as recited in claim 32, further comprising allowing the user to select an item in the tracking menu without moving the tracking menu.

34. A method as recited in claim 32, wherein movement of the tracking symbol is responsive to movement by the user of a stylus over a stylus sensing tablet and the moving of the tracking menu occurs when the stylus is in a tracking range of the stylus sensing tablet.

35. A method as recited in claim 34, further comprising making the tracking menu transparent when the stylus touches the stylus sensing tablet.

36. A method as recited in claim 35, further comprising performing a graphic function corresponding to motion of the stylus when the tracking menu is transparent.

37. A method as recited in claim 36, wherein the graphic function makes a mark on the display.

38. A method as recited in claim 32, wherein movement of the tracking symbol is responsive to movement by the user of a stylus over a stylus sensing tablet and further comprising positioning the tracking menu in correspondence when the stylus comes into tracking range.

39. A method as recited in claim 32, wherein movement of the tracking symbol is responsive to movement by the user of a stylus over a stylus sensing tablet and further comprising positioning the tracking menu in correspondence when the stylus ends contact with the stylus sensing tablet.

40. A method as recited in claim 32, further comprising allowing the user to designate a position for the tracking menu and allowing the tracking symbol to cross the edge of the tracking menu without moving the tracking menu.

41. A method as recited in claim 32, further comprising converting the menu to an outline when the symbol crosses a boundary of a persistent object.

42. A method as recited in claim 41, further comprising:

converting the tracking menu to a complete graphical menu when the tracking symbol exits the persistent object; and

clipping a portion of the complete graphical menu overlapping the persistent object.

43. A method as recited in claim 32, further comprising deforming a shape of the complete graphical menu to an outline when the tracking symbol approaches a boundary of a persistent object or display edge.

44. A method, comprising moving a first tracking symbol responsive to movement of a second tracking symbol, the first tracking symbol having a menu containing selectable objects with the menu having a menu boundary and comprising a mobile tracking region having a region boundary coincident with the menu boundary and moving the second tracking symbol responsive to an input transducer when the input transducer is in a tracking state, and the menu is always visible when one of the selectable objects is not activated and always not visible when one of the selectable objects is activated when the input transducer is in a down state over one of the controls.

45. A method, comprising using a single cursor movement to both move and activate a mobile control, the mobile control having a menu containing selectable objects with the menu having a menu boundary and comprising a mobile tracking region having a region boundary coincident with the menu boundary, and the menu is always visible when one of the selectable objects is not selected and always not visible when one of the selectable objects is selected when the single cursor is in a down state over one of the selectable objects.

46. An apparatus, comprising:

a position transducer;

a display; and

a computer coupled to the display and the position transducer, and producing for display a first tracking symbol having a first tracking symbol position controllable by the position transducer when the position transducer is in a tracking state and a second tracking symbol containing the first tracking symbol, having a second tracking symbol position controlled by the position of the first tracking symbol and having controls selectable by the first tracking symbol, the second tracking symbol having a menu containing selectable objects with the menu having a menu boundary and comprising a mobile tracking region having a region boundary coincident with the menu boundary, and the menu is always visible when one of the selectable objects is not activated and always not visible when one of the selectable objects is activated when the position transducer is in a down state over one of the selectable objects.

47. A computer readable storage controlling a computer by allowing a user to move a tracking symbol on a computer display, and moving a tracking menu in correspondence to the tracking symbol when the tracking symbol is in a tracking state and the tracking symbol encounters an edge of the tracking menu, the tracking menu containing selectable objects, with the tracking menu having a menu boundary and comprising a mobile tracking region having a region boundary coincident with the menu boundary, and the tracking menu is always visible when one of the selectable objects is not activated and always not visible when one of the selectable objects is activated when the tracking symbol is in a down state over one of the selectable objects.

48. A computer readable storage controlling a computer with a first tracking symbol having a first tracking symbol position controllable by a user;

and a second tracking symbol containing the first tracking symbol, having a second tracking symbol position controlled by the first tracking symbol and having a menu with objects selectable by the first tracking symbol with the menu having a menu boundary and comprising a mobile tracking region having a region boundary coincident with the menu boundary, and the menu is always visible when one of the selectable objects is not activated and always not visible when one of the selectable objects is activated when the first tracking symbol is in a down state over one of the selectable objects.

49. A graphical user interface display, comprising:

a display area that tracks a cursor tool when the cursor tool is in a tracking state and reaches a boundary of the display area, the display area having a display function; and

the cursor tool movable within the display area when in the tracking state and that drags the display area around when the boundary of the display area is reached and being activated by an input event when the cursor tool is in a down state, the display area having a menu containing selectable objects with the menu having a menu boundary and comprising a mobile tracking region having a region boundary coincident with the menu boundary, and the menu is always visible when one of the selectable objects is not activated and always not visible when one of the selectable objects is activated when the cursor tool is in the down state over one of the selectable objects.

50. A graphical user interface display, comprising:

a tracking symbol positioned corresponding to an input transducer movable by a user when the input transducer is in a tracking state; and

a mobile tracking region, on the graphical user interface display, having a region boundary enclosing the tracking symbol with the tracking symbol being movable when the input transducer is in the tracking state and within the region boundary when not dragging, the mobile tracking region moving in correspondence to the tracking symbol when the input transducer is in the tracking state and when the tracking symbol encounters the region boundary while moving, the mobile tracking region having controls activatable when the input transducer moving the tracking symbol is in a down state over the controls the controls, and the mobile tracking region is always visible when one of the controls is not activated and always not visible when one of the controls is activated when the input transducer is in the down state over one of the controls.

51. A graphical user interface display, comprising:

a tracking symbol positioned corresponding to an input transducer movable by a user when the input transducer is in a tracking state;

a mobile tracking region, on the graphical user interface display, having a region boundary enclosing the tracking symbol with the tracking symbol being movable when the input transducer is in the tracking state and the tracking symbol is within the region boundary, the mobile tracking region moving in correspondence to the tracking symbol when the input transducer is in the tracking state and the tracking symbol encounters the region boundary while moving, the mobile tracking region having controls activatable when the input transducer moving the tracking symbol is in a down state over the controls, the controls for selecting commands, and the mobile tracking region is always visible when one of the controls is not activated and always not visible when one of the controls is activated when the input transducer is in the down state over one of the controls.

52. A graphical user interface display, comprising:

a tracking symbol positioned corresponding to an input transducer movable by a user when the input transducer is in a tracking state; and

a menu, on the graphical user interface display, having an edge enclosing the tracking symbol with the tracking symbol being movable within the edge when the input transducer is in the tracking state, the menu moving in correspondence to the tracking symbol when the input transducer is in the tracking state and when the tracking symbol encounters the edge while moving, and a region defined within the edge having controls activatable when the input transducer moving the tracking symbol is in a down state over the controls, and the menu is always visible when one of the controls is not activated and always not visible when one of the controls is activated when the input transducer is in the down state over one of the controls.

53. A graphical user interface display, comprising:

a tracking symbol positioned on the graphical user interface display corresponding to an input transducer movable by a user when the input transducer is in a tracking state; and

a menu, on the graphical user interface display, having a menu boundary and comprising a mobile tracking region having a region boundary coincident with the menu boundary and enclosing the tracking symbol with the tracking symbol being movable within the region boundary when the input transducer is in the tracking state, the mobile tracking region moving in correspondence to the tracking symbol when the input transducer is in a tracking state and the tracking symbol encounters the region boundary while moving, the mobile tracking region having controls with boundaries and activatable when the tracking symbol is over one of the controls and the input transducer is in a down state.

55. A graphical user interface display as recited in claim 53, wherein the mobile tracking region moves in correspondence to the tracking symbol without activating a selection button on the input transducer.

56. A graphical user interface display as recited in claim 53, wherein the menu boundary deforms when encountering a persistent object while moving on the graphical user interface display.

54. A graphical user interface display, comprising:

a tracking symbol positioned on the graphical user interface display corresponding to an input transducer movable by a user when the input transducer is in a tracking state; and

a menu, on the graphical user interface display, having a menu boundary and comprising a mobile tracking region having a region boundary coincident with the menu boundary and enclosing the tracking symbol with the tracking symbol being movable within the region boundary when the input transducer is in the tracking state, the mobile tracking region moving in correspondence to the tracking symbol when the input transducer is in the tracking state and the tracking symbol encounters the region boundary while moving, the mobile tracking region having controls with boundaries and activatable when input transducer moving the tracking symbol is in a down state over the controls, the menu is always visible when one of the controls is not activated and always not visible when one of the controls is activated when the input transducer is in a down state, and the menu tracks the tracking symbol when the menu is not visible.