Biomechanical user interface elements for pen-based computers

• US 20040212605A1
• Filed: 12/31/2003
• Published: 10/28/2004
• Est. Priority Date: 01/08/2003
• Status: Active Grant

• Current Assignee: Alias Systems Corp. (Autodesk, Inc.), Autodesk, Inc.
• Original Assignee: Autodesk, Inc.
• Inventors: Fitzmaurice, George, Kurtenbach, Gordon
• Granted Patent: US 7,663,605 B2
• Time in Patent Office: Days
• US Class Current: 345/184
• CPC Class Codes: G06F 2203/04804 Transparency, e.g. transparent or translucent windows
• CPC Class Codes: G06F 2203/04807 Pen manipulated menu
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06T 11/60 Editing figures and text; Combining figures or text

Abstract

The present invention is a system that uses natural user position and natural user motion to position and layout interface elements for a pen-based computer display. Graphical user interfaces, such as a slider or menu, are popped-up at a position convenient to the user, such as at the current position of the cursor. A rectilinear interface is oriented along a natural motion arc of the user, such as an elbow arc. An arc shaped interface can also be positioned along a natural motion arc, such as the elbow arc, and be shaped according the elbow are or be shaped by another natural motion arc such as a wrist arc of the user. The interface arc, whether shaping or orienting the interface, can be a single motion arc, such as an elbow arc, a composite arc of an elbow arc and a wrist arc, a sequence of an elbow arc and a wrist arc, a compound arc where an elbow arc blends into a wrist arc or an arc followed by a linear interface section.

Claims

1. A display, comprising:

a control zone for a function of an interface; and

an interface element graphic aligned with the control zone and indicating the function with the interface graphic and control zone aligned to a natural user motion.

2. A display as recited in claim 1, wherein the alignment orients the graphic and zone with the motion.

3. A display as recited in claim 1, wherein the alignment follows the natural user motion.

4. A display as recited in claim 1, wherein the alignment positions the graphic and zone at a location accessible via the natural user motion.

5. A display as recited in claim 1, wherein the natural user motion comprises a curve determined by a stroke of the user on the display.

6. A display as recited in claim 5, wherein the curve includes natural motion variations.

7. A display as recited in claim 5, wherein the user natural motion stroke comprises one of an elbow motion curve, a wrist motion curve, a finger motion curve, a shoulder motion curve and a combination of two or more of the curves.

8. A display as recited in claim 7, wherein the curve is a curve determined by a single user.

9. A display as recited in claim 1, further comprising an interface location at which the zone and graphic are positioned.

10. A display as recited in claim 9, wherein the interface location is specified by a cursor positioned by the user.

11. A graphical user interface, comprising:

a cursor positioned on a display by a user at a location; and

a function control positioned on the display responsive to the location of the cursor, having a interface graphic indicating a function of the control and having a shape conforming to a motion arc of a hand caused by motion of an arm about an elbow of the user.

12. An interface as recited in claim 11, wherein the control comprises plural controls and the controls are aligned along the arc.

13. An interface as recited in claim 12, wherein a default control is positioned under the cursor.

14. An interface as recited in claim 12, wherein the controls can be one of re-oriented and moved.

15. An interface as recited in claim 12, wherein the controls are one or oriented and shaped to conform to a wrist arc caused by a hand moving about a wrist of the user

16. An interface as recited in claim 11, wherein the control comprises plural controls and the controls are aligned along an arc intersecting the motion arc at 90 degrees.

17. An interface as recited in claim 11, wherein the control comprises plural controls and the shape of the sides of each of the controls is one of rectilinear, arc shaped, wedge shaped and triangular shaped.

18. An interface as recited in claim 11, further comprising an overflow interface positioned responsive to the motion arc.

19. An interface as recited in claim 11, wherein text of the control is rectilinear aligned with a display.

20. An interface as recited in claim 19, wherein the overflow interface is natural motion arc shaped.

21. An interface as recited in claim 12, wherein the control is oriented to an extended arc.

24. A method as recited in claim 20, further comprising determining whether the user has specified a custom arc and positioning one of a custom and standard arc shaped interface responsive to the determination.

22. A graphical user interface for a tablet personal computer having a stylus input system, comprising:

a cursor positioned on a display by a user at a location on the display designed by the stylus;

a function control positioned on the display responsive to the location of the cursor, having a interface graphic indicating a function of the control and having a graphic shape and position conforming to a natural motion arc of a hand caused by motion of an arm about an elbow and of the hand moving about a wrist of the user, having plural controls with a default control positioned under the cursor, controls aligned along the arc and controls aligned along a counter arc intersecting the motion arc at 90 degrees and where the controls are shaped responsive to the natural motion arc with natural variations; and

an overflow interface and shaped positioned responsive to the motion arc.

23. A method, comprising:

determining a position of a cursor as designated by the user; and

positioning an arc shaped graphical user interface responsive to the position where the arc of the shape is defined by a natural user motion.

25. A computer readable storage for controlling a computer by determining a position of a cursor as designated by the user, and positioning an arc shaped graphical user interface responsive to the position where the arc of the shape is defined by a natural user motion.

26. A method, comprising:

allowing a user to make strokes with an input device;

determining an arc from the strokes; and

laying out a graphical user interface to conform to the arc.

27. A method as recited in claim 26, further comprising:

determining a position of a cursor specified by the user; and

positioning the interface responsive to the position; and

allowing the user to activate a function of the interface.

28. A method as recited in claim 26, wherein plural users are allowed to make strokes and the arc is determined from the strokes of the plural users.

29. An apparatus, comprising:

a display; and

a computer producing an arc shaped graphical user interface on the display where the arc of the shape is defined by a natural user motion.