ENHANCED TARGET SELECTION FOR A TOUCH-BASED INPUT ENABLED USER INTERFACE

• US 20130097550A1
• Filed: 10/14/2011
• Published: 04/18/2013
• Est. Priority Date: 10/14/2011
• Status: Active Grant

• Current Assignee: Autodesk, Inc.
• Original Assignee: Tovi Grossman
• Inventors: GROSSMAN, Tovi, Fitzmaurice, George, Yang, Xing-Dong, Irani, Pourang Polad
• Granted Patent: US 10,684,768 B2
• Time in Patent Office: Days
• US Class Current: 715/779
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures

Abstract

Systems and methods for providing graphical user interface elements optimized for touch-based input in connection with an application that is designed for conventional input received from a keyboard and a mouse. The touch-based graphical user interface elements are displayed when the computer system detects that a user is about to switch from conventional input devices to touch-sensitive input devices. The touch-based graphical user interface elements are hidden when the user provides input with the conventional input devices such that the touch-based graphical user interface elements do not distract from the applications normal operation. The display device includes a sensing capability that enables the computer system to detect when an object, such as a user'"'"'s finger or a stylus, is proximate to, but not in contact with, the display device.

Claims

1. A computer-implemented method for displaying one or more touch-based graphical user interface (GUI) elements, the method comprising:

executing an application that causes a GUI to be displayed on a touch screen display associated with a device, wherein the GUI is configured to interact with one or more conventional input devices;

determining whether a user intends to provide input to the device via the touch screen display; and

if the user intends to provide input via the touch screen display, then displaying the one or more touch-based GUI elements on top of the GUI, or if the user intends to provide input to the device via one of the one or more conventional input devices, then hiding the one or more touch-based GUI elements, wherein each touch-based GUI element corresponds to a different conventional GUI element included within the GUI, wherein each conventional GUI element is configured for a different one of the one or more conventional input devices.

2. The method of claim 1, wherein determining whether the user intends to provide input via the touch screen display comprises detecting that an object is located proximate to, but not yet in contact with, a surface of the touch screen display.

3. The method of claim 2, wherein the one or more touch-based GUI elements are displayed on top of the GUI in response to detecting that the object is within a threshold distance from the surface.

4. The method of claim 3, wherein each touch-based GUI element is displayed based on:

the user touching the touch screen display at a location associated with a particular conventional GUI element; and

the user specifying a size for the touch-based GUI element via a mouse device, wherein the touch-based GUI element corresponds to the particular conventional GUI element.

5. The method of claim 2, wherein determining whether the user intends to provide input via the touch screen display further comprises:

calculating a motion vector associated with the object that indicates a trajectory of the object relative to the surface of the touch screen display;

calculating a target location of an intersection point of the motion vector with the surface; and

determining a center of expansion for a touch-based toolbar based on the target location, wherein the center of expansion defines an anchor location for the touch-based toolbar relative to a conventional toolbar displayed within the GUI.

6. The method of claim 5, wherein the center of expansion is associated with a predefined point for a group of GUI elements within the conventional toolbar.

7. The method of claim 1, wherein the conventional input devices comprise at least one of a keyboard or a mouse.

8. A computer-readable storage medium containing a program that, when executed by a processor, performs an operation for displaying one or more touch-based graphical user interface (GUI) elements, the operation comprising:

executing an application that causes a GUI to be displayed on a touch screen display associated with a device, wherein the GUI is configured to interact with one or more conventional input devices;

determining whether a user intends to provide input to the device via the touch screen display; and

if the user intends to provide input via the touch screen display, then displaying the one or more touch-based GUI elements on top of the GUI, or if the user intends to provide input to the device via one of the one or more conventional input devices, then hiding the one or more touch-based GUI elements, wherein each touch-based GUI element corresponds to a different conventional GUI element included within the GUI, wherein each conventional GUI element is configured for a different one of the one or more conventional input devices.

9. The computer-readable storage medium of claim 8, wherein determining whether the user intends to provide input via the touch screen display comprises detecting that an object is located proximate to, but not yet in contact with, a surface of the touch screen display.

10. The computer-readable storage medium of claim 9, wherein the one or more touch-based GUI elements are displayed on top of the GUI in response to detecting that the object is within a threshold distance from the surface.

11. The computer-readable storage medium of claim 10, wherein each touch-based GUI element is displayed based on:

the user touching the touch screen display at a location associated with a particular conventional GUI element; and

the user specifying a size for the touch-based GUI element via a mouse device, wherein the touch-based GUI element corresponds to the particular conventional GUI element.

12. The computer-readable storage medium of claim 9, wherein determining whether the user intends to provide input via the touch screen display further comprises:

calculating a motion vector associated with the object that indicates a trajectory of the object relative to the surface of the touch screen display;

calculating a target location of an intersection point of the motion vector with the surface; and

determining a center of expansion for a touch-based toolbar based on the target location, wherein the center of expansion defines an anchor location for the touch-based toolbar relative to a conventional toolbar displayed within the GUI.

13. The computer-readable storage medium of claim 12, wherein the center of expansion is associated with a predefined point for a group of GUI elements within the conventional toolbar.

14. The computer-readable storage medium of claim 8, wherein the conventional input devices comprise at least one of a keyboard or a mouse.

15. A system for displaying one or more touch-based graphical user interface (GUI) elements, the system comprising:

a touch screen display;

a memory the includes an application that causes a GUI to be displayed on the touch screen display, wherein the GUI is configured to interact with one or more conventional input devices; and

a processor configured to;

determine whether a user intends to provide input to the device via the touch screen display, and if the user intends to provide input via the touch screen display, then displaying the one or more touch-based GUI elements on top of the GUI, or if the user intends to provide input to the device via one of the one or more conventional input devices, then hiding the one or more touch-based GUI elements, wherein each touch-based GUI element corresponds to a different conventional GUI element included within the GUI, wherein each conventional GUI element is configured for a different one of the one or more conventional input devices

16. The system of claim 15, wherein determining whether the user intends to provide input via the touch screen display comprises detecting that an object is located proximate to, but not yet in contact with, a surface of the touch screen display.

17. The system of claim 16, wherein the one or more touch-based GUI elements are displayed on top of the GUI in response to detecting that the object is within a threshold distance from the surface.

18. The system of claim 16, wherein determining whether the user intends to provide input via the touch screen display further comprises:

calculating a motion vector associated with the object that indicates a trajectory of the object relative to the surface of the touch screen display;

calculating a target location of an intersection point of the motion vector with the surface; and

determining a center of expansion for a touch-based toolbar based on the target location, wherein the center of expansion defines an anchor location for the touch-based toolbar relative to a conventional toolbar displayed within the GUI.

19. The system of claim 18, wherein the center of expansion is associated with a predefined point for a group of GUI elements within the conventional toolbar.

20. The system of claim 15, wherein the conventional input devices comprise at least one of a keyboard or a mouse.