Multi-Touch Integrated Desktop Environment

• US 20120169598A1
• Filed: 01/05/2011
• Published: 07/05/2012
• Est. Priority Date: 01/05/2011
• Status: Active Grant

• Current Assignee: Autodesk, Inc.
• Original Assignee: Autodesk, Inc.
• Inventors: Grossman, Tovi, Matejka, Justin Frank, Fitzmaurice, George, Bi, Xiaojun
• Granted Patent: US 9,600,090 B2
• Time in Patent Office: Days
• US Class Current: 345/163
• CPC Class Codes: G06F 2203/0381 Multimodal input, i.e. interface arrangements enabling the user to issue commands by simultaneous use of input devices of different nature, e.g. voice plus gesture on digitizer
• CPC Class Codes: G06F 2203/04808 Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen
• CPC Class Codes: G06F 3/033 Pointing devices displaced or positioned by the user , e.g. mice, trackballs, pens or joysticks; Accessories therefor digitisers characterised by the transducing means G06F3/041
• CPC Class Codes: G06F 3/038 Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures

Abstract

A technique for integrating a multi-touch surface into a desktop environment is disclosed. One or more multi-touch display devices are placed on the horizontal surface surrounding or beneath a keyboard or mouse. At least one region on the multi-touch surface is defined to display one or more user interface tools on the multi-touch surface. The one or more user interface tools displayed via the multi-touch surface may control or display information associated with desktop applications displayed via a primary display device.

Claims

1. A computer-implemented method for configuring a multi-touch surface to display a digital mouse pad, the method comprising:

defining a region on the multi-touch surface for displaying the digital mouse pad, wherein the region is proximate to a mouse device detected on the multi-touch surface;

generating one or more user interface elements that are disposed within the digital mouse pad, wherein each user interface element is configured to control a different operation within an application window displayed via a display device;

displaying the digital mouse pad in the region on the multi-touch surface;

detecting multi-touch input associated with a first user interface element disposed within the digital mouse pad; and

performing a first operation within the application window based on the multi-touch input.

2. The method of claim 1, further comprising:

monitoring the multi-touch surface for any changes in a location of the mouse device; and

in response to a change in the location of the mouse device, changing a location of the region to substantially match the change in the location of the mouse device.

3. The method of claim 1, wherein the first user interface element comprises a digital button, and, based on the multi-touch input, one or more objects highlighted with the mouse device are copied to a clipboard.

4. The method of claim 3, further comprising generating an additional user interface element disposed within the digital mouse pad comprising a thumbnail image view of the one or more objects copied to the clipboard.

5. The method of claim 4, further comprising:

detecting second multi-touch input associated with the additional user interface element; and

performing a second operation within the application window based on the second multi-touch input.

6. The method of claim 1, wherein the first user interface element comprises a digital button, and, based on the multi-touch input, one or more objects highlighted with the mouse device are cut and pasted to a clipboard.

7. The method of claim 1, wherein the first user interface element comprises a digital button, and, based on the multi-touch input, one or more objects highlighted disposed within the clipboard are pasted within the application window.

8. A computer-readable storage medium containing a program which, when executed, performs an operation for configuring a multi-touch surface to display a digital mouse pad, the operation comprising:

defining a region on the multi-touch surface for displaying the digital mouse pad, wherein the region is proximate to a mouse device detected on the multi-touch surface;

generating one or more user interface elements that are disposed within the digital mouse pad, wherein each user interface element is configured to control a different operation within an application window displayed via a display device;

displaying the digital mouse pad in the region on the multi-touch surface;

detecting multi-touch input associated with a first user interface element disposed within the digital mouse pad; and

performing a first operation within the application window based on the multi-touch input.

9. The computer-readable storage medium of claim 8, the operation further comprising:

monitoring the multi-touch surface for any changes in a location of the mouse device; and

in response to a change in the location of the mouse device, changing a location of the region to substantially match the change in the location of the mouse device.

10. The computer-readable storage medium of claim 8, wherein the first user interface element comprises a digital button, and, based on the multi-touch input, one or more objects highlighted with the mouse device are copied to a clipboard.

11. The computer-readable storage medium of claim 10, the operation further comprising generating an additional user interface element disposed within the digital mouse pad comprising a thumbnail image view of the one or more objects copied to the clipboard.

12. The computer-readable storage medium of claim 11, the operation further comprising:

detecting second multi-touch input associated with the additional user interface element; and

performing a second operation within the application window based on the second multi-touch input.

13. The computer-readable storage medium of claim 8, wherein the first user interface element comprises a digital button, and, based on the multi-touch input, one or more objects highlighted with the mouse device are cut and pasted to a clipboard.

14. The computer-readable storage medium of claim 8, wherein the first user interface element comprises a digital button, and, based on the multi-touch input, one or more objects highlighted disposed within the clipboard are pasted within the application window.

15. A system configured to display a digital mouse pad on a multi-touch surface, the system comprising:

a multi-touch surface; and

a processing unit coupled to the multi-touch surface and configured to;

define a region on the multi-touch surface for displaying the digital mouse pad, wherein the region is proximate to a mouse device detected on the multi-touch surface,

generate one or more user interface elements that are disposed within the digital mouse pad, wherein each user interface element is configured to control a different operation within an application window displayed via a display device,

display the digital mouse pad in the region on the multi-touch surface,

detect multi-touch input associated with a first user interface element disposed within the digital mouse pad, and

perform a first operation within the application window based on the multi-touch input.

16. The system of claim 15, the processing unit further configured to:

monitor the multi-touch surface for any changes in a location of the mouse device; and

in response to a change in the location of the mouse device, change a location of the region to substantially match the change in the location of the mouse device.

17. The system of claim 15, wherein the first user interface element comprises a digital button, and, based on the multi-touch input, one or more objects highlighted with the mouse device are copied to a clipboard.

18. The system of claim 17, the processing unit further configured to:

generate an additional user interface element disposed within the digital mouse pad comprising a thumbnail image view of the one or more objects copied to the clipboard;

detect second multi-touch input associated with the additional user interface element; and

perform a second operation within the application window based on the second multi-touch input.

19. The system of claim 15, wherein the first user interface element comprises a digital button, and, based on the multi-touch input, one or more objects highlighted with the mouse device are cut and pasted to a clipboard.

20. The system of claim 15, wherein the first user interface element comprises a digital button, and, based on the multi-touch input, one or more objects highlighted disposed within the clipboard are pasted within the application window.