Multi-touch integrated desktop environment

• US 9,600,090 B2
• Filed: 01/05/2011
• Issued: 03/21/2017
• Est. Priority Date: 01/05/2011
• Status: Active Grant

• Current Assignee: Autodesk, Inc.
• Original Assignee: Autodesk, Inc.
• Inventors: Grossman, Tovi, Matejka, Justin Frank, Fitzmaurice, George, Bi, Xiaojun
• Primary Examiner(s): Patel, Kumar
• Assistant Examiner(s): LAM, VINH TANG
• Application Number:
  US12/985,308
• Publication Number:
  US 20120169598A1
• Time in Patent Office: 2,267 Days
• Field of Search: 345156-179
• US Class Current: 1/1
• CPC Class Codes: G06F 2203/0381 Multimodal input, i.e. interface arrangements enabling the user to issue commands by simultaneous use of input devices of different nature, e.g. voice plus gesture on digitizer
• CPC Class Codes: G06F 2203/04808 Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen
• CPC Class Codes: G06F 3/033 Pointing devices displaced or positioned by the user , e.g. mice, trackballs, pens or joysticks; Accessories therefor digitisers characterised by the transducing means G06F3/041
• CPC Class Codes: G06F 3/038 Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures

Abstract

A technique for integrating a multi-touch surface into a desktop environment is disclosed. One or more multi-touch display devices are placed on the horizontal surface surrounding or beneath a keyboard or mouse. At least one region on the multi-touch surface is defined to display one or more user interface tools on the multi-touch surface. The one or more user interface tools displayed via the multi-touch surface may control or display information associated with desktop applications displayed via a primary display device.

Claims

1. A computer-implemented method for configuring a multi-touch surface to display a digital mouse pad, the method comprising:

defining a region on the multi-touch surface for displaying the digital mouse pad, wherein the region is proximate to a physical mouse device detected on the multi-touch surface and configured to transmit user input signals to a processing unit;

generating one or more user interface elements that are disposed within the digital mouse pad, wherein each user interface element is configured to control a different operation within an application window displayed via a display device;

generating an additional user interface element disposed within the digital mouse pad comprising one or more thumbnail image views of one or more objects disposed in a clipboard;

displaying the digital mouse pad in the region on the multi-touch surface;

detecting multi-touch input associated with a first user interface element disposed within the digital mouse pad; and

performing a first operation within the application window based on the multi-touch input.

2. The method of claim 1, further comprising:

monitoring the multi-touch surface for any changes in a location of the mouse device; and

in response to a change in the location of the mouse device, changing a location of the region to substantially match the change in the location of the mouse device.

3. The method of claim 1, wherein the first user interface element comprises a digital button, and, based on the multi-touch input, the one or more objects are highlighted with the mouse device and copied to the clipboard.

4. The method of claim 3, further comprising:

detecting second multi-touch input associated with the additional user interface element; and

performing a second operation within the application window based on the second multi-touch input.

5. The method of claim 1, wherein the first user interface element comprises a digital button, and, based on the multi-touch input, the one or more objects are highlighted with the mouse device and cut and pasted to the clipboard.

6. The method of claim 1, wherein the first user interface element comprises a digital button, and, based on the multi-touch input, the one or more objects disposed within the clipboard are pasted within the application window.

7. A non-transitory computer-readable storage medium containing a program which, when executed, performs an operation for configuring a multi-touch surface to display a digital mouse pad, the operation comprising:

defining a region on the multi-touch surface for displaying the digital mouse pad, wherein the region is proximate to a physical mouse device detected on the multi-touch surface and configured to transmit user input signals to a processing unit;

generating one or more user interface elements that are disposed within the digital mouse pad, wherein each user interface element is configured to control a different operation within an application window displayed via a display device;

generating an additional user interface element disposed within the digital mouse pad comprising one or more thumbnail image views of one or more objects disposed in a clipboard;

displaying the digital mouse pad in the region on the multi-touch surface;

detecting multi-touch input associated with a first user interface element disposed within the digital mouse pad; and

performing a first operation within the application window based on the multi-touch input.

8. The non-transitory computer-readable storage medium of claim 7, the operation further comprising:

monitoring the multi-touch surface for any changes in a location of the mouse device; and

in response to a change in the location of the mouse device, changing a location of the region to substantially match the change in the location of the mouse device.

9. The non-transitory computer-readable storage medium of claim 7, wherein the first user interface element comprises a digital button, and, based on the multi-touch input, the one or more objects are highlighted with the mouse device and copied to the clipboard.

10. The non-transitory computer-readable storage medium of claim 9, the operation further comprising:

detecting second multi-touch input associated with the additional user interface element; and

performing a second operation within the application window based on the second multi-touch input.

11. The non-transitory computer-readable storage medium of claim 7, wherein the first user interface element comprises a digital button, and, based on the multi-touch input, the one or more objects are highlighted with the mouse device and cut and pasted to the clipboard.

12. The non-transitory computer-readable storage medium of claim 7, wherein the first user interface element comprises a digital button, and, based on the multi-touch input, the one or more objects disposed within the clipboard are pasted within the application window.

13. The non-transitory computer-readable storage medium of claim 7, wherein the one or more thumbnail image views include a plurality of thumbnail image views, and each thumbnail image view included in the plurality of thumbnail image views corresponds to a different object disposed in the clipboard.

14. The non-transitory computer-readable storage medium of claim 7, the operation further comprising:

receiving input selecting a thumbnail image view included in the one or more thumbnail image views; and

in response, pasting an object associated with the thumbnail image view within the application window.

15. A system configured to display a digital mouse pad on a multi-touch surface, the system comprising:

a multi-touch surface; and

a processing unit coupled to the multi-touch surface and configured to;

define a region on the multi-touch surface for displaying the digital mouse pad, wherein the region is proximate to a physical mouse device detected on the multi-touch surface and configured to transmit user input signals to the processing unit,

generate one or more user interface elements that are disposed within the digital mouse pad, wherein each user interface element is configured to control a different operation within an application window displayed via a display device,

generate an additional user interface element disposed within the digital mouse pad comprising one or more thumbnail image views of one or more objects disposed in a clipboard,

display the digital mouse pad in the region on the multi-touch surface,

detect multi-touch input associated with a first user interface element disposed within the digital mouse pad, and

perform a first operation within the application window based on the multi-touch input.

16. The system of claim 15, the processing unit further configured to:

monitor the multi-touch surface for any changes in a location of the mouse device; and

in response to a change in the location of the mouse device, change a location of the region to substantially match the change in the location of the mouse device.

17. The system of claim 15, wherein the first user interface element comprises a digital button, and, based on the multi-touch input, the one or more objects are highlighted with the mouse device and copied to the clipboard.

18. The system of claim 17, the processing unit further configured to:

detect second multi-touch input associated with the additional user interface element; and

perform a second operation within the application window based on the second multi-touch input.

19. The system of claim 15, wherein the first user interface element comprises a digital button, and, based on the multi-touch input, the one or more objects are highlighted with the mouse device and cut and pasted to the clipboard.

20. The system of claim 15, wherein the first user interface element comprises a digital button, and, based on the multi-touch input, the one or more objects disposed within the clipboard are pasted within the application window.