Manipulation of objects on multi-touch user interface

• US 8,683,390 B2
• Filed: 10/01/2008
• Issued: 03/25/2014
• Est. Priority Date: 10/01/2008
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: de los Reyes, August
• Primary Examiner(s): Sax, Steven
• Assistant Examiner(s): VARGA, WILSON V
• Application Number:
  US12/243,800
• Publication Number:
  US 20100083111A1
• Time in Patent Office: 2,001 Days
• Field of Search: 715/702, 715/863, 715/788, 715/790, 715792-793
• US Class Current: 715/863
• CPC Class Codes: G06F 2203/04806 Zoom, i.e. interaction techniques or interactors for controlling the zooming operation
• CPC Class Codes: G06F 2203/04808 Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/0483 Interaction with page-structured environments, e.g. book metaphor
• CPC Class Codes: G06F 3/0486 Drag-and-drop
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus

Abstract

Embodiments related to the manipulation of objects on a multi-touch graphical user interface are disclosed. For example, in one disclosed embodiment, a method of operating a multi-touch graphical user interface on a computing device comprises displaying a group of objects on the graphical user interface in a group representation, receiving a first multi-touch input in which a first number of touches associated with the group representation are moved on the graphical user interface, and in response to the first multi-touch input, changing a scale of the objects in the group representation. The method further comprises receiving a second multi-touch input in which a second number of touches associated with the group representation are moved on the graphical user interface, and in response to the second multi-touch input, changing an organization of the objects in the group representation on the graphical user interface.

Claims

1. A method of operating a multi-touch graphical user interface on a computing device, comprising:

displaying a group of objects on the graphical user interface in a group representation, wherein the group of objects comprises three or more objects and wherein the group representation comprises a stacked organizational representation of the three or more objects that exposes a first portion of the three or more objects and occupies a first portion of a display;

receiving a first multi-touch input in which a first number of touches associated with the group representation are moved on the graphical user interface, the first multi-touch input comprising touches of a first, equal number of fingers of each hand of a plurality of hands at a border displayed around the group representation and wherein each hand is moved a distance relative to each other hand;

in response to the first multi-touch input, changing a scale of the objects in the group representation so as to change the portion of the display that the group representation occupies from the first portion to a second portion of the display;

receiving a second multi-touch input in which a second number of touches associated with the group representation are moved on the graphical user interface, the second multi-touch input comprising touches of a second, equal number of fingers of each hand of the plurality of hands at the border displayed around the group representation, the second number being different than the first number and each hand being moved a distance relative to each other hand; and

in response to the second multi-touch input, changing the group representation to a different group representation that comprises a tiled organizational representation of the three or more objects that exposes a second portion of each object of the three or more objects that is greater than the first portion of each obiect of the three or more objects and occupies a different, greater portion of the display than the second portion of the display.

2. The method of claim 1, wherein displaying the group of objects on the graphical user interface in the group representation comprises receiving a touch input requesting a grouping of a plurality of objects displayed on the graphical user interface, and moving the objects into the group representation on the user interface.

3. The method of claim 2, wherein moving the objects into the group representation on the user interface comprises displaying the border around the objects, reducing a brightness of the border if a user input is not received after a period of time, and releasing the objects from the group representation if no further user inputs are received during a period of time.

4. The method of claim 1, wherein displaying a group of objects on the graphical user interface in the group representation comprises displaying the group of objects in an application window.

5. The method of claim 2, wherein receiving a touch input requesting a grouping of a plurality of objects comprises detecting a bracketing of the objects by sides of hands touched to the graphical user interface.

6. The method of claim 1, wherein receiving the first multi-touch input comprises detecting a distance change between fingers of the plurality of hands resulting from relative movement between the plurality of hands, and wherein receiving the second multi-touch input comprises detecting a distance change between fingers of the hands resulting from relative movement between the plurality of hands.

7. The method of claim 6, further comprising receiving a third multi-touch input comprising a detected touch of a third number of fingers of each hand at the border displayed around the group representation and a changing of a distance between each hand, and in response, displaying a contextual menu in the border around the objects.

8. The method of claim 1, further comprising displaying a prompt for additional touches in response to receiving the first multi-touch input, wherein the prompt specifies a location at which an additional touch can be placed to accomplish the second multi-touch input.

9. The method of claim 1, wherein each object comprises a graphical representation of a letter of an alphabet on an underlying object, and wherein the method further comprises receiving an input selecting a letter, and in response, displaying on the graphical user interface a movement of the letter and the underlying object into a text display field.

10. A computing device, comprising:

a display;

a multi-touch input mechanism configured to detect multiple temporally overlapping touches on the display;

a logic subsystem comprising a processor;

and memory comprising instructions stored thereon that are executable by the logic subsystem to operate a graphical user interface via the display and the multi-touch input mechanism by;

receiving via the multi-touch input mechanism a first multi-touch input comprising a touch of a first, equal number of fingers of each of two hands at a border displayed around a group representation occupying a first portion of the graphical user interface and a changing of a distance between the fingers of the two hands resulting from relative movement between the two hands wherein each hand is moved a distance relative to each other hand, the group representation exposing a first portion of including three or more objects displayed on the graphical user interface within the border and the group representation comprises a stacked organizational representation of the three or more objects;

in response to the first multi-touch input, changing a scale of the three or more objects included in the group representation so as to change a portion of the graphical user interface occupied by the group representation from the first portion to a second portion of the graphical user interface;

receiving via the multi-touch input mechanism a second multi-touch input comprising a touch of a second, equal number of fingers of each of the two hands and a changing of a distance between the fingers of the two hands resulting from relative movement between the two hands and each hand being moved a distance relative to each other hand; and

in response to the second multi-touch input, changing the group representation to a different group representation that exposes a second portion of each object of the three or more objects that is greater than the first portion of each object of the three or more objects and comprises a tiled organizational representation and occupies a different, greater portion of the graphical user interface than the second portion of the graphical user interface.

11. The computing device of claim 10, wherein the instructions are further executable to, after receiving the first multi-touch input, display on the display a prompt for one or more additional touches that correspond to the second multi-touch input.

12. The computing device of claim 10, wherein receiving the first multi-touch input at the border includes receiving an input from a single finger of each of the two hands at the border, and wherein receiving the second multi-touch input at the border includes receiving an input from two fingers of each of the two hands at the border.

13. The computing device of claim 10, further comprising receiving a third multi-touch input comprising a touch of a third number of fingers of each of the two hands and a changing of a distance between the two hands, and, in response to the third multi-touch input, displaying a contextual menu on the display.