Organizational tools on a multi-touch display device

• US 8,499,255 B2
• Filed: 02/24/2012
• Issued: 07/30/2013
• Est. Priority Date: 05/21/2009
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Perceptive Pixel Incorporated (Microsoft Corporation)
• Inventors: Davidson, Philip L.
• Primary Examiner(s): TRAN, TUYETLIEN T
• Application Number:
  US13/404,494
• Publication Number:
  US 20130069991A1
• Time in Patent Office: 522 Days
• Field of Search: 715/769, 715/790, 715/798, 715/800
• US Class Current: 715/800
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus

Abstract

A process for enabling objects displayed on a multi-input display device to be grouped together is disclosed that includes defining a target element that enables objects displayed on a multi-input display device to be grouped together through interaction with the target element. Operations are invoked that establish a relationship between a particular displayed object and a position on the target element and that causes transformations applied to the target element also to be applied to the particular displayed object while maintaining the relationship between the particular displayed object and the position on the target element.

Claims

1. A computer-implemented method for performing a scaling transformation on a first subset of a set of grouped objects displayed on a multi-input display device while preserving a present scale of objects within a second subset of the grouped objects, the method comprising:

defining a target element that enables objects displayed on a multi-input display device to be grouped together through interaction with the target element, the target element having a one-dimensional extent and including an attachment strip along the one-dimensional extent;

defining a set of objects;

invoking processes that establish associations between constituent objects of the set and corresponding positions along the one-dimensional extent of the target element that cause the associations between the constituent objects of the set and the corresponding positions along the target element to be maintained when the one-dimensional extent of the target element is translated such that the constituent objects of the set are translated as a function of the translation of the positions along the one-dimensional extent of the target element with which they are associated;

displaying at least a portion of the target element;

displaying objects associated with positions along the one-dimensional extent of the target element that fall within the displayed portion of the target element in a manner that is consistent with the spatial relationships between the displayed objects defined by the positions along the one-dimensional extent of the target element with which the displayed objects are associated;

detecting that a first input mechanism has engaged the target element at a first contact point on the attachment strip along the one-dimensional extent of the target element;

while the first input mechanism remains engaged with the target element, detecting that a second input mechanism has engaged the target element at a second contact point on the attachment strip along the one-dimensional extent of the target element that is removed from the first contact point by a span along the attachment strip along the one-dimensional extent of the target element, the first and second contact points defining a specific region of the one-dimensional extent of the target element that includes at least one position that is associated with a corresponding particular displayed object;

as a consequence of detecting that the first input mechanism has engaged the target element, monitoring movements of the first input mechanism along the attachment strip while the first input mechanism remains engaged with the target element;

as a consequence of detecting that the second input mechanism has engaged the target element, monitoring movements of the second input mechanism along the attachment strip while the second input mechanism remains engaged with the target element;

based on monitoring movements of the first input mechanism and the second input mechanism while the first and second input mechanisms remain engaged with the target element, detecting that at least one of the first and second input mechanisms has moved while remaining engaged with the target element such that the span along the attachment strip along the one-dimensional extent of the target element between the first and second input mechanisms has increased;

as a consequence of detecting that the span along the attachment strip along the one-dimensional extent of the target element between the first and second input mechanisms has increased;

applying a one-dimensional scaling operation to the specific region of the one-dimensional extent of the target element as a function of the increase in the span along the attachment strip along the one-dimensional extent of the target element between the first and second input mechanisms while preserving a scale of the one-dimensional extent of the target element outside of the specific region of the one-dimensional extent of the target element, and

as a consequence of applying the one-dimensional scaling operation to the specific region of the one-dimensional extent of the target element as a function of the increase in the span along the attachment strip along the one-dimensional extent of the target element, applying a corresponding scaling operation to the particular displayed object that is associated with the position that falls within the specific region of the one-dimensional extent of the target element while preserving a scale of other constituent objects that are associated with positions along the one-dimensional extent of the target element that do not fall within the specific region of the one-dimensional extent of the target element.

2. The method of claim 1, further comprising:

after applying the corresponding scaling operation to the particular displayed object;

detecting that the first input mechanism has disengaged the target element, and

detecting that the second input mechanism has disengaged the target element;

as a consequence of detecting that the first and the second input mechanisms have disengaged the target element, undoing the one-dimensional scaling operation applied to the specific region of the one-dimensional extent of the target element; and

as a consequence of undoing the one-dimensional scaling operation applied to the specific region of the one-dimensional extent of the target element, undoing the corresponding scaling operation applied to the particular displayed object.

3. The method of claim 1, further comprising determining, as a consequence of detecting that the span along the one-dimensional extent of the target element between the first and second input mechanisms has increased, a factor by which the span along the one-dimensional extent of the target element between the first and second input mechanisms has increased, wherein applying the corresponding scaling operation to the particular displayed object includes increasing the size of the particular displayed object by a factor that corresponds to the factor by which the span along the one-dimensional extent of the target element between the first and second input mechanisms increased.

4. The method of claim 1, wherein preserving the scale of other constituent objects that are associated with positions along the one-dimensional extent of the target element that do not fall within the specific region of the one-dimensional extent of the target element includes:

preserving the size of the other constituent objects that are associated with positions along the one-dimensional extent of the target element that do not fall within the specific region of the one-dimensional extent of the target element; and

translating the other constituent objects that are associated with positions along the one-dimensional extent of the target element that do not fall within the specific region of the one-dimensional extent of the target element in order to maintain the spatial relationships between the displayed objects defined by the positions along the one-dimensional extent of the target element with which the displayed objects are associated.

5. The method of claim 1, further comprising:

based on monitoring movements of the first input mechanism and the second input mechanism while the first and second input mechanisms remain engaged with the target element, detecting, after applying the corresponding scaling operation to the particular displayed object, that at least one of the first and second input mechanisms has moved while remaining engaged with the target element such that the span along the one-dimensional extent of the target element between the first and second input mechanisms has decreased;

as a consequence of detecting that the span along the one-dimensional extent of the target element between the first and second input mechanisms has decreased;

applying a one-dimensional scaling operation to the specific region of the one-dimensional extent of the target element as a function of the decrease in the span along the one-dimensional extent of the target element between the first and second input mechanisms while preserving a scale of the one-dimensional extent of the target element outside of the specific region of the one-dimensional extent of the target element, and

as a consequence of applying the one-dimensional scaling operation to the specific region of the one-dimensional extent of the target element as a function of the decrease in the span along the one-dimensional extent of the target element, applying a corresponding scaling operation to the particular displayed object that is associated with the position that falls within the specific region of the one-dimensional extent of the target element while preserving a scale of the other constituent objects that are associated with positions along the one-dimensional extent of the target element that do not fall within the specific region of the one-dimensional extent of the target element.

6. The method of claim 1, further comprising:

after applying the corresponding scaling operation to the particular displayed object;

detecting that the first input mechanism has disengaged the target element, and

detecting that the second input mechanism has disengaged the target element; and

after detecting that the first input mechanism has disengaged the target element and detecting that the second input mechanism has disengaged the target element, maintaining the one-dimensional scaling operation applied to the specific region of the one-dimensional extent of the target element and maintaining the corresponding scaling operation applied to the particular displayed object despite the first and second input mechanisms having disengaged the target element.