Organizational tools on a multi-touch display device

• US 10,031,608 B2
• Filed: 02/24/2012
• Issued: 07/24/2018
• Est. Priority Date: 05/21/2009
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: Davidson, Philip L.
• Primary Examiner(s): Tran, Tuyetlien T
• Application Number:
  US13/404,473
• Publication Number:
  US 20130093693A1
• Time in Patent Office: 2,342 Days
• Field of Search: 715769, 715790
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus

Abstract

A process for enabling objects displayed on a multi-input display device to be grouped together is disclosed that includes defining a target element that enables objects displayed on a multi-input display device to be grouped together through interaction with the target element. Operations are invoked that establish a relationship between a particular displayed object and a position on the target element and that causes transformations applied to the target element also to be applied to the particular displayed object while maintaining the relationship between the particular displayed object and the position on the target element.

Claims

1. A computer-implemented method, comprising:

displaying via a display device at least a portion of a target element and one or more objects at least partially overlapping the target element,

wherein the target element and the one or more objects are attached such that transformations applied to the target element are applied to the one or more objects;

determining via the display device that an input mechanism is engaging the target element by physically touching a surface of the display device at a first pressure less than a predetermined pressure;

applying a transformation to the target element and the one or more objects as a function of monitored movement of the input mechanism that is engaging the target element at the first pressure less than the predetermined pressure;

determining via the display device that the input mechanism is engaging the target element in excess of the predetermined pressure;

determining that future movements by the input mechanism while the input mechanism remains engaged with the target element in excess of the predetermined pressure are to detach a particular object of the one or more objects and the target element; and

as a consequence of detecting movement of the input mechanism while engaging the target element in excess of the predetermined pressure, detaching the target element and the particular object such that transformations applied to the target element are no longer applied to the particular object.

2. The method of claim 1, further comprising:

after detaching the target element and the particular object, detecting that the input mechanism has engaged the particular object;

in response to detecting that the particular object has been engaged by the input mechanism, monitoring movement of the input mechanism while the input mechanism remains engaged with the particular object; and

applying a transformation to the particular object as a function of the monitored movement of the input mechanism without applying corresponding transformations to the target element.

3. The method of claim 1, further comprising:

after detaching the target element and the particular object, detecting that the input mechanism has newly engaged one of the target element and another one of the one or more objects;

in response to detecting that one of the target element and the other object has been newly engaged by the input mechanism, determining that subsequent movements by the input mechanism while the input mechanism remains engaged with one of the target element and the other object are not to detach the other object and the target element;

after determining that subsequent movements by the input mechanism are not to detach the target element and the other object, detecting movement of the input mechanism while the input mechanism remains engaged with one of the target element and the other object that the input mechanism engaged; and

as a consequence of detecting movement of the input mechanism while the input mechanism remains engaged with one of the target element and the other object;

applying a transformation to the target element and the other object as a function of the detected movement of the input mechanism.

4. The method of claim 1, wherein determining that future movements by the input mechanism while the input mechanism remains engaged with the target element in excess of the predetermined pressure are to detach the particular object of the one or more objects and the target element includes invoking a process to determine if the input mechanism engaged the target element with a plurality of consecutive engagements within a predefined period of time.

5. The method of claim 1, further comprising detecting that the input mechanism is physically touching a surface of a multi-input display device at a point corresponding to the target element.

6. The method of claim 1, further comprising detecting that the input mechanism is hovering within a particular distance from a surface of a multi-input display device at a point corresponding to the target element.

7. A computer-implemented method, comprising:

displaying via a display device at least a portion of a target element and one or more objects at least partially overlapping the target element,

wherein the target element and the one or more objects are attached such that transformations applied to the target element are applied to the one or more objects;

determining via the display device that an input mechanism is engaging the target element by physically touching a surface of the display device at a first pressure less than a predetermined pressure;

applying a transformation to the target element and the one or more objects as a function of monitored movement of the input mechanism that is engaging the target element at the first pressure less than the predetermined pressure;

determining via the display device that the input mechanism is engaging one of the target element and a particular object of the one or more objects in excess of the predetermined pressure;

determining that future movements by the input mechanism while the input mechanism remains engaged with one of the target element and the particular object in excess of the predetermined pressure are to detach the particular object and the target element; and

as a consequence of detecting movement of the input mechanism while engaging one of the target element and the particular object in excess of the predetermined pressure, detaching the target element and the particular object such that transformations applied to the target element are no longer applied to the particular object, wherein;

detecting that the input mechanism has engaged one of the target element and the particular object in excess of the predetermined pressure includes detecting that the input mechanism has engaged the particular object;

the method further comprises detecting that an additional input mechanism is engaging the target element while the input mechanism is engaged concurrently with the particular object in excess of the predetermined pressure;

determining that future movements by the input mechanism while the input mechanism remains engaged with one of the target element and the particular object in excess of the predetermined pressure are to detach the particular object and the target element includes determining that the input mechanism is engaging the particular object while the additional input mechanism is engaging the target element based on having detected that the additional input mechanism is engaging the target element while the input mechanism is concurrently engaging the particular object;

determining that future movements by the input mechanism are to detach the particular object and the target element includes determining, as a consequence of having determined that the input mechanism is engaging the particular object concurrently while the additional input mechanism is engaging the target element, that future movements by the input mechanism while the input mechanism remains engaged with the particular object in excess of the predetermined pressure and the additional input mechanism remains concurrently engaged with the target element are to detach the particular object and the target element;

detecting movement of the input mechanism while the input mechanism remains engaged with one of the target element and the particular object in excess of the predetermined pressure includes detecting movement of the input mechanism while the input mechanism remains engaged with the particular object in excess of the predetermined pressure and the additional input mechanism remains concurrently engaged with the target element; and

detaching the target element and the particular object includes detaching the target element and the particular object as a consequence of having detected movement of the input mechanism while the input mechanism remains engaged with the particular object in excess of the predetermined pressure and the additional input mechanism remains concurrently engaged with the target element.

8. A computer-implemented method, comprising:

displaying via a display device at least a portion of a target element and one or more objects at least partially overlapping the target element,

wherein the target element and the one or more objects are attached such that transformations applied to the target element are applied to the one or more objects;

determining via the display device that an input mechanism is engaging the target element by physically touching a surface of the display device at a first pressure less than a predetermined pressure;

applying a transformation to the target element and the one or more obj ects as a function of monitored movement of the input mechanism that is engaging the target element at the first pressure less than the predetermined pressure;

detecting via the display device that the input mechanism has engaged one of the target element and a particular object of the one or more objects in excess of the predetermined pressure;

determining that future movements by the input mechanism while the input mechanism remains engaged with whichever one of the target element and the particular object in excess of the predetermined pressure are to detach the particular object and the target element; and

as a consequence of detecting movement of the input mechanism while engaging one of the target element and the particular object in excess of the predetermined pressure, detaching the target element and the particular object such that transformations applied to the target element are no longer applied to the particular object, wherein;

detecting that the input mechanism has engaged one of the target element and the particular object includes detecting that the input mechanism has engaged the target element;

determining that future movements by the input mechanism while the input mechanism remains engaged with whichever one of the target element and the particular object are to detach the particular object and the target element includes determining that the input mechanism is engaging the target element in excess of the predetermined pressure;

determining that future movements by the input mechanism are to detach the particular object and the target element includes determining, as a consequence of having determined that the input mechanism is engaging the target element in excess of the predetermined pressure, that future movements by the input mechanism while the input mechanism remains engaged with the target element in excess of the predetermined pressure are to detach the particular object and the target element;

detecting movement of the input mechanism while the input mechanism remains engaged with one of the target element and the particular object includes detecting movement of the input mechanism while the input mechanism remains engaged with the target element in excess of the predetermined pressure; and

detaching the target element and the particular object includes detaching the target element and the particular object as a consequence of having detected movement of the input mechanism while the input mechanism remains engaged with the target element in excess of the predetermined pressure.

9. A computer-implemented method, comprising:

displaying via a display device at least a portion of a target element and one or more objects at least partially overlapping the target element,

wherein the target element and the one or more objects are attached such that transformations applied to the target element are applied to the one or more objects;

determining via the display device that an input mechanism is engaging the target element by physically touching a surface of the display device at a first pressure less than a predetermined pressure;

applying a transformation to the target element and the one or more objects as a function of monitored movement of the input mechanism that is engaging the target element at the first pressure less than the predetermined pressure;

determining via the display device that future movements by the input mechanism while the input mechanism remains engaged with one of the target element and a particular object of the one or more objects are to detach the particular object and the target element;

as a consequence of detecting movement of the input mechanism while engaging one of the target element and the particular object in excess of the predetermined pressure, detaching the target element and the particular object such that transformations applied to the target element are no longer applied to the particular object;

displaying a release button that is visually distinguished from the target element and the one or more objects;

after detaching the target element and the particular object, detecting that the input mechanism has engaged the release button; and

as a consequence of detecting that the input mechanism has engaged the release button, detaching the one or more objects other than the particular object and the target element.

10. A computer-implemented method, comprising:

displaying via a display device at least a portion of a target element and one or more objects at least partially overlapping the target element,

wherein the target element and the one or more objects are attached such that transformations applied to the target element are applied to the one or more objects;

determining via the display device that an input mechanism is engaging the target element by physically touching a surface of the display device at a first pressure less than a predetermined pressure;

applying a transformation to the target element and the one or more obj ects as a function of monitored movement of the input mechanism that is engaging the target element at the first pressure less than the predetermined pressure;

determining via the display device that future movements by the input mechanism while the input mechanism remains engaged with one of the target element and a particular object of the one or more objects are to detach the particular object and the target element;

as a consequence of detecting movement of the input mechanism while engaging one of the target element and the particular object in excess of the predetermined pressure, detaching the target element and the particular object such that transformations applied to the target element are no longer applied to the particular object;

displaying a release button that is visually distinguished from the target element and the one or more objects;

after detaching the target element and the particular object, detecting that the input mechanism has engaged the release button;

as a consequence of detecting that the input mechanism has engaged the release button, detaching the one or more objects other than the particular object and the target element; and

after detaching the one or more objects and the target element, moving the one or more objects such that the one or more objects do not overlap the target element.

11. A computer-implemented method, comprising:

displaying via a display device at least a portion of a target element and one or more objects at least partially overlapping the target element,

wherein the target element and the one or more objects are attached such that transformations applied to the target element are applied to the one or more objects;

determining via the display device that an input mechanism is engaging the target element by physically touching a surface of the display device at a first pressure less than a predetermined pressure;

applying a transformation to the target element and the one or more objects as a function of monitored movement of the input mechanism that is engaging the target element at the first pressure less than the predetermined pressure;

determining via the display device that the input mechanism is engaging one of the target element and a particular object of the one or more objects in excess of the predetermined pressure;

determining that future movements by the input mechanism while the input mechanism remains engaged with one of the target element and the particular object in excess of the predetermined pressure are to detach the particular object and the target element;

as a consequence of detecting movement of the input mechanism while engaging one of the target element and the particular object in excess of the predetermined pressure, detaching the target element and the particular object such that transformations applied to the target element are no longer applied to the particular object;

after detaching the target element and the particular object;

defining a reference axis for orienting objects upon detaching the target element and the objects;

comparing an orientation of a reference axis of the particular object to the defined reference axis for orienting objects upon detaching the target element and the objects;

as a consequence of comparing the orientation of the reference axis of the particular object to the defined reference axis, determining that the orientation of the reference axis of the particular object is not aligned with the defined reference axis; and

as a consequence of determining that the orientation of the reference axis of the particular object is not aligned with the defined reference axis, adjusting the orientation of the particular object to align the reference axis of the particular object with the defined reference axis.

12. A computer-implemented method, comprising:

displaying via a display device at least a portion of a target element and one or more objects at least partially overlapping the target element,

determining that a single input mechanism is engaging the target element by physically touching a surface of the display device at a first pressure less than a predetermined pressure;

wherein the target element and the one or more objects are attached such that transformations applied to the target element via the single input mechanism at the first pressure less than the predetermined pressure are applied to the one or more objects;

determining via the display device that the single input mechanism is engaging the target element at a second pressure in excess of the predetermined pressure;

determining that future movements by the single input mechanism while the single input mechanism remains engaged with the target element in excess of the predetermined pressure are to detach a particular object of the one or more objects and the target element;

as a consequence of detecting movement of the single input mechanism while engaging the target element in excess of the predetermined pressure, detaching the target element and the particular object such that transformations applied to the target element are no longer applied to the particular object;

tracking additional movements of the single input mechanism while the single input mechanism remains engaged with a multi-input display device;

determining that the single input mechanism has traced a path on the multi-input display device via movement of the single input mechanism that encompasses at least another one of the objects; and

based on determining that the single input mechanism has traced the path on the multi-input display device that encompasses the other object, detaching the target element and the other object such that transformations applied to the target element are no longer applied to the other object.

13. The method of claim 12, wherein:

determining that the single input mechanism has traced the path on the multi-input display device that encompasses the other object includes determining that the single input mechanism has traced a path on the multi-input display device that encompasses multiple objects; and

detaching the target element and the other object includes detaching the target element and the multiple objects such that transformations applied to the target element are no longer applied to the multiple objects.

14. The method of claim 13, further comprising:

after determining that the single input mechanism has traced the path on the multi-input display device that encompasses the multiple objects, visually rendering the traced path on the multi-input display device;

detecting that the single input mechanism has engaged the visually rendered traced path;

tracking movements of the single input mechanism while the single input mechanism remains engaged with the traced path; and

determining that the single input mechanism has moved such that it no longer overlaps the target element,

wherein detaching the target element and the multiple objects includes detaching the target element and the multiple objects based on determining that the single input mechanism has moved such that it no longer overlaps the target element.

15. The method of claim 13, further comprising:

after determining that the single input mechanism has traced the path on the multi-input display device that encompasses the multiple objects, detecting that the single input mechanism has engaged a specific one of the multiple objects encompassed by the path;

tracking movements of the single input mechanism while the single input mechanism remains engaged with the specific object encompassed by the path; and

determining that the single input mechanism has moved such that it no longer overlaps the target element,

wherein detaching the target element and the multiple objects includes detaching the target element and the multiple objects based on determining that the single input mechanism has moved such that it no longer overlaps the target element.

16. The method of claim 13, further comprising:

after determining that the single input mechanism has traced the path on the multi-input display device that encompasses the multiple objects, detecting that the single input mechanism has engaged an area encompassed by the traced path;

tracking movements of the single input mechanism while the input single mechanism remains engaged with the area encompassed by the traced path; and

determining that the single input mechanism has moved such that it no longer overlaps the target element,

wherein detaching the target element and the multiple objects includes detaching the target element and the multiple objects based on determining that the single input mechanism has moved such that it no longer overlaps the target element.

17. The method of claim 13, further comprising:

after detaching the target element and the multiple objects, defining a second target element on the multi-input display device,

wherein the second target element and the multiple objects are attached such that transformations applied to the second target element are applied to the multiple objects.

18. The method of claim 13, further comprising:

after detaching the target element and the multiple objects, detecting that additional objects and the target element remain attached; and

as a consequence of detecting that the additional objects and the target element remain attached, transforming the target element such that the additional objects overlap the target element and the multiple objects do not overlap the target element.

19. The method of claim 12, wherein determining that the single input mechanism has traced the path on the multi-input display device that encompasses the other object includes determining that the single input mechanism has traced an enclosed shape, such that the other object is at least one of overlapped by the enclosed shape and encompassed by the enclosed shape.

20. The method of claim 12, wherein determining that the single input mechanism has traced the path on the multi-input display device that encompasses the other object includes determining that the single input mechanism has traced a line, such that the other object is overlapped by the traced line.