Methods and apparatus for graphical object interaction and negotiation

• US 7,589,749 B1
• Filed: 08/16/2005
• Issued: 09/15/2009
• Est. Priority Date: 08/16/2005
• Status: Active Grant

• Current Assignee: Adobe Inc.
• Original Assignee: Adobe Systems Incorporated (Adobe Inc.)
• Inventors: Staczek, Jason L., Bauermeister, Benjamin P., Kelley, Yohko A. F., De Laurentis, Michael S.
• Primary Examiner(s): Brier; Jeffery A
• Application Number:
  US11/204,740
• Time in Patent Office: 1,491 Days
• Field of Search: 345676-680, 715/837
• US Class Current: 345/676
• CPC Class Codes: G06F 3/04812 Interaction techniques based on cursor appearance or behaviour, e.g. being affected by the presence of displayed objects
• CPC Class Codes: G06F 9/451 Execution arrangements for user interfaces

Abstract

A system provides interaction between graphical objects and a managing application by detecting that movement of a first graphical object relative to a second graphical object on the graphical user interface is within a spatial proximity. In response to the detection of movement, the system notifies the first graphical object of presence information related to the second graphical object. The presence information includes at least an identity of the second graphical object. The system forms an association between the first graphical object and the second graphical object based on the presence information, and then graphically alters a representation of at least one of the first graphical object and the second graphical object on the graphical user interface in response to the formation of the association with each other.

Claims

1. A computer-implemented method in which a computer system initiates execution of software instructions stored in memory to provide interaction between graphical objects and a management application, the computer-implemented method comprising:

detecting that a first graphical object is moved within a spatial proximity of a second graphical object in a graphical user interface;

in response to the detecting, notifying the first graphical object of presence information related to the second graphical object;

forming an association between the first graphical object and the second graphical object; and

graphically altering a representation of the first graphical object in response to formation of the association;

wherein graphically altering the representation of the first graphical object further comprises modifying the representation of the first graphical object based on an exchange of information from the second graphical object to the first graphical object; and

wherein modifying the representation of the first graphical object further comprises displaying the representation of the first graphical object to include information received from the second graphical object.

2. The computer-implemented method of claim 1 wherein the presence information includes at least an identity of the second graphical object and

wherein the first graphical object is rendered on the graphical user interface by a first independently executing software process and

wherein the second graphical object is rendered on the graphical user interface by a second independently executing software process, and comprising:

forming the association between the first graphical object and the second graphical object based on the presence information.

3. The computer-implemented method of claim 2 wherein the spatial proximity indicates that the first graphical object is nearby but not overlapping any portion of the second graphical object.

4. The computer-implemented method of claim 2 wherein notifying the first graphical object of presence information related to the second graphical object comprises:

using the management application, notifying the first graphical object of presence information, the presence information selected from the group consisting of;

i) an interface the second graphical object publishes;

ii) data the second graphical object publishes;

iii) an interface the second graphical object consumes; and

iv) data the second graphical object consumes.

5. The computer-implemented method of claim 4 wherein the management application performs the operations of detecting that movement of a first graphical object relative to a second graphical object on the graphical user interface, and notifying the first graphical object of presence information related to the second graphical object;

and

wherein notifying the first graphical object of presence information related to the second graphical object comprises;

notifying the first graphical object of only one of either the interfaces or data published by the second graphical object that are consumed by the first graphical object.

6. The computer-implemented method of claim 5 comprising:

notifying the second graphical object of only one of either of the interfaces or data published by the first graphical object that are consumed by the second graphical object.

7. The computer-implemented method of claim 2 wherein forming the association between the first graphical object and the second graphical object based on the presence information comprises:

in the first graphical object, receiving presence information from the second graphical object indicating at least one of data or interfaces available for communication with the second graphical object; and

in the second graphical object, receiving presence information from the first graphical object indicating at least one of data or interfaces available for communication with the first graphical object.

8. The computer-implemented method of claim 2 wherein forming the association between the first graphical object and the second graphical object based on the presence information comprises:

negotiating communication between the first graphical object and the second graphical object using presence information notified to the first and second graphical objects by the management application, the communication allowing an exchange of object information between the first and second graphical objects that is not supplied by the management application; and

exchanging object information between the first graphical object and the second graphical object.

9. The computer-implemented method of claim 2 wherein graphically altering a representation of either the first graphical object or the second graphical object on the graphical user interface comprises:

changing a visual appearance of either the first graphical object or the second graphical object on the graphical user interface based on presence information exchanged between the first graphical object and the second graphical object, the presence information including a distance of spatial proximity between the first and second graphical objects.

10. The computer-implemented method of claim 2 wherein graphically altering a representation of either the first graphical object or the second graphical object on the graphical user interface comprises:

detecting a granularity of proximity between the first graphical object and the second graphical object; and

altering a representation of either the first graphical object or the second graphical object, based on the granularity of proximity.

11. The computer-implemented method as in claim 1 further comprising:

graphically altering a representation of the second graphical object in response to formation of the association.

12. The computer-implemented method as in claim 1 further comprising:

generating a name for the second graphical object based on an exchange of information transmitted from the first graphical object to the second graphical object; and

displaying the name associated with second graphical object in a directory.

13. The computer-implemented method as in claim 1, wherein graphically altering the representation of the first graphical object further comprises:

aligning the first graphical object and the second graphical object with each other in the graphical user interface.

14. The computer-implemented method as in claim 1, wherein graphically altering the representation of the first graphical object further comprises:

modifying the first graphical object to be closer in size to the representation of the second graphical object in response to detecting that the first graphical object is moved in close proximity to the representation of the second graphical object.

15. The computer-implemented method as in claim 1 further comprising:

initiating a first modification to the representation of the first graphical object in response to detecting that the representation of the first graphical object and the representation of the second graphical object are within a first threshold distance from each other;

initiating a second modification to the representation of the first graphical object in response to detecting that the representation of the first graphical object and the representation of the second graphical object are within a second threshold distance from each other; and

wherein the first threshold distance is greater than the second threshold distance.

16. The computer-implemented method as in claim 1, wherein graphically altering the representation of the first graphical object further comprises:

attaching the representation of the first graphical object to a date in a timeline displayed in the representation of the second graphical object.

17. The computer-implemented method as in claim 1, wherein graphically altering the representation of the first graphical object further comprises:

modifying an appearance of the representation of the first graphical object to include a name associated with the second graphical object to indicate that the first graphical object is associated with the second graphical object.

18. The computer-implemented method as in claim 16, wherein the first graphical object is a task and the second graphical object is a timeline;

and

wherein modifying the appearance includes displaying the task to include a name associated with the timeline in response to detecting that an image representing the task is in close proximity to an image representing the timeline.

19. The computer-implemented method as in claim 1, further comprising:

graphically altering a representation of the second graphical object in response to formation of the association;

wherein graphically altering the representation of the second graphical object further comprises modifying the representation of the second graphical object based on an exchange of information from the first graphical object to the second graphical object; and

wherein modifying the representation of the second graphical object further comprises displaying the representation of the second graphical object to include information received from the first graphical object.

20. A computer-implemented method in which a computer system initiates execution of software instructions stored in memory to provide interaction between graphical objects and a management application, the computer-implemented method comprising:

detecting that movement of a first graphical object relative to a second graphical object on a graphical user interface is within a spatial proximity, the first graphical object being rendered on the graphical user interface by a first independently executing software process, the second graphical object being rendered on the graphical user interface by a second independently executing software process;

in response to the detecting, notifying the first graphical object of presence information related to the second graphical object comprising;

identifying and notifying the first graphical object of presence information published by the second graphical object that matches presence information consumed by the first graphical object; and

identifying and notifying the second graphical object of presence information published by the first graphical object that matches presence information consumed by the second graphical object; and

forming an association between the first graphical object and the second graphical object based on the presence information.

21. The computer-implemented method of claim 20 wherein forming the association between the first graphical object and the second graphical object based on the presence information comprises:

the first graphical object using the presence information to perform communications with the second graphical object, the communications allowing the first graphical object to create the association to the second graphical object;

the first graphical object indicating the association formed to the second graphical object to the management application.

22. The computer-implemented method of claim 21 wherein the association formed between the first and second graphical objects is dependent upon a distance of the spatial proximity between the first and second graphical objects on the graphical user interface.

23. The computer-implemented method of claim 22 wherein graphically altering a representation of either the first graphical object or the second graphical object on the graphical user interface in response to the formation of the association with each other comprises:

changing an appearance of the first graphical object on the graphical user interface to reflect the spatial proximity of the first graphical object to the second graphical object.

24. A computer-implemented method in which a computer system initiates execution of software instructions stored in memory to provide interaction between graphical objects and a management application, the computer-implemented method comprising:

detecting that movement of a first graphical object relative to a second graphical object on a graphical user interface is within a spatial proximity, the first graphical object is rendered on the graphical user interface by a first independently executing software process, the second graphical object is rendered on the graphical user interface by a second independently executing software process;

at the first graphical object, receiving a user selection of a portion of the first graphical object on the graphical user interface; and

detecting that the user has graphically manipulated the portion of the first graphical object to be within a predetermined distance from the second graphical object;

notifying the first graphical object of presence information related to the second graphical object comprising;

indicating, to the first graphical object, a connection interface of the second graphical object that can be called by the first graphical object to obtain connection information concerning the second graphical object to allow the portion of the first graphical object to be graphically connected with the second graphical object;

forming an association between the first graphical object and the second graphical object based on the presence information comprising;

the first graphical object calling the connection interface to obtain the connection information concerning the second graphical object; and

the first graphical object receiving the connection information concerning the second graphical object; and

graphically altering a representation of either the first graphical object or the second graphical object on the graphical user interface comprising;

the first graphical object using the connection information concerning the second graphical object to render, on the graphical user interface, the portion of the first graphical object selected by the user to appear to be connected to the second graphical object.

25. The computer-implemented method of claim 24 comprising:

detecting movement of either the first or the second graphical object on the graphical user interface;

in response, adjusting a graphical appearance of the portion of the first graphical object connected to the second graphical object so that the portion remains visually connected to between the first graphical object and the second graphical object.

26. The computer-implemented method of claim 25 wherein the second graphical object is not aware that the first graphical object is associated with the second graphical object.

27. The computer-implemented method of claim 24 wherein the first graphical object is a text object and the second graphical object is an image object.

28. The computer-implemented method of claim 24 wherein the first graphical object is a timeline object and the second graphical object is an image object and wherein graphically altering a representation of either the first graphical object or second graphical object on the graphical user interface comprises:

inserting the image object into the timeline object in a section on the timeline where a timestamp of the section corresponds to a timestamp of the image object; and

altering the image object such that the timestamp of the image object is visible to a user.

29. A computerized device comprising:

a memory;

a processor;

a communications interface;

an interconnection mechanism coupling the memory, the processor and the communications interface;

wherein the memory is encoded with executable instructions stored thereon that when executed on the processor, causes the computerized device to perform the operations of;

detecting that a first graphical object is moved within a spatial proximity of a second graphical object in a graphical user interface;

in response to the detecting, notifying the first graphical object of presence information related to the second graphical object, the presence information including at least an identity of the second graphical object;

forming an association between the first graphical object and the second graphical object based on the presence information; and

graphically altering a representation of the first graphical object in response to formation of the association by modifying the representation of the first graphical object based on an exchange of information from the second graphical object to the first graphical object and displaying the representation of the first graphical object to include information received from the second graphical object.

30. The computerized device of claim 29 wherein when the computerized device performs the operation of detecting that movement of a first graphical object relative to a second graphical object on the graphical user interface is within a spatial proximity, the computerized device performs the operations of:

at the first graphical object, receiving a user selection of a portion of the first graphical object on the graphical user interface; and

detecting that the user has graphically manipulated the portion of the first graphical object to be within a predetermined distance from the second graphical object;

and wherein when the computerized device performs the operation of notifying the first graphical object of presence information related to the second graphical object, the computerized device performs the operation of;

indicating, to the first graphical object, a connection interface of the second graphical object that can be called by the first graphical object to obtain connection information concerning the second graphical object to allow the portion of the first graphical object to be graphically connected with the second graphical object;

and wherein when the computerized device performs the operation of forming an association between the first graphical object and the second graphical object based on the presence information, the computerized device performs the operations of;

the first graphical object calling the connection interface to obtain the connection information concerning the second graphical object; and

the first graphical object receiving the connection information concerning the second graphical object;

and wherein when the computerized device performs the operation of graphically altering a representation of either the first graphical object or the second graphical object on the graphical user interface, the computerized device performs the operation of;

the first graphical object using the connection information concerning the second graphical object to render, on the graphical user interface, the portion of the first graphical object selected by the user to appear to be connected to the second graphical object.

31. A computer-readable storage medium having executable instructions stored thereon that, when executed on a processor in a computerized device, cause the computerized device to perform the operations of:

detecting that a first graphical object is moved within a spatial proximity of a second graphical object in a graphical user interface;

in response to the detecting, notifying the first graphical object of presence information related to the second graphical object, the presence information including at least an identity of the second graphical object;

forming an association between the first graphical object and the second graphical object based on the presence information; and

graphically altering a representation of the first graphical object in response to formation of the association by modifying the representation of the first graphical object based on an exchange of information from the second graphical object to the first graphical object and displaying the representation of the first graphical object to include information received from the second graphical object.