SPATIAL INTERFACES FOR REALTIME NETWORKED COMMUNICATIONS

• US 20090288007A1
• Filed: 07/27/2009
• Published: 11/19/2009
• Est. Priority Date: 04/05/2008
• Status: Abandoned Application

• Current Assignee: Social Communications Company
• Original Assignee: Social Communications Company
• Inventors: Brody, Paul J., Leacock, Matthew, Wie, David Van
• Application Number:
  US12/509,658
• Publication Number:
  US 20090288007A1
• Time in Patent Office: Days
• US Class Current: 715/716
• CPC Class Codes: G06Q 10/10 Office automation; Time management
• CPC Class Codes: H04L 12/1822 Conducting the conference, e.g. admission, detection, selection or grouping of participants, correlating users to one or more conference sessions, prioritising transmission
• CPC Class Codes: H04L 12/1827 Network arrangements for conference optimisation or adaptation
• CPC Class Codes: H04L 12/1831 Tracking arrangements for later retrieval, e.g. recording contents, participants activities or behavior, network status
• CPC Class Codes: H04L 51/04 Real-time or near real-time messaging, e.g. instant messaging [IM]
• CPC Class Codes: H04L 67/131 Protocols for games, networked simulations or virtual reality
• CPC Class Codes: H04L 67/54 Presence management, e.g. monitoring or registration for receipt of user log-on information, or the connection status of the users

Abstract

A current realtime communication session is established between communicants operating on respective network nodes. A spatial visualization of the current realtime communication session is displayed. The spatial visualization includes a graphical representation of each of the communicants in spatial relation to a graphical representation of a virtual area. During the current communication session, visual cues are depicted in the spatial visualization that show current communication states of the communicants, where each of the communication states corresponds to a state of a respective communication channel over which a respective one of the communicants is configured to communicate.

Claims

1. A computer-implemented method, comprising:

establishing a current realtime communication session between communicants operating on respective network nodes;

on a display, displaying a spatial visualization of the current realtime communication session, wherein the spatial visualization comprises a graphical representation of each of the communicants in spatial relation to a graphical representation of a virtual area; and

during the current communication session, depicting visual cues in the spatial visualization that show current communication states of the communicants, wherein each of the communication states corresponds to a state of a respective communication channel over which a respective one of the communicants is configured to communicate.

2. The method of claim 1, further comprising, during the current communication session, presenting on the display a log of event descriptions describing respective events involving interactions of the communicants in the virtual area in contextual association with elements of the spatial visualization of the current realtime communication session.

3. The method of claim 2, wherein the log of event descriptions and the graphical representation of the virtual area are displayed in a single graphical user interface window.

4. The method of claim 2, wherein the log of event descriptions comprises at least one of:

text of a chat conversation between the communicants in the virtual area;

a description of a data file shared by a respective one of the communicants in the virtual area; and

a description of an application shared by a respective one of the communicants in the virtual area.

5. The method of claim 2, wherein the presenting comprises visually associating the event descriptions in the log with respective ones of the graphical representations of the communicants involved in the events described by the respective event descriptions.

6. The method of claim 5, wherein the visually associating comprises associating with each of the event descriptions a respective label that has a respective visual appearance that matches a visual element of the graphical representation of the communicant involved in the event described by the respective event description.

7. The method of claim 2, further comprising storing the log of event descriptions in one or more database records that are indexed by an identifier of the virtual area.

8. The method of claim 1, wherein the displaying comprises displaying in the virtual area one or more props each representing a respective communication channel for realtime communications between the communicants during the communication session.

9. The method of claim 8, wherein the displaying comprises displaying a communicant-selectable table prop in the virtual area, and further comprising initiating a file share session between the communicants in response to selection of the table prop by one of the communicants.

10. The method of claim 8, wherein the displaying comprises displaying a communicant-selectable viewscreen prop in the virtual area, and further comprising initiating an application sharing session between the communicants in response to selection of the viewscreen prop by one of the communicants.

11. The method of claim 8, further comprising changing a spatial property of the graphical representation of a respective one of the communicants in relation to a respective one of the props in response to selection of the respective prop by the respective communicant.

12. The method of claim 11, wherein the changing comprises depicting the graphical representation of the respective communicant adjacent the selected prop.

13. The method of claim 11, wherein the changing comprises reorienting the graphical representation of the respective communicant to face the selected prop.

14. The method of claim 11, wherein the changing comprises changing the graphical representation of the respective communicant.

15. The method of claim 1, wherein the establishing comprises establishing during the current communication session a realtime instant messaging communication channel between the communicants.

16. The method of claim 15, wherein the displaying comprises displaying in association with the graphical representation of the virtual area a current chat log of a current chat conversation between the communicants occurring during the current communication session.

17. The method of claim 16, wherein the depicting comprises dynamically modulating the graphical representation of a given one of the communicants in response to receipt of a respective realtime chat stream from the given communicant over the realtime instant messaging communication channel such that the current communication state of the given communicant is reflected in the dynamic modulation of the graphical representation of the given communicant.

18. The method of claim 16, wherein the displaying comprises displaying in association with the current chat log a respective prior chat log of a prior chat conversation that occurred during a prior communication session between the communicants in the virtual area.

19. The method of claim 1, wherein the displaying comprises displaying a graphical representation of a file sharing prop in the virtual area, and further comprising:

in response to selection of the file sharing prop by a respective one of the communicants, depicting the graphical representation of the respective communicant adjacent the file sharing prop, and initiating a realtime file sharing session in the virtual area.

20. The method of claim 19, further comprising storing a data file shared by the respective communicant during the realtime file sharing session in a data storage device with an index comprising an identifier of the virtual area, and wherein the displaying comprises displaying on the file sharing prop a communicant-selectable graphical representation of the data file.

21. The method of claim 20, further comprising initiating a download of the data file to the network node from which a given one of the communicants is operating in response to selection of the graphical representation of the file by the given communicant.

22. The method of claim 1, wherein the displaying comprises displaying a graphical representation of an application sharing prop in the virtual area, and further comprising:

in response to selection of the application sharing prop by a respective one of the communicants, depicting the graphical representation of the respective communicant adjacent the application sharing prop, and initiating a realtime application sharing session in the virtual area.

23. The method of claim 22, further comprising sharing screen shots from the network node from which the respective communicant is operating with one or more of the other communicants during the realtime application sharing session, and wherein the displaying comprises displaying a graphical indication that an application that is being shared in connection with the application sharing prop.

24. The method of claim 22, wherein the displaying comprises displaying a first graphical representation of the application sharing prop during periods of application sharing between the communicants in the virtual area and displaying a second graphical representation of the application sharing prop different from the first graphical representation during periods free of application sharing between the communicants.

25. The method of claim 1, wherein in response to a command from a given one of the communicants to activate an audio sink communication channel, the establishing comprises establishing a realtime audio communication channel between the given communicant and one or more of the other communicants configured as audio sources, and the depicting comprises modifying the graphical representation of the given communicant to show that the given communicant is configured as an audio sink.

26. The method of claim 1, wherein in response to a command from a given one of the communicants to activate an audio source communication channel, the establishing comprises establishing a realtime audio communication channel between the given communicant and one or more of the other communicants configured as audio sinks, and the depicting comprises modifying the graphical representation of the given communicant to show that the given communicant is configured as an audio source.

27. The method of claim 1, wherein the displaying comprises displaying a static view of the graphical representation of the virtual area throughout the current communication session, and the communicants are unable to navigate the graphical representations of the communicants outside the static view of the virtual area.

28. The method of claim 1, wherein in response to receipt of a command from a first one of the communicants to initiate a private communication with a second one of the communicants:

the establishing comprises establishing the current realtime communication session between the first and second communicants; and

the displaying comprises displaying the graphical representations of the first and second communicants in spatial relation to a graphical representation of a virtual area that is indexed by identifiers of the first and second communicants.

29. The method of claim 1, further comprising determining an end state of a prior realtime communication session between the communicants from data that is indexed by an identifier of the virtual area and describes events that occurred during a prior communication session between the communicants;

and wherein the displaying comprises displaying the graphical representation of a virtual area in a state that corresponds to the determined end state of the prior communication session between the communicants.

30. Apparatus, comprising:

a computer-readable medium storing computer-readable instructions; and

a data processor coupled to the computer-readable medium, operable to execute the instructions, and based at least in part on the execution of the instructions operable to perform operations comprising

establishing a current realtime communication session between communicants operating on respective network nodes,

on a display, displaying a spatial visualization of the current realtime communication session, wherein the spatial visualization comprises a graphical representation of each of the communicants in spatial relation to a graphical representation of a virtual area, and

during the current communication session, depicting visual cues in the spatial visualization that show current communication states of the communicants, wherein each of the communication states corresponds to a state of a respective communication channel over which a respective one of the communicants is configured to communicate.

31. At least one computer-readable medium having computer-readable program code embodied therein, the computer-readable program code adapted to be executed by a computer to implement a method comprising:

establishing a current realtime communication session between communicants operating on respective network nodes;

on a display, displaying a spatial visualization of the current realtime communication session, wherein the spatial visualization comprises a graphical representation of each of the communicants in spatial relation to a graphical representation of a virtual area; and

during the current communication session, depicting visual cues in the spatial visualization that show current communication states of the communicants, wherein each of the communication states corresponds to a state of a respective communication channel over which a respective one of the communicants is configured to communicate.

32. A computer-implemented method, comprising:

establishing a current realtime communication session between communicants operating on respective network nodes;

on a display, displaying a spatial visualization of the current realtime communication session, wherein the spatial visualization comprises a graphical representation of each of the communicants in spatial relation to a graphical representation of a virtual area; and

during the current communication session, on the display presenting a log of event descriptions describing respective events involving interactions of the communicants in the virtual area, wherein the event descriptions are presented in contextual association with elements of the spatial visualization of the current realtime communication session.

33. The method of claim 32, wherein the presenting comprises depicting a visual association between respective ones of the event descriptions in the log and elements of the spatial visualization of the current realtime communication session.

34. The method of claim 33, wherein the depicting comprises depicting a visual association between respective ones of the event descriptions in the log with respective ones of the graphical representations of the communicants involved in the events described by the respective event descriptions.

35. The method of claim 34, wherein the depicting comprises associating with each of one or more of the event descriptions a respective label that has a respective visual appearance that matches a visual element of the graphical representation of the communicant involved in the event described by the event description.

36. The method of claim 32, wherein in response to an entry of a respective one of the communicants into the virtual area, the displaying comprises adding the graphical representation of the respective communicant to the spatial visualization, and the presenting comprises presenting a respective one of the event descriptions describing the entry of the respective communicant into the virtual area.

37. The method of claim 32, wherein in response to a departure of a respective one of the communicants from the virtual area, the displaying comprises removing the graphical representation of the respective communicant from the spatial visualization, and the presenting comprises presenting a respective one of the event descriptions describing the departure of the respective communicant from the virtual area.

38. The method of claim 32, wherein in response to a sharing of a data file by a respective one of the communicants with other ones of the communicants, the displaying comprises displaying a communicant-selectable graphical representation of the data file in spatial relation to the graphical representation of the virtual area, and the presenting comprises presenting a respective one of the event descriptions describing the sharing of the data file by the respective communicant.

39. The method of claim 32, wherein in response to a sharing of an application by a respective one of the communicants with other ones of the communicants, the displaying comprises displaying a graphical indication of the sharing of the application in spatial relation to the graphical representation of the virtual area, and the presenting comprises presenting a respective one of the event descriptions describing the sharing of the application by the respective communicant.

40. Apparatus, comprising:

a computer-readable medium storing computer-readable instructions; and

a data processor coupled to the computer-readable medium, operable to execute the instructions, and based at least in part on the execution of the instructions operable to perform operations comprising

establishing a current realtime communication session between communicants operating on respective network nodes,

on a display, displaying a spatial visualization of the current realtime communication session, wherein the spatial visualization comprises a graphical representation of each of the communicants in spatial relation to a graphical representation of a virtual area and

during the current communication session, on the display presenting a log of event descriptions describing respective events involving interactions of the communicants in the virtual area, wherein the event descriptions are presented in contextual association with elements of the spatial visualization of the current realtime communication session.

41. At least one computer-readable medium having computer-readable program code embodied therein, the computer-readable program code adapted to be executed by a computer to implement a method comprising:

establishing a current realtime communication session between communicants operating on respective network nodes;

on a display, displaying a spatial visualization of the current realtime communication session, wherein the spatial visualization comprises a graphical representation of each of the communicants in spatial relation to a graphical representation of a virtual area; and

during the current communication session, on the display presenting a log of event descriptions describing respective events Involving interactions of the communicants in the virtual area, wherein the event descriptions are presented in contextual association with elements of the spatial visualization of the current realtime communication session.

42. A computer-implemented method, comprising in response to receipt of a command from a first communicant operating on a first network node to initiate a private communication with a second communicant operating on a second network node:

establishing a current realtime communication session between the first and second network nodes;

identifying a private virtual area associated with the first and second communicants;

retrieving context configuration data associated with the private virtual area and generated in response to interactions of the first and second communicants in the private virtual area; and

on a display, displaying a spatial visualization of the current realtime communication session, wherein the spatial visualization comprises graphical representations of the first and second communicants in spatial relation to a graphical representation of the virtual area configured in accordance with the context configuration data.

43. The method of claim 42, further comprising during the current realtime communication session, generating a log of event descriptions describing respective events involving interactions of the first and second communicants in the virtual area.

44. The method of claim 43, further comprising during the current realtime communication session, storing the event descriptions in a data storage device with an index comprising an identifier of the virtual area.

45. The method of claim 44, wherein the log of event descriptions comprises at least one of:

text of a chat conversation between the first and second communicants in the virtual area;

a description of a data file shared by a respective one of the first and second communicants in the virtual area; and

a description of an application shared by a respective one of the first and second communicants in the virtual area.

46. The method of claim 43, further comprising during the current realtime communication session, presenting the log of event descriptions on the display.

47. The method of claim 46, wherein the presenting comprises presenting the log of event descriptions in contextual association with elements of the spatial visualization of the current realtime communication session.

48. The method of claim 46, wherein the retrieving comprises retrieving context configuration data comprising a log of event descriptions describing respective events involving interactions of the first and second communicants in the virtual area during one or more prior communication sessions before the current communication session, and the presenting comprises presenting the log of event descriptions generated during the current realtime communication session together with the retrieved context configuration data comprising the log of event descriptions.

49. The method of claim 42, wherein the retrieving comprises retrieving context configuration data comprising a description of an end state of a prior realtime communication session between the communicants, and the displaying comprises displaying the graphical representation of a virtual area in a state that corresponds to the end state of the prior communication session between the communicants.

50. Apparatus, comprising:

a computer-readable medium storing computer-readable instructions; and

a data processor coupled to the computer-readable medium, operable to execute the instructions, and based at least in part on the execution of the instructions operable to perform operations comprising in response to receipt of a command from a first communicant operating on a first network node to initiate a private communication with a second communicant operating on a second network node,

establishing a current realtime communication session between the first and second network nodes,

identifying a private virtual area associated with the first and second communicants,

retrieving context configuration data associated with the private virtual area and generated in response to interactions of the first and second communicants in the private virtual area, and

on a display, displaying a spatial visualization of the current realtime communication session, wherein the spatial visualization comprises graphical representations of the first and second communicants in spatial relation to a graphical representation of the virtual area configured in accordance with the context configuration data.

51. At least one computer-readable medium having computer-readable program code embodied therein, the computer-readable program code adapted to be executed by a computer to implement a method comprising:

in response to receipt of a command from a first communicant operating on a first network node to initiate a private communication with a second communicant operating on a second network node,

establishing a current realtime communication session between the first and second network nodes,

identifying a private virtual area associated with the first and second communicants,

retrieving context configuration data associated with the private virtual area and generated in response to interactions of the first and second communicants in the private virtual area, and

on a display, displaying a spatial visualization of the current realtime communication session, wherein the spatial visualization comprises graphical representations of the first and second communicants in spatial relation to a graphical representation of the virtual area configured in accordance with the context configuration data.