Automated real-time data stream switching in a shared virtual area communication environment

• US 9,762,641 B2
• Filed: 02/24/2012
• Issued: 09/12/2017
• Est. Priority Date: 10/24/2007
• Status: Active Grant

• Current Assignee: Sococo, Inc.
• Original Assignee: Sococo, Inc.
• Inventors: Brody, Paul J., Van Wie, David
• Primary Examiner(s): Fibbi, Christopher J
• Application Number:
  US13/404,453
• Publication Number:
  US 20120159354A1
• Time in Patent Office: 2,027 Days
• Field of Search: 715758, 715751, 715753, 715757
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
• CPC Class Codes: H04L 12/1822 Conducting the conference, e.g. admission, detection, selection or grouping of participants, correlating users to one or more conference sessions, prioritising transmission
• CPC Class Codes: H04L 12/1827 Network arrangements for conference optimisation or adaptation
• CPC Class Codes: H04L 65/765 intermediate
• CPC Class Codes: H04L 67/131 Protocols for games, networked simulations or virtual reality

Abstract

Switching real-time data stream connections between network nodes sharing a virtual area is described. In one aspect, the switching involves storing a virtual area specification. The virtual area specification includes a description of one or more switching rules each defining a respective connection between sources of a respective real-time data stream type and sinks of the real-time data stream type in terms of positions in the virtual area. Real-time data stream connections are established between network nodes associated with respective objects each of which is associated with at least one of a source and a sink of one or more of the real-time data stream types. The real-time data stream connections are established based on the one or more switching rules, the respective sources and sinks associated with the objects, and respective positions of the objects in the virtual area.

Claims

1. A computer-implemented method of constructing a virtual area, comprising:

in response to user input, creating a definition of a spatial model of the virtual area in a display monitor, wherein the spatial model comprises a spatial arrangement of stationary geometric elements of the virtual area that are presented in the display monitor and zones comprising boundaries that are fixed in relation to the stationary geometric elements of the virtual area;

in response to user input, associating switching rules with the model of the virtual area, wherein the associating comprises associating a first switching rule with a first one of the zones in the definition of the spatial model of the virtual area, wherein the first switching rule designates the first zone as a source zone, designates a second one of the zones as a sink zone, and defines a respective instruction to automatically connect sources of a respective real-time data stream type that are associated with objects in the first zone with sinks of the respective real-time data stream type that are associated with objects in the second zone, wherein the designated source zone and the designated sink zone are spatially different zones;

wherein in accordance with the first switching rule, entry of a given object associated with a source of the respective real-time data stream type into the first zone causes the source associated with the given object to be automatically connected with a sink of the respective real-time data stream type that is associated with an object in the second zone;

generating a virtual area specification describing the model of the virtual area and the associated switching rules; and

storing the virtual area specification in a non-transitory computer-readable storage medium.

2. The method of claim 1, wherein the first switching rule requires sources of the respective realtime data stream type that are associated with objects in the first zone to have a particular attribute value in order to be connected with respective ones of the sinks of the respective realtime data stream type that are associated with objects in the second zone.

3. The method of claim 1, wherein the first switching rule is associated with a respective stream priority attribute value that prioritizes connections of sources of the respective realtime data stream type that are associated with objects in the designated source zone with sinks of the respective realtime data stream type that are associated with objects in the second zone in relation to other connections between sources and sinks that are associated with the virtual area.

4. The method of claim 1, wherein the first switching rule is associated with a respective network routing topology attribute value that specifies a preferred routing topology for connections of sources of the respective realtime data stream type that are associated with objects in the first zone with sinks of the respective realtime data stream type that are associated with objects in the second zone.

5. The method of claim 1, wherein the first switching rule is associated with a respective bandwidth attribute value that influences bandwidth allocation to connections of sources of the respective realtime data stream type that are associated with objects in the first zone with sinks of the respective realtime data stream type that are associated with objects in the second zone.

6. At least one non-transitory computer-readable medium having processor-readable program code embodied therein, the processor-readable program code adapted to be executed by a processor to perform operations comprising:

based on user input, creating a definition of a spatial model of a virtual area in a display monitor, wherein the spatial model comprises a spatial arrangement of stationary geometric elements of the virtual area that are presented in the display monitor and zones comprising respective boundaries that are fixed in relation to the stationary geometric elements of the virtual area;

in response to user input, associating a switching rule with a first one of the zones in the definition of the spatial model of the virtual area, wherein the switching rule designates the first zone as a source zone, designates a second one of the zones as a sink zone, and defines a respective instruction to automatically connect sources of a respective real-time data stream type that are associated with objects in the first zone with sinks of the respective real-time data stream type that are associated with objects in the second zone, wherein the designated source zone and the designated sink zone are spatially different zones;

wherein in accordance with the switching rule, entry of a given object associated with a source of the respective real-time data stream type into the first zone causes the source associated with the given object to be automatically connected with a sink of the respective real-time data stream type that is associated with an object in the second zone;

generating a virtual area specification describing the model of the virtual area and the associated switching rules; and

storing the virtual area specification in a non-transitory computer-readable storage medium.

7. A method, comprising:

administering one or more real-time data stream connections between network nodes associated with respective objects based on a virtual area specification defining a spatial model of a virtual area comprising a spatial arrangement of stationary geometric elements, zones comprising respective boundaries that are fixed in relation to the stationary geometric elements of the virtual area, and switching rules comprising a first switching rule associated with a first one of the zones of the virtual area, wherein the first switching rule designates the first zone as a source zone, designates a second one of the zones as a sink zone, and defines a respective instruction to automatically connect sources of a first realtime data stream type that are associated with one or more of the objects in the first zone with sinks of the first realtime data stream type that are associated with one or more of the objects in the second zone, wherein the first zone and the second zone are different zones;

wherein the administering comprises, in response to entry of a given object associated with a source of the first real-time data stream type into the first zone, automatically connecting the source associated with the given object with a sink of the first real-time data stream type that is associated with an object in the second zone, wherein each of the objects is associated with at least one of a source and a sink of one or more real-time data stream types, and the administering is based on the switching rules, the respective sources and sinks associated with the objects, and the respective zones of the virtual area in which the objects are located.

8. The method of claim 7, wherein:

the spatial model of the virtual area comprises a second switching rule that designates a particular one of the first and second zones as both the source zone and the sink zone of the first realtime data stream type; and

the administering comprises administering realtime data stream connections between respective ones of the network nodes that have sources of the first realtime data stream type and are associated with objects located in the particular zone and respective ones of the network nodes that have sinks of the first realtime data stream type and are associated with objects located in the particular zone.

9. The method of claim 7, wherein the boundary of the first zone is outside the boundary of the second zone.

10. The method of claim 9, wherein the spatial model of the virtual area comprises a second switching rule that designates the first zone as both the source zone and the sink zone of a second realtime data stream type;

and

the administering comprises administering realtime data stream connections between respective ones of the network nodes that have sources of the second realtime data stream type and are associated with objects located in the first zone and respective ones of the network nodes that have sinks of the second realtime data stream type and are associated with objects located in the first zone.

11. The method of claim 10, wherein the first and second realtime data stream types are identical.

12. The method of claim 10, wherein the first and second realtime data stream types are different.

13. The method of claim 10, wherein the first switching rule defines the respective instruction to automatically connect any data streams of the first realtime data stream type that are sourced from the first zone to any sinks of the first realtime data stream type that are in the second zone and are associated with a first role.

14. The method of claim 13, wherein the second switching rule defines a respective instruction to automatically connect any data streams of the second realtime data stream type that are sourced from the first zone to any sinks of the second realtime data stream type that are in the first zone and are associated with a second role.

15. The method of claim 14, wherein the first and second roles are different.

16. The method of claim 15, wherein the first role is a moderator and the second role is a participant.

17. The method of claim 10, wherein the spatial model of the virtual area comprises a third switching rule that designates the second zone as both the source zone and the sink zone of a third realtime data stream type;

and

the administering comprises administering realtime data stream connections between respective ones of the network nodes that have sources of the third realtime data stream type and are associated with objects located in the second zone and respective ones of the network nodes that have sinks of the third realtime data stream type and are associated with objects located in the second zone.

18. The method of claim 17, wherein the first and second realtime data stream types are identical and the third realtime data stream type is different from the first and second realtime data stream types.

19. The method of claim 18, wherein the first and second realtime data stream types are a voice data stream type, and the third realtime data stream type is a chat data stream type.

20. The method of claim 17, wherein:

the first switching rule defines the respective instruction to automatically connect any data streams of the first realtime data stream type that are sourced from the first zone and are associated with a first role to any sinks of the first realtime data stream type that are in the second zone and are associated with a second role;

the second switching rule defines a respective instruction to automatically connect any data streams of the second realtime data stream type that are sourced from the first zone and are associated with the first role to any sinks of the first realtime data stream type that are in the first zone and are associated with a third role; and

the third switching rule defines a respective instruction to automatically connect any data streams of the third realtime data stream type that are sourced from the second zone and are associated with the second role to any sinks of the third realtime data stream type that are in the second zone and area associated with the second role.

21. The method of claim 20, wherein the virtual area is a virtual concert hall.

22. The method of claim 10, wherein the spatial model of the virtual area comprises a third switching rule that designates the second zone as a source zone of a third realtime data stream type and designates the first zone as a sink zone of the third realtime data stream type;

and

the administering comprises administering realtime data stream connections between respective ones of the network nodes that have sources of the third realtime data stream type and are associated with objects located in the second zone and respective ones of the network nodes that have sinks of the third realtime data stream type and are associated with objects located in the first zone.

23. The method of claim 22, wherein the first and third realtime data stream types are identical.

24. The method of claim 22, wherein the first and third realtime data stream types are different.

25. The method of claim 22, wherein:

the first switching rule defines the respective instruction to automatically connect any data streams of the first realtime data stream type that are sourced from the first zone to any sinks of the first realtime data stream type that are in the second zone and are associated with a first role;

the second switching rule defines a respective instruction to automatically connect any data streams of the second realtime data stream type that are sourced from the first zone to any sinks of the first realtime data stream type that are in the first zone and are associated with a second role; and

the third switching rule defines a respective instruction to automatically connect any data streams of the third realtime data stream type that are sourced from the second zone and are associated with the first role to any sinks of the third realtime data stream type that are in the first zone and area associated with the second role.

26. The method of claim 25, wherein the first and second roles are different.

27. The method of claim 25, wherein the first and second data stream types are a voice data stream type, and the third data stream type is an audio data stream type.

28. The method of claim 7, wherein the specification of the virtual area is free of any switching rule that designates the second zone as a source zone and designates the first zone as a sink zone.

29. The method of claim 7, wherein the geometric boundary of the second zone is inside the geometric boundary of the first zone.

30. The method of claim 29, wherein the first switching rule designates the second zone as both the source zone and the sink zone of a second realtime data stream type;

and

the administering comprises administering realtime data stream connections between respective ones of the network nodes that have sources of the second realtime data stream type and are associated with objects located in the second zone and respective ones of the network nodes that have sinks of the second realtime data stream type and are associated with objects located in the second zone.

31. The method of claim 30, wherein the specification of the virtual area is free of any switching rule that designates the second zone as a source zone and designates the first zone as a sink zone.

32. The method of claim 30, wherein the first and third realtime data stream types are identical.

33. The method of claim 30, wherein the first and third realtime data stream types are different.

34. The method of claim 7, wherein the administering comprises connecting respective ones of the network nodes that have sources of the first realtime data stream type and are associated with objects located in the first zone with respective ones of the network nodes that have sinks of the first realtime data stream type and are associated with objects located in the second zone.

35. The method of claim 7, further comprising moving ones of the objects into and out of respective ones of the first and second zones responsive to user input.

36. The method of claim 7, wherein the objects are avatars respectively representing communicants operating respective ones of the network nodes.

37. The method of claim 7, wherein the virtual area is a virtual art gallery comprising a visualization of images on walls of the virtual area, and ones of the images are associated with respective zones that are associated with respective switching rules each of which respectively designates a respective one of the respective zones as both the source zone and the sink zone of the first realtime data stream type;

and

for each particular one of the respective zones, the administering comprises administering realtime data stream connections between respective ones of the network nodes that have sources of the first realtime data stream type and are associated with objects located in the particular zone and respective ones of the network nodes that have sinks of the first realtime data stream type and are associated with objects located in the particular zone.

38. The method of claim 7, wherein the administering comprises identifying ones of the objects that are associated with sources of the first realtime data stream type, present in the first zone, and associated with a particular role, and administering connections between the network nodes associated with the identified objects and respective ones of the network nodes that have sinks of the first realtime data stream type in the second zone.

39. The method of claim 7, wherein the administering comprises prioritizing connections of sources of the first realtime data stream type that are associated with the first zone with sinks of the first realtime data stream type that are associated with the second zone in relation to other connections between sources and sinks that are associated with the virtual area based on a respective stream priority attribute value associated with at least one of the first zone and the second zone.

40. A method, comprising:

administering one or more real-time data stream connections between network nodes associated with respective objects based on a virtual area specification defining a spatial model of a virtual area comprising a spatial arrangement of stationary geometric elements, zones of the virtual area, and a switching rule associated with a first one of the zones of the virtual area, wherein the switching rule designates the first zone as a source zone, designates a second one of the zones as a sink zone, and defines a respective instruction to automatically connect sources of a respective realtime data stream type associated with one or more objects in the first zone with sinks of the respective realtime data stream type associated with one or more objects in the second zone;

wherein each of the first and second zones is associated with a different respective geometric boundary that is fixed in relation to the stationary geometric elements of the virtual area, each of the objects is associated with at least one of a source and a sink of one or more real-time data stream types, and the administering is based on the switching rule, the respective sources and sinks associated with the objects, and the respective zones of the virtual area in which the objects are located;

wherein the administering comprises, in response to entry of a given object associated with a source of the first real-time data stream type into the first zone, automatically connecting the source associated with the given object with a sink of the first real-time data stream type that is associated with an object in the second zone;

wherein the administering further comprises managing connections of sources of the respective realtime data stream type that are associated with the first zone with sinks of the respective realtime data stream type that are associated with the second zone based on a specified network routing topology that is selected from a set comprising a peer-to-peer routing topology and a direct routing topology and is associated with at least one of the first zone and the second zone.

41. The method of claim 40, wherein the specified routing topology is the server-mediated routing topology, and the administering comprises directing the managed connections over server-mediated network links.

42. The method of claim 40, wherein the specified routing topology is the direct routing topology, and the administering comprises directing the managed connections over peer-to-peer network links.

43. The method of claim 40, wherein the administering comprises managing allocation of bandwidth to connections of sources of the respective realtime data stream type in the first zone with sinks of the respective realtime data stream type in the second zone based on a bandwidth attribute value associated with at least one of the first zone and the second zone.

44. The method of claim 43, wherein the bandwidth attribute value identifies a preferred bandwidth level, and the administering comprises attempting to allocate the preferred bandwidth level to the managed connections.

45. The method of claim 43, wherein the bandwidth attribute value identifies a minimum bandwidth level, and the administering comprises allocating no less than the minimum bandwidth level to the managed connections.

46. Apparatus, comprising:

a memory storing processor-readable instructions; and

a processor coupled to the memory, operable to execute the instructions, and based at least in part on the execution of the instructions operable to perform operations comprising

administering one or more real-time data stream connections between network nodes associated with respective objects based on a virtual area specification defining a spatial model of a virtual area comprising a spatial arrangement of stationary geometric elements, zones comprising respective boundaries that are fixed in relation to the stationary geometric elements, and a switching rule associated with a first one of the zones of the virtual area, wherein the switching rule designates the first zone as a source zone, designates a second one of the zones as a sink zone, and defines a respective instruction to automatically connect sources of a respective realtime data stream type associated with objects in the first zone with sinks of the respective realtime data stream type associated with objects in the second zone, wherein the first zone and the second zone are different zones;

wherein the administering comprises, in response to entry of a first object associated with a source of the first real-time data stream type into the first zone, automatically connecting the source associated with the first object with a sink of the first real-time data stream type that is associated with a second object in the second zone;

wherein each of the objects is associated with at least one of a source and a sink of one or more real-time data stream types, and the administering is based on the switching rule, the respective sources and sinks associated with the objects, and the respective zones of the virtual area in which the objects are located.

47. At least one non-transitory computer-readable medium having processor-readable program code embodied therein, the processor-readable program code adapted to be executed by a processor to perform operations comprising:

administering one or more real-time data stream connections between network nodes associated with respective objects based on a virtual area specification defining a spatial model of a virtual area comprising a spatial arrangement of stationary geometric elements, zones comprising respective boundaries that are fixed in relation to the stationary geometric elements, and a switching rule associated with a first one of the zones of the virtual area, wherein the switching rule designates the first zone as a source zone, designates a second one of the zones as a sink zone, and defines a respective instruction to automatically connect sources of a respective realtime data stream type associated with objects in the first zone with sinks of the respective realtime data stream type associated with objects in the second zone, wherein the first zone and the second zone are different zones;

wherein the administering comprises, in response to entry of a first object associated with a source of the first real-time data stream type into the first zone, automatically connecting the source associated with the first object with a sink of the first real-time data stream type that is associated with a second object in the second zone;

wherein each of the objects is associated with at least one of a source and a sink of one or more real-time data stream types, and the administering is based on the switching rule, the respective sources and sinks associated with the objects, and the respective zones of the virtual area in which the objects are located.

48. A method, comprising:

administering, by a computer system, one or more real-time data stream connections between first and second network nodes respectively associated with first and second objects in a virtual area having a spatial visualization and comprising a spatial arrangement of stationary visual geometric elements, first and second zones comprising different respective boundaries that are fixed in relation to the stationary visual geometric elements, and a switching rule that is associated with a first one of the zones of the virtual area, designates the first zone as a source zone for a realtime data stream type, and designates the second zone as a sink zone for the realtime data stream type;

wherein each of the first and second network nodes respectively has a source and a sink of the realtime data stream type and is associated with a respective object in a respective one of the zones of the virtual area;

wherein the administering comprises administering connections between sources of ones of the network nodes associated with respective objects in the first zone and outside the second zone and sinks of respective ones of the network nodes associated with respective objects in the second zone and outside the first zone, wherein the administering comprises by the computer system, responding to entry of the first object into the first zone while the second object is in the second zone by automatically connecting the source of the first network node with a sink of the second network node based on the switching rule and the respective locations of the first and second objects in the first and second zones of the virtual area.