Automated real-time data stream switching in a shared virtual area communication environment

• US 8,578,044 B2
• Filed: 06/18/2010
• Issued: 11/05/2013
• Est. Priority Date: 10/24/2007
• Status: Active Grant

• Current Assignee: Sococo, Inc.
• Original Assignee: Social Communications Company
• Inventors: Van Wie, David, Brody, Paul J.
• Primary Examiner(s): SALL, EL HADJI MALICK
• Application Number:
  US12/818,517
• Publication Number:
  US 20100268843A1
• Time in Patent Office: 1,236 Days
• Field of Search: 709/203, 709/200, 709/231, 715/706
• US Class Current: 709/231
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
• CPC Class Codes: H04L 12/1822 Conducting the conference, e.g. admission, detection, selection or grouping of participants, correlating users to one or more conference sessions, prioritising transmission
• CPC Class Codes: H04L 12/1827 Network arrangements for conference optimisation or adaptation
• CPC Class Codes: H04L 65/765 intermediate
• CPC Class Codes: H04L 67/131 Protocols for games, networked simulations or virtual reality

Abstract

Switching real-time data stream connections between network nodes sharing a virtual area is described. In one aspect, the switching involves storing a virtual area specification. The virtual area specification includes a description of one or more switching rules each defining a respective connection between sources of a respective real-time data stream type and sinks of the real-time data stream type in terms of positions in the virtual area. Real-time data stream connections are established between network nodes associated with respective objects each of which is associated with at least one of a source and a sink of one or more of the real-time data stream types. The real-time data stream connections are established based on the one or more switching rules, the respective sources and sinks associated with the objects, and respective positions of the objects in the virtual area.

Claims

1. A method of switching real-time data stream connections between network nodes represented by respective objects in a virtual area, comprising by a computer:

storing a description of one or more switching rules each defining a respective connection between sources of a respective real-time data stream type and sinks of the real-time data stream type in terms of positions in the virtual area;

for each of the network nodes determining one or more real-time data stream connections between respective ones of the network nodes based on the one or more switching rules, respective sources and sinks of the real-time data stream types that are respectively associated with the objects, and respective positions of the objects in the virtual area; and

transmitting to the respective ones of the network nodes information for establishing the one or more real-time data stream connections.

2. The method of claim 1, wherein:

The storing comprises storing a description of one or more zones in the virtual area;

the one or more switching rules associate with one or more of the zones (i) a respective real-time data stream type that is sourced from the zone and (ii) a respective one of the zones into which the respective real-time data stream type is sunk; and

the determining comprises ascertaining the positions of the first and second objects in relation to one or more of the zones, and determining the one or more real-time data stream connections based on the ascertained positions.

3. The method of claim 1, wherein at least one of the switching rules associates a respective source role identifier with sources of a given one of the real-time data stream types, and the determining comprises determining one or more of the real-time data stream connections based on a comparison of the source role identifier with user role identifiers respectively associated with one or more of the objects associated with sources of the given real-time data stream type.

4. The method of claim 1, wherein at least one of the switching rules associates a respective sink role identifier with sinks of a given one of the real-time data stream types, and the determining comprises determining one or more of the real-time data stream connections based on a comparison of the sink role identifier with user role identifiers respectively associated with one or more of the objects associated with sinks of the real-time data stream type.

5. The method of claim 1, wherein the determining additionally is based on at least one proximity policy rule that only allows connections of ones of the sources with compatible ones of the sinks that are associated with respective objects that are within a prescribed distance of each other in the virtual area.

6. The method of claim 1, wherein the storing comprises storing a description of one or more respective bandwidth levels assigned to each of one or more real-time data stream types, the establishing comprises creating the one or more real-time data stream connections through respective links, each of the links has a respective link bandwidth and carries a respective transmission set of one or more real-time data streams, and the creating is based on the one or more bandwidth levels respectively assigned to the one or more real-time data stream types by the virtual area specification.

22. The method of claim 1, wherein at least one of the one or more switching rules defines the respective connection between sources of a respective real-time data stream type and sinks of the real-time data stream type in terms of position in a multi-dimensional coordinate system.

23. The method of claim 22, wherein the determining is based on respective positions of the objects defined with respect to the multi-dimensional coordinate system.

24. The method of claim 1, wherein the objects are avatars that represent respective communicants in the virtual area.

25. The method of claim 1, wherein:

the storing comprises storing a description of zones in the virtual area;

the switching rules associate with each of the zones (i) a respective real-time data stream type that is sourced from the zone and (ii) a respective one of the zones into which the respective real-time data stream type is sunk; and

the determining comprises ascertaining the positions of the first and second objects in relation to the zones, and determining the one or more real-time data stream connections based on the ascertained positions.

26. The method of claim 1, wherein the storing comprises storing a description of a first switching rule that defines a respective connection between sources of a first real-time data stream type and sinks of the first real-time data stream type and a description of a second switching rule that defines a respective connection between sources of a second real-time data stream type and sinks of the second real-time data stream type, and the first and second real-time data stream types are different.

27. The method of claim 26, wherein the determining comprises determining real-time data streams of the first and second real-time data stream types between respective ones of the network nodes based on the positions of the respective objects associated with the first and second real-time data stream types in the virtual area.

7. Apparatus for switching real-time data stream connections between network nodes represented by respective objects in a virtual area, comprising:

a non-transitory computer readable memory storing a description of one or more switching rules each defining a respective connection between sources of a respective real-time data stream type and sinks of the real-time data stream type in terms of positions in the virtual area; and

a processing unit that, for each of the network nodes, performs operations comprising

determining one or more real-time data stream connections between respective ones of the network nodes based on the one or more switching rules, respective sources and sinks of the real-time data stream types that are respectively associated with the objects, and respective positions of the objects in the virtual area, and

transmitting to the respective ones of the network nodes information for establishing the one or more real-time data stream connections.

8. The apparatus of claim 7, wherein:

the non-transitory computer readable memory stores a description of one or more zones in the virtual area;

the one or more switching rules associate with one or more of the zones (i) a respective real-time data stream type that is sourced from the zone and (ii) a respective one of the zones into which the respective real-time data stream type is sunk; and

the processing unit is operable to ascertain the positions of the first and second objects in relation to one or more of the zones and determining the one or more real-time data stream connections based on the ascertained positions.

9. The apparatus of claim 7, wherein at least one of the switching rules associates a respective role identifier with a given one of the real-time data stream types, and the processing unit determining one or more of the real-time data stream connections based on a comparison of the role identifier with role identifiers respectively associated with one or more of the objects associated with at least one of (i) sources of the given real-time data stream type and (ii) sinks of the given real-time data stream types.

10. A network switch for switching real-time data stream connections between network nodes represented by respective objects in a virtual area, comprising:

a non-transitory computer readable memory storing

a description of one or more switching rules each defining a respective connection between sources of a respective real-time data stream type and sinks of the real-time data stream type in terms of positions in the virtual area, and

a table comprising network topology information describing routes to network destinations; and

a processing unit that, for each of the network nodes, performs operations comprising

determining one or more real-time data stream connections between respective ones of the network nodes based on the one or more switching rules, respective sources and sinks of the real-time data stream types that are respectively associated with the objects, respective positions of the objects in the virtual area, and the network topology information, and

transmitting to the respective ones of the network nodes information for establishing the one or more real-time data stream connections.

11. The network switch of claim 10, wherein the determining comprises determining a real-time data stream handling topology that delivers a specified set of real-time data stream data to a given one of the network nodes, wherein in determining the real-time data stream handling topology the processing unit discovers the bandwidth capabilities of one or more of the given network node and the other network nodes associated with objects in the virtual area and selects the stream handling topology based on the discovered bandwidth capabilities.

12. The network switch of claim 10, wherein:

the transitory computer readable memory stores a description of zones in the virtual area;

the switching rules associate with each of the zones (i) a respective real-time data stream type that is sourced from the zone and (ii) a respective one of the zones into which the respective real-time data stream type is sunk; and

the determining comprises ascertaining the positions of the first and second objects in relation to the zones, and determining one or more real-time data stream connections between respective ones of the network nodes based on the ascertained positions.

13. The network switch of claim 10, wherein at least one of the switching rules associates a respective source role identifier with sources of a given one of the real-time data stream types, and the determining comprises determining real-time data stream connections between respective ones of the network nodes based on a comparison of the source role identifier with user role identifiers respectively associated with one or more of the objects associated with sources of the given real-time data stream type.

14. The network switch of claim 10, wherein at least one of the switching rules associates a respective sink role identifier with sinks of a given one of the real-time data stream types, and the determining comprises determining real-time data stream connections between respective ones of the network nodes based on a comparison of the sink role identifier with user role identifiers respectively associated with one or more of the objects associated with sinks of the real-time data stream type.

15. The network switch of claim 10, wherein the virtual area specification assigns different bandwidth levels to respective real-time data stream types, the determining comprises determining real-time data stream connections between respective ones of the network nodes through respective links, each of the links has a respective link bandwidth and carries a respective transmission set of one or more real-time data streams, and the determining of the real-time data stream connections is based on the different bandwidth levels respectively assigned to the one or more real-time data stream types by the virtual area specification.

16. The network switch of claim 10, wherein the transmitting comprises:

from the network switch to each of respective ones of the network nodes, transmitting data for establishing real-time data stream connections between respective ones of the network nodes.

17. The network switch of claim 10, wherein at least one of the one or more switching rules defines the respective connection between sources of a respective real-time data stream type and sinks of the real-time data stream type in terms of position in a multi-dimensional coordinate system.

18. The network switch of claim 17, wherein the determining comprises determining the real-time data stream connections between respective ones of the network nodes based on respective positions of the objects defined with respect to the multi-dimensional coordinate system.

19. The network switch of claim 10, wherein the objects are avatars that represent respective communicants in the virtual area.

20. The network switch of claim 10, wherein the non-transitory computer readable memory stores a description of a first switching rule that defines a respective connection between sources of a first real-time data stream type and sinks of the first real-time data stream type and a description of a second switching rule that defines a respective connection between sources of a second real-time data stream type and sinks of the second real-time data stream type, and the first and second real-time data stream types are different.

21. The network switch of claim 20, wherein the determining comprises determining connections for streaming real-time data streams of the first and second real-time data stream types between respective ones of the network nodes based on positions of the respective objects associated with the first and second real-time data stream types in the virtual area.

28. A method of switching real-time data stream connections between first and second network nodes respectively represented by first and second objects in a virtual area, comprising by the first network node:

determining one or more switching rules each defining a respective connection between sources of a respective real-time data stream type and sinks of the real-time data stream type in terms of positions in a virtual area;

ascertaining one or more real-time data stream connections between the first and second network nodes based on the one or more switching rules, respective sources and sinks of the real-time data stream types that are respectively associated with the objects, and respective positions of the objects in the virtual area; and

establishing the one or more real-time data stream connections with the second network node.

29. The method of claim 28, further comprising:

from the first network node to the second network node, transmitting data for establishing the one or more real-time data stream connections between the first network node and a second one of the network nodes.

30. The method of claim 28, wherein:

The determining comprises determining a description of zones in the virtual area;

the switching rules associate with each of the zones (i) a respective real-time data stream type that is sourced from the zone and (ii) a respective one of the zones into which the respective real-time data stream type is sunk; and

the ascertaining comprises ascertaining the positions of the first and second objects in relation to the zones, and determining the one or more real-time data stream connections based on the ascertained positions.

31. The method of claim 28, wherein at least one of the switching rules associates a respective source role identifier with sources of a given one of the real-time data stream types, and the ascertaining comprises determining one or more of the real-time data stream connections based on a comparison of the source role identifier with user role identifiers respectively associated with one or more of the objects associated with sources of the given real-time data stream type.

32. The method of claim 28, wherein at least one of the switching rules associates a respective sink role identifier with sinks of a given one of the real-time data stream types, and the ascertaining comprises determining one or more of the real-time data stream connections based on a comparison of the sink role identifier with user role identifiers respectively associated with one or more of the objects associated with sinks of the real-time data stream type.

33. The method of claim 28, wherein the ascertaining additionally is based on at least one proximity policy rule that only allows connections of ones of the sources with compatible ones of the sinks that are associated with respective objects that are within a prescribed distance of each other in the virtual area.

34. The method of claim 28, wherein the wherein the determining comprises determining different bandwidth levels assigned to respective real-time data stream types, the ascertaining comprises ascertaining real-time data stream connections between respective ones of the network nodes through respective links, each of the links has a respective link bandwidth and carries a respective transmission set of one or more real-time data streams, and the ascertaining of the one or more real-time data stream connections is based on the different bandwidth levels respectively assigned to real-time data stream types by the virtual area specification.

35. The method of claim 28, wherein at least one of the one or more switching rules defines the respective connection between sources of a respective real-time data stream type and sinks of the real-time data stream type in terms of position in a multi-dimensional coordinate system.

36. The method of claim 35, wherein the ascertaining of the one or more real-time data stream connections is based on respective positions of the objects defined with respect to the multi-dimensional coordinate system.

37. The method of claim 28, wherein the objects are avatars that represent respective communicants in the virtual area.

38. The method of claim 28, wherein the determining comprises determining a first switching rule that defines a respective connection between sources of a first real-time data stream type and sinks of the first real-time data stream type and a second switching rule that defines a respective connection between sources of a second real-time data stream type and sinks of the second real-time data stream type, and the first and second real-time data stream types are different.

39. The method of claim 38, wherein the ascertaining comprises determining respective connections for streaming of real-time data streams of the first and second real-time data stream types between respective ones of the network nodes based on the positions of the respective objects associated with the first and second real-time data stream types in the virtual area.

40. A method of switching real-time data stream connections between first and second network nodes respectively represented by first and second objects in a virtual area, comprising:

by the first network node, receiving from a server network node data for establishing one or more real-time data stream connections between the first network node and the second network node, wherein each of the first and second objects respectively is associated with at least one of a source and a sink of one or more of the real-time data stream types, the data received from the server network node controls switching of the one or more real-time data stream connections by the first network node in accordance with the sources and sinks respectively associated with the first and second objects in the virtual area, respective positions of the first and second objects in the virtual area, and one or more switching rules, and each of the switching rules defines a respective connection between sources of a respective one of the real-time data stream types and sinks of the respective real-time data stream type in terms of positions in the virtual area; and

by the first network node, establishing the one or more real-time data stream connections between the first network node and the second network node based on the data received from the server network node, wherein the establishing is based on the one or more switching rules, the respective sources and sinks associated with the first and second objects, and the respective positions of the first and second objects in the virtual area.

41. The method of claim 40, wherein at least one of the one or more switching rules defines the respective connection between sources of a respective real-time data stream type and sinks of the real-time data stream type in terms of position in a multi-dimensional coordinate system.

42. The method of claim 41, further comprising by the first network node transmitting to the server network node different positions of the first object defined with respect to the multi-dimensional coordinate system, receiving from the server network node switching instructions for establishing the one or more real time data stream connections responsive to the different positions of the first object, and establishing the one or more real-time data stream connections with the second network node based on the received switching instructions.

43. The method of claim 40, wherein the data received from the server network node comprises switching instructions for establishing the one or more real time data stream connections, and the establishing is performed based on the switching instructions.

44. The method of claim 40, wherein the one or more switching rules comprise a first switching rule that defines a respective connection between sources of a first real-time data stream type and sinks of the first real-time data stream type and a second switching rule that defines a respective connection between sources of a second real-time data stream type and sinks of the second real-time data stream type, and the first and second real-time data stream types are different.

45. The method of claim 40, wherein:

the virtual area comprises zones;

the one or more switching rules associate with each of the zones (i) a respective real-time data stream type that is sourced from the zone and (ii) a respective one of the zones into which the respective real-time data stream type is sunk; and

further comprising by the first network node receiving from the server network node data for depicting on a display graphical representations of the first and second objects in relation to the zones in the virtual area.

46. The method of claim 40, wherein the objects are avatars that represent respective communicants in the virtual area.