Automated real-time data stream switching in a shared virtual area communication environment

• US 10,659,511 B2
• Filed: 09/12/2017
• Issued: 05/19/2020
• Est. Priority Date: 10/24/2007
• Status: Active Grant

• Current Assignee: Sococo, Inc.
• Original Assignee: Sococo, Inc.
• Inventors: Van Wie, David, Brody, Paul J.
• Primary Examiner(s): Fibbi, Christopher J
• Application Number:
  US15/702,665
• Publication Number:
  US 20180020032A1
• Time in Patent Office: 980 Days
• Field of Search: None
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
• CPC Class Codes: H04L 12/1822 Conducting the conference, e.g. admission, detection, selection or grouping of participants, correlating users to one or more conference sessions, prioritising transmission
• CPC Class Codes: H04L 12/1827 Network arrangements for conference optimisation or adaptation
• CPC Class Codes: H04L 65/765 intermediate
• CPC Class Codes: H04L 67/131 Protocols for games, networked simulations or virtual reality

Abstract

Switching real-time data stream connections between network nodes sharing a virtual area is described. In one aspect, the switching involves storing a virtual area specification. The virtual area specification includes a description of one or more switching rules each defining a respective connection between sources of a respective real-time data stream type and sinks of the real-time data stream type in terms of positions in the virtual area. Real-time data stream connections are established between network nodes associated with respective objects each of which is associated with at least one of a source and a sink of one or more of the real-time data stream types. The real-time data stream connections are established based on the one or more switching rules, the respective sources and sinks associated with the objects, and respective positions of the objects in the virtual area.

Claims

1. A method of connecting network nodes associated with respective objects in a virtual area comprising:

by computer apparatus, sending to the network nodes computer readable instructions for establishing one or more real-time data stream connections between the network nodes according to a virtual area specification comprising a description of a spatial layout of zones that are fixed in relation to geometric elements of the virtual area, wherein each of the zones is associated with a different respective zone boundary in the virtual area and a respective switching rule, and each switching rule specifies a stream connection between sources of a respective real-time data stream type within the zone boundary of a respective designated source one of the zones and sinks of the respective real-time data stream type within the boundary of a respective designated sink one of the zones; and

wherein execution of the instructions causes the network nodes to perform operations comprising, for each switching rule, establishing a respective stream connection for streaming the respective real-time data stream type between (i) a first one of the network nodes that is associated with an object within the zone boundary of the respective designated source zone and (ii) a second one of the network nodes that is associated with an object within the geometric boundary of the respective designated sink zone.

2. The method of claim 1, wherein the establishing comprises ascertaining the positions of the objects in relation to the respective zone boundary of each of one or more of the zones.

3. The method of claim 2, wherein the establishing comprises determining a target set of real-time data stream types that one or more of the switching rules associate with one or more of the zones that are occupied by a given one of the objects.

4. The method of claim 3, wherein the establishing comprises:

ascertaining ones of the objects excluding the given object that are contained in one or more zones from which ones of the real-time data stream types in the target set are sourced and into which ones of the real-time data stream types in the target set are sunk as defined by the one or more switching rules;

determining a connectable set of real-time data streams each of which is at least one of (i) sourced from one or more of the network nodes that are associated with the ascertained objects and (ii) sunk into one or more of the network nodes that are associated with the ascertained objects; and

determining a set of required real-time data stream data based on a matching of sources and sinks that are associated with the connectable set of real-time data streams.

5. The method of claim 1, wherein at least one of the switching rules associates a respective source role identifier with a given one of the real-time data stream types, and the establishing comprises establishing one or more of the real-time data stream connections based on a comparison of the source role identifier with role identifiers respectively associated with one or more of the objects associated with sources of the given real-time data stream type.

6. The method of claim 1, wherein at least one of the one or more switching rules associates a respective sink role identifier with a given one of the real-time data stream types, and the administering comprises administering one or more of the real-time data stream connections based on a comparison of the sink role identifier with role identifiers respectively associated with one or more of the objects associated with sinks of the given real-time data stream type.

7. The method of claim 1, wherein the respective designated source zone and the respective designated sink zone specified in at least one of the switching rules are different zones.

8. The method of claim 1, wherein the respective designated source zone and the respective designated sink zone specified in at least one of the switching rules are the same zone.

9. The method of claim 1, wherein the objects represent respective communicants in the virtual area.

10. The method of claim 1, further comprising, by the computer apparatus, transmitting to the first and second network nodes data for establishing the one or more real-time data stream connections between the first and second network nodes.

11. The method of claim 1, wherein the respective zone boundary of the respective one of the zones is defined by referencing a respective one of the geometry elements that defines a respective geometric shape in the virtual area.

12. The method of claim 1, wherein the establishing comprises selecting a stream handling topology from a set of stream handling topologies comprising:

a first stream handling topology in accordance with which data of at least one real-time data stream type is streamed between the first and second network nodes peer-to-peer; and

a second stream handling topology in accordance with which data of the at least one real-time data stream type is streamed through an intermediate network node configured to receive streams of the at least one respective real-time data stream type from the first and second network nodes, generate a stream mix from the received streams, and transmit the stream mix to one or more of the network nodes associated with objects in the virtual area.

13. The method of claim 12, wherein the selecting comprises selecting between the first stream handling topology and the second stream handling topology based on occurrence of an event.

14. The method of claim 13, wherein the event comprises a change in a count of the network nodes associated with objects in the virtual area.

15. The method of claim 13, wherein the event comprises reaching a bandwidth constraint of one or more of the network nodes.

16. The method of claim 12, wherein the selecting comprises maximizing a count of unmixed real-time data streams received by the network nodes that are associated with objects in the virtual area.

17. Apparatus for connecting network nodes associated with respective objects in a virtual area, comprising:

non-transitory memory storing processor-readable instructions, and

a processor coupled to the memory, operable to execute the instructions, and based at least in part on the execution of the instructions operable to perform operations comprising;

sending to the network nodes computer readable instructions for establishing one or more real-time data stream connections between the network nodes according to a virtual area specification comprising a description of a spatial layout of zones that are fixed in relation to geometric elements of the virtual area, wherein each of the zones is associated with a different respective zone boundary in the virtual area and a respective switching rule, and each switching rule specifies a stream connection between sources of a respective real-time data stream type within the zone boundary of a respective designated sink one of the zones; and

wherein execution of the instructions causes the network nodes to perform operations comprising, for each switching rule, establishing a respective stream connection for streaming the respective real-time data stream type between (i) a first one of the network nodes that is associated with an object within the zone boundary of the respective designated source zone and (ii) a second one of the network nodes that is associated with an object within the geometric boundary of the respective designated sink zone.

18. At least one, non-transitory computer-readable medium comprising computing instructions for connecting network nodes associated with respective objects in a virtual area, the computing instructions comprising:

a code segment to send to the network nodes computer readable instructions for establishing one or more real-time data stream connections between the network nodes according to a virtual area specification comprising a description of a s spatial layout of zones that are fixed in relation to geometric elements of the virtual area, wherein each of the zones is associated with a different respective zone boundary in the virtual area and a respective switching rule, and each switching rule specifies a stream connection between sources of a respective real-time data stream type within the zone boundary of a respective designated source one of the zones and sinks of the respective real-time data stream type within the zone boundary of a respective designated sink one of the zones; and

wherein execution of the instructions causes the network nodes to perform operations comprising, for each switching rule, establishing a respective stream connection for streaming the respective real-time data stream type between (i) a first one of the network nodes that is associated with an object within the zone boundary of the respective designated source zone and (ii) a second one of the network nodes that is associated with an object within the geometric boundary of the respective designated sink zone.