Peer-to-peer multi-party voice-over-IP services

• US 7,849,138 B2
• Filed: 02/27/2008
• Issued: 12/07/2010
• Est. Priority Date: 03/10/2006
• Status: Active Grant

• Current Assignee: Meta Platforms, Inc. (f/k/a Facebook, Inc.)
• Original Assignee: International Business Machines Corporation
• Inventors: Shae, Zon-Yin, Yu, Philip S., Gu, Xiaohui, Wen, Zhen
• Primary Examiner(s): Bruckart; Benjamin R
• Assistant Examiner(s): BEHARRY, NOEL R
• Application Number:
  US12/038,386
• Publication Number:
  US 20080177833A1
• Time in Patent Office: 1,014 Days
• Field of Search: 709/205, 709/252, 370/261
• US Class Current: 709/205
• CPC Class Codes: H04L 12/1818 Conference organisation arrangements, e.g. handling schedules, setting up parameters needed by nodes to attend a conference, booking network resources, notifying involved parties
• CPC Class Codes: H04L 45/16 Multipoint routing
• CPC Class Codes: H04L 45/48 Routing tree calculation

Abstract

A system and computer program product for establishing multi-party VoIP conference audio calls in a distributed, peer-to-peer network where any number of nodes are able to arbitrarily and asynchronously start or stop producing audio output to be mixed into a single composite audio stream that is distributed to all nodes. A single distribution tree is used that has optimal communications characteristics to distribute the composite audio signal to all nodes. An audio mixing tree is established and maintained by adaptively and dynamically adding and merging intermediate mixing nodes operating between user nodes and the root of the single distribution tree. The intermediate mixing nodes and the root of the single distribution tree are all hosted, in an exemplary embodiment, on user nodes that are endpoints of the distribution tree.

Claims

1. A peer-to-peer processing node for participating in multi-party voice-over-IP services, the peer-to-peer processing node comprising:

a host node;

a distribution tree processor operating on the host node that;

establishes overlay mesh connections from the host node to a plurality of participating nodes, wherein a subset of the participating nodes are originating nodes that provide a respective audio stream output received by a root mixing node to produce the composite audio signal;

constructs a local distribution tree to broadcast a composite audio signal from the host node to every other node within the participating nodes

determines a local performance characteristic for the local distribution tree;

receives, from each of the participating nodes, a respective performance characteristic for each respective distribution tree rooted at the each node within the participating nodes;

performs an election protocol based upon the local performance characteristics and the respective performance characteristic for each respective distribution tree to determine a selected root mixing node operating in one of the participating nodes; and

determines a selected distribution tree that is rooted at the selected root mixing node to distribute the composite audio signal;

a mixing tree processor operating on the host node that;

identifies, independently of the selected distribution tree, a first intermediate mixing node from within the plurality of participating nodes, the first intermediate mixing node being identified based upon characteristics of data transmission from the first intermediate mixing node to the selected root mixing node and based upon characteristics of data transmission from each originating node within a first subset of originating nodes to the first intermediate mixing node; and

a mixer operating on the host node, that;

accepts, in response to the mixing tree processor identifying the host node as the first intermediate mixing node, respective audio stream outputs provided by the first subset of originating node; and

provides to the root mixing node a mixing of the respective audio stream outputs provided by the first subset of originating nodes.

2. The peer-to-peer processing node of claim 1, further comprising:

a responder that transmits a response to a request, received from a remote peer-to-peer processing node, to become a participating node, and

wherein the mixing tree processor further;

accepts a received request from a new processing node to become a participating node, wherein the new processing node has been added to the overlay mesh connections and the request is broadcast to at least a portion of the participating nodes, and

assigns the destination of a new audio stream produced by the new processing node to be a parent mixing node of a participating node that first responds to the received request, and

wherein the distribution tree processor adds, in response to the mixing tree processor accepting the request, the new processing node to the selected distribution tree.

3. The peer-to-peer processing node of claim 1, wherein the root mixing node directly receives at least one of audio stream output from a second subset of originating nodes within the participating nodes, the peer-to-peer processing node further comprising:

a mixing load monitor that monitors a processing load on the root mixing node;

wherein the mixing tree processor further;

identifies, in response to an increase in the processing load on the root mixing node monitored by the mixing load monitor and independently of the distribution tree, a second intermediate mixing node from the at least one neighbor; and

assigns, in response to the identification of the second intermediate mixing node, the second subset of originating nodes to the second intermediate mixing node and configures the second intermediate mixing node to provide a mixing of the at least one audio stream outputs from the second subset to the root mixing node.

4. The peer-to-peer processing node of claim 1, further comprising:

a mixing load monitor that monitors a mixing processing load of the mixer and a mixing processing load of at least one neighbor node within the participating nodes, and

wherein the mixing tree processor further;

identifies, in response to an increase in the processing load monitored by the mixing load monitor and independently of the distribution tree, a second intermediate mixing node from the at least one neighbor, and

assigns, in response to the identification of the second intermediate mixing node, a portion of the first subset of originating nodes to the second intermediate mixing node and configures the second intermediate mixing node to provide a mixing of the portion of the first subset of originating nodes to a parent mixing node of the first intermediate mixing node.

5. The peer-to-peer processing node of claim 4, wherein

the mixing load monitor further determines that the combined processing load on the first intermediate mixing node and the second intermediate mixing node are below a pre-determined threshold, and

wherein the mixing tree processor further assigns, in response to the determining by the mixing load monitor that the combined processing load on the first intermediate mixing node and the second intermediate mixing node are below a pre-determined threshold, all originating nodes that are assigned to the second intermediate mixing node to the first intermediate mixing node.

6. The peer-to-peer processing node of claim 4, wherein the mixing tree processor further determines an initiation, at a non-originating node within the participating nodes, of a production of an additional audio stream to be delivered to the first intermediate mixing node for inclusion in the mixing, and wherein the increase in the processing load is a result of the initiating the production of the additional audio stream.

7. The peer-to-peer processing node of claim 1, wherein the mixing tree processor further identifies, independently of the distribution tree, a backup intermediate mixing node from within the plurality of participating nodes, the peer-to-peer processing node further comprising:

a primary mixing monitor that monitors, at the backup intermediate mixing node, a first status of the first intermediate mixing node; and

a child node controller that assigns, in response to the first status, the first subset of originating nodes to the backup intermediate mixing node, thereby causing the backup intermediate mixing node to provide a mixing of respective audio stream outputs provided by the first subset of originating nodes to the root mixing node.

8. The peer-to-peer processing node of claim 7, wherein the primary mixing monitor comprises a heartbeat monitor that monitors the first status by receiving a repetitive heartbeat message from the first mixing node, and

wherein the child node controller assigns in response to a failure to receive the repetitive heartbeat message.

9. The peer-to-peer processing node of claim 7, wherein the first intermediate mixing node provides the mixing of respective audio stream outputs to the root mixing node by data communications through at least one higher level mixing nodes, wherein the mixing tree processor further:

identifies a number of additional backup intermediate mixing nodes, the number of additional backup mixing nodes being dependent upon a number of the at least one higher level mixing nodes through which the mixing is communicated from the first intermediate mixing node to reach the root mixing node.

10. A method of providing multi-party voice-over-IP services, the method comprising:

establishing, with a processor, overlay mesh connections from a host node to a plurality of participating nodes, wherein a subset of the participating nodes are originating nodes that provide a respective audio stream output received by a root mixing node to be mixed into a composite audio signal;

constructing, with the processor, a local distribution tree to broadcast an audio signal from the host node to every other node within the participating nodes determining, with the processor, a local performance characteristic for the local distribution tree;

receiving, with the processor from each of the participating nodes, a respective performance characteristic for each respective distribution tree rooted at the each node within the participating nodes;

performing, with the processor, an election protocol based upon the local performance characteristics and the respective performance characteristic for each respective distribution tree to determine a selected root mixing node operating in one of the participating nodes;

determining a selected distribution tree that is rooted at the selected root mixing node to distribute the composite audio signal;

identifying, with the processor independently of the selected distribution tree, a first intermediate mixing node from within the plurality of participating nodes, the first intermediate mixing node being identified based upon characteristics of data transmission from the first intermediate mixing node to the selected root mixing node and based upon characteristics of data transmission from each originating node within a first subset of originating nodes to the first intermediate mixing node; and

accepting at the host node, with the processor in response to the mixing tree processor identifying the host node as the first intermediate mixing node, respective audio stream outputs provided by the first subset of originating node; and

providing, with the processor, to the root mixing node a mixing of the respective audio stream outputs provided by the first subset of originating nodes.

11. The method of claim 10, further comprising:

accepting a request from a new processing node to become a participating node, wherein the new processing node has been added to the overlay mesh connections and the request is broadcast to at least a portion of the participating nodes;

adding, in response to the request, the new processing node to the selected distribution tree;

transmitting, by a first responder from within the participating nodes, a response to the request; and

assigning the destination of a new audio stream produced by the new processing node to be a parent mixing node of the first responder.

12. A computer program product for providing multi-party voice-over-IP services, the computer program product comprising:

a non-transitory storage medium readable by a processing circuit and storing computer instructions for execution by the processing circuit for performing a method comprising;

establishing, with a processor, overlay mesh connections from a host node to a plurality of participating nodes, wherein a subset of the participating nodes are originating nodes that provide a respective audio stream output received by a root mixing node to be mixed into a composite audio signal;

constructing, with the processor, a local distribution tree to broadcast an audio signal from the host node to every other node within the participating nodes

determining, with the processor, a local performance characteristic for the local distribution tree;

receiving, with the processor from each of the participating nodes, a respective performance characteristic for each respective distribution tree rooted at the each node within the participating nodes;

performing, with the processor, an election protocol based upon the local performance characteristics and the respective performance characteristic for each respective distribution tree to determine a selected root mixing node operating in one of the participating nodes;

determining a selected distribution tree that is rooted at the selected root mixing node to distribute the composite audio signal;

identifying, with the processor independently of the selected distribution tree, a first intermediate mixing node from within the plurality of participating nodes, the first intermediate mixing node being identified based upon characteristics of data transmission from the first intermediate mixing node to the selected root mixing node and based upon characteristics of data transmission from each originating node within a first subset of originating nodes to the first intermediate mixing node; and

accepting at the host node, with the processor in response to the mixing tree processor identifying the host node as the first intermediate mixing node, respective audio stream outputs provided by the first subset of originating node; and

providing, with the processor, to the root mixing node a mixing of the respective audio stream outputs provided by the first subset of originating nodes.

13. The computer program product of claim 12, wherein the method further comprises:

establishing a peer-to-peer distribution tree to broadcast a composite audio signal from a root mixing node to a plurality of participating nodes, wherein a subset of the participating nodes are originating nodes that provide a respective audio stream output received by the root mixing node to produce the composite audio signal;

monitoring a processing load on the first intermediate mixing node and on at least one neighbor node within the participating nodes;

identifying, in response to an increase in the processing load on the first intermediate mixing node and independently of the distribution tree, a second intermediate mixing node from the at least one neighbor;

assigning, in response to the identifying, a portion of the first subset of originating nodes to the second intermediate mixing node and configuring the second intermediate mixing node to provide a mixing of the portion of the first subset of originating nodes to a parent mixing node of the first intermediate mixing node; and

identifying, independently of the peer-to-peer distribution tree, a first intermediate mixing node and a backup intermediate mixing node from within the plurality of participating nodes, the first intermediate mixing node providing to the root mixing node a mixing of respective audio stream outputs provided by a first subset of originating nodes to the first intermediate mixing node.

14. The computer program product of claim 12, wherein the method further comprises:

identifying, independently of the peer-to-peer distribution tree, a backup intermediate mixing node from within the plurality of participating nodes;

monitoring, at the backup intermediate mixing node, a first status of the first intermediate mixing node; and

assigning, in response to the first status, the first subset of originating nodes to the backup intermediate mixing node, thereby causing the backup intermediate mixing node to provide a mixing of respective audio stream outputs provided by the first subset of originating nodes to the root mixing node.

15. The computer program product of claim 14, wherein the monitoring the first status comprises receiving a repetitive heartbeat message from the first mixing node, and wherein the assigning is performed in response to a failure to receive the repetitive heartbeat message.

16. The computer program product of claim 14, wherein the first intermediate mixing node provides the mixing of respective audio stream outputs to the root mixing node by data communications through at least one higher level mixing nodes, the method further comprising:

identifying a number of additional backup intermediate mixing nodes, the number of additional backup mixing nodes being dependent upon a number of the at least one higher level mixing nodes through which the mixing is communicated from the first intermediate mixing node to reach the root mixing node.

17. The computer program product of claim 12, wherein the method further comprises:

monitoring a processing load on the first intermediate mixing node and on at least one neighbor node within the participating nodes;

identifying, in response to an increase in the processing load on the first intermediate mixing node and independently of the distribution tree, a second intermediate mixing node from the at least one neighbor; and

assigning, in response to the identifying, a portion of the first subset of originating nodes to the second intermediate mixing node and configuring the second intermediate mixing node to provide a mixing of the portion of the first subset of originating nodes to a parent mixing node of the first intermediate mixing node.

18. The computer program product of claim 17, wherein the method further comprises determining an initiation, at a non-originating node within the participating nodes, of a production of an additional audio stream to be delivered to the first intermediate mixing node for inclusion in the mixing, and wherein the increase in the processing load is a result of the initiating the production of the additional audio stream.

19. The computer program product of claim 17, wherein the method further comprises:

determining that the combined processing load on the first intermediate mixing node and the second intermediate mixing node each are below a pre-determined threshold; and

assigning, in response to the determining that the combined processing load on the first intermediate mixing node and the second intermediate mixing node are below a pre-determined threshold, all originating nodes that are assigned to the second intermediate mixing node to the first intermediate mixing node.

20. The computer program product of claim 12, wherein the method further comprises:

accepting a request from a new processing node to become a participating node, wherein the new processing node has been added to the overlay mesh connections and the request is broadcast to at least a portion of the participating nodes;

adding, in response to the request, the new processing node to the peer-to-peer distribution tree;

transmitting, by a first responder from within the participating nodes, a response to the request; and

assigning the destination of a new audio stream produced by the new processing node to be a parent mixing node of the first responder.