System and method for peer-to-peer multi-party voice-over-IP services

• US 7,379,450 B2
• Filed: 03/10/2006
• Issued: 05/27/2008
• Est. Priority Date: 03/10/2006
• Status: Active Grant

• Current Assignee: Meta Platforms, Inc. (f/k/a Facebook, Inc.)
• Original Assignee: International Business Machines Corporation
• Inventors: Shae, Zon-Yin, Yu, Philip S., Gu, Xiaohui, Wen, Zhen
• Primary Examiner(s): Tran; Len
• Assistant Examiner(s): NGUYEN, PHUNG HOANG JOSEPH
• Application Number:
  US11/372,634
• Publication Number:
  US 20070211703A1
• Time in Patent Office: 809 Days
• Field of Search: 370/261, 370/356, 370/352, 707/100
• US Class Current: 370/352
• CPC Class Codes: H04L 12/1818 Conference organisation arrangements, e.g. handling schedules, setting up parameters needed by nodes to attend a conference, booking network resources, notifying involved parties
• CPC Class Codes: H04L 45/16 Multipoint routing
• CPC Class Codes: H04L 45/48 Routing tree calculation

Abstract

A system, method, and computer program product for establishing multi-party VoIP conference audio calls in a distributed, peer-to-peer network where any number of nodes are able to arbitrarily and asynchronously start or stop producing audio output to be mixed into a single composite audio stream that is distributed to all nodes. A single distribution tree is used that has optimal communications characteristics to distribute the composite audio signal to all nodes. An audio mixing tree is established and maintained by adaptively and dynamically adding and merging intermediate mixing nodes operating between user nodes and the root of the single distribution tree. The intermediate mixing nodes and the root of the single distribution tree are all hosted, in an exemplary embodiment, on user nodes that are endpoints of the distribution tree.

Claims

1. A method for providing multi-party voice-over-IP services, the method on an information processing system comprising:

establishing a peer-to-peer distribution tree to broadcast a composite audio signal from a root mixing node to a plurality of participating nodes, wherein a subset of the participating nodes are originating nodes that provide a respective audio stream output received by the root mixing node to produce the composite audio signal, wherein the root mixing node directly receives at least one of audio stream output from a second subset of originating nodes within the participating nodes;

identifying, independently of the peer-to-peer distribution tree, a first intermediate mixing node from within the plurality of participating nodes, the first intermediate mixing node providing to the root mixing node a mixing of respective audio stream outputs provided by a first subset of originating nodes to the first intermediate mixing node;

monitoring a processing load on the root mixing node;

identifying, in response to an increase in the processing load on the root mixing node and independently of the distribution tree, a second intermediate mixing node from the at least one neighbor; and

assigning, in response to the identifying the second intermediate mixing node, the second subset of originating nodes to the second intermediate mixing node and configuring the second intermediate mixing node to provide a mixing of the at least one audio stream outputs from the second subset to the root mixing node.

2. The method of claim 1, further comprising:

identifying, independently of the peer-to-peer distribution tree, a backup intermediate mixing node from within the plurality of participating nodes;

monitoring, at the backup intermediate mixing node, a first status of the first intermediate mixing node; and

assigning, in response to the first status, the first subset of originating nodes to the backup intermediate mixing node, thereby causing the backup intermediate mixing node to provide a mixing of respective audio stream outputs provided by the first subset of originating nodes to the root mixing node.

3. The method of claim 2, wherein the monitoring the first status comprises receiving a repetitive heartbeat message from the first mixing node, and wherein the assigning is performed in response to a failure to receive the repetitive heartbeat message.

4. The method of claim 2, wherein the first intermediate mixing node provides the mixing of respective audio stream outputs to the root mixing node by data communications through at least one higher level mixing nodes, the method further comprising:

identifying a number of additional backup intermediate mixing nodes, the number of additional backup mixing nodes being dependent upon a number of the at least one higher level mixing nodes through which the mixing is communicated from the first intermediate mixing node to reach the root mixing node.

5. A method for providing multi-party voice-over-IP services, the method on an information processing system comprising:

establishing a peer-to-peer distribution tree to broadcast a composite audio signal from a root mixing node to a plurality of participating nodes, wherein a subset of the participating nodes are originating nodes that provide a respective audio stream output received by the root mixing node to produce the composite audio signal;

identifying, independently of the peer-to-peer distribution tree, a first intermediate mixing node from within the plurality of participating nodes, the first intermediate mixing node providing to the root mixing node a mixing of resrective audio stream outputs provided by a first subset of originating nodes to the first intermediate mixing node;

monitoring a processing load on the first intermediate mixing node and on at least one neighbor node within the participating nodes;

identifying, in response to an increase in the processing load on the first intermediate mixing node and independently of the distribution tree, a second intermediate mixing node from the at least one neighbor; and

assigning, in response to the identifying, a portion of the first subset of originating nodes to the second intermediate mixing node and configuring the second intermediate mixing node to provide a mixing of the portion of the first subset of originating nodes to a parent mixing node of the first intermediate mixing node.

6. The method of claim 5, further comprising determining an initiation, at a non-originating node within the participating nodes, of a production of an additional audio stream to be delivered to the first intermediate mixing node for inclusion in the mixing, and wherein the increase in the processing load is a result of the initiating the production of the additional audio stream.

7. The method of claim 5, further comprising:

determining that the combined processing load on the first intermediate mixing node and the second intermediate mixing node each are below a pre-determined threshold; and

assigning, in response to the determining that the combined processing load on the first intermediate mixing node and the second intermediate mixing node are below a pre-determined threshold, all originating nodes that are assigned to the second intermediate mixing node to the first intermediate mixing node.

8. A method for providing multi-party voice-over-IP services, the method on an information processing system comprising:

establishing a peer-to-peer distribution tree to broadcast a composite audio signal from a root mixing node to a plurality of participating nodes, wherein a subset of the participating nodes are originating nodes that provide a resrective audio stream output received by the root mixing node to produce the composite audio signal; and

identifying, independently of the peer-to-peer distribution tree, a first intermediate mixing node from within the plurality of participating nodes, the first intermediate mixing node providing to the root mixing node a mixing of respective audio stream outputs provided by a first subset of originating nodes to the first intermediate mixing node,

wherein the establishing the peer-to-peer distribution tree comprises;

establishing overlay mesh interconnections among the participating nodes;

constructing, at each node within the participating nodes, a respective broadcast tree from the respective node to every other node within the participating nodes;

distributing a respective performance characteristic for each respective broadcast tree to each node within the participating nodes; and

performing, at each node within the participating node based upon the respective performance characteristic, an election protocol to determine an optimal root mixing node to be the root mixing node of the peer-to-peer distribution tree.

9. The method of claim 8, further comprising:

accepting a request from a new processing node to become a participating node, wherein the new processing node has been added to the overlay mesh connections and the request is broadcast to at least a portion of the participating nodes;

adding, in response to the request, the new processing node to the peer-to-peer distribution tree;

transmitting, by a first responder from within the participating nodes, a response to the request; and

assigning the destination of a new audio stream produced by the new processing node to be a parent mixing node of the first responder.