Audio conferencing server for the internet

• US 9,602,295 B1
• Filed: 11/09/2007
• Issued: 03/21/2017
• Est. Priority Date: 11/09/2007
• Status: Active Grant

• Current Assignee: Avaya Incorporated
• Original Assignee: Avaya Incorporated
• Inventors: Weiner, Keith, Scott, Frederick
• Primary Examiner(s): Zhao, Wei
• Assistant Examiner(s): Preval, Lionel
• Application Number:
  US11/983,616
• Time in Patent Office: 3,420 Days
• Field of Search: 370/260, 370/331, 370/261, 379/202.01, 348/14.09, 348/14.08, 700/94
• US Class Current: 1/1
• CPC Class Codes: H04L 12/1813 for computer conferences, e.g. chat rooms instant messaging H04L51/04; protocols for multimedia communication H04L65/1101; arrangements for multi-party communication H04L65/403; telephonic conference arrangements H04M3/56; television conference systems H04N7/15
• CPC Class Codes: H04L 12/1822 Conducting the conference, e.g. admission, detection, selection or grouping of participants, correlating users to one or more conference sessions, prioritising transmission
• CPC Class Codes: H04L 12/1827 Network arrangements for conference optimisation or adaptation
• CPC Class Codes: H04L 65/403 Arrangements for multi-party communication, e.g. for conferences data switching systems for conference H04L12/18; arrangements for connecting several subscribers to a common circuit, i.e. affording conference facilities H04M3/56; television conferencing systems H04N7/15
• CPC Class Codes: H04L 65/765 intermediate
• CPC Class Codes: H04M 3/562 where the conference facilities are distributed
• CPC Class Codes: H04M 3/568 audio processing specific to telephonic conferencing, e.g. spatial distribution, mixing of participants echo suppression in two-way loud-speaking telephone systems H04M9/02; sound field processing per se H04S7/30

Abstract

An audio conferencing server that facilitates free form multi-party conversations between computer users. The audio conferencing server includes gateway elements, mixing elements, and a control element. A method for using the audio conferencing system to facilitate free form multi-party conversations between computer users, particularly in a three-dimensional virtual world using an audio conferencing server.

Claims

1. An audio conferencing server that facilitates free form multi-party conversations between users, said audio conferencing server comprising:

a plurality of gateway elements, each gateway element in two-way communication with at least one of a plurality of user computers;

a plurality of mixing elements, each gateway element in two-way communication with at least one of the mixing elements over a persistent control connection and a dynamic audio connection and each mixing element in two-way communication with at least one other mixing element over a persistent control connection and a dynamic audio connection;

a control element in two-way communication with each of the plurality of gateway elements, each of the plurality of mixing elements, and each of the plurality of user computers over persistent control connections, the control element dynamically creating and removing the logical connections to distribute a workload among said plurality of mixing elements by dynamically creating and removing dynamic audio connections between the mixing elements and between the mixing elements and the gateway elements while maintaining the persistent control connections;

at least one source computer from the plurality of user computers, the source computer providing a source audio stream to one of said plurality of gateway elements,

one of said plurality of mixing elements receiving said source audio stream from said one of said plurality of gateway elements; and

one of said plurality of mixing elements performing a mixing function on said source audio stream to form an audio stream mix comprising a plurality of output audio streams using said at least one source audio stream; and

at least one destination computer from the plurality of user computer, the destination computer receiving said audio stream mix from said one of said plurality of mixing elements performing a mixing function on said source audio stream;

wherein the mixing function performed by the one of the plurality of mixing elements comprises adjusting sound settings for at least one of the output audio streams independent of the other output audio streams based on a mix list or three-dimensional position received from the destination computer.

2. The audio conferencing server of claim 1, wherein said audio conferencing server facilitates free form multi-party conversations between users of the plurality of user computers in a three-dimensional virtual world.

3. The audio conferencing server of claim 1, wherein said persistent control connections are distinct from the dynamic audio connections between said gateway elements and said mixing elements and between said mixing elements.

4. The audio conferencing server of claim 1, wherein said two-way communication between said user computers and said gateway elements are persistent, session-long audio connections.

5. The audio conferencing server of claim 1, wherein said dynamic audio connections between said gateway elements and said mixing elements are over logical connections that are created and removed dynamically.

6. The audio conferencing server of claim 1, wherein said at least one source computer comprises a plurality of source computers, each source computer providing a source audio stream to one of said plurality of gateway elements based on a gateway spreading function.

7. The audio conferencing server of claim 1, wherein said at least one source computer comprises a plurality of source computers, each source computer providing a source audio stream via a respective gateway element to one of said plurality of mixing elements.

8. The audio conferencing server of claim 1, wherein said at least one source computer comprises a plurality of source computers, each source computer providing a source audio stream via a respective gateway element to one of said plurality of mixing elements based on a position of a user of the source computer in a three-dimensional virtual world.

9. The audio conferencing server of claim 1, wherein each of said plurality of mixing elements provides said audio stream mix to the destination computer based on a position of a user of the destination computer in association with said mixing element in a three-dimensional virtual world.

10. The audio conferencing server of claim 1, wherein said one of said plurality of mixing elements receiving said source audio stream resends said source audio stream to said one of said plurality of mixing elements performing a mixing function.

11. The audio conferencing server of claim 1, wherein said control element is a plurality of control elements.

12. The audio conferencing server of claim 1, wherein said two-way communication between said user computers and said gateway elements are dynamically created and removed audio connections.

13. A method of facilitating free-form, multi-part conversations between users in an audio conference, the method comprising:

establishing, by an audio conferencing server, a two-way communication between each of a plurality of user computers and at least one of a plurality of gateway elements;

establishing, by the audio conferencing server, two-way communication between each gateway element and at least one of a plurality of mixing elements over a persistent control connection and a dynamic audio connection;

establishing, by the audio conferencing server, a two-way communication between each mixing element and at least one other mixing element over a persistent control connection and a dynamic audio connection;

establishing, by the audio conferencing server, a two-way communication between a control element and each of the plurality of gateway elements, each of the plurality of mixing elements, and each of the plurality of user computers over persistent control connections;

distributing, by the audio conferencing server through the control element, a workload among said plurality of mixing elements by dynamically creating and removing dynamic audio connections between the mixing elements and between the mixing elements and the gateway elements while maintaining the persistent control connections;

receiving, by the audio conferencing server from at least one source computer of the plurality of user computers, a source audio stream to one of said plurality of gateway elements, wherein one of said plurality of mixing elements receives said source audio stream from said one of said plurality of gateway elements and one of said plurality of mixing elements performs a mixing function on said source audio stream to form an audio stream mix comprising a plurality of output audio streams using said at least one source audio stream; and

providing, by the audio conferencing server to at least one destination computer of the plurality of user computers, said audio stream mix from said one of said plurality of mixing elements performing a mixing function on said source audio stream, wherein the mixing function performed by the one of the plurality of mixing elements comprises adjusting sound settings for at least one of the output audio streams independent of the other output audio streams based on a mix list or three-dimensional position received from the destination computer.

14. The method of claim 13, wherein said at least one source computer comprises a plurality of source computers, each source computer providing a source audio stream to one of said plurality of gateway elements based on a gateway spreading function.

15. The method of claim 13, wherein said at least one source computer comprises a plurality of source computers, each source computer providing a source audio stream via a respective gateway element to one of said plurality of mixing elements.

16. The method of claim 13, wherein said at least one source computer comprises a plurality of source computers, each source computer providing a source audio stream via a respective gateway element to one of said plurality of mixing elements based on a position of a user of the source computer in a three-dimensional virtual world.

17. The method of claim 13, wherein each of said plurality of mixing elements provides said audio stream mix to the destination computer based on a position of a user of the destination computer in association with said mixing element in a three-dimensional virtual world.

18. A computer readable memory comprising a set of instructions stored thereon which, when executed by a processor, causes the processor to facilitate free-form, multi-part conversations between users in an audio conference by:

establishing a two-way communication between each of a plurality of user computers and at least one of a plurality of gateway elements;

establishing two-way communication between each gateway element and at least one of a plurality of mixing elements over a persistent control connection and a dynamic audio connection;

establishing a two-way communication between each mixing element and at least one other mixing element over a persistent control connection and a dynamic audio connection;

establishing a two-way communication between a control element and each of the plurality of gateway elements, each of the plurality of mixing elements, and each of the plurality of user computers over persistent control connections;

distributing, through the control element, a workload among said plurality of mixing elements by dynamically creating and removing dynamic audio connections between the mixing elements and between the mixing elements and the gateway elements while maintaining the persistent control connections;

receiving, from at least one source computer of the plurality of user computers, a source audio stream to one of said plurality of gateway elements, wherein one of said plurality of mixing elements receives said source audio stream from said one of said plurality of gateway elements and one of said plurality of mixing elements performs a mixing function on said source audio stream to form an audio stream mix comprising a plurality of output audio streams using said at least one source audio stream; and

providing, to at least one destination computer of the plurality of user computers, said audio stream mix from said one of said plurality of mixing elements performing a mixing function on said source audio stream, wherein the mixing function performed by the one of the plurality of mixing elements comprises adjusting sound settings for at least one of the output audio streams independent of the other output audio streams based on a mix list or three-dimensional position received from the destination computer.