Teleconferencing bridge with EdgePoint mixing

• US 7,006,616 B1
• Filed: 05/15/2000
• Issued: 02/28/2006
• Est. Priority Date: 05/21/1999
• Status: Expired due to Term

• Current Assignee: Google Technology Holdings LLC (Alphabet Inc.)
• Original Assignee: Terayon Communications Systems Incorporated (Motorola Solutions, Inc.)
• Inventors: Miller, Edward M., Christofferson, Frank C.
• Primary Examiner(s): Matar, Ahmad F.
• Assistant Examiner(s): AL AUBAIDI, RASHA S
• Application Number:
  US09/571,577
• Time in Patent Office: 2,115 Days
• Field of Search: 379/202.01, 379/263, 379/266, 379/267
• US Class Current: 379/202.01
• CPC Class Codes: A63F 2300/572 Communication between players during game play of non game information, e.g. e-mail, chat, file transfer, streaming of audio and streaming of video
• CPC Class Codes: H04L 12/1822 Conducting the conference, e.g. admission, detection, selection or grouping of participants, correlating users to one or more conference sessions, prioritising transmission
• CPC Class Codes: H04L 65/103 in the network
• CPC Class Codes: H04L 65/104 in the network
• CPC Class Codes: H04L 65/1101 Session protocols
• CPC Class Codes: H04L 65/4038 with floor control
• CPC Class Codes: H04L 67/131 Protocols for games, networked simulations or virtual reality
• CPC Class Codes: H04L 9/40 Network security protocols
• CPC Class Codes: H04M 2201/40 using speech recognition
• CPC Class Codes: H04M 2242/14 with services dependent on location
• CPC Class Codes: H04M 3/2281 Call monitoring, e.g. for law enforcement purposes; Call tracing; Detection or prevention of malicious calls
• CPC Class Codes: H04M 3/56 Arrangements for connecting several subscribers to a common circuit, i.e. affording conference facilities video conference systems H04N7/15
• CPC Class Codes: H04M 3/562 where the conference facilities are distributed
• CPC Class Codes: H04M 7/006 Networks other than PSTN/ISDN providing telephone service, e.g. Voice over Internet Protocol (VoIP) , including next generation networks with a packet-switched transport layer H04L65/00 takes precedence; aspects not specific to the type of network H04M3/00; special services in those networks H04M3/42

Abstract

In accordance with the principles of the present invention, an audio-conference bridging system and method are provided. The present invention discards the traditional notion of a single mixing function for a conference. Instead, the novel, flexible design of the present invention provides a separate mixing function for each participant in the conference. This new architecture is described generally herein as “EdgePoint mixing.” EdgePoint mixing overcomes limitations of traditional conferencing systems by providing each participant control over his/her conference experience. EdgePoint mixing also allows, when desired, the simulation of a “real-life” conference by permitting each participant to receive a distinctly mixed audio signal from the conference depending on the speaker'"'"'s “position” within a virtual conference world. The present invention also preferably accommodates participants of different qualities of service. Each participant, thus, is able to enjoy the highest-level conferencing experience that his/her own connection and equipment will permit.

Claims

1. A method for facilitating an audio conference, comprising the steps of:

generating an audio conference bridge operatively connecting participant stations in an audio conference, including at least a first participant station and a plurality of other participant stations, and adapted to receive incoming audio signals from the participant stations;

receiving first mixing control data for the first participant station, including data necessary to derive individual mixing parameters for at least two of the incoming audio signals from other than the first participant station;

receiving the incoming audio signals from a plurality of the participant stations;

setting a first set of audio conference mixing parameters based on at least the first mixing control data received for the first participant station;

dynamically modifying the first set of audio conference mixing parameters pursuant to an algorithm for creating a desired effect;

mixing N of the incoming audio signals according to the modified first set of audio conference mixing parameters to produce a first mixed audio signal, where N is an integer greater than one; and

outputting the first mixed audio signal.

2. The method of claim 1, wherein the step of outputting includes transmitting the first mixed audio signal to the first participant station.

3. The method of claim 1, wherein the first participant station is connected to a first communications network and the audio conference bridge is connected to a second communications network;

and wherein the step of generating includes operatively connecting the first participant station to the audio conference bridge via a gateway between the first communications network and the second communications network.

4. The method of claim 3, wherein:

the first participant station is operatively connected to the second communications network;

the first participant station receives the first mixed audio signal via the first communications network; and

the first participant station transmits the first mixing control data via the second communications network.

5. The method of claim 4, wherein the first communications network comprises at least one of:

a public switched telephone network;

a wireless communications network; and

a satellite communications network.

6. The method of claim 4, wherein the second communications network comprises at least one of:

the Internet;

a wide-area network; and

a local-area network.

7. The method of claim 1, wherein the first mixing control data comprises explicit mixing instructions from the first participant station.

8. The method of claim 7, wherein:

the second participant transmits an audio signal to the audio conference bridge; and

the mixing instructions include increasing gain for the audio signal transmitted by the second participant station.

9. The method of claim 7, wherein:

the second participant station transmits an audio signal to the audio conference bridge; and

the first mixing control data includes decreasing gain for the audio signal transmitted by the second participant station without completely muting the audio signal transmitted by the second participant station.

10. The method of claim 1, wherein the mixing control data comprises the value of at least a first variable related to the first participant station and the step of dynamically modifying comprises automatically calculating the modified first set of mixing parameters based on the value of at least the first variable.

11. The method of claim 10, wherein at least a first participant associated with the first participant station is visually represented by a first avatar within a virtual conference world, and wherein the first variable comprises the position of the avatar within the virtual conference world.

12. The method of claim 11, wherein the first participant controls the position of the first avatar within the virtual conference world.

13. The method of claim 11, wherein the virtual conference world is three-dimensional.

14. The method of claim 11, wherein:

at least a second participant associated with the second participant station is visually represented by a second avatar within the virtual conference world;

the second participant station transmits an audio signal to the audio conference bridge;

and further comprising the step of;

revising the first set of audio conference mixing parameters to increase gain for the audio signal transmitted by the second participant station as the first avatar and the second avatar move closer together.

15. The method of claim 2, wherein the other participant stations include at least a second participant station, and further comprising the steps of:

receiving second mixing control data from the second participant station including data necessary to derive individual mixing parameters for at least two of the incoming audio signals from participant stations other than the second participant station;

setting a second set of audio conference mixing parameters based on at least the second mixing control data;

dynamically modifying the second set of audio conference mixing parameters pursuant to the algorithm;

mixing N of the incoming audio signals according to the modified second set of audio conference mixing parameters to produce a second mixed audio signal, where N is an integer greater than one; and

transmitting to the second participant station the second mixed audio signal;

wherein the first set and second set of modified audio conference mixing parameters are distinct.

16. The method of claim 1, wherein the step of dynamically modifying includes monitoring the content of the incoming audio signals and automatically altering the first set of audio conference mixing parameters if preset events are detected in the content of the audio signals.

17. The method of claim 16, wherein the preset events include offensive language.

18. The method of claim 1, wherein the step of generating includes;

establishing a control connection with the first participant station;

assigning a session identifier to the first participant station;

establishing an audio connection with the first participant station; and

correlating the control connection and the audio connection via the session identifier.

19. The method of claim 1, wherein the modified first set of audio conference mixing parameters includes a parameter limiting the maximum number N of incoming signals mixed to produce the first mixed audio signal.

20. An audio conference bridging system for bridging a plurality of participant stations together in an audio conference, comprising:

means for generating an audio conference bridge operatively connecting participant stations in an audio conference, including at least a first participant station and a plurality of other participant stations, and adapted to receive incoming audio signals from the participant stations;

means for receiving first mixing control data for the first participant station, including data necessary to derive individual mixing parameters for at least two of the incoming audio signals from other than the first participant station;

means for receiving incoming audio signals from a plurality of the participant stations;

means for setting a first set of audio conference mixing parameters based on at least the first mixing control data received for the first participant station;

means for dynamically modifying the first set of audio conference mixing parameters pursuant to an algorithm for creating a desired effect;

means for mixing N of the incoming audio signals according to the modified first set of audio conference mixing parameters to produce a first mixed audio signal, where N is an integer greater than one; and

means for outputting the first mixed audio signal.

21. A computer-readable medium containing instructions for controlling a computer system to facilitate an audio conference process among a plurality of participant stations, the process comprising:

generating an audio conference bridge operatively connecting participant stations in an audio conference, including at least a first participant station and a plurality of other participant stations, and adapted to receive incoming audio signals from the participants stations;

receiving first mixing control data for the first participant station, including data necessary to derive individual mixing parameters for at least two of the incoming audio signals from other than the first participant station;

receiving incoming audio signals from a plurality of the participant stations;

setting a first set of audio conference mixing parameters based on at least the first mixing control data received for the first participant station;

dynamically modifying the first set of audio conference mixing parameters pursuant to an algorithm for creating a desired effect;

mixing N of the incoming audio signals according to the modified first set of audio conference mixing parameters to produce a first mixed audio signal, where N is an integer greater than one; and

outputting the first mixed audio signal.

22. An audio conference bridging system for bridging a plurality of participant stations together in an audio conference, comprising:

a system control unit adapted to receive mixing control data from a plurality of participant stations, including at least a first participant station and a plurality of other participant stations, and to produce at least a first set of audio-conference mixing parameters based at least on first mixing control data received from the first participant station, the first mixing control data including data necessary to derive individual mixing parameters for at least two incoming audio signals from other than the first participant station;

an audio bridging unit, operatively connected to the system control unit, adapted to receive a plurality of audio signals from the plurality of participant stations and receive the first set of audio conference mixing parameters from the system control unit, the audio bridging unit including;

a first EdgePoint mixer adapted to dynamically modify the first set of audio conference mixing parameters pursuant to an algorithm for creating a desired effect and mix at least N of the plurality of audio signals according to the modified first set of audio-conference mixing parameters to produce a first mixed audio signal, where N is an integer greater than one;

and the audio bridging unit adapted to output the first mixed audio signal.

23. An audio-conference bridging system for bridging a plurality of participant stations in an audio conference, wherein the participant stations include a visual interface depicting a virtual conference world and the virtual conference world includes avatars representing participants associated with the participant stations, comprising:

means for receiving audio signals from the plurality of participant stations;

means for receiving mixing control data from the plurality of participant stations, the mixing control data including data representing the position of the avatars within the virtual conference world;

means for setting separate mixing control parameters for each of the plurality of participant stations based at least on the mixing control data;

means for mixing the audio signals according to the mixing control parameters to produce separate mixed audio signals for each of the participant stations; and

means for outputting the mixed audio signals to the participant stations.

24. A method for facilitating an audio conference bridging a plurality of participant stations, wherein the participant stations include a visual interface depicting a virtual conference world and the virtual conference world includes avatars representing participants associated with the participant stations, comprising:

receiving audio signals from the plurality of participant stations;

receiving mixing control data from the plurality of participant stations, the mixing control data including data representing the position of the avatars within the virtual conference world;

setting separate mixing control parameters for each of the plurality of participant stations based at least on the mixing control data;

mixing the audio signals according to the mixing control parameters to produce separate mixed audio signals for each of the participant stations; and

outputting the mixed audio signals to the participant stations.

25. An audio conference bridging system for dynamically bridging a plurality of participant stations together in an audio conference, the system comprising

a system control unit adapted to receive mixing control data from at least one participant station, wherein

the mixing control data from the at least one participant includes data necessary to derive individual mixing parameters for at least two incoming audio signals from other than the at least one participant station,

the system control unit selects an algorithm for application to the mixing control data for creating a desired effect;

and

the system control unit produces at least one set of mixing parameters, including the individual mixing parameters and the selected algorithm, based upon the mixing control data received from the at least one participant station;

an audio bridging unit operatively connected to the system control unit, wherein the audio bridging unit is adapted to

receive a plurality of audio signals associated with the plurality of participant stations, respectively;

receive the at least one set of mixing parameters from the system control unit; and

associate the at least one set of mixing parameters with the plurality of audio signals; and

a mixing unit operatively associated with the audio bridging unit and adapted to

mix at least N of the plurality of audio signals, where N is an integer greater than one, according to the at least one set of mixing parameters to produce the at least one mixed audio signal, and

output at the least one mixed audio signal.

26. The audio conference bridging system of claim 25 further comprising a media interface unit adapted to

receive the plurality of audio signals in a plurality of signal formats,

convert the plurality of audio signals into a single uniform format, and

transfer the converted plurality of audio signals to the audio bridging unit.

27. The audio conference bridging system of claim 25, wherein the media interface unit is further adapted to

receive the at least one mixed audio signal output from the audio bridging unit;

convert the at least one mixed audio signal into an original signal format preferable to the at least one participant station; and

transmit the at least one mixed audio signal to the at least one participant station.

28. The audio conference bridging system of claim 25, wherein the algorithm includes a speech activity detection routine, which identifies audio signals of active participants at any given time during the audio conference and reduces the number of possible audio signals for mixing by the mixing unit from all of the plurality of audio signals to only the audio signals of active participants.

29. The audio conference bridging system of claim 25, wherein the algorithm includes a signal strength detection routine, which evaluates the signal strength of each of the plurality of audio signals and reduces the number of possible audio signals for mixing by the mixing unit to only audio signals of meeting a predetermined criteria based on signal strength.

30. The audio conference bridging system of claim 25, wherein the control data comprises position information related to the virtual positions of the plurality of participants in a virtual space and the algorithm includes a position detection and compensation routine, which adjusts the at least one mixed audio signal to reflect the relative virtual positions of the plurality of participants.