Audio processing in a multi-participant conference

• US 20060247045A1
• Filed: 04/28/2005
• Published: 11/02/2006
• Est. Priority Date: 04/28/2005
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Jeong, Hyeonkuk, Salsbury, Ryan
• Granted Patent: US 7,864,209 B2
• Time in Patent Office: Days
• US Class Current: 463/35
• CPC Class Codes: H04N 7/15 Conference systems

Abstract

Some embodiments provide an architecture for establishing multi-participant audio conferences over a computer network. This architecture has a central distributor that receives audio signals from one or more participants. The central distributor mixes the received signals and transmits them back to participants. In some embodiments, the central distributor eliminates echo by removing each participant'"'"'s audio signal from the mixed signal that the central distributor sends to the particular participant.

Claims

1. A method of distributing audio content in a multi-participant audio/video conference, said conference having one central distributor of audio content, the method comprising:

a) at the central distributor, receiving audio signals from each participant,

b) generating mixed audio signals from the received audio signals, and

c) transmitting said audio signals to said participants.

2. The method of claim 1, the method further comprising:

a) measuring strength of each received audio signal,

b) generating an indicia of said strength of each received audio signal,

c) appending said indicia to every said mixed signals.

3. The method of claim 2, wherein said strength of each received audio signal is calculated as RMS power of said received audio signal.

4. The method of claim 1, wherein during said mixing, said received audio signal for each participant is eliminated from said mixed signal to be sent to the same said participant.

5. A method of identifying audio levels in a multi-participant audio video conference, each participant has a display, the method comprising:

a) receiving a mixed audio signal by each participant, said mixed audio signal includes indicia of signal strength of each participant'"'"'s voice,

b) using said indicia of signal strength to show a level meter on each participant'"'"'s display corresponding to said indication.

6. A method of creating stereo panning effect in a multi-participant audio/video conference, each participant having a computer with a display for showing images of a set of participants, each participant'"'"'s computer having a set of audio loudspeakers, the method comprising:

a) receiving a mixed audio signal for a particular participant, said mixed audio signal including indicia of signal strength of the participants'"'"' audio,

b) using said indicia of signal strength to pan the mixed audio across the audio loudspeakers of the particular participant to account for location of each participant in the set of participants on the display of the particular participant.

7. The method of claim 6, wherein said panning is created by:

a) identifying location of each participant'"'"'s image in the set of participants on the display of the particular participant'"'"'s computer, and

b) creating a delay on said audio loudspeaker of the particular participant'"'"'s computer to account for the identified location of the participants.

8. A method of creating stereo panning effect in a multi-participant audio/video conference, each participant having a computer with a display for showing images of a set of participants, each participant'"'"'s computer having a set of audio loudspeakers, the method comprising:

a) when a first participant performs a particular action, identifying the location of the first participant image in the set of participants on the display of a second participant'"'"'s computer,

b) creating a sound effect for the particular action, and

c) panning said sound effect across the audio loudspeakers of the second participant'"'"'s computer to account for location of the first participant taking said action.

9. The method of claim 8, wherein said panning is created by introducing a delay on said loudspeaker of the the second participant'"'"'s computer to account for the identified location of the first participant taking said action.

10. The method of claim 8, wherein said action is joining the conference.

11. The method of claim 8, wherein said action is leaving the conference.

12. A computer readable medium that stores a computer program for distributing audio content in a multi-participant audio/video conference, said conference having one central distributor of audio content, the program comprising sets of instructions for:

a) receiving, at the central distributor, audio signals from each participant,

b) generating mixed audio signals from the received audio signals, and

c) transmitting said audio signals to said participants.

13. The computer readable medium of claim 12, the program further comprising sets of instructions for:

a) measuring strength of each received audio signal,

b) generating an indicia of said strength of each received audio signal,

c) appending said indicia to every said mixed signals.

14. The computer readable medium of claim 13, wherein said strength of each received audio signal is calculated as RMS power of said received audio signal.

15. The computer readable medium of claim 12, wherein during said mixing, said received audio signal for each participant is eliminated from said mixed signal to be sent to the same said participant.

16. A computer readable medium storing a computer program for identifying audio levels in a multi-participant audio video conference, each participant has a display, the computer program comprising sets of instructions for:

a) receiving a mixed audio signal by each participant, said mixed audio signal includes indicia of signal strength of each participant'"'"'s voice,

b) using said indicia of signal strength to show a level meter on each participant'"'"'s display corresponding to said indication.

17. A computer readable medium storing a computer program for creating stereo panning effect in a multi-participant audio/video conference, each participant having a computer with a display for showing images of a set of participants, each participant'"'"'s computer having a set of audio loudspeakers, the computer program comprising sets of instructions for:

a) receiving a mixed audio signal for a particular participant, said mixed audio signal including indicia of signal strength of the participants'"'"' audio,

b) using said indicia of signal strength to pan the mixed audio across the audio loudspeakers of the particular participant to account for location of each participant in the set of participants on the display of the particular participant.

18. The computer readable medium of claim 17, wherein said set of instructions for panning comprises sets of instructions for:

a) identifying location of each participant'"'"'s image in the set of participants on the display of the particular participant'"'"'s computer, and

b) creating a delay on said audio loudspeaker of the particular participant'"'"'s computer to account for the identified location of the participants.