Common scene based conference system

• US 8,494,841 B2
• Filed: 10/09/2008
• Issued: 07/23/2013
• Est. Priority Date: 10/09/2008
• Status: Active Grant

• Current Assignee: Telefonaktiebolaget LM Ericsson
• Original Assignee: Telefonaktiebolaget LM Ericsson
• Inventors: Sandgren, Patrik, Eriksson, Anders, Falk, Tommy
• Primary Examiner(s): Godbold, Douglas
• Application Number:
  US13/122,861
• Publication Number:
  US 20110196682A1
• Time in Patent Office: 1,748 Days
• Field of Search: 704200-201, 704270-504, 379/93.21, 379/158, 379/202.01
• US Class Current: 704/201
• CPC Class Codes: H04M 3/56 Arrangements for connecting several subscribers to a common circuit, i.e. affording conference facilities video conference systems H04N7/15
• CPC Class Codes: H04S 2400/11 Positioning of individual sound objects, e.g. moving airplane, within a sound field H04S2420/13 takes precedence
• CPC Class Codes: H04S 7/30 Control circuits for electronic adaptation of the sound field

Abstract

Conference bridge (1) for managing an audio scene comprising two or more participants, the conference bridge comprising a mixer (2) and several user channels (3a, 3b, 3N). The conference bridge is arranged to continuously create a 3D positional audio environment signal for each participant as a listening participant, by rendering the speech of each participant as a 3D positioned virtual sound source and excluding the speech of the listening participant, and to distribute each created 3D positional audio environment signal to the corresponding listening participant. Further, the conference bridge is arranged to place the virtual sound source corresponding to each participant at the same spatial position relative the listening participant in every created 3D positional audio environment.

Claims

1. A method implemented by a conference bridge for managing an audio scene comprising two or more participants, the participants using the same codec or different codecs, the method comprising:

continuously detecting which of the participants are speaking participants and which of the participants are non-speaking participants, by using voice detection on an input signal received from each participant,

continuously creating a 3D positional audio environment signal for each participant, including an individual 3D positional audio environment signal for each speaking participant and a common 3D positional audio environment signal for all non-speaking participants, by;

rendering the speech of each of one or more other participants as a 3D positioned virtual sound source, excluding the speech of said participant if said participant is a speaking participant, and

placing the 3D positioned virtual sound source corresponding to each of the one or more other participants at the same spatial position relative said participant as in every other created 3D positional audio environment signal,

continuously distributing each created 3D positional audio environment signal to the corresponding participant, and

encoding the common 3D positional audio environment signal only once for each codec used by the non-speaking participants.

2. The method of claim 1, wherein said placing comprises placing the one or more 3D positioned virtual sound sources to form an arc-shape.

3. The method of claim 1, wherein a predetermined maximum number of speaking participants are selected from said detected speaking participants.

4. The method of claim 3, wherein only the speech from said selected speaking participants are rendered as 3D positioned virtual sound sources.

5. The method of claim 3, wherein only the speech from said selected speaking participants are re-sampled, if a re-sampling to a different sampling rate is required.

6. The method of claim 1, further comprising separately encoding each of said individual 3D positional audio environment signals.

7. A method implemented by a conference bridge for managing an audio scene comprising two or more participants, the method comprising:

rendering 3D positional audio environment signals that are individualized for speaking participants to respectively exclude the speech of those participants and one 3D positional audio environment signal that is common to all non-speaking participants, wherein rendering different 3D positional audio environment signals comprises placing virtual sound sources for speaking participants at the same spatial positions relative the respective participants for which those signals are rendered; and

distributing the common 3D positional audio environment signal to a common encoder that encodes the signal for non-speaking participants using the same codec.

8. A conference bridge for managing an audio scene comprising two or more participants, the participants using the same codec or different codecs, the conference bridge comprising:

a number of user channels, each corresponding to one of said participants;

a mixer comprising;

a voice detector connected to each user channel and configured to detect which of the participants are speaking participants and which of the participants are non-speaking participants,

mixing units configured to create a 3D positional audio environment signal for each participant, including a number of individual mixing units configured to render an individual 3D positioned audio environment signal for each speaking participant and a common mixing unit configured to render a common 3D positional audio environment signal for all non-speaking participants, each mixing unit configured to create a 3D positional audio environment signal for a participant by;

rendering the speech of each of one or more other participants as a 3D positioned virtual sound source, excluding the speech of said participant if said participant is a speaking participant, and

placing the virtual sound source corresponding to each of the one or more other participants at the same spatial position relative said participant as in every other 3D positional audio environment signal, and

a mixing control unit configured to control said mixing units,

wherein the conference bridge is configured to distribute each created 3D positional audio environment signal to the user channel of the corresponding participant, and

wherein the user channels are configured to encode the common 3D positional audio environment signal only once for each codec used by the participants.

9. The conference bridge of claim 8, wherein the mixer is configured to select a predetermined maximum number of speaking participants.

10. The conference bridge of claim 9, wherein a mixing unit is configured to render only the speech of said selected speaking participants as 3D positioned virtual sound sources.

11. The conference bridge of claim 9, wherein the mixer further comprises re-sampling units configured to re-sample only the speech of said selected speaking participants, if re-sampling is required.

12. The conference bridge of claim 9, wherein each user channel is configured to encode each rendered individual 3D positional audio environment signal.