Audio communication control unit

• US 5,734,724 A
• Filed: 02/28/1996
• Issued: 03/31/1998
• Est. Priority Date: 03/01/1995
• Status: Expired due to Fees

• Current Assignee: Nippon Telegraph and Telephone Corporation
• Original Assignee: Nippon Telegraph and Telephone Corporation
• Inventors: Hayashi, Nobuo, Okamoto, Manabu, Aoki, Shigeaki, Kinoshita, Ikuichiro
• Primary Examiner(s): Kuntz, Curtis
• Assistant Examiner(s): LEE, PING
• Application Number:
  US08/608,082
• Time in Patent Office: 762 Days
• Field of Search: 381/17, 381/18, 381/1, 370/266, 370/260, 370/265, 379/202-206, 348/15, 348/16
• US Class Current: 381/17
• CPC Class Codes: H04M 3/56 Arrangements for connecting several subscribers to a common circuit, i.e. affording conference facilities video conference systems H04N7/15
• CPC Class Codes: H04M 3/568 audio processing specific to telephonic conferencing, e.g. spatial distribution, mixing of participants echo suppression in two-way loud-speaking telephone systems H04M9/02; sound field processing per se H04S7/30
• CPC Class Codes: H04S 3/00 Systems employing more than two channels, e.g. quadraphonic H04S5/00, H04S7/00 take precedence

Abstract

In an audio communication control unit, audio signals from at least three terminals connected to a switching part are branched to left- and right-channels audio signals, then the left- and right-channel audio signals are processed using sound image control parameters in such a manner as to impart them with target positions different for each terminal, then all left-channel audio signals corresponding to the respective terminals are mixed together into a left-channel mixed audio signal and all the right-channel audio signals are mixed together into a right-channel mixed audio signal, and these left- and right-channel mixed audio signals are distributed and sent to all the connected terminals.

Claims

1. An audio communication control unit for teleconferencing which is connected via a communication network to a plurality of terminals, comprising:

a switching part for switching audio signals received from N terminals via said communication network, N being an integer equal to or greater than three;

N input channels connected to said switching part and supplied with the input audio signals from said N terminals, respectively;

a channel branching part for branching each of said input audio signals from said N input channels into two branched audio signals of branched channels;

a sound image control part for processing said two branched audio signals of said two branched channels corresponding to each of said N input channels with a corresponding one of N parameter sets each including two sound image control parameters or predetermined kind of kinds to produce sound-image controlled audio signals of two branch channels corresponding to each of said N input channels, at least one of said N parameter sets being different from the other parameters sets according to target positions of said terminals;

a mixing part for mixing said sound-image controlled audio signals of two branch channels corresponding respectively to said N terminals, for each branch channel, to thereby generate mixed audio signals of two channels;

a terminal-associated branching part for branching said mixed audio signals of two channels in correspondence with said N terminals for input into said switching part; and

signal processing control part for deciding a top-priority one of said N input audio signals as an audio signal of a principal speaker and the other remaining input audio signals as audio signals of other speakers;

wherein said channel branching part branches each of said N input audio signals fed thereto from said N input channels into first and second branch channel audio signals and outputs them as said two branched audio signals; and

said sound image control part includes a phase control part which, under the control of said signal processing control part, sets said first and second branch channel audio signals corresponding to said principal speaker'"'"'s audio signal to be in-phase with each other and sets said first- and second-channel audio signals corresponding to said other speakers'"'"' audio signals to be out-of-phase with each other.

4. The audio communication control unit of claims 1 or 2, wherein said sound image control part includes an attenuation part which attenuates said other speakers'"'"' audio signals to a level lower than that of said principal speaker'"'"'s audio signal under the control of said signal processing part.

5. The audio communication control unit of claims 1 or 3, further comprising an utterance detection processing part for monitoring levels of said input audio signals fed through said N input channels via said switching part from respectively corresponding said N terminals and for detecting utterance at each of said N terminals and wherein said signal processing control part decides a principal speaker on the basis of the utterance detected by said utterance detection processing part and controls said sound image control part according to the decision result.

2. An audio communication control unit for teleconferencing which is connected via a communication network to a plurality of terminals, comprising:

a switching part for switching audio signals received from N terminals via said communication network, N being an integer equal to or greater than three;

N input channels connected to said switching part and supplied with the input audio signals from said N terminals, respectively;

a channel branching part for branching each of said input audio signals from said N input channels into two branched audio signals of two branched channels;

a sound image control part for processing said two branched audio signals of said two branched channels corresponding to each of said N input channels with a corresponding one of N parameter sets each including two sound image control parameters of predetermined kind or kinds to produce sound-image controlled audio signals of two branch channels corresponding to each of said N input channels, at least one of said N parameter sets being different from the other parameter sets according to target positions of said terminals;

a mixing part for mixing said sound-image controlled audio signals of two branch channels corresponding respectively to said N terminals, for each branch channel, to thereby generate mixed audio signals of two channels;

a terminal-associated branching part for branching said mixed audio signals of two channels in correspondence with said N terminals for input into said switching part;

a speaker selecting part provided between said N input channels and said channel branching part, for selecting input audio signals to be mixed together from said input audio signals inputted through said N input channels via said switching part and for outputting said selected input audio signals;

N selected audio signals channels for applying said selected input audio signals from said speaker selecting part to said channel branching part; and

a signal processing control part for controlling said speaker selecting part so that one of said input audio signals to be processed by said at least one of said N parameter sets, is outputted to a predetermined one of said N selected audio signal channels;

wherein said signal processing control part decides a top-priority one of said N input audio signals as an audio signal of a principal speaker and the other remaining input audio signals as audio signals of other speakers;

said speaker selecting part outputs, on the basis of the results of said decision by said signal processing control part, said principal speaker'"'"'s audio signal and said other speakers'"'"' audio signals to said predetermined one of said N selected audio signal channels and the other remaining selected audio signal channels, respectively, as input to said channel branching part;

said channel branching part branches each of said N input audio signals applied thereto and outputs first- and second-branch channel audio signals as said branched audio signals of said two branch channels; and

said sound image control part includes a phase control part which, under the control of said signal processing control part, sets said first- and second-branch channel audio signals corresponding to said principal speaker'"'"'s audio signal from said predetermined one selected audio channel to be in-phase with each other and sets said first- and second-branch channel audio signals corresponding to said other speakers'"'"' audio signals from said other selected audio channels to be out-of-phase with each other.

3. An audio communication control unit for teleconferencing which is connected via a communication network to a plurality of terminals, comprising:

a switching part for switching audio signals received from N terminals via said communication network, N being an integer equal to or greater than three;

N input channels connected to said switching part and supplied with the input audio signals from said N terminals, respectively;

a channel branching part for branching each of said input audio signals from said N input channels into two branched audio signals of two branched channels;

a sound image control part for processing said two branched audio signals of said two branched channels corresponding to each of said N input channels with a corresponding one of N parameter sets each including two sound image control parameters of predetermined kind or kinds to produce sound-image controlled audio signals of two branch channels corresponding to each of said N input channels, at least one of said N parameter sets being different from the other parameter sets according to target positions of said terminals;

a mixing part for mixing said sound-image controlled audio signals of two branch channels corresponding respectively to said N terminals, for each branch channel, to thereby generate mixed audio signals of two channels; and

a terminal-associated branching part for branching said mixed audio signals of two channels in correspondence with said N terminals for input into said switching part;

wherein said channel branching part branches each of said N input audio signal fed thereto into first and second branch channel audio signals and outputs them as said two branched audio signals;

a signal processing control part decides a top-priority one of said N input audio signals as an audio signal of a principal speaker and the other remaining input audio signals as audio signals of other speakers; and

said signal processing control part sets said N parameter sets to said sound image control part such that said sound image control part attenuates said second branch channel audio signal corresponding to said decided principal speaker'"'"'s audio signal by a first value sufficiently larger than the attenuation value of said first branch channel audio signal corresponding to said decided principal speaker'"'"'s audio signal and attenuates said first branch channel audio signal corresponding to said other speakers'"'"' audio signals by a second value sufficiently larger than the attenuation value of said second branch channel audio signal corresponding to said other speakers'"'"' audio signals.

6. An audio communication control unit for teleconferencing which is connected via a communication network to a plurality of terminals, comprising:

a switching part for switching audio signals received from N terminals via said communication network, N being an integer equal to or greater than three;

N input channels connected to said switching part and supplied with the input audio signals from said N terminals, respectively;

a channel branching part for branching each of said input audio signals from sid N input channels into two branched audio signals of two branched channels;

a sound image control part for processing said two branched audio signals of said two branched channels corresponding to each of said N input channels with a corresponding one of N parameter sets each including two sound image control parameters of predetermined kind or kinds to produce sound-image controlled audio signals of two branch channels corresponding to each of said N input channels, at least one of said N parameter sets being different from the other parameter sets according to target positions of said terminals;

a mixing part for mixing said sound-image controlled audio signals of two branch channels corresponding respectively to said N terminals, for each branch channel, to thereby generate mixed audio signals of two channels;

a terminal-associated branching part for branching said mixed audio signals of two channels in correspondence with said N terminals for input into said switching part;

a speaker selecting part provided between said N input channels and said channel branching part, for selecting input audio signals to be mixed together from said input audio signals inputted through said N input channels via said switching part and for outputting said selected input audio signals;

N selected audio signal channels for applying said selected input audio signals from said speaker selecting pan to said channel branching part; and

a signal processing control part for controlling said speaker selecting part so that one of said input audio signals to be processed by said at least one of said N parameter sets, is outputted to a predetermined one of said N selected audio signal channels;

wherein said signal processing control part decides a top-priority one of said N input audio signals from said N input channels as an audio signal of a principal speaker and the other remaining input audio signals as audio signals of other speakers;

said speaker selecting part outputs said principal speaker'"'"'s audio signal and said other speakers'"'"' audio signals to said predetermined one of said N selected audio channels and the other remaining selected audio signal channels, respectively, for input to said channel branching part;

said channel branching part branches each of said N input audio signals applied thereto into first and second branch channel audio signals and outputs them as said two branched audio signals; and

said sound image control part includes an attenuation part which, under the control of said signal processing control part, attenuates said second branch channel audio signal from said predetermined one selected audio channel by a first attenuation value sufficiently larger than the attenuation value of said first branch channel audio signal from said predetermined one selected audio channel and attenuates each of said first-channel audio signals from said remaining selected audio channel by a second value sufficiently larger than the attenuation value of said second branch channels audio signals from said remaining selected audio channels.

7. An audio communication control unit for teleconferencing which is connected via a communication network to a plurality of terminals, comprising:

a switching part for switching audio signals received from N terminals via said communication network, N being an integer equal to or greater than 3;

N input channels connected to said switching part and supplied with the input audio signals from said N terminals, respectively;

a channel branching part for branching each of said input audio signals from said N input channels to K branched audio signals of K branched channels, K being an integer equal to or greater than 2;

a sound image control part for processing said K branched audio signals of said K branched channels corresponding to each of said N input channels with a corresponding one of N parameter sets each including K sound image control parameters of predetermined kind or kinds to produce sound-image controlled audio signals of K branch channels corresponding to each of said N input channels, at least one of said N parameter sets being different from the other parameter sets according to target positions of said terminals;

a mixing part for mixing sound-image controlled audio signals of K branch channels corresponding respectively to said N terminals, for each branch channel, to thereby generate mixed audio signals of K channels;

a terminal-associated branching part for branching said mixed audio signals of K channels in correspondence with said N terminals for input into said switching part; and

a cancelling part for cancelling from each of said K-channel mixed audio signals distributed by said terminal-associated branching part to each of said N terminals, respectively, the component of each of said K-channel sound-image controlled audio signals from said sound image control part corresponding to said each terminal.

8. An audio communication control unit for teleconferencing which is connected via a communication network to a plurality of terminals, comprising:

a switching part for switching audio signals received from N terminals via said communication network, N being an integer equal to or greater than 3;

N input channels connected to said switching part and supplied with the input audio signals from said N terminals, respectively;

a channel branching part for branching each of said input audio signals from said N input channels into K branched audio signals of K branched channels, K being an integer equal to or greater than 2;

a sound image control part for processing said K branched audio signals of said K branched channels corresponding to each of said N input channels with a corresponding one of N parameter sets each including K sound image control parameters of predetermined kind or kinds to produce sound-image controlled audio signals of K branch channels corresponding to each of said N input channels, at least one of said N parameter sets being different from the other parameter sets according to target positions of said terminals;

a mixing part for mixing said sound-image controlled audio signals of K branch channels corresponding respectively to said N terminals, for each branch channel, to thereby generate mixed audio signals of K channels; and

a terminal-associated branching part for branching said mixed audio signals of K channels in correspondence with said N terminals for input into said switching part;

wherein Q sets of said mixing part and said terminal-associated branching part are provided in correspondence with Q teleconferences;

Q being an integer equal to or greater than 2;

said audio communication control unit further comprising a combination assignment part for applying said K-channel sound-image controlled audio signal from said sound image control part, which corresponds to each of said N terminals, to designated one or more mixing parts; and

an inter-combination mixing part for mixing together, for a corresponding one of the K channels, said K-channel mixed audio signals distributed from one or more of said terminal-associated branching parts and for outputting said channel-associated mixed audio signals to said each terminal;

said K channels being left and right channels and said sound image control parts each generating, for each terminal, a stereo audio signal of left and right channels as said sound-image controlled audio signal by convolving said branched audio signals of said left and right channels corresponding to said each terminal, respectively, with a pair of acoustic transfer functions used as said sound image control parameters, which correspond to a target position of a sound source different for each of said N terminals.

9. The audio communication control unit of claim 8, further comprising a signal processing control part which detects the number of said terminals participating in any of said Q teleconferences by detecting signals requesting to participate in the teleconferences from said terminals, determines a plurality of target positions of the same number as the number of terminals participating in the teleconferences, determines said pairs of acoustic transfer functions as said sound image control parameters corresponding to said determined target positions and provides said determined pairs of acoustic transfer functions to said sound image control parts, respectively.

10. The audio communication control unit of claim 9, wherein, letting the numbers of terminals participating in all teleconferences be represented by M, wherein M is an integer equal to or greater than 2, said signal processing control part determines said target positions for all conference participating terminals to be symmetric left-right positions at intervals of 180/(M-1) degrees.

11. An audio communication control unit for teleconferencing which is connected via a communication network to a plurality of terminals, comprising:

a switching part for switching audio signals received from N terminals via said communication network, N being an integer equal to or greater than 3;

N input channels connected to said switching part and supplied with the input audio signals from said N terminals, respectively;

a channel branching part for branching each of said input audio signals from said N input channels into K branched audio signals of K branched channels, K being an integer equal to or greater than 2;

a sound image control part for processing said K branched audio signals of said K branched channels corresponding to each of said N input channels with a corresponding one of N parameter sets each including K sound image control parameters of predetermined kind or kinds to produce sound-image controlled audio signals of K branch channels corresponding to each of said N input channels, at least one of said N parameter sets being different from the other parameter sets according to target positions of said terminals;

a mixing part for mixing said sound-image controlled audio signals of K branch channels corresponding respectively to said N terminals, for each branch channel, to thereby generate mixed audio signals of K channels;

a terminal-associated branching part for branching said mixed audio signals of K channels in correspondence with said N terminals for input into said switching part;

wherein Q sets of said channel branching part, said sound image control part, said mixing part and said terminal-associated branching part are provided, Q being an integer equal to or greater than 2;

a combination assignment part for applying said input audio signal from each of said N terminals via said switching part to designated one or more of said channel branching parts; and

an inter-combination mixing part for mixing together, for a corresponding one of the K channels, said K-channel mixed audio signals distributed from designated one or more of said terminal-associated branching parts and outputting said channel-associated mixed audio signal to said each terminal; and

wherein said K channels are left and right two channels and said Q sound image control parts corresponding to said teleconferences each generate, for each terminal, a stereo audio signal of left and right channels as said sound-image controlled audio signal by convolving a pair of acoustic transfer functions as said sound image control parameters, which correspond to a target position of a sound source different for each of said N terminals, into said branched audio signals of said left and right channels corresponding to said each terminal, respectively.

12. The audio communication control unit of claim 11, further comprising a signal processing control part which detects the number of terminals participating in each of said teleconferences by detecting signals requesting to participate in said each teleconference from said N terminals, determines pairs of acoustic transfer functions corresponding to target positions of the same number as said detected number of participating terminals for said each teleconference and sets said determined pairs of acoustic transfer functions in that one of said sound image control parts corresponding to said each teleconference.

13. The audio communication control unit of claim 12, wherein, letting the number of terminals participating in each teleconference be represented by M_P, wherein Mp is an integer equal to or greater than 2, said signal processing control part determines said target positions for all conference participating terminals to be symmetric left-right positions at intervals of 180/(M_P -1) degrees.

14. The audio communication control unit of claim 12, wherein upon each change in the number of terminals participating in any one of said teleconferences by a request to participate in or leave said any one teleconference, said signal processing control part updates said target positions of said any one teleconference according to the new number of conference participating terminals, updates said pair of transfer functions according to said updated target positions and sets said updated pair of transfer functions in that one of said sound image control parts corresponding to said any one teleconference.