Videoconferencing echo cancellers

• US 7,903,137 B2
• Filed: 04/17/2006
• Issued: 03/08/2011
• Est. Priority Date: 10/15/2004
• Status: Active Grant

• Current Assignee: Lifesize, Inc. (Enghouse Systems Limited)
• Original Assignee: Lifesize, Inc. (Enghouse Systems Limited)
• Inventors: Kenoyer, Michael L., Oxford, William V.
• Primary Examiner(s): Kuntz; Curtis
• Assistant Examiner(s): El-Zoobi; Maria
• Application Number:
  US11/405,684
• Publication Number:
  US 20060239443A1
• Time in Patent Office: 1,786 Days
• Field of Search: 379/202.01, 379/406.01, 348 1401- 1416, 381/92, 381/122
• US Class Current: 348/14.01
• CPC Class Codes: H04M 19/00 Current supply arrangements for telephone systems for selecting-equipment H04Q1/28
• CPC Class Codes: H04N 7/142 Constructional details of the terminal equipment, e.g. arrangements of the camera and the display
• CPC Class Codes: H04N 7/147 Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals selecting H04Q
• CPC Class Codes: H04N 7/15 Conference systems

Abstract

A system may be configured to: receive remote audio signals and corresponding spatial indicators from remote systems; generate output signals for local speakers based on the remote audio signals and the corresponding spatial indicators; supply a microphone input signal to a first echo canceller in a series of echo cancellers, where each echo canceller of the series corresponds to a position in a set of positions along a one-dimensional locus connecting the speakers; map each of the remote audio signals to a corresponding one of the positions based on the corresponding spatial indicator; for each position of the set of positions, combine any of the remote audio signals that map to that position in order to form a corresponding input signal for the corresponding echo canceller; transmit a resultant signal including at least an output of a last echo canceller of the series to the remote systems.

Claims

1. A method for performing echo cancellation of audio signals comprising:

(a) receiving one or more remote audio signals and corresponding spatial indicators from one or more remote systems;

(b) generating output signals for a plurality of speakers based on the one or more remote audio signals and the corresponding spatial indicators;

(c) supplying a microphone input signal to a first echo canceller in a series of echo cancellers, wherein each echo canceller of the series corresponds to a position in a set of positions along a one-dimensional locus passing through the plurality of speakers˜

wherein each echo canceller of the series includes a first input, a second input and an output, wherein the output of each echo canceller except for a last echo canceller of the series feeds the first input of a next echo canceller of the series, wherein the microphone input signal is supplied to the first input of the first echo canceller;

(d) mapping each of the remote audio signals to a corresponding one of the positions based on the corresponding spatial indicator;

(e) for each position of the set of positions, combining any of the remote audio signals that map to that position in order to form a corresponding input signal which is supplied as the second input of the corresponding echo canceller;

(f) transmitting a resultant signal including at least the output of the last echo canceller to the one or more remote systems.

2. The method of claim 1, wherein said generating output signals for a plurality of speakers comprises determining a set of gain coefficients for each remote audio signal based on the corresponding spatial indicator, wherein each gain coefficient of the set of gain coefficients controls an extent to which the remote audio signal contributes to a corresponding one of the speaker output signals.

3. The method of claim 1, wherein (a) through (f) are performed by one or more processors in a videoconferencing system.

4. The method of claim 1 further comprising:

receiving one or more remote video signals from the one or more remote systems;

generating a local video signal from the one or more remote video signals; and

displaying the local video signal on a display unit.

5. The method of claim 1, wherein (a) through (f) are performed by one or more processors in a speakerphone.

6. The method of claim 1, wherein said combining any of the remote audio signals that map to that position in order to form a corresponding input signal comprises setting the corresponding input signal equal to zero if there are currently no remote audio signals that map to that position.

7. The method of claim 1 further comprising:

repeating (a) through (f) a number of times.

8. A computer-readable memory medium configured to store program instructions, wherein the program instructions are executable to implement:

(a) receiving one or more remote audio signals and corresponding spatial indicators from one or more remote systems;

(b) generating output signals for a plurality of speakers based on the one or more remote audio signals and the corresponding spatial indicators;

(c) supplying a microphone input signal to a first echo canceller in a series of echo cancellers, wherein each echo canceller of the series corresponds to a position in a set of positions along a one-dimensional locus passing through the plurality of speakers, wherein each echo canceller of the series includes a first input, a second input and an output, wherein the output of each echo canceller except for a last echo canceller of the series feeds the first input of a next echo canceller of the series, wherein the microphone input signal is supplied to the first input of the first echo canceller;

(d) mapping each of the remote audio signals to a corresponding one of the positions based on the corresponding spatial indicator;

(e) for each position of the set of positions, combining any of the remote audio signals that map to that position in order to form a corresponding input signal which is supplied as the second input of the corresponding echo canceller;

(f) transmitting a resultant signal including at least the output of the last echo canceller to the one or more remote systems.

9. The memory medium of claim 8, wherein said generating output signals for a plurality of speakers comprises determining a set of gain coefficients for each remote audio signal based on the corresponding spatial indicator, wherein each gain coefficient of the set of gain coefficients controls an extent to which the remote audio signal contributes to a corresponding one of the speaker output signals.

10. The memory medium of claim 8, wherein the program instructions are executable to further implement:

receiving one or more remote video signals from the one or more remote systems;

generating a local video signal from the one or more remote video signals; and

displaying the local video signal on a display unit.

11. The memory medium of claim 8, wherein said combining any of the remote audio signals that map to that position in order to form a corresponding input signal comprises setting the corresponding input signal equal to zero if there are currently no remote audio signals that map to that position.

12. The memory medium of claim 8 wherein the program instructions are executable to further implement:

repeating (a) through (f) a number of times.

13. A system for performing echo cancellation of audio signals comprising:

a memory configured to store program instructions;

a processor configured to read and execute the program instructions from the memory, wherein the program instructions are executable by the processor to implement;

(a) receiving one or more remote audio signals and corresponding spatial indicators from one or more remote systems;

(b) generating output signals for a plurality of speakers based on the one or more remote audio signals and the corresponding spatial indicators;

(c) supplying a microphone input signal to a first echo canceller in a series of echo cancellers, wherein each echo canceller of the series corresponds to a position in a set of positions along a one-dimensional locus passing through the plurality of speakers, wherein each echo canceller of the series includes a first input, a second input and an output, wherein the output of each echo canceller except for a last echo canceller of the series couples to the first input of a next echo canceller of the series, wherein the microphone input signal is supplied to the first input of the first echo canceller;

(d) mapping each of the remote audio signals to a corresponding one of the positions based on the corresponding spatial indicator;

(e) for each position of the set of positions, combining any of the remote audio signals that map to that position in order to form a corresponding input signal which is supplied as the second input of the corresponding echo canceller;

(f) transmitting a resultant signal including at least the output of the last echo canceller to the one or more remote systems.

14. The system of claim 13, wherein said generating output signals for a plurality of speakers comprises determining a set of gain coefficients for each remote audio signal based on the corresponding spatial indicator, wherein each gain coefficient of the set of gain coefficients controls an extent to which the remote audio signal contributes to a corresponding one of the speaker output signals.

15. The system of claim 13 further comprising the microphone and the plurality of speakers.

16. The system of claim 15 further comprising a display unit and a video camera.

17. The system of claim 13, where the program instructions are executable to further implement:

receiving one or more remote video signals from the one or more remote systems;

generating a local video signal from the one or more remote video signals; and

displaying the local video signal on a display unit.

18. The system of claim 13, wherein said combining any of the remote audio signals that map to that position in order to form a corresponding input signal comprises setting the corresponding input signal equal to zero if there are currently no remote audio signals that map to that position.

19. The system of claim 13, wherein the program instructions are executable to further implement:

repeating (a) through (f) for each microphone in an array of microphones.

20. The system of claim 13, wherein the program instructions are executable to further implement:

repeating (a) through (f) a number of times.