Videoconferencing echo cancellers

• US 20060239443A1
• Filed: 04/17/2006
• Published: 10/26/2006
• Est. Priority Date: 10/15/2004
• Status: Active Grant

• Current Assignee: Lifesize, Inc. (Enghouse Systems Limited)
• Original Assignee: Lifesize, Inc. (Enghouse Systems Limited)
• Inventors: Kenoyer, Michael L., Oxford, William V.
• Granted Patent: US 7,903,137 B2
• Time in Patent Office: Days
• US Class Current: 379/406.10
• CPC Class Codes: H04M 19/00 Current supply arrangements for telephone systems for selecting-equipment H04Q1/28
• CPC Class Codes: H04N 7/142 Constructional details of the terminal equipment, e.g. arrangements of the camera and the display
• CPC Class Codes: H04N 7/147 Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals selecting H04Q
• CPC Class Codes: H04N 7/15 Conference systems

Abstract

A system may be configured to: receive remote audio signals and corresponding spatial indicators from remote systems; generate output signals for local speakers based on the remote audio signals and the corresponding spatial indicators; supply a microphone input signal to a first echo canceller in a series of echo cancellers, where each echo canceller of the series corresponds to a position in a set of positions along a one-dimensional locus connecting the speakers; map each of the remote audio signals to a corresponding one of the positions based on the corresponding spatial indicator; for each position of the set of positions, combine any of the remote audio signals that map to that position in order to form a corresponding input signal for the corresponding echo canceller; transmit a resultant signal including at least an output of a last echo canceller of the series to the remote systems.

Claims

1. A method comprising:

(a) receiving one or more remote audio signals and corresponding spatial indicators from one or more remote systems;

(b) generating output signals for a plurality of speakers based on the one or more remote audio signals and the corresponding spatial indicators;

(c) supplying a microphone input signal to a first echo canceller in a series of echo cancellers, wherein each echo canceller of the series corresponds to a position in a set of positions along a one-dimensional locus passing through the plurality of speakers;

(d) mapping each of the remote audio signals to a corresponding one of the positions based on the corresponding spatial indicator;

(e) for each position of the set of positions, combining any of the remote audio signals that map to that position in order to form a corresponding input signal for the corresponding echo canceller;

(f) transmitting a resultant signal including at least an output of a last echo canceller of the series to the one or more remote systems.

2. The method of claim 1, wherein said generating output signals for a plurality of speakers comprises determining a set of gain coefficients for each remote audio signal based on the corresponding spatial indicator, wherein each gain coefficient of the set of gain coefficients controls an extent to which the remote audio signal contributes to a corresponding one of the speaker output signals.

3. The method of claim 1, wherein (a) through (f) are performed by one or more processors in a videoconferencing system.

4. The method of claim 1 further comprising:

receiving one or more remote video signals from the one or more remote systems;

generating a local video signal from the one or more remote video signals; and

displaying the local video signal on a display unit.

5. The method of claim 1, wherein (a) through (f) are performed by one or more processors in a speakerphone.

6. The method of claim 1, wherein said combining any of the remote audio signals that map to that position in order to form a corresponding input signal comprises setting the corresponding input signal equal to zero if there are currently no remote audio signals that map to that position.

7. The method of claim 1 further comprising:

repeating (a) through (f) a number of times.

8. A computer-readable memory medium configured to store program instructions, wherein the program instructions are executable to implement:

(a) receiving one or more remote audio signals and corresponding spatial indicators from one or more remote systems;

(b) generating output signals for a plurality of speakers based on the one or more remote audio signals and the corresponding spatial indicators;

(c) supplying a microphone input signal to a first echo canceller in a series of echo cancellers, wherein each echo canceller of the series corresponds to a position in a set of positions along a one-dimensional locus passing through the plurality of speakers;

(d) mapping each of the remote audio signals to a corresponding one of the positions based on the corresponding spatial indicator;

(e) for each position of the set of positions, combining any of the remote audio signals that map to that position in order to form a corresponding input signal for the corresponding echo canceller;

(f) transmitting a resultant signal including at least an output of a last echo canceller of the series to the one or more remote systems.

9. The memory medium of claim 8, wherein said generating output signals for a plurality of speakers comprises determining a set of gain coefficients for each remote audio signal based on the corresponding spatial indicator, wherein each gain coefficient of the set of gain coefficients controls an extent to which the remote audio signal contributes to a corresponding one of the speaker output signals.

10. The memory medium of claim 8, wherein the program instructions are executable to further implement:

receiving one or more remote video signals from the one or more remote systems;

generating a local video signal from the one or more remote video signals; and

displaying the local video signal on a display unit.

11. The memory medium of claim 8, wherein said combining any of the remote audio signals that map to that position in order to form a corresponding input signal comprises setting the corresponding input signal equal to zero if there are currently no remote audio signals that map to that position.

12. The memory medium of claim 8 wherein the program instructions are executable to further implement:

repeating (a) through (f) a number of times.

13. A system comprising:

a memory configured to store program instructions;

a processor configured to read and execute the program instructions from the memory, wherein the program instructions are executable by the processor to implement;

(a) receiving one or more remote audio signals and corresponding spatial indicators from one or more remote systems;

(b) generating output signals for a plurality of speakers based on the one or more remote audio signals and the corresponding spatial indicators;

(c) supplying a microphone input signal to a first echo canceller in a series of echo cancellers, wherein each echo canceller of the series corresponds to a position in a set of positions along a one-dimensional locus passing through the plurality of speakers;

(d) mapping each of the remote audio signals to a corresponding one of the positions based on the corresponding spatial indicator;

(e) for each position of the set of positions, combining any of the remote audio signals that map to that position in order to form a corresponding input signal for the corresponding echo canceller;

(f) transmitting a resultant signal including at least an output of a last echo canceller of the series to the one or more remote systems.

14. The system of claim 13, wherein said generating output signals for a plurality of speakers comprises determining a set of gain coefficients for each remote audio signal based on the corresponding spatial indicator, wherein each gain coefficient of the set of gain coefficients controls an extent to which the remote audio signal contributes to a corresponding one of the speaker output signals.

15. The system of claim 13 further comprising the microphone and the plurality of speakers.

16. The system of claim 15 further comprising a display unit and a video camera.

17. The system of claim 13, where the program instructions are executable to further implement:

receiving one or more remote video signals from the one or more remote systems;

generating a local video signal from the one or more remote video signals; and

displaying the local video signal on a display unit.

18. The system of claim 13, wherein said combining any of the remote audio signals that map to that position in order to form a corresponding input signal comprises setting the corresponding input signal equal to zero if there are currently no remote audio signals that map to that position.

19. The system of claim 13, wherein the program instructions are executable to further implement:

repeating (a) through (f) for each microphone in an array of microphones.

20. The system of claim 13, wherein the program instructions are executable to further implement:

repeating (a) through (f) a number of times.