Integrated latency detection and echo cancellation

• US 8,503,669 B2
• Filed: 04/07/2008
• Issued: 08/06/2013
• Est. Priority Date: 04/07/2008
• Status: Active Grant

• Current Assignee: Sony Interactive Entertainment Inc. (Sony Group Corp.)
• Original Assignee: Sony Computer Entertainment Incorporated (Sony Group Corp.)
• Inventors: Mao, Xiadong
• Primary Examiner(s): Landau, Matthew
• Assistant Examiner(s): Ahmad, Khaja
• Application Number:
  US12/099,030
• Publication Number:
  US 20090252343A1
• Time in Patent Office: 1,947 Days
• Field of Search: 381/66, 381/93, 381/94.1, 381/94.3, 37940601-40616, 370/289, 370282-286
• US Class Current: 379/406.06
• CPC Class Codes: H04M 9/082 using echo cancellers echo cancellers per se H04B3/23

Abstract

In an audio system having a microphone, a speaker coupled to a source of audio output, and an echo canceller coupled to the speaker and microphone, latency between the source of audio output and the speaker may be compensated in echo cancellation performed by the echo canceller. The echo canceller may use a reference signal derived from a signal from the source of audio output in echo cancellation. The latency may be compensated by measuring the latency between the signal from the source of audio output and the speaker, determining a delay amount from the latency, delaying the reference signal by the delay amount to produce a delayed reference signal, and using the delayed reference signal as the reference signal in the echo canceller.

Claims

1. In an audio system having a microphone, a speaker coupled to a source of audio output, and an echo canceller coupled to the speaker and microphone, a method for compensating for latency between the source of audio output and the speaker in echo cancellation performed by the echo canceller, wherein the echo canceller uses a reference signal derived from a signal from the source of audio output in echo cancellation, the method comprising:

a) measuring a frequency dependent latency between the signal from the source of audio output and the speaker, wherein measuring the frequency dependent latency includes applying a broadband white noise calibration signal to the speaker, wherein the frequency dependent latency is caused by one or more components of the audio system that are characterized by a component latency that depends on the frequency of the signal, generating sound from the broadband white noise calibration signal with the speaker, capturing the sound with the microphone and converting the sound to a microphone signal, and comparing the broadband white noise calibration signal to the microphone signal;

b) determining a frequency dependent delay amount from the frequency dependent latency;

c) delaying the reference signal by the frequency dependent delay amount to produce a delayed reference signal; and

d) using the delayed reference signal as the reference signal in the echo canceller.

2. The method of claim 1, wherein applying the calibration signal to the speaker and generating sound from the calibration signal with the speaker include applying the calibration signal to a signal converter coupled between the source of audio output and the speaker.

3. The method of claim 1 wherein the delay amount is determined by comparing the latency determined in b) to a latency tolerance of the echo canceller.

4. The method of claim 1 wherein d) includes comparing the delayed reference signal with the microphone signal, extracting an echo signal from the microphone signal and subtracting the echo signal from the microphone signal.

5. An audio system operable with a source of audio output, a speaker and a microphone, comprising:

a microphone interface configured to receive a signal from the microphone;

a speaker output configured to be coupled to the source of audio output;

an echo canceller coupled to the speaker output and the microphone interface, wherein the echo canceller is configured to use a reference signal derived from a signal from the source of audio output in echo cancellation,

a latency compensator configured to measure a frequency dependent latency between the signal from the source of audio output and the speaker, wherein the frequency dependent latency is caused by one or more components of the audio system that are characterized by a component latency that depends on the frequency of the signal, determine a frequency dependent delay amount from the frequency dependent latency and

delay the reference signal by the frequency dependent delay amount, whereby the echo canceller uses the delayed reference signal as the reference signal for echo cancellation of a signal from the microphone; and

a calibration signal generator coupled to the latency compensator and the speaker output wherein the calibration signal generator is configured to generate a broadband white noise calibration signal, and apply the broadband white noise calibration signal to the speaker output.

6. The audio system of claim 5 wherein the speaker output is configured to receive a removable connection to the speaker.

7. The audio system of claim 6 wherein the removable connection is connection for a HDMI or S/PDIF interface.

8. The audio system of claim 5, further comprising a user interface coupled to the latency compensator.

9. The audio system of claim 8 wherein the latency compensator is configured to adjust the delay amount in response to a signal from the user input.

10. An audio system comprising:

a speaker output configured to be coupled to a source of audio output;

a computer processor coupled to the speaker output and an interface configured to receive a signal from a microphone and

computer readable instructions executable by the processor, wherein the computer readable instructions include echo canceller instructions that, when executed by the processor, use a reference signal derived from a signal from the source of audio output in echo cancellation of the signal from the microphone; and

latency compensation instructions that, when executed by the processor, generate a broadband white noise calibration signal, apply the white noise calibration signal to a signal converter coupled between the source of audio output and the speaker, wherein one or more components of the audio system are characterized by a component latency that depends on the frequency of the signal, capture the signal from the microphone and compare the broadband white noise calibration signal applied to the signal converter to the signal from the microphone, wherein the signal from the microphone contains sound generated from the broadband white noise calibration signal with the signal converter and the speaker, measure a latency between the signal from the source of audio output and the speaker, wherein the frequency dependent latency is caused by the component latency of the one or more components of the audio system, determine a frequency dependent delay amount from the frequency dependent latency and delay the reference signal by the frequency dependent delay amount, whereby the echo canceller uses the delayed reference signal as the reference signal for echo cancellation of the signal from the microphone.

11. The audio system of claim 10, further comprising a user interface coupled to the processor.

12. The audio system of claim 11 wherein the compensation instructions are configured to adjust the delay amount in response to a signal from the user interface.