Method and system for enhancing sound

• US 8,938,078 B2
• Filed: 10/07/2011
• Issued: 01/20/2015
• Est. Priority Date: 10/07/2010
• Status: Active Grant

• Current Assignee: Concertsonics LLC
• Original Assignee: Concertsonics LLC
• Inventors: Meyer, James E.
• Primary Examiner(s): Paul, Disler
• Application Number:
  US13/269,536
• Publication Number:
  US 20120087507A1
• Time in Patent Office: 1,201 Days
• Field of Search: 381/77, 381/82, 381/56, 381 79- 80, 381/74
• US Class Current: 381/82
• CPC Class Codes: H04R 2227/007 Electronic adaptation of audio signals to reverberation of the listening space for PA
• CPC Class Codes: H04R 2420/07 Applications of wireless loudspeakers or wireless microphones
• CPC Class Codes: H04R 27/00 Public address systems circuits for preventing acoustic reaction H04R3/02; circuits for distributing signals to loudspeakers H04R3/12; monitoring or testing arrangements for public address systems H04R29/007; amplifiers H03F
• CPC Class Codes: H04R 5/033 Headphones for stereophonic communication details thereof, e.g. relating to batteries, cables or control elements H04R1/10
• CPC Class Codes: H04R 5/04 Circuit arrangements, e.g. for selective connection of amplifier inputs/outputs to loudspeakers, for loudspeaker detection, or for adaptation of settings to personal preferences or hearing impairments combinations of amplifiers H03F3/68; stereophonic systems H04S

Abstract

A method of enhancing audio sound. The method includes sensing an acoustic signal using a microphone in an electronic device. The acoustic signal is emitted in response to a primary sound signal and transmitted as a sound wave through a space. The method further includes receiving, using an antenna in the electronic device, a wireless signal encoded with the primary sound signal. An impulse response for the space is estimated based on the sensed acoustic signal and the primary sound signal encoded within the received wireless signal. A delay between the sensed acoustic signal and the primary sound signal encoded within the received wireless signal is calculated based on the estimated impulse response. The primary sound signal encoded within the received wireless signal is delayed using the calculated delay and reproduced to enhance the acoustic signal heard by a user of the electronic device.

Claims

1. A method of enhancing an acoustic signal, comprising steps of:

sensing an acoustic signal using a microphone in an electronic device, the acoustic signal emitted in response to a primary sound signal and transmitted through a space;

converting the sensed acoustic signal to a digitized acoustic signal;

receiving, using an antenna in the electronic device, a wireless signal encoded with the primary sound signals;

decoding the primary sound signal encoded in the wireless signal as a digital primary sound signal;

estimating an impulse response for the space based on the digitized acoustic signal and the digital primary sound signal;

calculating a delay between the digitized acoustic signal and the digital primary sound signal by scanning the estimated impulse response to identify a peak magnitude of the estimated impulse response;

calculating an average magnitude of the estimated impulse response;

comparing the average magnitude of the estimated impulse response to the peak magnitude of the estimated impulse response to determine a peak-to-average ratio;

delaying the digital primary sound signal using the calculated delay if the peak-to-average ratio exceeds a predetermined value; and

reproducing the delayed digital primary sound signal to enhance the acoustic signal heard by a user of the electronic device.

2. The method of claim 1, further comprising a step of high-pass filtering the estimated impulse response.

3. The method of claim 2, wherein;

the step of calculating the delay comprises calculating the delay between the digitized acoustic signal and the digital primary sound signal by scanning the high-pass filtered, estimated impulse response to identify a peak magnitude of the high-pass filtered, estimated impulse response,

the step of calculating an average magnitude of the estimated impulse response comprises calculating an average magnitude of the high-pass filtered, estimated impulse response, and

the step of comparing comprises comparing the average magnitude of the high-pass filtered, estimated impulse response to the peak magnitude of the high-pass filtered, estimated impulse response to determine the peak-to-average ratio.

4. The method of claim 1, further comprising a step of low-pass filtering the digitized acoustic signal and the digital primary sound signal, wherein the step of estimating the impulse response comprises estimating the impulse response for the space based on the low-pass filtered, digitized acoustic signal and the low-pass filtered, digital primary sound signal.

5. The method of claim 4, further comprising steps of:

down-sampling the low-pass filtered, digitized acoustic signal; and

down-sampling the low-pass filtered, digital primary sound signal,

wherein the step of estimating the impulse response comprises estimating the impulse response for the space based on the down-sampled, low-pass filtered, digitized acoustic signal and the down-sampled, low-pass filtered, digital primary sound signal.

6. The method of claim 1, further comprising a step of looping through the steps of sensing, converting, receiving, decoding, estimating, and calculating the delay to calculate a plurality of delay times, wherein the step of delaying the digital primary sound signal comprises delaying the digital primary sound signal using an average of the plurality of delay times if the plurality of delay times are consistent.

7. The method of claim 6, further comprising a step of:

capturing a sequence of the digitized acoustic signal and a sequence of the digital primary sound signal,

wherein the step of estimating comprises estimating the impulse response for the space based on the captured sequence of the digitized acoustic signal and the captured sequence of the digital primary sound signal, and

wherein the captured sequence of the digital primary sound signal is shifted each time the steps of sensing, converting, receiving, decoding, estimating, and calculating the delay are looped through.

8. The method of claim 1, wherein the step of estimating the impulse response comprises performing deconvolution on the digitized acoustic signal and the digital primary sound signal to estimate the impulse response for the space.

9. The method of claim 1, wherein the step of estimating the impulse response comprises performing a cross-correlation algorithm on the digitized acoustic signal and the digital primary sound signal to estimate the impulse response for the space.

10. A method of enhancing an acoustic signal, comprising steps of:

sensing an acoustic signal using a microphone in an electronic device, the acoustic signal emitted in response to a primary sound signal and transmitted through a space;

converting the sensed acoustic signal to a digitized acoustic signal;

receiving, using an antenna in the electronic device, a wireless signal encoded with the primary sound signal;

decoding the primary sound signal encoded in the wireless signal as a digital primary sound signal;

estimating an impulse response for the space based on the digitized acoustic signal and the digital primary sound signal;

calculating a delay between the digitized acoustic signal and the digital primary sound signal by scanning the estimated impulse response to identify a peak magnitude of the estimated impulse response;

calculating a root mean square (RMS) of a magnitude of the estimated impulse response;

comparing the RMS of the magnitude of the estimated impulse response to the peak magnitude of the estimated impulse response to determine a peak-to-RMS ratio;

delaying the digital primary sound signal using the calculated delay if the peak-to-RMS ratio exceeds a predetermined value; and

reproducing the delayed digital primary sound signal to enhance the acoustic signal heard by a user of the electronic device.

11. The method of claim 10, further comprising a step of looping through the steps of sensing, converting, receiving, estimating, decoding, and calculating the delay to calculate a plurality of delay times, wherein the step of delaying the digital primary sound signal comprises delaying the digital primary sound signal using an average of the plurality of delay times if the plurality of delay times are consistent.

12. The method of claim 11, further comprising a step of:

capturing a sequence of the digitized acoustic signal and a sequence of the digital primary sound signal,

wherein the step of estimating comprises estimating the impulse response for the space based on the captured sequence of the digitized acoustic signal and the captured sequence of the digital primary sound signal, and

wherein the captured sequence of the digital primary sound signal is shifted each time the steps of sensing, converting, receiving, decoding, estimating, and calculating the delay are looped through.

13. The method of claim 10, wherein the step of estimating the impulse response comprises performing deconvolution on the digitized acoustic signal and the digital primary sound signal to estimate the impulse response for the space.

14. The method of claim 10, wherein the step of estimating the impulse response comprises performing a cross-correlation algorithm on the digitized acoustic signal and the digital primary sound signal to estimate the impulse response for the space.

15. A method of enhancing an acoustic signal comprising steps of:

sensing an acoustic signal using a microphone in an electronic device, the acoustic signal emitted in response to a primary sound signal and transmitted through a space;

converting the sensed acoustic signal to a digitized acoustic signal;

receiving, using an antenna in the electronic device, a wireless signal encoded with the primary sound signal;

decoding the primary sound signal encoded in the wireless signal as a digital primary sound signal;

calculating a power spectrum of the digital primary sound signal;

determining whether the power spectrum of the digital primary sound signal indicates whether the digital primary sound signal has sufficient power;

estimating an impulse response for the space based on the digitized acoustic signal and the digital primary sound signal if the power spectrum of the digital primary sound signal indicates that the digital primary sound signal has sufficient power;

calculating a delay between the digitized acoustic signal and the digital primary sound signal based on the estimated impulse response;

delaying the digital primary sound signal using the calculated delay; and

reproducing the delayed digital primary sound signal to enhance the acoustic signal heard by a user of the electronic device.

16. A method of enhancing an acoustic signal, comprising steps of:

sensing an acoustic signal using a microphone in an electronic device, the acoustic signal emitted in response to a primary sound signal and transmitted through a space;

converting the sensed acoustic signal to a digitized acoustic signal;

receiving, using an antenna in the electronic device, a wireless signal encoded with the primary sound signal;

decoding the primary sound signal encoded in the wireless signal as a digital primary sound signal;

estimating an impulse response for the space based on the digitized acoustic signal and the digital primary sound signal, wherein the step of estimating further comprises calculating an error factor;

calculating a delay between the digitized acoustic signal and the digital primary sound signal based on the estimated impulse response if the error factor indicates a good signal-to-noise ratio for the estimated impulse response;

delaying the digital primary sound signal using the calculated delay; and

reproducing the delayed digital primary sound signal to enhance the acoustic signal heard by a user of the electronic device.

17. The method of claim 16, further comprising a step of high-pass filtering the estimated impulse response if the error factor indicates a good signal-to-noise ratio for the estimated impulse response.

18. The method of claim 17, wherein the step of calculating the delay comprises calculating the delay between the digitized acoustic signal and the digital primary sound signal by scanning the high-pass filtered, estimated impulse response to identify a peak magnitude of the high-pass filtered, estimated impulse response if the error factor indicates a good signal-to-noise ratio for the estimated impulse response.

19. A method of enhancing an acoustic signal, comprising steps of:

sensing an acoustic signal using a microphone in an electronic device, the acoustic signal emitted in response to a primary sound signal and transmitted through a space;

converting the sensed acoustic signal to a digitized acoustic signal;

receiving, using an antenna in the electronic device, a wireless signal encoded with the primary sound signal;

decoding the primary sound signal encoded in the wireless signal as a digital primary sound signal;

estimating an impulse response for the space based on the digitized acoustic signal and the digital primary sound signal;

calculating a transfer function from the estimated impulse response;

calculating an average group delay for the transfer function;

calculating a delay between the digitized acoustic signal and the digital primary sound by scanning the estimated impulse response to identify a peak magnitude of the estimated impulse response and comparing a time corresponding to the peak magnitude of the estimated impulse response to the average group delay for the transfer function;

delaying the digital primary sound signal using the calculate delay if a difference between the time corresponding to the peak magnitude of the estimated impulse response and the average group delay is less than a predetermined value; and

reproducing the delayed digital primary sound signal to enhance the acoustic signal heard by a user of the electronic device.

20. A device for enhancing sound, the device comprising:

a microphone configured for sensing an acoustic signal, the acoustic signal emitted in response to a primary sound signal and transmitted through a space;

an analog-to-digital converter for converting the sensed acoustic signal to a digitized acoustic signal;

an antenna configured for receiving a wireless signal encoded with the primary sound signal;

a receiver for receiving and decoding the primary sound signal encoded in the wireless signal as a digital primary sound signal;

a processor configured for;

estimating an impulse response for the space based on the digitized acoustic signal and the digital primary sound signal;

calculating a delay between the digitized acoustic signal and the digital primary sound signal by scanning the estimated impulse response to identify a peak magnitude of the estimated impulse response;

calculating an average magnitude of the estimated impulse response; and

comparing the average magnitude of the estimated impulse response to the peak magnitude of the estimated impulse response to determine a peak-to-average ratio;

a delay line configured for delaying the digital primary sound signal using the calculated delay if the peak-to-average ratio exceeds a predetermined value; and

an output configured for outputting the delayed digital primary sound signal.

21. The device of claim 20, wherein the processor is further configured for high-pass filtering the estimated impulse response.

22. The device of claim 21, wherein:

the calculating of the delay comprises calculating the delay between the digitized acoustic signal and the digital primary sound signal by scanning the high-pass filtered, estimated impulse response to identify a peak magnitude of the high-pass filtered, estimated impulse response,

the calculating of the average magnitude of the estimated impulse response comprises calculating an average magnitude of the high-pass filtered, estimated impulse response, and

the comparing comprises comparing the average magnitude of the high-pass filtered, estimated impulse response to the peak magnitude of the high-pass filtered, estimated impulse response to determine the peak-to-average ratio.

23. The device of claim 20, wherein the processor is further configured for low-pass filtering the digitized acoustic signal and the digital primary sound signal, wherein the estimating of the impulse response comprises estimating the impulse response for the space based on the low-pass filtered, digitized acoustic signal and the low-pass filtered, digital primary sound signal.

24. The device of claim 23, wherein the processor is further configured for:

down-sampling the low-pass filtered, digitized acoustic signal; and

down-sampling the low-pass filtered, digital primary sound signal,

wherein the estimating of the impulse response comprises estimating the impulse response for the space based on the down-sampled, low-pass filtered, digitized acoustic signal and the down-sampled, low-pass filtered, digital primary sound signal.

25. The device of claim 20, wherein the processor is further configured for calculating a plurality of delay times, and wherein the delay line is configured for delaying the digital primary sound signal using an average of the plurality of delay times if the plurality of delay times are consistent.

26. The device of claim 25, wherein:

the processor is further configured for capturing a sequence of the digitized acoustic signal and a sequence of the digital primary sound signal,

the estimating of the impulse response comprises estimating the impulse response for the space based on the captured sequence of the digitized acoustic signal and the captured sequence of the digital primary sound signal, and

the processor is further configured for shifting the captured sequence of the digital primary sound signal in between calculating each of the plurality of delay times.

27. The device of claim 20, wherein the estimating the impulse response comprises performing deconvolution on the digitized acoustic signal and the digital primary sound signal to estimate the impulse response for the space.

28. The device of claim 20, wherein the estimating the impulse response comprises performing a cross-correlation algorithm on the digitized acoustic signal and the digital primary sound signal to estimate the impulse response for the space.

29. A device for enhancing sound, the device comprising:

a microphone configured for sensing an acoustic signal, the acoustic signal emitted in response to a primary sound signal and transmitted through a space;

an analog-to-digital converter for converting, the sensed acoustic signal to a digitized acoustic signal;

an antenna configured for receiving a wireless signal encoded with the primary sound signal;

a receiver for receiving and decoding the primary sound signal encoded in the wireless signal as a digital primary sound signal;

a processor configured for;

estimating an impulse response for the space based on the digitized acoustic signal and the digital primary sound signal;

calculating a delay between the digitized acoustic signal and the digital primary sound signal by scanning the estimated impulse response to identify a peak magnitude of the estimated impulse response;

calculating a root mean square (RMS) of a magnitude of the estimated impulse response; and

comparing the RMS of the magnitude of the estimated impulse response to the peak magnitude of the estimated impulse response to determine a peak-to-RMS ratio;

a delay line configured for delaying the digital primary sound signal using the calculated delay if the peak-to-RMS ratio exceeds a predetermined value; and

an output configured for outputting the delayed digital primary sound signal.

30. The device of claim 29, wherein the processor is further configured for calculating a plurality of delay times, and wherein the delay line is configured for delaying the digital primary sound signal using an average of the plurality of delay times if the plurality of delay times are consistent.

31. The device of claim 30, wherein:

the processor is further configured for capturing a sequence of the digitized acoustic signal and a sequence of the digital primary sound signal,

the estimating of the impulse response comprises estimating the impulse response for the space based on the captured sequence of the digitized acoustic signal and the captured sequence of the digital primary sound signal, and

the processor is further configured for shifting the captured sequence of the digital primary sound signal in between calculating each of the plurality of delay times.

32. The device of claim 29, wherein the estimating the impulse response comprises performing deconvolution on the digitized acoustic signal and the digital primary sound signal to estimate the impulse response for the space.

33. The device of claim 29, wherein the estimating the impulse response comprises performing a cross-correlation algorithm on the digitized acoustic signal and the digital primary sound signal to estimate the impulse response for the space.

34. A device for enhancing sound, the device comprising:

a microphone configured for sensing an acoustic signal, the acoustic signal emitted in response to a primary sound signal and transmitted through a space;

an analog-to-digital converter for converting the sensed acoustic signal to a digitized acoustic signal;

an antenna configured for receiving a wireless signal encoded with the primary sound signal;

a receiver for receiving and decoding the primary sound signal encoded in the wireless signal as a digital primary sound signal;

a processor configured for;

calculating a power spectrum of the digital primary sound signal;

determining whether the power spectrum of the digital primary sound signal indicates whether the digital primary sound signal has sufficient power;

estimating an impulse response for the space based on the digitized acoustic signal and the digital primary sound signal if the power spectrum of the digital primary sound signal indicates that the digital primary sound signal has sufficient power; and

calculating a delay between the digitized acoustic signal and the digital primary sound signal by scanning the estimated impulse response to identify a peak magnitude of the estimated impulse response;

a delay line configured for delaying the digital primary sound signal using the calculated delay if the power spectrum of the digital primary sound signal indicates that the digital primary sound signal has sufficient power; and

an output configured for outputting the delayed primary sound signal.

35. A device for enhancing sound, the device comprising:

a microphone configured for sensing an acoustic signal, the acoustic signal emitted in response to a primary sound signal and transmitted through a space;

an analog-to-digital converter for converting the sensed acoustic signal to a digitized acoustic signal;

an antenna configured for receiving a wireless signal encoded with the primary sound signal;

a receiver for receiving and decoding the primary sound signal encoded in the wireless signal as a digital primary sound signal;

a processor configured for;

estimating an impulse response for the space based on the digitized acoustic signal and the digital primary sound signal, the estimating further comprising calculating an error factor; and

calculating the delay between the digitized acoustic signal and the digital primary sound signal based on the estimated impulse response if the error factor indicates a good signal-to-noise ratio for the estimated impulse response;

a delay line configured for delaying the digital primary sound signal using the calculated delay; and

an output configured for outputting the delayed digital primary sound signal.

36. The device of claim 35, wherein the processor is further configured for high-pass filtering the estimated impulse response if the error factor indicates a good signal-to-noise ratio for the estimated impulse response.

37. The device of claim 36, wherein the calculating of the delay comprises calculating the delay between the digitized acoustic signal and the digital primary sound signal by scanning the high-pass filtered, estimated impulse response to identify a peak magnitude of the high-pass filtered, estimated impulse response if the error factor indicates a good signal-to-noise ratio for the estimated impulse response.

38. A device for enhancing sound, the device comprising:

a microphone configured for sensing an acoustic signal, the acoustic signal emitted in response to a primary sound signal and transmitted through a space;

an analog-to-digital converter for converting the sensed acoustic signal to a digitized acoustic signal;

an antenna configured for receiving a wireless signal encoded with the primary sound signal;

a receiver for receiving and decoding the primary sound signal encoded in the wireless signal as a digital primary sound signal;

a processor configured for;

estimating an impulse response for the space based on the digitized acoustic signal and the digital primary sound signal;

calculating a transfer function from the estimated impulse response;

calculating an average group delay for the transfer function; and

calculating a delay between the digitized acoustic signal and the digital primary sound signal by scanning the estimated impulse response to identify a peak magnitude of the estimated impulse response and comparing a time corresponding to the peak magnitude of the estimated impulse response to the average group delay for the transfer function;

a delay line configured for delaying the digital primary sound signal by the calculated delay if a difference between the time corresponding to the peak magnitude of the estimated impulse response and the average group delay is less than a predetermined value; and

an output configured for outputting the delayed digital primary sound signal.