Noise reduction in multi-microphone systems

• US 10,469,944 B2
• Filed: 10/16/2014
• Issued: 11/05/2019
• Est. Priority Date: 10/21/2013
• Status: Active Grant

• Current Assignee: Nokia Technologies Oy (Nokia Corporation)
• Original Assignee: Nokia Technologies Oy (Nokia Corporation)
• Inventors: Niemisto, Riitta, Myllyla, Ville
• Primary Examiner(s): Chin, Vivian C
• Assistant Examiner(s): Suthers, Douglas J
• Application Number:
  US14/515,917
• Publication Number:
  US 20150110284A1
• Time in Patent Office: 1,846 Days
• Field of Search: 381 711, 381 92, 381334
• CPC Class Codes: G10L 2021/02166 Microphone arrays; Beamforming
• CPC Class Codes: G10L 21/0208 Noise filtering
• CPC Class Codes: H04R 1/08 Mouthpieces; Microphones; Attachments therefor
• CPC Class Codes: H04R 2410/01 Noise reduction using microphones having different directional characteristics
• CPC Class Codes: H04R 3/002 Damping circuit arrangements for transducers, e.g. motional feedback circuits

Abstract

An apparatus comprising: an input configured to receive at least three microphone audio signals, the at least three microphone audio signals comprising at least two near microphone audio signals generated by at least two near microphones located near to an desired audio source and at least one farmic audio signal generated by a farmic located further from the desired audio source; a first interference canceller module configured to generate a first processed audio signal based on a first selection from the near microphone audio signals; at least one further interference canceller module configured to generate at least one further processed audio signal based on at least one further selection from the at least three microphone audio signals; a comparator configured to determine from the first processed audio signal and the at least one further processed audio signal the audio signal with greater noise suppression.

Claims

1. A method comprising:

receiving at least three microphone audio signals from at least three microphones, the at least three microphones located on or coupled to an apparatus;

determining which of the at least three microphone audio signals is from a main microphone of the at least three microphones, where the main microphone comprises a first near microphone of the at least three microphones located near to a desired audio source;

generating a beam audio signal based on a filtering of a first near microphone audio signal of the at least three microphone audio signals from the first near microphone and a second near microphone audio signal of the at least three microphone audio signals from a second near microphone of the at least three microphones;

generating an anti-beam audio signal based on a different filtering of the first near microphone audio signal and the second near microphone audio signal;

generating a first audio interference cancellation output signal based on the beam audio signal and the anti-beam audio signal;

generating a second audio interference cancellation output signal based on the beam audio signal and a input third microphone audio signal of the at least three microphone audio signals from a far microphone of the at least three microphones located further from the desired audio source than the first near microphone and the second near microphone;

comparing levels of the first audio interference cancellation output signal and the second audio interference cancellation output signal; and

providing a highest output signal of the first audio interference cancellation output signal and the second audio interference cancellation output signal based on the comparing of the levels.

2. The method as claimed in claim 1, wherein receiving the at least three microphone audio signals comprises:

receiving one of the first near microphone audio signal or the second near microphone audio signal from a front microphone of the at least three microphones located substantially at a front of the apparatus;

receiving one of the first near microphone audio signal or the second near microphone audio signal from a back microphone of the at least three microphones located substantially at a rear of the apparatus; and

receiving the third microphone audio signal from the far microphone located substantially at an opposite end of the apparatus from the front and back microphones, wherein either the front microphone or the back microphone is determined to be the main microphone which comprises the first near microphone located near to the desired audio source.

3. The method as claimed in claim 2, where generating the beam audio signal comprises:

applying a first finite impulse response filter to the first near microphone audio signal;

applying a second finite impulse response filter to the second near microphone audio signal; and

combining output of the first finite impulse response filter and the second finite impulse response filter to generate the beam audio signal.

4. The method as claimed in claim 3, where generating the anti-beam audio signal comprises:

applying a third finite impulse response filter to the first near microphone audio signal;

applying a fourth finite impulse response filter to the second near microphone audio signal; and

combining output of the third finite impulse response filter and the fourth finite impulse response filter to generate the anti-beam audio signal.

5. The method as claimed in claim 2, wherein generating the second audio interference cancellation output signal comprises filtering the beam audio signal based on the third microphone audio signal.

6. The method as claimed in claim 2, wherein generating the first audio interference cancellation output signal comprises filtering the beam audio signal based on the anti-beam audio signal.

7. The method as claimed in claim 1, further comprising filtering the beam audio signal based on the third microphone audio signal to generate the second audio interference cancellation output signal.

8. The method as claimed in claim 7, wherein filtering the beam audio signal based on the third microphone audio signal comprises noise suppression filtering of the beam audio signal based on the third microphone audio signal.

9. The method as claimed in claim 1, further comprising single channel noise suppressing the highest output signal, wherein the single channel noise suppressing comprises:

generating an indicator showing a period of the highest output signal comprises a lack of speech components or is significantly noise;

estimating and updating a background noise value from the highest output signal based on the indicator; and

processing the highest output signal based on the estimated background noise value to generate a noise suppressed audio signal.

10. The method as claimed in claim 9, wherein generating the indicator comprises:

normalising selections from the at least three microphone audio signals, wherein the selections comprise;

the beam audio signal and the anti-beam audio signal; and

the at least three microphone audio signals;

filtering the normalised selections from the at least three microphone audio signals;

comparing the filtered normalised selections to determine a power difference ratio; and

generating the indicator where at least one comparison of the filtered normalised selections has a power difference ratio greater than a determined threshold.

11. The method as claimed in claim 1, further comprising:

determining whether any of the at least three microphones are impaired; and

correcting any of the at least three microphone audio signals where impairment is determined.

12. The method as claimed in claim 1, wherein determining which of the at least three microphones is the main microphone which comprises the first near microphone comprises determining which of the at least three microphone audio signals is loudest and determining a microphone of the at least three microphones associated with the determined loudest microphone audio signal is the main microphone and is directed towards the desired audio source.

13. The method as claimed in claim 1, wherein the desired audio source is local speech and wherein generating the beam and anti-beam audio signals comprises:

generating the beam audio signal wherein the local speech, with respect to the main microphone which comprises the first near microphone, is substantially passed while noise coming from an opposite direction is significantly attenuated; and

generating the anti-beam audio signal wherein the local speech, with respect to the main microphone which comprises the first near microphone, is substantially attenuated while noise from other directions is substantially passed.

14. The method as claimed in claim 1, wherein generating the first audio interference cancellation output signal comprises generating the first audio interference cancellation output signal based on:

the beam audio signal as a signal comprising local speech, with respect to the main microphone which comprises the first near microphone, which is substantially passed while noise coming from an opposite direction is significantly attenuated, and

the anti-beam audio signal as a signal comprising the local speech, with respect to the main microphone which comprises the first near microphone, which is substantially attenuated while noise from other directions is substantially passed.

15. The method as claimed in claim 14, wherein generating the second audio interference cancellation output signal comprises generating the second audio interference cancellation output signal based on:

the beam audio signal as a signal comprising local speech, with respect to the main microphone which comprises the first near microphone, which is substantially passed while noise coming from an opposite direction is significantly attenuated, and

the third microphone audio signal as a signal comprising the local speech which is substantially attenuated while noise from other directions is substantially passed.

16. An apparatus comprising at least one processor and at least one non-transitory memory including computer code for one or more programs, the at least one non-transitory memory and the computer code configured to with the at least one processor cause the apparatus to:

receive at least three microphone audio signals from at least three microphones, the at least three microphones located on or coupled to the apparatus;

determine which of the at least three microphone audio signals is from a main microphone of the at least three microphones, where the main microphone comprises a first near microphone of the at least three microphones located near to a desired audio source;

generate a beam audio signal based on a filtering of a first near microphone audio signal of the at least three microphone audio signals from the first near microphone and a second near microphone audio signal of the at least three microphone audio signals from a second near microphone of the at least three microphones;

generating an anti-beam audio signal based on a different filtering of the first near microphone audio signal and the second near microphone audio signal;

generate a first audio interference cancellation output signal based on the beam audio signal and the anti-beam audio signal;

generate a second audio interference cancellation output signal based on the beam audio signal and a third microphone audio signal of the at least three microphone audio signals from a far microphone of the at least three microphones located further from the desired audio source than the first near microphone and the second near microphone;

compare levels of the first audio interference cancellation output signal and the second audio interference cancellation output signal; and

provide a selected output signal of the first audio interference cancellation output signal and the second audio interference cancellation output signal based on comparing the levels, where the selected output signal is one of;

a default output signal selected from the first audio interference cancellation output signal and the second audio interference cancellation output signal, or

a highest output signal of the first audio interference cancellation output signal and the second audio interference cancellation output signal.

17. The apparatus as claimed in claim 16, wherein the default output signal comprises the first audio interference cancellation output signal, and when providing the selected output signal, the at least one non-transitory memory and the computer code are further configured to with the at least one processor cause the apparatus to provide as the selected output signal the highest output signal comprising the second audio interference cancellation output signal where a level difference between the first audio interference cancellation output signal and the second audio interference cancellation output signal is greater than a threshold value.

18. The apparatus as claimed in claim 17, wherein the threshold value comprises a predetermined decibel level.

19. The apparatus as claimed in claim 16, wherein the at least one non-transitory memory and the computer code are further configured to with the at least one processor cause the apparatus to:

determine whether any of the at least three microphones are operating in mild wind, wherein providing the selected output signal further comprises providing the first audio interference cancellation output signal or the second audio interference cancellation output signal based on the determination.

20. The apparatus as claimed in claim 16, wherein the at least one non-transitory memory and the computer code are further configured to with the at least one processor cause the apparatus to:

determine whether any of the at least three microphones are operating in strong wind and/or wind shadow, wherein providing the selected output signal further comprises providing the first audio interference cancellation output signal or the second audio interference cancellation output signal based on the determination.

21. The apparatus as claimed in claim 16, wherein receiving the at least three microphone audio signals comprises:

receiving the first near microphone audio signal from the first near microphone located substantially at a front of the apparatus;

receiving the second near microphone audio signal from the second near microphone located substantially at a rear of the apparatus; and

receiving the third microphone audio signal from the far microphone located substantially at an opposite end of the apparatus from the first and second near microphones.

22. The apparatus as claimed in claim 16, wherein the at least one non-transitory memory and the computer code are further configured to with the at least one processor cause the apparatus to:

generate the beam audio signal, where generating the beam audio signal comprises;

applying a first finite impulse response filter to the first near microphone audio signal;

applying a second finite impulse response filter to the second near microphone audio signal; and

combining output of the first finite impulse response filter and the second finite impulse response filter to generate the beam audio signal; and

generate the anti-beam audio signal, where generating the anti-beam audio signal comprises;

applying a third finite impulse response filter to the first near microphone audio signal;

applying a fourth finite impulse response filter to the second near microphone audio signal; and

combining output of the third finite impulse response filter and the fourth finite impulse response filter to generate the anti-beam audio signal.

23. The apparatus as claimed in claim 16, wherein the at least one non-transitory memory and the computer code are further configured to with the at least one processor cause the apparatus to single channel noise suppress the selected output signal, wherein single channel noise suppressing the selected output signal comprises:

determining a period of the selected output signal comprises a lack of speech components or is significantly noise;

estimating and updating a background noise value from the selected output signal based on the determined period; and

processing the selected output signal based on the estimated background noise value to generate a noise suppressed audio signal.

24. The apparatus as claimed in claim 23, wherein determining the period comprises:

normalising selections from the at least three microphone audio signals, wherein the selections comprise;

the beam audio signal and the anti-beam audio signal; and

the at least three microphone audio signals;

filtering the normalised selections from the at least three microphone audio signals;

comparing the filtered normalised selections to determine a power difference ratio; and

determining the period where at least one comparison of the filtered normalised selections has a power difference ratio greater than a determined threshold.