Audio signal processing for noise reduction

• US 10,424,315 B1
• Filed: 03/19/2018
• Issued: 09/24/2019
• Est. Priority Date: 03/20/2017
• Status: Active Grant

• Current Assignee: Bose Corporation
• Original Assignee: Bose Corporation
• Inventors: Ganeshkumar, Alaganandan
• Primary Examiner(s): Yu, Norman
• Application Number:
  US15/925,241
• Time in Patent Office: 554 Days
• Field of Search: 381 26, 381309, 381317, 381 716, 381 7111, 381 92, 381 941- 943, 381 947, 381110, 381122, 381 74
• CPC Class Codes: G10K 2210/1081 Earphones, e.g. for telephones, ear protectors or headsets
• CPC Class Codes: G10L 2021/02165 Two microphones, one receiving mainly the noise signal and the other one mainly the speech signal
• CPC Class Codes: G10L 2021/02166 Microphone arrays; Beamforming
• CPC Class Codes: G10L 21/0208 Noise filtering
• CPC Class Codes: G10L 21/0232 Processing in the frequency domain
• CPC Class Codes: G10L 21/0364 for improving intelligibility
• CPC Class Codes: G10L 25/21 the extracted parameters being power information
• CPC Class Codes: G10L 25/51 for comparison or discrimination
• CPC Class Codes: G10L 25/78 Detection of presence or absence of voice signals switching of direction of transmission by voice frequency in two-way loud-speaking telephone systems H04M9/10
• CPC Class Codes: G10L 25/84 for discriminating voice from noise
• CPC Class Codes: H03G 5/165 Equalizers; Volume or gain control in limited frequency bands
• CPC Class Codes: H04R 1/1008 Earpieces of the supra-aural or circum-aural type
• CPC Class Codes: H04R 1/1041 Mechanical or electronic switches, or control elements switches in general H01H
• CPC Class Codes: H04R 1/1083 Reduction of ambient noise active noise reduction per se G10K11/175; protective devices for the ear, e.g. providing acoustic protection A61F11/06
• CPC Class Codes: H04R 1/406 microphones
• CPC Class Codes: H04R 2201/107 Monophonic and stereophonic headphones with microphone for two-way hands free communication
• CPC Class Codes: H04R 2410/05 Noise reduction with a separate noise microphone
• CPC Class Codes: H04R 2410/07 Mechanical or electrical reduction of wind noise generated by wind passing a microphone
• CPC Class Codes: H04R 2430/03 Synergistic effects of band splitting and sub-band processing
• CPC Class Codes: H04R 2430/25 Array processing for suppression of unwanted side-lobes in directivity characteristics, e.g. a blocking matrix
• CPC Class Codes: H04R 2460/01 : Hearing devices using active noise cancellation
• CPC Class Codes: H04R 3/005 : for combining the signals of two or more microphones specially adapted for hearing aids H04R25/407
• CPC Class Codes: H04R 5/033 : Headphones for stereophonic communication details thereof, e.g. relating to batteries, cables or control elements H04R1/10

Abstract

Audio device systems and methods are provided to enhance speech pick-up from a user. The systems and methods include a plurality of left signals and right signals from microphones coupled to left and right earpieces. Various of the signals are combined to provide a primary signal having enhanced acoustic response in the direction of a selected location, such as the user'"'"'s mouth. Additionally, the left signals are combined to provide a left reference signal having reduced acoustic response from the selected location, and the right signals are combined to provide a right reference signal also having reduced acoustic response from the selected location. Each of the left and right reference signals are filtered to provide left and right noise estimates, respectively, and the left and right noise estimates are subtracted from the primary signal.

Claims

1. A headphone system, comprising:

a plurality of left microphones coupled to a left earpiece to provide a plurality of left signals;

a plurality of right microphones coupled to a right earpiece to provide a plurality of right signals;

one or more processors configured to;

combine one or more of the plurality of left signals or the plurality of right signals to provide a primary signal having enhanced acoustic response in a direction of a selected location,

combine the plurality of left signals to provide a left reference signal having reduced acoustic response from the selected location, and

combine the plurality of right signals to provide a right reference signal having reduced acoustic response from the selected location;

a left filter configured to filter the left reference signal to provide a left estimated noise signal;

a right filter configured to filter the right reference signal to provide a right estimated noise signal; and

a combiner configured to subtract the left estimated noise signal and the right estimated noise signal from the primary signal.

2. The headphone system of claim 1 further comprising a voice activity detector configured to indicate whether a user is talking, and wherein each of the left filter and the right filter is an adaptive filter configured to adapt during periods of time when the voice activity detector indicates the user is not talking.

3. The headphone system of claim 1 further comprising a wind detector configured to indicate whether a wind condition exists, and wherein the one or more processors are configured to transition to a monaural operation when the wind detector indicates a wind condition exists.

4. The headphone system of claim 3 wherein the wind detector is configured to compare a first combination of one or more of the plurality of left signals and the plurality of right signals using a first array processing technique to a second combination of the one or more of the plurality of left signals and the plurality of right signals using a second array processing technique and to indicate whether the wind condition exists based upon the comparison.

5. The headphone system of claim 1 further comprising an off-head detector configured to indicate whether at least one of the left earpiece or the right earpiece is removed from proximity to a user'"'"'s head, and wherein the one or more processors are configured to transition to a monaural operation when the off-head detector indicates at least one of the left earpiece or the right earpiece is removed from proximity to the user'"'"'s head.

6. The headphone system of claim 1 wherein the one or more processors is configured to combine the plurality of left signals by a delay-and-subtract technique to provide the left reference signal and to combine the plurality of right signals by a delay-and-subtract technique to provide the right reference signal.

7. The headphone system of claim 1 further comprising one or more signal mixers configured to transition the headphone system to monaural operation by weighting a left-right balance to be fully left or right.

8. A method of enhancing speech of a headphone user, the method comprising:

receiving a plurality of left microphone signals;

receiving a plurality of right microphone signals;

combining one or more of the plurality of left and right microphone signals to provide a primary signal having enhanced acoustic response in a direction of a selected location;

combining the plurality of left microphone signals to provide a left reference signal having reduced acoustic response from the selected location;

combining the plurality of right microphone signals to provide a right reference signal having reduced acoustic response from the selected location;

filtering the left reference signal to provide a left estimated noise signal;

filtering the right reference signal to provide a right estimated noise signal; and

subtracting the left estimated noise signal and the right estimated noise signal from the primary signal.

9. The method of claim 8 further comprising receiving an indication whether a user is talking and adapting one or more filters associated with filtering the left and right reference signals during periods of time when the user is not talking.

10. The method of claim 8 further receiving an indication whether a wind condition exists and transitioning to a monaural operation when the wind condition exists.

11. The method of claim 10 further comprising providing the indication whether a wind condition exists by comparing a first combination of one or more of the plurality of left and right microphone signals using a first array processing technique to a second combination of the one or more of the plurality of left and right microphone signals using a second array processing technique and indicating whether the wind condition exists based upon the comparison.

12. The method of claim 8 further comprising receiving an indication of an off-head condition and transitioning to a monaural operation when the off-head condition exists.

13. The method of claim 8 wherein each of combining the plurality of left microphone signals to provide the left reference signal and combining the plurality of right microphone signals to provide the right reference signal comprises a delay-and-subtract technique.

14. The method of claim 8 further comprising weighting a left-right balance to transition the headphone to monaural operation.

15. A headphone system, comprising:

a plurality of left microphones to provide a plurality of left signals;

a plurality of right microphones to provide a plurality of right signals;

one or more processors configured to;

combine the plurality of left signals to provide a left primary signal having enhanced acoustic response in a direction of a user'"'"'s mouth,

combine the plurality of right signals to provide a right primary signal having enhanced acoustic response in the direction of the user'"'"'s mouth,

combine the left primary signal and the right primary signal to provide a voice estimate signal,

combine the plurality of left signals to provide a left reference signal having reduced acoustic response in the direction of the user'"'"'s mouth, and

combine the plurality of right signals to provide a right reference signal having reduced acoustic response in the direction of the user'"'"'s mouth;

a left filter configured to filter the left reference signal to provide a left estimated noise signal;

a right filter configured to filter the right reference signal to provide a right estimated noise signal; and

a combiner configured to subtract the left estimated noise signal and the right estimated noise signal from the voice estimate signal.

16. The headphone system of claim 15 further comprising a voice activity detector configured to indicate whether a user is talking, and wherein each of the left filter and the right filter is an adaptive filter configured to adapt during periods of time when the voice activity detector indicates the user is not talking.

17. The headphone system of claim 15 further comprising a wind detector configured to indicate whether a wind condition exists, and wherein the one or more processors are configured to transition to a monaural operation when the wind detector indicates a wind condition exists.

18. The headphone system of claim 17 wherein the wind detector is configured to compare a first combination of one or more of the plurality of left signals and the plurality of right signals using a first array processing technique to a second combination of the one or more of the plurality of left signals and the plurality of right signals using a second array processing technique and to indicate whether the wind condition exists based upon the comparison.

19. The headphone system of claim 15 further comprising an off-head detector configured to indicate whether at least one of the left earpiece or the right earpiece is removed from proximity to a user'"'"'s head, and wherein the one or more processors are configured to transition to a monaural operation when the off-head detector indicates at least one of the left earpiece or the right earpiece is removed from proximity to the user'"'"'s head.

20. The headphone system of claim 15 wherein the one or more processors is configured to combine the plurality of left signals by a delay-and-subtract technique to provide the left reference signal and to combine the plurality of right signals by a delay-and-subtract technique to provide the right reference signal.