Method and apparatus for removing noise from electronic signals

• US 20030128848A1
• Filed: 11/21/2002
• Published: 07/10/2003
• Est. Priority Date: 07/12/2001
• Status: Abandoned Application

• Current Assignee: JAWB Acquisition LLC
• Original Assignee: JAWB Acquisition LLC
• Inventors: Burnett, Gregory C.
• Application Number:
  US10/301,237
• Publication Number:
  US 20030128848A1
• Time in Patent Office: Days
• US Class Current: 381/71.8
• CPC Class Codes: G10L 19/0204 using subband decomposition
• CPC Class Codes: G10L 2021/02082 the noise being echo, reverberation of the speech
• CPC Class Codes: G10L 2021/02161 Number of inputs available containing the signal or the noise to be suppressed
• CPC Class Codes: G10L 2021/02168 the estimation exclusively taking place during speech pauses
• CPC Class Codes: G10L 21/0208 Noise filtering
• CPC Class Codes: G10L 25/78 Detection of presence or absence of voice signals switching of direction of transmission by voice frequency in two-way loud-speaking telephone systems H04M9/10

Abstract

A method and system for removing acoustic noise removal from human speech is described. Acoustic noise is removed regardless of noise type, amplitude, or orientation. The system includes a processor coupled among microphones and a voice activation detection (“VAD”) element. The processor executes denoising algorithms that generate transfer functions. The processor receives acoustic data from the microphones and data from the VAD. The processor generates various transfer functions when the VAD indicates voicing activity and when the VAD indicates no voicing activity. The transfer functions are used to generate a denoised data stream.

Claims

1. A method for removing noise from electronic signals, comprising:

receiving a plurality of acoustic signals in a first receiving device;

receiving a plurality of acoustic signals in a second receiving device, wherein the plurality of acoustic signals include at least one noise signal generated by at least one noise source and at least one voice signal generated by at least one signal source, wherein the at least one signal source comprises a human speaker, and wherein relative locations of the signal source, the first receiving device, and the second receiving device are fixed and known;

receiving physiological information associated with human voicing activity of the human speaker, including whether voice activity is present;

generating at least one first transfer function representative of the plurality of acoustic noise signals upon determining that voicing activity is absent from the plurality of acoustic signals for at least one specified period;

generating at least one second transfer function representative of the plurality of acoustic signals upon determining that voicing information is present in the plurality of acoustic signals for the at least one specified period of time; and

removing noise from the plurality of acoustic signals using at least one combination of the at least one first transfer function and the at least one second transfer function to produce at least one denoised data stream.

2. The method of claim 1, wherein the first receiving device and the second receiving device each comprise a microphone selected from a group comprising unidirectional microphones and unidirectional microphones.

3. The method of claim 1, wherein the plurality of acoustic signals are received in discrete time samples, and wherein the first receiving device and the second receiving device are located a distance “

d”

apart, wherein d corresponds to n discrete time samples

4. The method of claim 1, wherein the at least one second transfer function is fixed as a function of a difference in amplitude of signal data at the first receiving device and the amplitude of signal data at the second receiving device.

5. The method of claim 1, wherein removing noise from the plurality of acoustic signals includes using a direction and a range to the at least one signal source from the at least one first receiving device.

6. The method of claim 1, wherein respective frequency responses of the at least one first receiving device and the second at least one receiving device are different, and wherein the signal data from the at least one second receiving device is compensated to have a proper relationship to signal data from the at least one first receiving device.

7. The method of claim 6, wherein compensating the signal data from the at least one second receiving device comprises recording a broadband signal in the at least one first receiving device and the at least one second receiving device from a source located at a distance and an orientation expected for a signal from the at least one signal source.

8. The method of claim 6, wherein compensating the signal data from the at least one second receiving device comprises frequency domain compensation.

9. The method of claim 8, wherein frequency compensation comprises:

calculating a frequency transform for signal data from each of the at least one first receiving device and the at least one second receiving device signal is calculated;

calculating a magnitude of the frequency transform at each frequency bin; and

setting a magnitude of the frequency transform for the signal data from the at least one second receiving device in each frequency to a value related to a magnitude of the frequency transform for the signal data from the at least one first receiving device.

10. The method of claim 6, wherein compensating the signal data from the at least one second receiving device comprises time domain compensation.

11. The method of claim 6, further comprising:

initially setting the at least one second transfer function to zero; and

calculating compensation coefficients at times when there the at least one noise signal is small relative to the at least one voice signal.

12. The method of claim 1, wherein the plurality of acoustic signals include at least one reflection of the at least one noise signal and at least one reflection of the at least one voice signal.

13. The method of claim 1, wherein receiving physiological information comprises receiving physiological data associated with human voicing using at least one detector selected from a group consisting of acoustic microphones, radio frequency devices, electroglottographs, ultrasound devices, acoustic throat microphones, and airflow detectors.

14. The method of claim 1 wherein generating the at least one first transfer function and the at least one second transfer function comprises use of at least one technique selected from a group comprising adaptive techniques and recursive techniques.

15. A system for removing noise from acoustic signals, comprising:

at least one receiver comprising,

at least one signal receiver configured to receive at least one acoustic signal from a signal source; and

at least one noise receiver configured to receive at least one noise signal from a noise source, wherein relative locations of the signal source, the at lease one signal receiver, and the at least one noise receiver are fixed and known;

at least one sensor that receives physiological information associated with human voicing activity; and

at least one processor coupled among the at least one receiver and the at least one sensor that generates a plurality of transfer functions, wherein at least one first transfer function representative of the at least one acoustic signal is generated in response to a determination that voicing information is absent from the at least one acoustic signal for at least one specified period of time, wherein at least one second transfer function representative of the at least one acoustic signal is generated in response to a determination that voicing information is present in the at least one acoustic signal for at least one specified period of time, wherein noise is removed from the at least one acoustic signal using at least one combination of the at least one first transfer function and the at least one second transfer function.

16. The system of claim 15, wherein the at least one sensor includes at least one radio frequency (“

RF”

) interferometer that detects tissue motion associated with human speech.

17. The system of claim 15, wherein the at least one sensor includes at least one sensor selected from a group consisting of acoustic microphones, radio frequency devices, electroglottographs, ultrasound devices, acoustic throat microphones, and airflow detectors.

18. The system of claim 15, wherein the at least one processor is configured to:

divide acoustic data of the at least one acoustic signal into a plurality of subbands;

remove noise from each of the plurality of subbands using the at least one combination of the at least one first transfer function and the at least one second transfer function, wherein a plurality of denoised acoustic data streams are generated; and

combine the plurality of denoised acoustic data streams to generate the at least one denoised acoustic data stream.

19. The system of claim 15, wherein the at least one signal receiver and the at least one noise receiver are each microphones selected from a group comprising unidirectional microphones and omnidirectional microphones.

20. A signal processing system coupled among at least one user and at least one electronic device, the signal processing system comprising:

at least one first receiving device configured to receive at least one acoustic signal from a signal source;

at least one second receiving device configured to receive at least one noise signal from a noise source, wherein relative locations of the signal source, the at least one first receiving device, and the at least one second receiving device are fixed and known; and

at least one denoising subsystem for removing noise from acoustic signals, the denoising subsystem comprising;

at least one processor coupled among the at least one first receiver and the at least one second receiver; and

at least one sensor coupled to the at least one processor, wherein the at least one sensor is configures to receive physiological information associated with human voicing activity, wherein the at least one processor generates a plurality of transfer functions, wherein at least one first transfer function representative of the at least one acoustic signal is generated in response to a determination that voicing information is absent from the at least one acoustic signal for at least one specified period of time, wherein at least one second transfer function representative of the at least one acoustic signal is generated in response to a determination that voicing information is present in the at least one acoustic signal for at least one specified period of time, wherein noise is removed from the at least one acoustic signal using at least one combination of the at least one first transfer function and the at least one second transfer function to produce at least one denoised data stream.

21. The signal processing system of claim 20, wherein the first receiving device and the second receiving device are each microphones selected from a group comprising unidirectional microphones and omnidirectional microphones.

22. The signal processing system of claim 20, wherein the at least one acoustic signal is received in discrete time samples, and wherein the first receiving device and the second receiving device are located a distance “

d”

apart, wherein d corresponds to n discrete time samples

23. The signal processing system of claim 20, wherein the at least one second transfer function is fixed as a function of a difference in amplitude of signal data at the first receiving device and the amplitude of signal data at the second receiving device.

24. The signal processing system of claim 20, wherein removing noise from the at least one acoustic signal includes using a direction and a range to the at least one signal source from the at least one first receiving device.

25. The signal processing system of claim 20, wherein respective frequency responses of the at least one first receiving device and the second at least one receiving device are different, and wherein the signal data from the at least one second receiving device is compensated to have a proper relationship to signal data from the at least one first receiving device.

26. The signal processing system of claim 25, wherein compensating the signal data from the at least one second receiving device comprises recording a broadband signal in the at least one first receiving device and the at least one second receiving device from a source located at a distance and an orientation expected for a signal from the at least one signal source.

27. The signal processing system of claim 25, wherein compensating the signal data from the at least one second receiving device comprises frequency domain compensation.

28. The signal processing system of claim 27, wherein frequency compensation comprises:

calculating a frequency transform for signal data from each of the at least one first receiving device and the at least one second receiving device signal is calculated;

calculating a magnitude of the frequency transform at each frequency bin; and

setting a magnitude of the frequency transform for the signal data from the at least one second receiving device in each frequency to a value related to a magnitude of the frequency transform for the signal data from the at least one first receiving device.

29. The signal processing system of claim 25, wherein compensating the signal data from the at least one second receiving device comprises time domain compensation.

30. The signal processing system of claim 25, further compensating further comprises:

initially setting the at least one second transfer function to zero; and

calculating compensation coefficients at times when there the at least one noise signal is small relative to the at least one acoustic signal.

31. The signal processing system of claim 20, wherein the at least one acoustic signal includes at least one reflection of the at least one noise signal and at least one reflection of the at least one acoustic signal.

32. The signal processing system of claim 20, wherein receiving physiological information comprises receiving physiological data associated with human voicing using at least one detector selected from a group consisting of acoustic microphones, radio frequency devices, electroglottographs, ultrasound devices, acoustic throat microphones, and airflow detectors.

33. The signal processing system of claim 20 wherein generating the at least one first transfer function and the at least one second transfer function comprises use of at least one technique selected from a group comprising adaptive techniques and recursive techniques.