Hearing device and a hearing system configured to localize a sound source

• US 9,980,055 B2
• Filed: 10/11/2016
• Issued: 05/22/2018
• Est. Priority Date: 10/12/2015
• Status: Active Grant

• Current Assignee: Oticon A/S (William Demant Fonden)
• Original Assignee: Oticon A/S (William Demant Fonden)
• Inventors: Jensen, Jesper, Farmani, Mojtaba, Pedersen, Michael Syskind
• Primary Examiner(s): Jerez Lora, William A
• Application Number:
  US15/290,643
• Publication Number:
  US 20170105074A1
• Time in Patent Office: 588 Days
• Field of Search: 381 231, 381 60, 381312, 381313, 381356, 381380, 381381
• CPC Class Codes: G01S 3/8036 derived directly from separate directional systems
• CPC Class Codes: G01S 3/8083 determining direction of source
• CPC Class Codes: H04R 2420/01 Input selection or mixing for amplifiers or loudspeakers for hearing aids H04R25/43
• CPC Class Codes: H04R 25/405 by combining a plurality of transducers
• CPC Class Codes: H04R 25/407 Circuits for combining signals of a plurality of transducers
• CPC Class Codes: H04R 25/552 Binaural
• CPC Class Codes: H04R 25/554 using a wireless connection, e.g. between microphone and amplifier or using Tcoils

Abstract

The problem of estimating the direction to one or more sound sources of interest relative to a user wearing a pair of hearing devices, e.g. hearing aids, is dealt with. A target signal is generated by a target signal source and transmitted through an acoustic channel to a microphone of a hearing system. Due to additive environmental noise, a noisy acoustic signal is received at the microphones of the hearing system. An essentially noise-free version of the target signal is transmitted to the hearing devices of the hearing system via a wireless connection. Each of the hearing devices comprises a signal processing unit comprising a sound propagation model of the acoustic propagation channel from the target sound source to the hearing device when worn by the user. The sound propagation model is configured to be used for estimating a direction-of-arrival of the target sound signal relative to the user.

Claims

1. A hearing system comprising first and second hearing devices, each being adapted to be worn at or on the head or to be fully or partially implanted in the head of a user, the first and second hearing devices being adapted to be located at or in first and second ears, respectively, of the user, and each of the hearing devices comprising:

at least one input transducer for converting an input sound comprising mixture of a) a target sound signal from a target sound source and b) a possible additive noise sound signal from the environment to a noisy electric input signal;

at least one wireless receiver for receiving a wirelessly transmitted version of the target signal and providing an essentially noise-free target signal; and

a signal processing unit connected to said at least one input transducer and to said at least one wireless receiver, the signal processing unit comprising

a frequency independent sound propagation model of an acoustic propagation channel from the target sound source to the hearing device when worn by the user, the sound propagation model being configured to be used for estimating a direction of arrival of the target sound signal relative to the user,

wherein the signal processing unit is configured to

provide a maximum-likelihood estimate of the direction of arrival θ

of the target sound signal based on an additive noise signal model, and

estimate the value of the direction of arrival θ

that maximizes the likelihood function using Inverse Discrete Fourier Transforms (IDFTs); and

wherein each of the first and second hearing devices, comprises antenna and transceiver circuitry configured to allow an exchange of information between them, including to allow an exchange of audio data and/or data regarding the direction of arrival as estimated in a respective one of the first and second hearing devices to the other one.

2. A hearing device according to claim 1 wherein the sound propagation model comprises a far field model.

3. A hearing device according to claim 1 wherein the sound propagation model allows interaural time differences (ITD) and inter aural level differences (ILD) to be estimated by

ILD=K₁ sin(θ

)[relative level]

ITD=K₂θ

+K₃ sin(θ

)[time], respectively,

where K₁, K₂, and K₃ are constants to be chosen, and θ

is the angle of the direction of arrival of the target sound source relative to a reference direction.

4. A hearing device according to claim 3 wherein the least one input transducer comprises two microphones, and wherein the constants (K₁, K₂, K₃) are chosen to be equal to or substantially equal to (0, 0, a/c) or to (γ

, a/(2c), a/(2c)), where a is the microphone distance, and c is the speed of sound, and where γ

is a constant.

5. A hearing device according to claim 1 wherein the sound propagation model comprises a free field model.

6. A hearing device according to claim 1 wherein the sound propagation model comprises a spherical head model.

7. A hearing device according to claim 1 comprising a time to time-frequency conversion unit for converting an electric input signal in the time domain into a representation of the electric input signal in a frequency domain, providing the electric input signal at each time instance 1 in a number for frequency bins k, k=1, 2, . . . , N.

8. A hearing device according to claim 1 wherein the sound propagation model of an acoustic propagation channel from the target sound source to the hearing device when worn by the user comprises a signal model defined by

R(l,k)=S(l,k){tilde over (H)}(k,θ

)+V(l,k)

where R(l, k) is a time-frequency representation of the noisy target signal, S(l, k) is a time-frequency representation of the noise-free target signal, {tilde over (H)}(k, θ

) is a frequency transfer function of the acoustic propagation channel from the target sound source to the respective input transducers of the hearing device, and V(l, k) is a time-frequency representation of the additive noise.

9. A hearing device according to claim 1 wherein the signal processing unit is configured to provide a maximum-likelihood estimate of the direction of arrival θ

of the target sound signal by finding the value of θ

, for which the likelihood function

10. A hearing device according to claim 1 wherein the at least one input transducer of the hearing devices comprises one or two input transducers.

11. A hearing device according to claim 1 configured to determine whether a signal arrives from a front or a rear half plane relative to a user.

12. A hearing device according to claim 1 comprising a hearing aid, a headset, an earphone, an ear protection device or a combination thereof.

13. A hearing device according to claim 1 configured to only determine a direction of arrival, when a voice is detected in an input signal.

14. A hearing device according to claim 1 comprising a beamformer unit and wherein the signal processing unit is configured to use the estimate of the direction of arrival of the target sound signal relative to the user in the beamformer unit to provide a beamformed signal comprising the target signal.

15. A hearing device according to claim 10, wherein the one or two input transducers are microphones.

16. A hearing device according to claim 13 configured to only determine a direction of arrival, when a voice is detected in the wirelessly received noise-free signal.

17. A hearing system according to claim 1 configured to determine a difference between the target source to input transducer propagation delays for the first and second hearing devices.

18. A hearing system according to claim 1, wherein the first and second hearing devices further comprise:

one or more detectors for monitoring a current input signal of the hearing devices and/or the current acoustic environment, including one or more of a correlation detector, a level detector, and a speech detector.

19. A hearing system comprising first and second hearing devices according to claim 1 adapted to be located at or in first and second ears, or to be fully or partially implanted in the head at or in first and second ears, respectively, of the user.

20. A hearing system according to claim 19 configured to estimate a target source to input transducer propagation delay for the first and second hearing devices.