Binaural hearing assistance system comprising binaural noise reduction

• US 10,123,134 B2
• Filed: 11/01/2016
• Issued: 11/06/2018
• Est. Priority Date: 04/03/2014
• Status: Active Grant

• Current Assignee: Oticon A/S (William Demant Fonden)
• Original Assignee: Oticon A/S (William Demant Fonden)
• Inventors: Jensen, Jesper, Pedersen, Michael Syskind, De Haan, Jan Mark
• Primary Examiner(s): KAUFMAN, JOSHUA A
• Application Number:
  US15/340,369
• Publication Number:
  US 20170048626A1
• Time in Patent Office: 735 Days
• CPC Class Codes: G10L 25/78 Detection of presence or absence of voice signals switching of direction of transmission by voice frequency in two-way loud-speaking telephone systems H04M9/10
• CPC Class Codes: H04R 2225/43 Signal processing in hearing aids to enhance the speech intelligibility
• CPC Class Codes: H04R 2225/61 Aspects relating to mechanical or electronic switches or control elements, e.g. functioning
• CPC Class Codes: H04R 2430/20 Processing of the output signals of the acoustic transducers of an array for obtaining a desired directivity characteristic H04R2203/12 takes precedence
• CPC Class Codes: H04R 25/405 by combining a plurality of transducers
• CPC Class Codes: H04R 25/407 Circuits for combining signals of a plurality of transducers
• CPC Class Codes: H04R 25/552 Binaural
• CPC Class Codes: H04R 25/554 using a wireless connection, e.g. between microphone and amplifier or using Tcoils
• CPC Class Codes: H04R 25/558 Remote control, e.g. of amplification, frequency

Abstract

A binaural hearing assistance method and system comprising left and right hearing assistance devices and a user interface are provided. The left and right hearing assistance devices comprises a) at least two input units for providing a time-frequency representation of an input signal in a number of frequency bands and a number of time instances; and b) a multi-input unit noise reduction system comprising a multi-channel beamformer filtering unit operationally coupled to said at least two input units and configured to provide a beamformed signal. The binaural hearing assistance system is configured to allow a user to indicate a direction to or location of a target signal source relative to the user via said user interface.

Claims

1. A binaural hearing assistance system comprising left and right hearing assistance devices adapted for being located at or in left and right ears of a user, or adapted for being fully or partially implanted in the head of the user, each of the left and right hearing assistance devices comprising

a) a multitude of input units IU_i, i=1, . . . , M, M being larger than or equal to two, for providing a time-frequency representation X_i(k,m) of an input signal x_i(n) at an i^th input unit in a number of frequency bands and a number of time instances, k being a frequency band index, m being a time index, n representing time, the time-frequency representation X_i(k,m) of the i^th input signal comprising a target signal component and a noise signal component, the target signal component originating from a target signal source;

and

b) a multi-input unit noise reduction system comprising a multi-channel beamformer filtering unit operationally coupled to said multitude of input units IU_i, i=1, . . . , M, and configured to provide a beamformed signal Y(k,m), wherein signal components from other directions than a direction of the target signal source are attenuated, whereas signal components from the direction of the target signal source are left un-attenuated or attenuated less than signal components from said other directions;

wherein the binaural hearing assistance system further

comprises a user interface configured to communicate with said left and right hearing assistance devices and to allow a user to influence functionality of the left and right hearing assistance devices, and

is configured to allow a user to indicate a direction to or a location of the target signal source relative to the user via said user interface, and

is adapted to synchronize the respective multi-channel beamformer filtering units of the left and right hearing assistance devices so that both beamformer filtering units focus on the direction or location of the target signal source.

2. A binaural hearing assistance system according to claim 1 wherein multi-channel beamformer filtering units of the left and right hearing assistance devices are designed to deliver a gain of 0 dB for signals originating from a given direction or location, while suppressing signal components originating from any other spatial location.

3. A binaural hearing assistance system according to claim 1 wherein the multi-channel beamformer filtering units of the left and right hearing assistance devices are designed to deliver a larger gain (smaller attenuation) for signals originating from a given target direction or location, than signal components originating from any other spatial location.

4. A binaural hearing assistance system according to claim 1 wherein the multi-channel beamformer filtering units of the left and right hearing assistance devices are configured to apply the same gain or attenuation to signal components from the target signal source, so that any spatial cues in the target signal are not obscured by the beamformers.

5. A binaural hearing assistance system according to claim 1 wherein the multi-channel beamformer filtering unit of each of the left and right hearing assistance devices comprises a linearly constrained minimum variance (LCMV) beamformer, or a minimum variance distortionless response (MVDR) beamformer.

6. A binaural hearing assistance system according to claim 1 wherein the multi-channel beamformer filtering unit of each of the left and right hearing assistance devices comprises a minimum variance distortionless response (MVDR) filter providing filter weights w_mvdr(k,m), said filter weights w_mvdr(k,m) being based on a look vector d(k,m) and an inter-input unit covariance matrix R_vv(k,m) for the noise signal.

7. A binaural hearing assistance system according to claim 1 wherein each of the left and right hearing assistance devices comprises a memory unit comprising a number of predefined look vectors, each corresponding to the beamformer pointing in and/or focusing at a predefined direction and/or location.

8. A binaural hearing assistance system according to claim 1 configured to provide said target direction or location for said left and right hearing assistance devices from a given target direction or location for the target sound source.

9. A binaural hearing assistance system according to claim 1 wherein each of the left and right hearing assistance devices comprises a voice activity detector for identifying respective time segments of an input signal where a human voice is present or dominant.

10. A binaural hearing assistance system according to claim 1 wherein the user interface forms part of an auxiliary device.

11. A binaural hearing assistance system according to claim 10 wherein the user interface is configured to communicate the indicated direction or location of the target sound source to the left and right hearing assistance devices for use in choosing an appropriate corresponding predetermined set of filter weights for the multi-channel beamformer filtering unit, or for calculating such weights based on the received location of the target sound source.

12. A binaural hearing assistance system according to claim 10 wherein appropriate filter weights determined or stored in the auxiliary device are communicated to the left and right hearing assistance devices for use in the respective beamformer filtering units.

13. A binaural hearing assistance system according to claim 10, wherein the user interface is implemented as a software application executed on the auxiliary device.

14. A binaural hearing assistance system according to claim 10, wherein the user interface is configured to allow a user to select a current location of the target sound source from a number of predefined vectors d_sq, q=1, 2, . . . , N_s, or angles φ

_q, or angles φ

_q and distances d_q=|d_sq|, q=1, 2, . . . , N_s.

15. A binaural hearing assistance system according to claim 14 configured to provide that for each of the predefined angles and distances q=1, 2, . . . , N_s corresponding look vectors and/or filter weights are determined and stored in a memory of the respective left and right hearing assistance devices or are accessible from a common database of the binaural hearing assistance system.

16. A binaural hearing assistance system according to claim 14 configured to provide that for each of the predefined angles and distances q=1, 2, . . . , N_s corresponding look vectors and/or filter weights are accessible from a common database of the binaural hearing assistance system, wherein the common database is located in the auxiliary device.

17. A binaural hearing assistance system according to claim 10 adapted to allow an external wireless communication link between the auxiliary device and the respective left and right hearing assistance devices to be established to allow exchange of data between the left and right hearing aid devices.

18. A binaural hearing assistance system according to claim 1 wherein at least one of said multitude of input units IU_i of the left and right hearing assistance devices comprises a microphone for converting an input sound to an electric input signal x′

_i(n) and a time to time-frequency conversion unit for providing a time-frequency representation X_i(k,m) of the input signal x_i(n) at the i^th input unit IU_i in a number of frequency bands k and a number of time instances m.

19. A binaural hearing assistance system according to claim 1 wherein the time dependent input signals x_il(n) and x_ir(n), i=1, . . . , M, are signals originating from acoustic signals received at the respective left and right ears of the user to include spatial cues related to the head and body of the user.

20. A binaural hearing assistance system according to claim 1 wherein each of said left and right hearing assistance devices further comprises a single channel post-processing filter unit operationally coupled to said multi-channel beamformer filtering unit and configured to provide an enhanced signal Ŝ

(k,m).

21. A binaural hearing assistance system according to claim 20 wherein the multi-channel beamformer filtering unit and/or the single channel post-processing filter unit is/are configured to maintain interaural spatial cues of the target signal.

22. A binaural hearing assistance system according to claim 1 adapted to allow an interaural wireless communication link between the left and right hearing assistance devices to be established to allow exchange of data between the left and right hearing aid devices.

23. A binaural hearing assistance system according to claim 1 wherein the left and right hearing assistance devices each comprise a hearing instrument adapted for being located at the ear or fully or partially in the ear canal of a user, or for being fully or partially implanted in the head of a user.

24. A method of operating a binaural hearing assistance system, the system comprising left and right hearing assistance devices adapted for being located at or in left and right ears of a user, or adapted for being fully or partially implanted in the head of the user, the binaural hearing assistance system further comprising a user interface configured to communicate with said left and right hearing assistance devices and to allow a user to influence functionality of the left and right hearing assistance devices,

the method comprising

in each of the left and right hearing assistance devices

a) providing a time-frequency representation X_i(k,m) of an input signal x_i(n) at an i^th input unit in a number of frequency bands and a number of time instances, k being a frequency band index, m being a time index, n representing time, M being larger than or equal to two, for the time-frequency representation X_i(k,m) of the i^th input signal comprising a target signal component and a noise signal component, the target signal component originating from a target signal source;

b) providing a beamformed signal Y(k,m) from said time-frequency representations X_i(k,m) of said multitude of input signals, wherein signal components from other directions than a direction of the target signal source are attenuated, whereas signal components from the direction of the target signal source are left un-attenuated or are attenuated less than signal components from said other directions in said beamformed signal Y(k,m); and

configuring the binaural hearing assistance system to allow a user to indicate a direction to or a location of the target signal source relative to the user via said user interface, and

synchronizing the respective multi-channel beamformer filtering units of the left and right hearing assistance devices so that both beamformer filtering units focus on the location of the target signal source.

25. A data processing system comprising a processor and program code means for causing the processor to perform the steps of the method of claim 24.