Conversation assistance system

• US 9,560,451 B2
• Filed: 02/10/2015
• Issued: 01/31/2017
• Est. Priority Date: 02/10/2014
• Status: Active Grant

• Current Assignee: Bose Corporation
• Original Assignee: Bose Corporation
• Inventors: Eichfeld, Jahn Dmitri, Rabinowitz, William M., Berardi, William, Trotter, John, Shay, Michael
• Primary Examiner(s): Bernardi, Brenda
• Application Number:
  US14/618,889
• Publication Number:
  US 20150230026A1
• Time in Patent Office: 721 Days
• Field of Search: None
• US Class Current: 1/1
• CPC Class Codes: G10L 21/02 Speech enhancement, e.g. noise reduction or echo cancellation reducing echo effects in line transmission systems H04B3/20; echo suppression in hands-free telephones H04M9/08
• CPC Class Codes: H04R 2201/403 Linear arrays of transducers
• CPC Class Codes: H04R 2430/25 Array processing for suppression of unwanted side-lobes in directivity characteristics, e.g. a blocking matrix
• CPC Class Codes: H04R 25/405 by combining a plurality of transducers
• CPC Class Codes: H04R 25/407 Circuits for combining signals of a plurality of transducers
• CPC Class Codes: H04R 25/552 Binaural
• CPC Class Codes: H04R 5/027 Spatial or constructional arrangements of microphones, e.g. in dummy heads

Abstract

A conversation assistance system with a bi-lateral array of microphones arranged externally of a space that does not include any array microphones, where the space has a left side, a right side, a front and a back, the array comprising a left side sub-array of multiple microphones and a right side sub-array of multiple microphones, where each microphone has a microphone output signal, and a processor that creates from the microphone output signals a left-ear audio signal and a right-ear audio signal. The left-ear audio signal is created based on the microphone output signals from one or more of the microphones of the left-side sub-array and one or more of the microphones of the right-side sub-array and the right-ear audio signal is created based on the microphone output signals from one or more of the microphones of the left-side sub-array and one or more of the microphones of the right-side sub-array.

Claims

1. A conversation assistance system, comprising:

a bi-lateral array of microphones arranged externally of a space that does not include any array microphones, where the space has a left side, a right side, a front and a back, the array comprising a left side sub-array of multiple microphones and a right side sub-array of multiple microphones, where each microphone has a microphone output signal;

active noise reducing (ANR) electroacoustic transducers associated with each of the left side sub array and the right side sub array and having a controlled amount of ANR provided; and

a processor that creates from the microphone output signals a left-ear audio signal and a right-ear audio signal;

wherein;

the left-ear audio signal is created based on the microphone output signals from one or more of the microphones of the left-side sub-array and one or more of the microphones of the right-side sub-array;

the right-ear audio signal is created based on the microphone output signals from one or more of the microphones of the left-side sub-array and one or more of the microphones of the right-side sub-array;

the bi-lateral array has a directivity index (DI); and

the ANR transducers are controlled such that the amount of noise reduction provided by the ANR transducers is equal to or greater than the DI of the bi-lateral array.

2. The conversation assistance system of claim 1 wherein the processor comprises a filter for the output signal of each microphone that is involved in the creation of the audio signals.

3. The conversation assistance system of claim 2 wherein the filters are created using at least one polar specification comprising the magnitude and phase of idealized output signals of one or both of the left-side sub-array and the right-side sub-array as a function of frequency.

4. The conversation assistance system of claim 3 comprising separate polar specifications for each sub-array.

5. The conversation assistance system of claim 3 wherein a polar specification is based on polar head-related transfer functions of each ear of a binaural dummy.

6. The conversation assistance system of claim 3 wherein a polar specification is based on polar head-related transfer functions of each ear of a person'"'"'s head.

7. The conversation assistance system of claim 3 wherein a polar specification is based on a model.

8. The conversation assistance system of claim 1 wherein the processor creates both the left- and right-ear audio signals based on the microphone output signals from one or more of the microphones of the left-side sub-array and one or more of the microphones of the right-side sub-array, but only below a predetermined frequency.

9. The conversation assistance system of claim 8 wherein above the predetermined frequency the processor creates the left-ear audio signal based only on the microphone output signals from microphones of the left-side sub-array and creates the right-ear audio signal based only on the microphone output signals from the microphones of the right-side sub-array.

10. The conversation assistance system of claim 1 wherein the left side sub-array is arranged to be worn proximate the left side of a user'"'"'s head and the right side sub-array is arranged to be worn proximate the right side of the user'"'"'s head.

11. The conversation assistance system of claim 1 wherein the left side sub-array microphones are spaced along the left side of the space and the right side sub-array microphones are spaced along the right side of the space.

12. The conversation assistance system of claim 11 wherein the array of microphones further comprises at least one microphone located along either the front or back of the space.

13. The conversation assistance system of claim 1 wherein the processor is configured to attenuate sounds arriving at the microphone array from outside of a predetermined pass angle from a primary receiving direction of the array.

14. The conversation assistance system of claim 13 further comprising functionality that changes the predetermined pass angle.

15. The conversation assistance system of claim 14 wherein the predetermined pass angle is changed based on tracking movements of a user'"'"'s head.

16. The conversation assistance system of claim 1 wherein the processor is configured to process the microphone signals to create specific polar interaural level differences (ILDs) and specific polar interaural phase differences (IPDs) between the left and right ear audio signals.

17. The conversation assistance system of claim 1 wherein the processor is configured to process the microphone signals to create specific polar ILDs and specific polar IPDs in the left and right ear audio signals, as if the sound source was at an angle that is different than the actual angle of the sound source to the array.

18. The conversation assistance system of claim 1 wherein the microphone array has a directivity that establishes the primary receiving direction of the array, and wherein the conversation assistance system further comprises functionality that changes the array directivity.

19. The conversation assistance system of claim 18 further comprising a user-operable input device that is adapted to be manipulated so as to cause a change in the array directivity.

20. The conversation assistance system of claim 19 wherein the user-operable input device comprises a display of a portable computing device.

21. The conversation assistance system of claim 18 wherein the array directivity is changed automatically.

22. The conversation assistance system of claim 21 wherein the array directivity is changed based on movements of a user.

23. The conversation assistance system of claim 18 wherein the array can have multiple directivities, and wherein the system comprises a binaural array with ILDs and IPDs that correspond to the orientation angle for each array directivity.

24. The conversation assistance system of claim 1 wherein the left side sub-array is coupled to the left side of a cell phone case that is adapted to hold a cell phone, and the right side sub-array is coupled to the right side of the cell phone case.

25. The conversation assistance system of claim 1 wherein the array is constrained to have a maximum white noise gain (WNG).

26. The conversation assistance system of claim 1 wherein the DI is controllable, and wherein the DI and the amount of noise reduction accomplished with the electroacoustic transducers are both controlled such that the amount of noise reduction is kept equal to or greater than the DI of the array.

27. The conversation assistance system of claim 1 comprising at least two separate physical devices each with a processor, where the devices communicate with each other via wired or wireless communication.

28. A conversation assistance system, comprising:

a bi-lateral array of microphones arranged externally of a space that does not include any array microphones, where the space has a left side, a right side, a front and a back, the array comprising a left side sub-array of multiple microphones and a right side sub-array of multiple microphones, where each microphone has a microphone output signal;

active noise reducing (ANR) electroacoustic transducers associated with each of the left side sub array and the right side sub array and having a controlled amount of ANR provided; and

a processor that creates from the microphone output signals a left-ear audio signal and a right-ear audio signal;

wherein;

the left-ear audio signal is created based on the microphone output signals from one or more of the microphones of the left-side sub-array and one or more of the microphones of the right-side sub-array, but only below a predetermined frequency; and

the right-ear audio signal is created based on the microphone output signals from one or more of the microphones of the left-side sub-array and one or more of the microphones of the right-side sub-array, but only below a predetermined frequency;

above the predetermined frequency the processor creates the left-ear audio signal based only on the microphone output signals from microphones of the left-side sub-array and creates the right-ear audio signal based only on the microphone output signals from the microphones of the right-side sub-array;

the processor is configured to process the microphone signals to create specific polar interaural level differences (ILDs) and specific polar interaural phase differences (IPDs) between the left and right ear audio signals;

the bi-lateral array has a directivity index (DI); and

the ANR transducers are controlled such that the amount of noise reduction provided by the ANR transducers is equal to or greater than the DI of the bi-lateral array.

29. A conversation assistance system, comprising:

a bi-lateral array of microphones that are coupled to a portable device and arranged on the portable device, the array comprising a left side sub-array of multiple microphones and a right side sub-array of multiple microphones, wherein the microphone array has a directivity that establishes the primary receiving direction of the array, and wherein each microphone has a microphone output signal;

active noise reducing (ANR) electroacoustic transducers associated with each of the left side sub array and the right side sub array and having a controlled amount of ANR provided;

a processor that creates from the microphone output signals a left-ear audio signal and a right-ear audio signal;

wherein;

the left-ear audio signal is created based on the microphone output signals from one or more of the microphones of the left-side sub-array and one or more of the microphones of the right-side sub-array, but only below a predetermined frequency;

the right-ear audio signal is created based on the microphone output signals from one or more of the microphones of the left-side sub-array and one or more of the microphones of the right-side sub-array, but only below a predetermined frequency;

above the predetermined frequency the processor creates the left-ear audio signal based only on the microphone output signals from microphones of the left-side sub-array and creates the right-ear audio signal based only on the microphone output signals from the microphones of the right-side sub-array;

the processor is configured to process the microphone signals to create specific polar interaural level differences (ILDs) and specific polar interaural phase differences (IPDs) between the left and right ear audio signals;

the bi-lateral array has a directivity index (DI); and

the ANR transducers are controlled such that the amount of noise reduction provided by the ANR transducers is equal to or greater than the DI of the bi-lateral array; and

a user-operable input device that is adapted to be manipulated so as to cause a change in the array directivity.