Multifunction System and Method for Integrated Hearing and Communication with Noise Cancellation and Feedback Management

• US 20090097681A1
• Filed: 10/14/2008
• Published: 04/16/2009
• Est. Priority Date: 10/12/2007
• Status: Active Grant

• Current Assignee: EarLens Corporation
• Original Assignee: EarLens Corporation
• Inventors: Perkins, Rodney C., Puria, Sunil, Fay, Jonathan P.
• Granted Patent: US 8,401,212 B2
• Time in Patent Office: Days
• US Class Current: 381/318
• CPC Class Codes: H04R 1/265 of microphones
• CPC Class Codes: H04R 2225/43 Signal processing in hearing aids to enhance the speech intelligibility
• CPC Class Codes: H04R 2460/01 Hearing devices using active noise cancellation
• CPC Class Codes: H04R 2460/13 Hearing devices using bone conduction transducers
• CPC Class Codes: H04R 25/405 by combining a plurality of transducers
• CPC Class Codes: H04R 25/407 Circuits for combining signals of a plurality of transducers
• CPC Class Codes: H04R 25/43 Electronic input selection or mixing based on input signal analysis, e.g. mixing or selection between microphone and telecoil or between microphones with different directivity characteristics H04R25/407 takes precedence
• CPC Class Codes: H04R 25/453 electronically
• CPC Class Codes: H04R 25/554 using a wireless connection, e.g. between microphone and amplifier or using Tcoils
• CPC Class Codes: H04R 25/606 acting directly on the eardrum, the ossicles or the skull, e.g. mastoid, tooth, maxillary or mandibular bone, or mechanically stimulating the cochlea, e.g. at the oval window
• CPC Class Codes: H04R 29/00 Monitoring arrangements; Testing arrangements for hearing aids H04R25/30; detection of loudspeaker connection H04R5/04; sound-field adaptation dependent on speaker detection H04S7/308

Abstract

Systems, devices and methods for communication include an ear canal microphone configured for placement in the ear canal to detect high frequency sound localization cues. An external microphone positioned away from the ear canal can detect low frequency sound, such that feedback can be substantially reduced. The canal microphone and the external microphone are coupled to a transducer, such that the user perceives sound from the external microphone and the canal microphone with high frequency localization cues and decreased feedback. Wireless circuitry can be configured to connect to many devices with a wireless protocol, such that the user can receive and transmit audio signals. A bone conduction sensor can detect near-end speech of the user for transmission with the wireless circuitry in noisy environment. Noise cancellation of background sounds near the user can improve the user'"'"'s hearing of desired sounds.

Claims

1. A communication device for use with an ear of a user, the device comprising:

a first input transducer configured for placement at least one of inside an ear canal or near an opening of the ear canal;

a second input transducer configured for placement outside the ear canal; and

at least one output transducer configured for placement inside the ear canal of the user, the at least one output transducer coupled to the first microphone and the second microphone to transmit sound from the first microphone and the second microphone to the user.

2. The device of claim 1 wherein the first input transducer comprises at least one of a first microphone configured to detect sound from air or a first acoustic sensor configured to detect vibration from tissue and wherein the second input transducer comprises at least one of a second microphone configured to detect sound from air or a second acoustic sensor configured to detect vibration from tissue.

3. The device of claim 1 wherein the first input transducer comprises a microphone configured to detect high frequency localization cues and wherein the at least one output transducer is acoustically coupled to first input transducer when the transducer is positioned in the ear canal and wherein second input transducer is positioned away from the ear canal opening to minimize feedback when the first input transducer detects the high frequency localization cues.

4. The device of claim 1 wherein the first input transducer is configured to detect high frequency sound comprising spatial localization cues when placed inside the ear canal or near the ear canal opening and transmit the high frequency localization cues to the user.

5. The device of claim 4 wherein the high frequency localization cues comprise frequencies above about 4 kHz and wherein the first input transducer is coupled to the at least one output transducer to transmit high frequencies above at least about 4 kHz to the user with a first gain and to transmit low frequencies below about 3 kHz with a second gain and wherein the first gain is greater than the second gain so as to minimize feedback from the transducer to the first input transducer.

6. The device of claim 5 wherein the first input transducer is configured to detect at least one of a sound diffraction cue from a pinna of the ear of the user or a head shadow cue from a head of the user when the first input transducer is positioned at least one of inside the ear canal or near the opening of the ear canal.

7. The device of claim 1 wherein the first input transducer is coupled to the at least one output transducer to vibrate an eardrum of the ear in response to high frequency sound localization cues above a resonance frequency of the ear canal and wherein the second input transducer is coupled to the at least one output transducer to vibrate the eardrum in response sound frequencies at or below the resonance frequency of the ear canal.

8. The device of claim 7 wherein the resonance frequency of the ear canal comprises frequencies within a range from about 2 to 3 kHz.

9. The device of claim 7 wherein the first input transducer is coupled to the at least one output transducer to vibrate the eardrum with a resonance gain for first sound frequencies corresponding to the resonance frequencies of the ear canal and a cue gain for sound localization cue comprising frequencies above the resonance frequencies of the ear canal, and wherein the cue gain is greater than the resonance gain to minimize feedback.

10. The device of claim 7 wherein the first input transducer is coupled to the at least one output transducer to vibrate the eardrum with a first gain for first sound frequencies corresponding to the resonance frequencies of the ear canal and wherein the second input transducer is coupled to the at least one output transducer to vibrate the eardrum with a second gain for the sound frequencies corresponding to the resonance frequencies of the ear canal and wherein the first gain is less than the second gain to minimize feedback.

11. The device of claim 1 wherein the second input transducer is configured to detect low frequency sound without high frequency localization cues from a pinna of the ear when placed outside the ear canal to minimize feedback from the transducer.

12. The device of claim 11 wherein the low frequency sound comprises frequencies below about 3 kHz.

13. The device of claim 1 further comprising circuitry coupled to the first input transducer, the second input transducer and the at least one output transducer, wherein the circuitry is coupled to the first input transducer and the at least one output transducer to transmit high frequency sound comprising frequencies above about 4 kHz from the first input transducer to the user.

14. The device of claim 13, wherein the circuitry is coupled to the second input transducer and the at least one output transducer to transmit low frequency sound comprising frequencies below about 4 kHz from the second input transducer to the user.

15. The device of claim 13, wherein the circuitry comprises at least one of a sound processor or an amplifier coupled to the first input transducer, the second input transducer and the at least one output transducer to transmit high frequencies from the first input transducer and low frequencies from the second input transducer to the user so as to minimize feedback.

16. The device of claim 1 wherein the at least one output transducer comprises a first transducer and a second transducer, the first transducer coupled to the first input transducer to transmit high frequency sound, the second transducer coupled to the second input transducer to transmit low frequency sound.

17. The device of claim 1 wherein the first input transducer is coupled to the at least one output transducer to transmit first frequencies to the user with a first gain and the second input transducer is coupled to the at least one output transducer to transmit second frequencies to the user with a second gain.

18. The device of claim 1 wherein the at least one output transducer comprises at least one of an acoustic speaker configured for placement inside the ear canal, a magnet supported with a support configured for placement on an eardrum of the user, an optical transducer supported with a support configured for placement on the eardrum of the user, a magnet configured for placement in a middle ear of the user, and an optical transducer configured for placement in the middle ear of the user.

19. The device of claim 18 wherein the at least one output transducer comprises the magnet supported with the support configured for placement on an eardrum of the user, and wherein the at least one output transducer further comprises at least one coil configured for placement in the ear canal to couple to the magnet to transmit sound to the user.

20. The device of claim 19 wherein the at least one coil comprises a first coil and a second coil, the first coil coupled to the first input transducer and configured to transmit first frequencies from the first input transducer to the magnet, the second coil coupled to the second input transducer and configured to transmit second frequencies from the second input transducer to the magnet.

21. The device of claim 18 wherein the at least one output transducer comprises the optical transducer supported with the support configured for placement on the eardrum of the user and wherein the optical transducer further comprises a photodetector coupled to at least one of a coil or a piezo electric transducer supported with the support and configured to vibrate the eardrum.

22. The device of claim 1 wherein the first input transducer is configured to generate a first audio signal and the second input transducer is configured to generate a second audio signal and wherein the at least one output transducer is configured to vibrate with a first gain in response to the first audio signal and a second gain in response to the second audio signal to minimize feedback.

23. The device of claim 1 further comprising wireless communication circuitry configured to transmit near-end sound from the user to a far-end person when the user speaks.

24. The device of claim 23 wherein the wireless communication circuitry is configured to transmit the near-end sound from at least one of the first input transducer or the second input transducer.

25. The device of claim 24 wherein the wireless communication circuitry is configured to transmit the near-end sound from the second input transducer.

26. The device of claim 23 further comprising a third input transducer coupled to the wireless communication circuitry, the third input transducer configured to couple to tissue of the patient and transmit near-end speech from the user to the far-end person in response to bone conduction vibration when the user speaks.

27. The device of claim 1 further comprising:

a second device for use with a second contralateral ear of the user, the second device comprising,

a third input transducer configured for placement inside a second ear canal or near an opening of the second ear canal to detect second high frequency localization cues,

a fourth input transducer configured for placement outside the second ear canal, and

a second at least one output transducer configured for placement inside the second ear canal, and wherein the second at least one output transducer is acoustically coupled to the third input transducer when the second at least one output transducer is positioned in the second ear canal and wherein fourth input transducer is positioned away from the second ear canal opening to minimize feedback when the third input transducer detects the second high frequency localization cues.

28. A communication system for use with an ear of a user, the device comprising:

a first at least one input transducer configured to detect sound;

a second input transducer configured to detect tissue vibration when the user speaks;

wireless communication circuitry coupled to the second input transducer and configured to transmit near-end speech from the user to a far-end person when the user speaks; and

at least one output transducer configured for placement inside an ear canal of the user, the at least one output transducer coupled to the first input transducer to transmit sound from the first input transducer to the user.

29. The system of claim 28 wherein the first at least one input transducer comprises a microphone configured for placement at least one of inside an ear canal or near an opening of the ear canal to detect high frequency localization cues.

30. The system of claim 28 wherein the first at least one input transducer comprises a microphone configured for placement outside the ear canal to detect low frequency speech and minimize feedback from the at least one output transducer.

31. The system of claim 28 wherein the second input transducer comprises at least one of an optical vibrometer or a laser vibrometer configured to generate a signal in response to vibration of the eardrum when the user speaks.

32. The system of claim 28 wherein the second input transducer comprises a bone conduction sensor configured to couple to a skin of the user to detect tissue vibration when the user speaks.

33. The system of claim 32 the bone conduction sensor is configured for placement within the ear canal.

34. The system of claim 33 further comprising:

an elongate support configured to extend from the opening toward the eardrum to deliver energy to the at least one output transducer; and

a positioner coupled to the elongate support, the positioner sized to fit in the ear canal and position the elongate support within the ear canal, the positioner comprising the bone conduction sensor.

35. The system of claim 34 wherein bone conduction sensor comprises a piezo electric transducer configured to couple to the ear canal to bone vibration when the user speaks.

36. The system of claim 28 wherein the at least one output transducer comprises a support configured for placement on an eardrum of the user.

37. The system of claim 28 wherein the wireless communication circuitry is configured to receive sound from at least one of a cellular telephone, a hands free wireless device of an automobile, a paired short range wireless connectivity system, a wireless communication network, or a WiFi network.

38. The system of claim 28 wherein the wireless communication circuitry is coupled to the at least one output transducer to transmit far-end sound to the user from a far-end person in response to speech from the far-end person.

39. An audio listening system for use with an ear of a user, the system comprising:

a canal microphone configured for placement in an ear canal of the user;

an external microphone configured for placement external to the ear canal; and

a transducer coupled to the canal microphone and the external microphone and wherein the transducer is configured for placement inside the ear canal on an eardrum of the user to vibrate the eardrum and transmit sound to the user in response to the canal microphone and the external microphone.

40. The system of claim 41 wherein the transducer comprises a magnet and a support configured for placement on the eardrum to vibrate the eardrum in response to a wide bandwidth signal comprising frequencies from about 0.1 kHz to about 10 kHz.

41. The system of claim 39 further comprising a sound processor coupled to the canal microphone and configured to receive an input from the canal microphone and wherein the sound processor is configured to vibrate the eardrum in response to the input from the canal microphone.

42. The system of claim 41 wherein the sound processor is configured to minimize feedback from the transducer.

43. The system of claim 41 wherein the sound processor is coupled to the external microphone and configured to vibrate the eardrum in response to an input from the external microphone.

44. The system of claim 41 wherein the sound processor is configured to cancel feedback from the transducer to the canal microphone with a feedback transfer function.

45. The system of claim 41 wherein the sound processor is coupled to the external microphone and configured to cancel noise in response to input from the external microphone.

46. The system of claim 45 wherein the external microphone is configured to measure external sound pressure and wherein the sound processor is configured to minimize vibration of the eardrum in response to the external sound pressure measured with the external microphone.

47. The system of claim 45 wherein the sound processor is configured to measure feedback from the transducer to the canal microphone and wherein the processor is configured to minimize vibration of the eardrum in response to the feedback.

48. The system of claim 45 wherein the external microphone is configured to measure external sound pressure and wherein the canal microphone is configured to measure canal sound pressure and wherein the sound processor is configured to determine feedback transfer function in response to the canal sound pressure and the external sound pressure.

49. The system of claim 45 further comprising an external input for listening.

50. The system of claim 49 wherein the external input comprises an analog input configured to receive an analog audio signal from an external device.

51. The system of claim 45 further comprising a bone vibration sensor to detect near-end speech of the user.

52. The system of claim 45 further comprising wireless communication circuitry coupled to the transducer and configured to vibrate the transducer in response to far-end speech.

53. The system of claim 52 further comprising a sound processor coupled to the wireless communication circuitry and wherein the sound processor is configured to process the far-end speech to generate processed far-end speech and wherein the processor is configured to vibrate the transducer in response to the processed far-end speech.

54. The system of claim 53 wherein wireless communication circuitry is configured to receive far-end speech from a communication channel of a mobile phone.

55. The system of claim 53 wherein the wireless communication circuitry is configured to transmit near-end speech of the user to a far-end person.

56. The system of claim 53 further comprising a mixer configured to mix a signal from the canal microphone and a signal from the external microphone to generate a mixed signal comprising near-end speech and wherein the wireless communication circuitry is configured to transmit the mixed signal comprising the near-end speech to a far-end person.

57. The system of claim 56 wherein the sound processor is configured to provide mixed near-end speech to the user.

58. The system of claim 57 further comprising a bone vibration sensor configured to detect near-end speech, the bone vibration sensor coupled to the wireless communication circuitry, and wherein the wireless communication circuitry is configured to transmit the near-end speech to the far-end person in response to bone vibration when the user speaks.

59. The system of claim 53 wherein the system is configured to transmit near-end speech from a noisy environment to a far-end person.

60. A method of transmitting sound to an ear of a user, the method comprising:

detecting high frequency sound comprising high frequency localization cues with a first microphone placed at least one of inside an ear canal or near an opening of the ear canal;

a second microphone is placed external to the ear canal; and

at least one output transducer is placed inside the ear canal of the user and wherein the at least one output transducer is coupled to the first microphone and the second microphone and transmits sound from the first microphone and the second microphone to the user.

61. A device to detect sound from an ear canal of a user, the device comprising:

a piezo electric transducer configured for placement in the ear canal of the user.

62. The device of claim 61 wherein the piezo electric transducer comprises at least one elongate structure configured to extend at least partially across the ear canal from a first side of the ear canal to a second side of the ear canal to detect sound when the user speaks and wherein the first side is opposite the second side.

63. The device of claim 62 wherein the at least one elongate structure comprises a plurality of elongate structures configured to extend at least partially across the long dimension of the ear canal and wherein a gap extends at least partially between the plurality of elongate structures to minimize occlusion when the piezo electric transducer is placed in the canal.

64. The device of claim 61 further comprising a positioner coupled to the transducer, the positioner configured to contact the ear canal and support the piezoelectric transducer in the ear canal to detect vibration when the user speaks.

65. The device of claim 64 wherein at least one of the positioner or the piezo electric transducer are configured to define at least one aperture to minimize occlusion when the user speaks.

66. The device of claim 61 wherein the positioner comprises an outer portion configured extend circumferentially around the piezo electric transducer to contact the ear canal with an outer perimeter of the outer portion when the positioner is positioned in the ear canal.

67. The device of claim 64 further comprising an elongate support comprising an elongate energy transmission structure, the elongate energy transmission structure passing through at least one of the piezo electric transducer or the positioner to transmit an audio signal to the eardrum of the user, the elongate energy transmission structure comprising at least one of an optical fiber to transmit light energy or a wire configured to transmit electrical energy.

68. The device of claim 61 wherein the piezo electric transducer comprises at least one of a ring piezo electric transducer, a bender piezo electric transducer, a bimorph bender piezo electric transducer or a piezoelectric multi-morph transducer, a stacked piezoelectric transducer with a mechanical multiplier or a ring piezoelectric transducer with a mechanical multiplier or a disk piezo electric transducer.

69. An audio listening system having multiple functionalities, comprising a body configured for positioning in an open ear canal, the functionalities including a wide-bandwidth hearing aid, a microphone within the body, a noise suppression system, a feedback cancellation system, a mobile phone communication system, and an audio entertainment system.