Hearing Assistance Using an External Coprocessor

• US 20100040248A1
• Filed: 11/18/2008
• Published: 02/18/2010
• Est. Priority Date: 08/13/2008
• Status: Active Grant

• Current Assignee: III Holdings 7, LLC (Intellectual Ventures LLC)
• Original Assignee: Intelligent Systems Incorporated (Johnson Controls International plc)
• Inventors: Shridhar, Vasant, Wertz, Duane, Shridhar, Malayappan
• Granted Patent: US 7,929,722 B2
• Time in Patent Office: Days
• US Class Current: 381/315
• CPC Class Codes: H04R 2225/55 Communication between hearing aids and external devices via a network for data exchange
• CPC Class Codes: H04R 25/554 using a wireless connection, e.g. between microphone and amplifier or using Tcoils
• CPC Class Codes: H04R 25/558 Remote control, e.g. of amplification, frequency

Abstract

Techniques are described for enhancing a hearing assist device using one or more coprocessor devices. The hearing assist device uses a handshaking protocol to detect and pair with the one or more coprocessor devices. The hearing assist device is capable of stand-alone signal processing in the absence of the coprocessor devices. In one embodiment, the hearing assist device directs processing of a signal to the coprocessor device when the coprocessor is detected. In another embodiment, the hearing assist device detects a coprocessor device and uses the coprocessor device to supplement signal processing performed by the hearing assist device. In yet another embodiment, the hearing assist device communicates with a plurality of coprocessor devices and the work of processing the signal is shared amongst the devices according to a respective functionality of each device.

Claims

1. One or more processor-readable storage media containing instructions that, when executed by a processor, perform acts comprising:

detecting a coprocessor device;

comparing a functionality of a hearing assist device to a functionality of the coprocessor device to determine if;

a signal processing functionality absent from the hearing assist device is available on the coprocessor device or a signal processing functionality absent from the coprocessor device is available on the hearing assist device;

or

a signal processing functionality present on the hearing assist device is enhanced on the coprocessor device or a signal processing functionality present on the coprocessor device is enhanced on the hearing assist device; and

directing a signal obtained at the hearing assist device for at least partial processing to at least one the hearing assist device or the coprocessor device.

2. The one or more processor-readable storage media of claim 1, further comprising:

detecting an additional coprocessor device;

comparing the functionality of at least one of the hearing assist device or the coprocessor device to the additional coprocessor device to determine if;

a signal processing functionality absent from one of the hearing assist device, the coprocessor device, or the additional coprocessor device is available on the hearing assist device, the coprocessor device, or the additional coprocessor device;

or

a signal processing functionality present on one of the hearing assist device, the coprocessor device, or the additional coprocessor device is enhanced on the hearing assist device, the coprocessor device, or the additional coprocessor device; and

directing the signal obtained at the hearing assist device for at least partial processing to at least one the hearing assist device or the coprocessor device, or the additional coprocessor device.

3. The one or more processor-readable storage media of claim 1, wherein the signal processing functionality present on the hearing assist device is enhanced on the coprocessor device or the additional coprocessor device, the enhancement comprising at least one of an enhanced signal processing algorithm or an enhanced processing capability of the coprocessor device or the additional coprocessor device.

4. The one or more processor-readable storage media of claim 1, further comprising repeating the comparing if at least a one of the coprocessor device or the additional coprocessor device is no longer detected.

5. The one or more processor-readable storage media of claim 1, wherein the directing directs the signal to the hearing assist device for processing if the coprocessor device and the additional coprocessor device are no longer detected.

6. The one or more processor-readable storage media of claim 1, wherein the signal is processed at least partially in parallel by a plurality of the hearing assist device, the coprocessor device, or the one or more additional coprocessor devices.

7. A one or more processor-readable storage media of claim 1, wherein the signal is processed at least partially in series by a plurality of the hearing assist device, the coprocessor device, or the one or more additional coprocessor devices.

8. A method comprising:

detecting a coprocessor device;

comparing a functionality of the coprocessor device to a functionality of a hearing assist device; and

directing a signal to at least one of the hearing assist device or the coprocessor device.

9. The method of claim 8, wherein the detecting includes detecting a signal processing algorithm on the coprocessor device.

10. The method of claim 8, wherein the directing is based on the comparing and the comparing compares one or more signal processing algorithms available on the coprocessor device to one or more signal processing algorithms available on the hearing assist device.

11. The method of claim 8, wherein the directing is based on at least one of:

an availability of the coprocessor device;

a user input;

or

a determination that, based on the comparing, the coprocessor device has a necessary functionality to process the signal.

12. The method of claim 8, wherein the functionality of the coprocessor device and the functionality of the hearing assist device each comprise at least one of:

a processor speed;

a processor load;

a processor capability;

a memory capacity;

a memory capability;

an available signal processing algorithm;

an ability to enhance a signal processing algorithm;

a sensor capability;

or

a strength of a communication signal.

13. The method of claim 8 further comprising:

determining that the coprocessor device lacks a desired functionality; and

instructing the coprocessor device to obtain the desired functionality from a server.

14. The method of claim 8, further comprising processing the signal at least in part by the hearing assist device if the directing directs the signal to the hearing assist device.

15. The method of claim 8, further comprising receiving a processed signal from the coprocessor device if the directing directs the signal to the coprocessor device, wherein the processed signal is processed at least in part by the coprocessor device.

16. The method of claim 8, further comprising:

processing the signal in part by the hearing assist device and receiving a processed signal from the coprocessor device if the directing directs the signal to the hearing assist device and the coprocessor device, wherein the processed signal is processed in part by the coprocessor device.

17. A method comprising:

receiving a handshake communication indicating a desired signal processing algorithm for processing a signal from a hearing assist device;

receiving the signal from the hearing assist device;

communicating with a server storing the desired signal processing algorithm;

managing a processing of the signal with the desired signal processing algorithm to obtain a processed signal; and

sending the processed signal to the hearing assist device.

18. The method of claim 17, wherein the managing comprises receiving the desired signal processing algorithm from the server and processing the signal with the received, desired signal processing algorithm.

19. The method of claim 17, wherein the managing comprises sending the signal to the server and receiving the processed signal from the server following processing with the desired signal processing algorithm.

20. A hearing assist device comprising:

a sensor configured to detect energy in the form of sound waves;

a converter configured to convert the detected energy into a signal;

a memory configured to store one or more signal processing algorithms;

a processor configured to execute one or more of the signal processing algorithms to process the signal;

a communication interface configured to communicate with a coprocessor device;

a handshaking module configured to receive information regarding a functionality of the coprocessor device via the communication interface;

a functionality comparing module configured to compare the functionality of the coprocessor device to a functionality of the hearing assist device;

a processor switching module configured to direct the signal to at least one of the processor of the hearing assist device or a processor of the coprocessor device; and

a stimulator configured to stimulate an auditory nerve of a user based on the signal as processed by at least one of the processor of the hearing assist device or the processor of the coprocessor device.

21. The hearing assist device of claim 20, wherein the handshaking module is further configured to send information regarding the functionality of the hearing assist device to the coprocessor device.

22. The hearing assist device of claim 20, wherein the processor switching module is configured to direct the signal based on a comparison performed by the functionality comparing module.

23. The hearing assist device of claim 20, wherein the stimulator comprises one of a speaker or a cochlear implant.

24. A coprocessor device comprising:

a memory configured to store one or more signal processing algorithms;

a processor configured execute one or more of the signal processing algorithms to process a signal;

a communication interface configured to communicate with at least one of a hearing assist device or an additional coprocessor device; and

a handshaking module configured to send information regarding a functionality of the coprocessor to a hearing assist device via the communication interface.

25. The coprocessor device of claim 24, wherein the communication interface receives the signal from the hearing assist device and the processor processes the signal using the signal processing algorithms.

26. The coprocessor device of claim 24, wherein the processor is further configured to process a plurality of signals received from a plurality of hearing assist devices and to send the plurality of processed signals to each respective one of the plurality of hearing assist devices.

27. The coprocessor device of claim 24, further comprising a sensor configured to provide additional information used at least in part in processing of the signal.

28. The coprocessor device of claim 27, wherein the sensor comprises a microphone.

29. The coprocessor device of claim 24, wherein the communication interface is configured to receive an indication of a functionality of the hearing assist device and an indication of a desired processing for the signal, and to send the signal processed by the processing module to the hearing assist device.

30. The coprocessor device of claim 24, wherein the functionality comprises at least one of availability of coprocessor device, processor speed, processor capability, memory capacity, memory capability, signal processing algorithms available on the coprocessor device, a number of sensors, or a strength of a communication signal.

31. The coprocessor device of claim 24, wherein the communication interface is further configured to:

receive from the hearing assist device an indication of a desired processing for the signal; and

responsive to the receipt of the indication, obtain from a server one or more signal processing algorithms to perform the desired processing, the one or more signal processing algorithms.