Cochlear implant and method enabling enhanced music perception

• US 8,747,447 B2
• Filed: 07/21/2012
• Issued: 06/10/2014
• Est. Priority Date: 07/22/2011
• Status: Active Grant

• Current Assignee: Nurotone Medical Ltd.
• Original Assignee: Lockheed Martin Corporation (Martin Marietta Corporation)
• Inventors: Stafford, Ryan C., Stafford, James W.
• Primary Examiner(s): Jackson, Gary
• Assistant Examiner(s): PAHAKIS, MANOLIS Y
• Application Number:
  US13/555,094
• Publication Number:
  US 20130023962A1
• Time in Patent Office: 689 Days
• Field of Search: 607/57, 607 88- 89
• US Class Current: 607/89
• CPC Class Codes: A61N 1/0541 Cochlear electrodes
• CPC Class Codes: A61N 1/36039 fitting procedures
• CPC Class Codes: A61N 2005/0605 Ear
• CPC Class Codes: A61N 2005/0626 Monitoring, verifying, controlling systems and methods
• CPC Class Codes: A61N 2005/0652 Arrays of diodes
• CPC Class Codes: A61N 2005/0659 infrared
• CPC Class Codes: A61N 5/0622 Optical stimulation for exciting neural tissue
• CPC Class Codes: A61N 5/067 using laser light
• CPC Class Codes: F04C 2270/0421 Controlled or regulated

Abstract

Method and apparatus in which optical sources deliver light to small specific areas of the cochlea for purposes of stimulation, which brings the advantage of increased spectral fidelity because the stimulation illumination can be more specifically placed than electrical-stimulation signals. In some embodiments, a plurality of light sources or light delivery devices are placed at finely-spaced locations along the cochlea but only a fraction of them are used within any short period of time due to the limitation of power delivery to the optical emitters and a restriction on heat within the cochlea due to the absorption of the optical stimulation signals. The ability to choose which optical sources are used at any given time frame provides the ability to choose the sources that illuminate and thus stimulate the particular small areas of the cochlea that generate nerve signals perceived as the semitone frequencies found in Western music.

Claims

1. A method for optically stimulating neurons of a cochlea of a person to provide music-perception auditory sensations for the person, wherein the neurons of the cochlea include a plurality of frequency-response regions, each different frequency-response region, when stimulated, generates nerve-action-potential (NAP) signal pulses that the person'"'"'s brain perceives as a different frequency, the method comprising:

entering a calibration mode in a calibration system and performing a calibration that includes;

generating a first plurality of pulsed light signals into a first plurality of optical-stimulation emitting channels using an optical generator, wherein each of the first plurality of optical-stimulation emitting channels carries a plurality of successive pulses that, when applied to a neuron of a person, will each stimulate a nerve-action-potential (NAP) signal pulse in the neuron;

delivering the first plurality of pulsed light signals through the first plurality of optical-stimulation emitting channels to a plurality of neuron locations in the cochlea of the person using an optical guide;

selectively controlling through a controller the pulsed light signals in each of the first plurality of optical-stimulation emitting channels to separately optically stimulate a respective plurality of different frequency-response regions of the cochlea in order to trigger NAPs;

testing and empirically determining through the controller based on feedback from the person, which of the first plurality of optical-stimulation emitting channels are most effective in optically stimulating frequency-response regions of the cochlea where semitones are psychophysically represented, wherein the testing includes empirically mapping pairs of musical pitches that are perceived by the person as a result of the pulsed light signals to respective pairs of optical-stimulation emitting channels of the first plurality of optical-stimulation emitting channels that are most effective in providing the person with the best perception of the pairs of musical pitches based on feedback from the person,

and based on the mapping, determining a second plurality of optical-stimulation emitting channels that is a subset of the first plurality of optical-stimulation channels, wherein, when delivering optical stimulation pulsed light, each nearest-neighbor pair of the second plurality of optical-stimulation emitting channels trigger a semitone-interval pair of perceived musical pitches that have a predetermined frequency ratio to one another;

and entering a first listening mode in a first-listening-mode system, wherein the method further includes;

receiving an audio signal that contains different spectrums of frequencies at each of a plurality of successive times using an audio sensor;

determining through the controller based on the received audio signal, a subset of one or more frequencies that are to be perceived by the person at each of the plurality of successive times as a result of the audio signal;

using results of the testing to generate a second plurality of pulsed light signals into the second plurality of optical-stimulation emitting channels using the optical generator,

wherein each of the second plurality of pulsed light signals includes a plurality of successive pulses that, when applied to a neuron in the cochlea of the person, will each stimulate a nerve action potential (NAP) in the neuron; and

delivering the second plurality of light signals in the second plurality of optical-stimulation emitting channels using the optical guide and to the cochlea of the person to optically stimulate the plurality of frequency-response regions of the cochlea at the plurality of successive times.

2. The method of claim 1,

wherein the performing of the calibration determines which of the nearest-neighbor pairs of the second plurality of optical-stimulation emitting channels correspond to which semitone-interval pairs of perceived musical pitches, and wherein in the listening mode, the received audio signal is analyzed to determine semitone frequencies in the audio signal and the delivering includes delivering pulsed light signals in the second plurality of optical-stimulation emitting channels to trigger perception by the person of the semitone frequencies.

3. The method of claim 1, wherein the predetermined frequency ratio is equal for each semitone-interval pair of perceived musical pitches.

4. The method of claim 1, further comprising:

obtaining an audio signal having an audio spectrum that includes a harmonic structure; and

selecting which frequency-response regions to stimulate in order to preserve the harmonic structure of the audio signal.

5. The method of claim 1, further comprising:

obtaining an audio signal having an audio spectrum; and

selecting which frequency-response regions to stimulate in order to improve the music perception of the person.

6. The method of claim 1, further comprising:

obtaining an audio signal having an audio spectrum;

determining whether the audio signal is spoken human voice or music;

selecting a first set of the plurality of frequency-response regions to stimulate in order to improve voice perception in the person when the audio signal is determined to be spoken human voice; and

selecting a second set of the plurality of frequency-response regions, different from the first set, to stimulate in order to improve music perception in the person when the audio signal is determined to be music.

7. The method of claim 1, wherein the predetermined frequency ratio for each semitone-interval pair of perceived musical pitches is about the twelfth root of two.

15. A non-transitory computer readable medium having instructions stored thereon for causing a suitable programmed information processor to perform a method for optically stimulating neurons of a cochlea of a person to provide music-perception auditory sensations for the person, wherein the neurons of the cochlea include a plurality of frequency-response regions, each different frequency-response region, when stimulated, generates nerve-action-potential (NAP) signal pulses that the person'"'"'s brain perceives as a different frequency, the method comprising:

the steps of the method of claim 1.

16. The non-transitory computer readable medium of claim 15, wherein the medium further includes instructions such that the performing of the calibration determines which of the nearest-neighbor pairs of the second plurality of optical-stimulation emitting channels correspond to which semitone-interval pairs of perceived musical pitches, and wherein the medium further includes instructions such that in the listening mode, the received audio signal is analyzed to determine semitone frequencies in the audio signal and the delivering includes delivering pulsed light signals in the second plurality of optical-stimulation emitting channels to trigger perception by the person of the semitone frequencies.

17. The non-transitory computer readable medium of claim 16, wherein the medium further includes instructions such that the predetermined frequency ratio is equal for each semitone-interval pair of perceived relative frequencies.

18. The non-transitory computer readable medium of claim 15, wherein the medium further includes instructions such that the method further includes:

obtaining an audio signal having an audio spectrum that includes a harmonic structure; and

selecting which frequency-response regions to stimulate in order to preserve the harmonic structure of the audio signal.

19. The non-transitory computer readable medium of claim 15, wherein the medium further includes instructions such that the method further includes:

obtaining an audio signal having an audio spectrum; and

selecting which frequency-response regions to stimulate in order to improve the music perception of the person.

20. The non-transitory computer readable medium of claim 15, wherein the medium further includes instructions such that the method further includes:

obtaining an audio signal having an audio spectrum;

determining whether the audio signal is spoken human voice or music;

selecting a first set of the plurality of frequency-response regions to stimulate in order to improve voice perception in the person when the audio signal is determined to be spoken human voice; and

selecting a second set of the plurality of frequency-response regions, different from the first set, to stimulate in order to improve music perception in the person when the audio signal is determined to be music.

8. An apparatus for optically stimulating neurons of a cochlea of a person to provide music-perception auditory sensations for the person, wherein the neurons of the cochlea include a plurality of frequency-response regions, each different frequency-response region, when stimulated, generates nerve-action-potential (NAP) signal pulses that the person'"'"'s brain perceives as a different frequency, the apparatus comprising:

a calibration system that includes;

an optical generator configured to generate a first plurality of pulsed light signals into a first plurality of optical-stimulation emitting channels, wherein each of the first plurality of optical-stimulation emitting channels carries a plurality of successive pulses that, when applied to a neuron of a person, will each stimulate a nerve-action-potential (NAP) signal pulse in the neuron;

an optical guide configured to deliver the first plurality of pulsed light signals through the first plurality of optical-stimulation emitting channels to a plurality of neuron locations in the cochlea of the person;

and a controller configured to;

selectively control the pulsed light signals in each of the first plurality of optical-stimulation emitting channels to separately optically stimulate a respective plurality of different of frequency-response regions of the cochlea in order to trigger NAPs, test and empirically determine based on feedback from the person, which of the first plurality of optical-stimulation emitting channels are most effective in optically stimulating frequency-response regions of the cochlea where semitones are psychophysically represented, wherein the test includes empirically mapping pairs of musical pitches that are perceived by the person as a result of the pulsed light signals to respective pairs of optical-stimulation emitting channels of the first plurality of optical-stimulation emitting channels that are most effective in providing the person with the best perception of the pairs of musical pitches based on feedback from the person, and based on the mapping, determine a second plurality of optical-stimulation emitting channels that is a subset of the first plurality of optical-stimulation emitting channels, wherein, when each nearest-neighbor pair of the second plurality of optical-stimulation emitting channels deliver optical-stimulation pulsed light, each nearest-neighbor pair triggers a semitone-interval pair of perceived musical pitches that have a predetermined frequency ratio to one another; and

a first-listening-mode system that includes;

an audio sensor configured to receive an audio signal that contains different spectrums of frequencies at each of a plurality of successive times;

wherein the controller is further configured to determine based on the received audio signal, a subset of one or more frequencies that are to be perceived by the person as a result of the audio signal;

wherein the optical generator is further configured to generate a second plurality of pulsed light signals into the second plurality of optical-stimulation emitting channels, each of the second plurality of pulsed light signals having a plurality of successive pulses that, when applied to a neuron of a person, will each stimulate a nerve action potential (NAP) in the neuron;

and wherein the optical guide is further configured to deliver the second plurality of light signals in the second plurality of optical-stimulation emitting channels to the cochlea of the person to optically stimulate the plurality of frequency-response regions of the cochlea at the plurality of successive times.

9. The apparatus of claim 8,

wherein the calibration system determines which of the nearest-neighbor pairs of the second plurality of optical-stimulation emitting channels correspond to which semitone-interval pairs of perceived musical pitches, and wherein the controller is further configured to analyze the received audio signal to determine semitone frequencies in the audio signal and the optical guide is further configured to deliver the pulsed light signals in the second plurality of optical-stimulation emitting channels to trigger perception by the person of the semitone frequencies.

10. The apparatus of claim 8, wherein the predetermined frequency ratio for each semitone-interval pair of perceived musical pitches is about the twelfth root of two.

11. The apparatus of claim 8, further comprising:

an audio sensor configured to obtain an audio signal having an audio spectrum that includes a harmonic structure; and

an audio processor configured to select which frequency-response regions to stimulate in order to preserve the harmonic structure of the audio signal.

12. The apparatus of claim 8, further comprising:

an audio sensor configured to obtain an audio signal having an audio spectrum; and

an audio processor configured to select which frequency-response regions to stimulate in order to improve the music perception of the person.

13. The apparatus of claim 8, further comprising:

an audio sensor configured to obtain an audio signal having an audio spectrum; and

an audio processor configured to;

determine whether the audio signal is spoken human voice or music,

select a first set of the plurality of frequency-response regions to stimulate in order to improve voice perception in the person when the audio signal is determined to be spoken human voice, and

select a second set of the plurality of frequency-response regions, different from the first set, to stimulate in order to improve music perception in the person when the audio signal is determined to be music.

14. The apparatus of claim 8, wherein each of the first plurality of optical stimulation emitting channels corresponds to a single vertical-cavity surface-emitting laser (VCSEL).