Method and apparatus for sound responsive tactile stimulation of deaf individuals

• US 5,035,242 A
• Filed: 04/16/1990
• Issued: 07/30/1991
• Est. Priority Date: 04/16/1990
• Status: Expired due to Fees

• Current Assignee: Audiological Engineering Corporation
• Original Assignee: Audiological Engineering Corporation
• Inventors: Franklin, Joseph, Hughes, Paul, Franklin, David
• Primary Examiner(s): Jaworski, Francis
• Assistant Examiner(s): MANUEL, GEORGE C
• Application Number:
  US07/508,728
• Time in Patent Office: 470 Days
• Field of Search: 128/420.5, 128/420.6, 128/421, 128/422, 128/379
• US Class Current: 607/108
• CPC Class Codes: A61F 11/04 Methods or devices for enabling ear patients to achieve auditory perception through physiological senses other than hearing sense, e.g. through the touch sense electronic stimulation of auditory nerves A61N1/36036
• CPC Class Codes: G09B 21/009 Teaching or communicating with deaf persons G09B21/04 takes precedence; deaf and dumb persons G09B21/00
• CPC Class Codes: G10L 21/06 Transformation of speech into a non-audible representation, e.g. speech visualisation or speech processing for tactile aids G10L15/26 takes precedence

Abstract

A tactile aid for deaf individuals includes a conveniently wearable array of vibration transducers mounted on a flexible carrier strip so as to be positionally biased toward the individuals'"'"'s skin. Each transducer includes an enclosed magnetically vibratable cantilevered beam, an angled mounting slot to effect the positional bias mounting on the strip, and contact pads rather than conventional pin connectors to both reduce mass and facilitate electrical connection to contact pads on carrier strips in the form of printed circuit boards. Received acoustic signals are processed in at least first and second formant circuits each sub-divided into plural sub-bands corresponding to the number of transducers. In each formant circuit the corresponding formant frequency and amplitude are measured, averaged over a predetermined number of cycles, and a voltage corresponding to the measured amplitude is provided on a corresponding sub-hand channel to pulse width modulate a pulse train employed to excite the transducers. Spectral resolution can be increased by averaging the amplitude/frequency measurements over fewer cycles. Glottal pulses in the speech signal are monitored to provide a glottal rate signal at a stepped down frequency related to the actual glottal rate. The channel amplitude is modulated by the glottal signal to cause alternation of transducer excitation at the related glottal rate. Additional formants may be detected to derive additional information in the excitation signal.

Claims

1. A tactile aid apparatus for providing tactile stimulation to a deaf individual in response to acoustic signals and particularly acoustic speech signals, said apparatus comprising:

multiple transducers disposed in an array adapted to be placed against the skin of said individual, each transducer including means responsive to electrical excitation signals applied thereto for providing a tactually sensible vibration to the individual'"'"'s skin;

acoustic receiver means for receiving said acoustic signals and providing corresponding electrical audio signals;

signal conditioning means responsive to said audio signals for providing a conditioned signal suitable for processing by the apparatus;

first and second formant circuits, each including;

formant separation means responsive to said conditioned signal for passing as respective formant signals only frequency components of said conditioned signal corresponding to frequencies typically found in the first and second formants, respectively, of speech signals;

band separation means for sub-dividing the formant circuit into a plurality of pre-determined formant frequency sub-bands, each sub-band having a respective signal channel;

amplitude measuring means for measuring the amplitude of said formant signal and providing an amplitude signal as a predetermined function thereof;

channel selecting means responsive to said formant signal for measuring the frequency thereof and selecting the formant sub-band in which the measured formant frequency resides;

switching means for applying said amplitude signal to the signal channel corresponding to the formant sub-band selected by the channel selecting means;

wherein each of said transducers is disposed in a respective one of said signal channels; and

excitation means in each of said signal channels for applying to the transducer in that channel an excitation signal as a predetermined function of the amplitude signal in that channel.

2. The apparatus according to claim 1 wherein said excitation means comprises:

pulse width converter means in each of said signal channels for converting the amplitude signal in said channel to a train of fixed frequency pulses having a pulse width as a predetermined function of said amplitude signal; and

means for applying said train of pulses as the excitation signal to the transducer in the signal channel containing said excitation means.

3. The apparatus according to claim 2 further comprising:

means for generating a timing signal having a lower frequency than the repetition rate of said train of pulses;

driver means in each signal channel for delivering said train of pulses to said transducers; and

means for delivering said train of pulses to said transducers at different alternating polarities during alternate half-cycles of said timing signal.

4. The apparatus according to claim 2 further comprising:

glottal rate detector means responsive to said conditioned signal for detecting glottal pulse rates in said conditioned signal and providing an alternating glottal rate signal at a frequency that is a sub-multiple of the detected glottal rate; and

modulation means for amplitude modulating the amplitude signal in each signal channel with the glottal rate signal, whereby the pulses in said pulse train are alternately inhibited and enabled at the glottal rate signal frequency.

5. The apparatus according to claim 1 wherein said channel selecting means includes means for measuring the time between zero-axis crossings in alternate half-cycles of said formant signal.

6. The apparatus according to claim 1 wherein said amplitude measuring means includes:

peak detector means for detecting the peak voltage of one polarity of said formant signal;

common capacitor means for substantially immediately storing the peak voltage detected by said peak detector means;

a plurality of channel capacitors disposed in said plurality of signal channels, respectively;

a resistive charging path for transferring voltage stored in said common capacitor means selectively to an individual channel capacitor in the channel selected by said switching means;

wherein said switching means includes means for inhibiting voltage transfer to all of said channel capacitors during half-cycles of said one polarity of said formant signal and for permitting voltage transfer to the channel capacitor in the selected channel during half-cycles of opposite polarity of said formant signal; and

discharge means responsive to each zero-axis crossing of said formant signal from said opposite polarity to said one polarity for substantially instantaneously discharging the voltage from said common capacitor.

7. The apparatus according to claim 6 wherein said channel selecting means comprises:

a first timing capacitor;

charge path means for charging said first timing capacitor from a constant voltage and at a constant rate for the time interval between successive formant signal zero-axis crossings corresponding to half-cycles of said one polarity;

a second timing capacitor;

a selectively actuable charge transfer path for transferring voltage between said first and second timing capacitor;

control means for actuating said charge transfer path only during half-cycles of said opposite polarity of said formant signal;

discharge means responsive to each zero-axis crossing of said formant signal from said opposite polarity to said one polarity for substantially instantaneously discharging the voltage from said first timing capacitor; and

decoder means responsive to the voltage level stored in said second timing capacitor for selecting a formant sub-band and associated signal channel.

8. The apparatus according to claim 7 wherein said excitation means comprises:

pulse width converter means in each of said signal channels for converting the amplitude signal in said channel to a train of fixed frequency pulses having a pulse width that is a predetermined function of said amplitude signal; and

means for applying said train of pulses as the excitation signal to the transducer in the signal channel containing said excitation means.

9. The apparatus according to claim 8 further comprising:

means for generating a timing signal having a lower frequency than the repetition rate of said train of pulses;

driver means in each signal channel for delivering said train of pulses to said transducers; and

means for delivering said train of pulses to said transducers at different alternating polarities during alternate half-cycles of said timing signal.

10. The apparatus according to claim 9 further comprising:

glottal rate detector means responsive to said conditioned signal for detecting the presence of glottal pulses in said conditioned signal; and

modulation means for selectively modulating the amplitude signal in each signal channel to distinguish between the presence and absence of glottal pulses in said conditioned signal.

11. The apparatus according to claim 9 wherein said transducers are all secured to a flexible strip adapted to be secured and contoured to a predetermined body part of said individual.

12. The apparatus according to claim 11 wherein said flexible strip is a plastic printed circuit board on which electrical wiring for said transducers is printed.

13. The apparatus according to claim 12 wherein each of said transducers comprises:

a casing having an interior space and a skin-contacting surface;

wherein said means responsive to electrical excitation signals includes vibration means comprising a vibratable member disposed in said interior space for vibrating in response to said excitation signals, and means for securing said vibratable member to said casing for transmitting vibrations of said vibratable member to said skin-contacting surface; and

mounting means for mounting the transducer on a mounting edge of said flexible strip with said skin-contacting surface angularly oriented out of plane with respect to the flexible strip so as to be urged against the skin of said individual when the flexible strip is secured to said predetermined body part.

14. The apparatus according to claim 13 wherein said mounting means comprises a mounting slot defined in said casing for receiving said mounting edge of said flexible strip, said mounting slot being oriented angularly out of plane with respect to said skin-contacting surface.

15. The apparatus according to claim 14 further comprising:

contactor strips disposed in said mounting slot and electrically connected to said vibration means; and

edge connector means disposed at said mounting edge of said circuit board and positioned to mate with said contactor strips when said mounting edge is received in said mounting slot.

16. The apparatus according to claim 15 wherein said flexible strip has a multiple cut-outs defined therein, one cut-out for each of said transducers, and wherein said mounting slot of each transfer receives an edge of a respective cut-out at said mounting edge.

17. The apparatus according to claim 16 wherein said vibration means comprises:

an electromagnet disposed in said interior space and including a coil electrically connected across said contactor strips and wrapped about a magnetic pole piece; and

a beam corresponding to said vibratable member and mounted in cantilever fashion in said interior space to be vibrated in response to alternating current through said coil.

18. The apparatus according to claim 17 further comprising a permanent magnet secured to said beam so as to be magnetically reciprocated relative to said pole piece in response to said alternating current through said coil.

19. The apparatus according to claim 17 wherein each of said transducers comprises:

a casing having an interior space and a skin-contacting surface;

wherein said means responsive to electrical excitation signals includes vibration means comprising a vibratable member disposed in said interior space for vibrating in response to said excitation signals, and means for securing said vibratable member to said casing for transmitting vibrations of said vibratable member to said skin-contacting surface; and

mounting means for mounting the transducer on a mounting edge of said flexible strip with said skin-contacting surface angularly oriented out of plane with respect to the flexible strip so as to be urged against the skin of said individual when the flexible strip is secured to said predetermined body part.

20. The apparatus according to claim 19 wherein said mounting means comprises a mounting slot confined in said casing for receiving said mounting edge of said flexible strip, said mounting slot being oriented angularly out of plane with respect to said skin-contacting surface.

21. The apparatus according to claim 20 wherein said flexible strip has multiple cut-outs defined therein, one cut-out for each of said transducers, and wherein said mounting slot of each transducer receives an edge of a respective cut-out as said mounting edge.

22. The apparatus according to claim 19 wherein said vibration means comprises:

an electromagnet disposed in said interior space and including a coil electrically connected across said contactor strips and wrapped about a magnetic pole piece; and

a beam corresponding to said vibratable member and mounted in cantilever fashion in said interior space to be vibrated in response to alternating current through said coil.

23. The apparatus according to claim 22 further comprising a permanent magnet secured to said beam so as to be magnetically reciprocated relative to said pole piece in response to said alternating current through said coil.

24. The apparatus according to claim 1 wherein said transducers are each secured to a flexible strip adapted to be secured and contoured to a predetermined body part of said individual.

25. The apparatus according to claim 24 wherein each of said transducers comprises:

a casing having an interior space and a skin-contacting surface;

wherein said means responsive to electrical excitation signals includes vibration means comprising a vibratable member disposed in said interior space for vibrating in response to said excitation signals, and means for securing said vibratable member to said casing for transmitting vibrations of said vibratable member to said skin-contacting surface; and

mounting means for mounting the transducer on a mounting edge of said flexible strip with said skin-contacting surface angularly oriented out of plane with respect to the flexible strip so as to be urged against the skin of said individual when the flexible strip is secured to said predetermined body part.

26. The apparatus according to claim 25 wherein said mounting means comprises a mounting slot confined in said casing for receiving said mounting edge of said flexible strip, said mounting slot being oriented angularly out of plane with respect to said skin-contacting surface.

27. The apparatus according to claim 26 wherein said flexible strip has multiple cut-outs defined therein, one cut-out for each of said transducers, and wherein said mounting slot of each transducer receives an edge of a respective cut-out as said mounting edge.

28. The apparatus according to claim 26 wherein said flexible strip is a plastic printed circuit board on which electrical wiring for said transducers is printed.

29. The apparatus according to claim 28 further comprising:

contactor strips disposed in said mounting slot and electrically connected to said vibration means; and

edge connector means disposed at said mounting edge of said circuit board and positioned to mate with said contactor strips when said mounting edge is received in said mounting slot.

30. The apparatus according to claim 29 wherein said vibration means comprises:

an electromagnet disposed in said interior space and including a coil electrically connected across said contactor strips and wrapped about a magnetic pole piece; and

a beam having a permanent magnet secured thereto corresponding to said vibratable member and mounted in cantilever fashion in said interior space to be vibrated in response to alternating current through said coil.

31. Apparatus for processing acoustic signals, particularly acoustic speech signals, comprising:

acoustic receiver means for receiving said acoustic signals and providing corresponding electrical audio signals;

signal conditioning means responsive to said audio signals for providing a conditioned signal suitable for processing by the apparatus;

first and second formant circuits, each formant circuit including;

formant separation means responsive to said conditioned signal for passing as respective formant signals only frequency components of said conditioned signal typically found in the first and second formants, respectively of speech signals;

band separation means for sub-dividing said formant circuit into a plurality of predetermined formant frequency sub-bands, each sub-band having a respective signal channel;

amplitude measuring means for measuring the amplitude of said formant signal and providing an amplitude signal as a predetermined function thereof;

channel selecting means responsive to said formant signal for measuring the frequency thereof and selecting the formant sub-band in which the measured formant frequency resides; and

switching means for applying said amplitude signal to the signal channel corresponding to the formant sub-band selected by the channel selecting means.

32. The apparatus according to claim 31 further comprising glottal rate detector means responsive to said conditioned signal for detecting the presence of glottal pulse in said conditioned signal;

and

modulation means for selectively modulating the amplitude signal in each signal channel to distinguish between the absence and presence of glottal pulses in said conditioned signal.

33. The apparatus according to claim 31 wherein said channel selecting means includes means for measuring the time between zero-axis crossings in alternate half-cycles of said formant signal.

34. The apparatus according to claim 31 wherein said amplitude measuring means includes:

peak detector means for detecting the peak voltage of one polarity of said formant signal;

common capacitor means for substantially immediately storing the peak voltage detected by said peak detector means;

a plurality of channel capacitors disposed in said plurality of signal channels, respectively;

a resistive charging path for transferring voltage stored in said common capacitor means selectively to an individual channel capacitor in the channel selected by said switching means;

wherein said switching means includes means for inhibiting voltage transfer to all of said channel capacitors during half-cycles of said one polarity of said formant signal and for permitting voltage transferred to the channel capacitor in the selected channel during half-cycles of opposite polarity of said formant signal; and

discharge means responsive to each zero-axis crossing of said formant signal from said opposite polarity to said one polarity for substantially instantaneously discharging the voltage from said common capacitor.

35. The apparatus according to claim 31 wherein said channel selecting means comprises:

a first timing capacitor;

charge path means for charging said first timing capacitor from a constant voltage and at a constant rate for the time interval between successive formant signal zero-axis crossings corresponding to half-cycles of said one polarity;

a second timing capacitor;

a selectively actuable charge transfer path for transferring voltage between said first and second timing capacitor;

control means for actuating said charge transfer path only during half-cycles of said opposite polarity of said formant signal;

discharge means responsive to each zero-axis crossing of said formant signal from said opposite polarity to said one polarity for substantially instantaneously discharging the voltage from said first timing capacitor; and

decoder means responsive to the voltage level stored in said second timing capacitor for selecting a formant sub-band and associated signal channel.

36. Transducer apparatus for imparting tactually sensible vibrations to the skin of an individual, said apparatus comprising:

a casing having an interior space and a skin-contacting surface;

means responsive to electrical excitation signals for providing said tactually sensible vibrations, said means comprising;

vibration means including a vibratable member disposed in said interior space for vibrating in response to said excitation signals; and

means securing said vibratable member to said casing for transmitting vibrations of said vibratable member to said skin-contacting surface; and

mounting means in the form of a mounting slot defined in said casing for receiving a mounting edge of a support strip therein.

37. The apparatus according to claim 36 wherein said casing includes a pair of electrical connector strips disposed in said mounting slot and adapted to make electrical connections with contacts on the support strip edge received by said mounting slot to conduct said excitation signals to said vibration means.

38. The apparatus according to claim 37 wherein said mounting slot is oriented angularly out of plane with respect to said skin-contacting surface such that said skin-contacting surface angularly intersects the support surface when the support surface mounting edge is received in said mounting slot.

39. The apparatus according to claim 37 wherein said vibration means comprises:

an electromagnet disposed in said interior space and including a coil electrically connected across said contactor strips and wrapped about a magnetic pole piece; and

a beam corresponding to said vibratable member, said beam mounted in cantilever fashion in said interior space to be vibrated in response to alternating current through said coil.

40. The apparatus according to claim 39 further comprising a permanent magnet secured to said beam so as to be magnetically reciprocated relative to said pole piece in response to said alternating current through said coil.

41. The apparatus according to claim 39 wherein said mounting slot is oriented angularly out of plane with respect to said skin-contacting surface such that said skin-contacting surface angularly intersects the support surface when the support surface mounting edge is received in said mounting slot.

42. The apparatus according to claim 37 wherein said support strip is a flexible strip adapted to support a plurality of said transducers and be secured to a body part of said individual such that the skin-contacting surface of each of said transducers abuts the skin of the individual.

43. The apparatus according to claim 42 wherein said flexible strip is a plastic printed circuit board on which electrical wiring for said transducers is printed.

44. The apparatus according to claim 43 further comprising:

contactor strips disposed in said mounting slot and electrically connected to said vibration means; and

edge connector means disposed at said mounting edge of said circuit board and positioned to mate with said contactor strips when said mounting edge is received in said mounting slot.

45. The apparatus according to claim 44 wherein said flexible strip has multiple cut-outs defined therein, one cut-out for each of said transducers, and wherein said mounting slot of each transducer receives an edge of a respective cut-out as said mounting edge.

46. The apparatus according to claim 45 wherein said vibration means comprises:

an electromagnet disposed in said interior space and including a coil electrically connected across said contactor strips and wrapped about a magnetic pole piece; and

a beam having a permanent magnet secured thereto corresponding to said vibratable member and mounted in cantilever fashion in said interior space to be vibrated in response to alternating current through said coil.

47. A method for providing tactile stimulation to a deaf individual in response to acoustic signals and particularly acoustic speech signals, said method comprising the steps of:

(a) in response to electrical excitation signals applied to respective transducers disposed in an array and placed against the skin of said individual, providing tactually sensible vibrations to the individual'"'"'s skin;

(b) receiving said acoustic signals and providing corresponding electrical audio signals;

(c) in response to said audio signal, providing a conditioned signal suitable for processing;

(d) in response to said conditioned signal, passing as first and second formant signals only frequency components of said conditioned signal typically found in the first and second formants, respectively, of speech signals;

(e) sub-dividing each formant signal into a plurality of predetermined formant frequency sub-bands, each sub-band having a respective signal channel;

(f) measuring the amplitude to each formant signal and providing a respective amplitude signal as a predetermined function thereof;

(g) in response to each formant signal, measuring the frequency thereof and selecting the formant sub-band in which the measured formant frequency resides;

(h) applying each amplitude signal to the signal channel corresponding to the selected formant sub-band;

wherein each of said transducers is disposed in a respective one of said signal channels; and

(i) applying to the transducer in each channel an excitation signal that is a predetermined function of the amplitude signal in that channel.

48. The method according to claim 47 wherein step (i) comprises:

(i.1) in each of said signal channels, converting the amplitude signal in that channel to a train of fixed frequency pulses having a pulse width that is a predetermined function of the amplitude signal; and

(i.2) applying said train of pulses as the excitation signal to the transducer in said channel.

49. The method according to claim 48 further comprising the steps of:

(j) generating a timing signal having a lower frequency than the repetition rate of said train of pulses;

(k) in each signal channel, delivering said train of pulses to said transducer at different alternating polarities during alternate half-cycles of said timing signal.

50. The method according to claim 47 further comprising the steps of:

(j) detecting the presence of glottal pulses in said conditioned signal; and

(k) selectively modulating the amplitude signal in each signal channel to distinguish between the absence and present of glottal pulses in said conditioned signal.

51. The method according to claim 47 wherein step (g) includes measuring the time between zero-axis crossings in alternate half-cycles of said formant signal.

52. The method according to claim 47 wherein step (f) comprises the steps of:

(f.1) detecting the peak voltage of one polarity of each formant signal;

(f.2) substantially immediately storing the peak voltage detected in step (f.1) in a common capacitor;

(f.3) transferring voltage stored in said common capacitor selectively to an individual channel capacitor in the channel selected by said switching means; and

wherein step (h) includes the steps of;

(h.1) inhibiting voltage transfer to all of said channel capacitors during half-cycles of said one polarity of said formant signal and for permitting voltage transfer to the channel capacitor in the selected channel during half-cycles of opposite polarity of said formant signals; and

(h.2) in response to each zero-axis crossing of said formant signal from said opposite polarity to said one polarity, substantially instantaneously discharging the voltage from said common capacitor.

53. The apparatus according to claim 52 wherein step (g) comprises the steps of:

(g.1) charging a first timing capacitor from a constant voltage and at a constant rate for the time interval between successive format signal zero-axis crossings corresponding to half-cycles of said one polarity;

(g.2) transferring voltage from said first to a second timing capacitor via a selectively actuable charge transfer path;

(g.3) actuating said charge transfer path only during half-cycles of said opposite polarity of said formant signal;

(g.4) in response to each zero-axis crossing of said formant signal from said opposite polarity to said one polarity, substantially instantaneously discharging the voltage from said first timing capacitor; and

(g.5) in response to the voltage level stored in said second timing capacitor, selecting a formant sub-band and associated signal channel.

54. The method according to claim 47 further comprising the steps of:

mounting each of said transducers to respective edge segments of a flexible support strip such that a skin contacting surface of each transducer is disposed angularly out of plane with respect to the support strip; and

securing the support strip to the skin of said individual such that the skin contacting surface of each transducer is forcefully urged against the individual'"'"'s skin.