Method and device for enhancing the recognition of speech among speech-impaired individuals

• US 5,813,862 A
• Filed: 05/20/1997
• Issued: 09/29/1998
• Est. Priority Date: 12/08/1994
• Status: Expired due to Term

• Current Assignee: Rutgers University, Regents of the University of California (University of California)
• Original Assignee: Rutgers University, Regents of the University of California (University of California)
• Inventors: Miller, Steven Lamont, Jenkins, William Michael, Merzenich, Michael Mathias, Schreiner, Christoph E., Tallal, Paula Anne
• Primary Examiner(s): CHENG, JOE H
• Application Number:
  US08/858,961
• Time in Patent Office: 497 Days
• Field of Search: 434/118, 434/156, 434/169, 434/185, 434/307 R, 434/308, 434/309, 434/323, 434/362, 434/365, 704/1, 704/9, 704/200, 704/211, 704/241-261, 704/213, 381/34
• US Class Current: 434/185
• CPC Class Codes: G09B 19/04 Speaking with audible presentation of the material to be studied G09B5/04
• CPC Class Codes: G09B 5/065 Combinations of audio and video presentations, e.g. videotapes, videodiscs, television systems
• CPC Class Codes: G10L 21/0364 for improving intelligibility
• CPC Class Codes: G11B 31/00 Arrangements for the associated working of recording or reproducing apparatus with related apparatus with cameras or projectors G03B31/00 ; recording/reproducing of music for electrophonic musical instruments G10H1/0033; automatic arrangements for answering calls or for recording messages for absent subscribers H04M1/64; telephonic communication systems adapted for combination with dictation recording and playback systems H04M11/10; connection of TV recorder with other related apparatus, e.g. TV camera or receiver, in which the TV signal is significantly involved H04N, e.g. H04N23/00, H04N5/765; combination of radio or TV with other apparatus, e.g. with vehicles H05K11/00
• CPC Class Codes: H04R 2225/43 Signal processing in hearing aids to enhance the speech intelligibility

Abstract

A method and a system is disclosed that provide means to enable individuals with speech, language and reading based communication disabilities, due to a temporal processing problem, to improve their temporal processing abilities as well as their communication abilities. The method and system include provisions to elongate portions of phonemes that have brief and/or rapidly changing acoustic spectra, such as occur in the stop consonants b and d in the phonemes /ba/ and /da/, as well as reduce the duration of the steady state portion of the syllable. In addition, some emphasis is added to the rapidly changing segments of these phonemes. Additionally, the disclosure includes method for and computer software to modify fluent speech to make the modified speech better recognizable by communicatively impaired individuals. Finally, the disclosure includes method for and computer software to train temporal processing abilities, specifically speed and precision of temporal integration, sequencing and serial memory.

Claims

1. A method of teaching temporally impaired individuals to discriminate between the stimuli of at least two rapidly changing frequencies of consonant sounds, the method comprising the steps of:

a) separating the at least two differing sound stimuli to provide an interstimulus interval of at least 100 milliseconds;

b) prolonging the consonant sound in each of the stimuli by a factor of at least thirty percent;

c) repeating the at least two differing stimuli in random order until the temporally impaired individual is able to distinguish the order of each stimulus;

d) decreasing the interstimulus interval by at least a one percent factor;

e) repeating step c) with a decreased interstimulus interval until the temporally impaired individual is able to distinguish the order of each stimulus; and

,

f) repeating steps c) through e).

2. The method of claim 1 further comprising the step of increasing the energy of the consonant sound following the step of prolonging (step b) but before the first step of repeating (step c).

3. The method of claim 2 wherein step e) includes shortening progressively the duration of the prolonged consonant sounds.

4. The method of claim 2 wherein step c) includes the step of recognition of one of the consonant sounds, rather than sequence order.

5. The method of claim 1 wherein step e) includes shortening progressively the duration of the prolonged consonant sounds.

6. The method of claim 3 wherein step c) includes the step of recognition of one of the consonant sounds, rather than sequence order.

7. The method of claim 1 wherein step c) includes the step of recognition of one of the consonant sounds, rather than sequence order.

8. Computerized interactive exercise for use in teaching temporally impaired individuals to discriminate between the stimuli of at least two rapidly changing frequencies of consonant sounds, the computerized exercise comprising:

a computer having processor, a memory, input means including a compact disk reader for receiving input data, first output means including a video display tube for displaying textual material and second output means for generating audio means;

a compact disk having an interactive exercise including audio signals and video signals recorded thereon; and

program means for a) separating at least two differing sound stimuli to provide an interstimulus interval of at least 100 milliseconds;

b) prolonging the consonant sound in each of the stimuli by a factor of at least thirty percent;

c) repeating at least two differing stimuli in random order until the temporally impaired individual is able to distinguish the order of each stimulus;

d) decreasing the interstimulus interval by at least a one percent factor;

e) repeating the step c) with a decreased interstimulus interval until the temporally impaired individual is able to distinguish the order of each stimulus;

f) repeating steps of c) through e); and

g) rewarding correct responses to exercise queries.

9. A method of teaching temporally impaired to discriminate between the stimuli of at least two differing fast, non-speech audio sounds, the method comprising the-steps of:

a) separating the at least two differing audio sounds to provide an interstimulus interval of at least 100 milliseconds;

b) prolonging a portion of the sound in each of the audio sounds by a factor of at least thirty percent;

c) repeating the at least two differing sounds in random order until the temporally impaired individual is able to distinguish the order of each sound;

d) decreasing the interstimulus interval by at least a one percent factor;

e) repeating step c) with the decreased interstimulus interval until the temporally impaired individual is able to distinguish the order of each of the sounds; and

,

f) repeating steps c) through e).

10. The method of claim 9 further comprising the step of increasing the energy of the prolonged portion of the sounds following the step of prolonging (step b) but before the first step of repeating (step c).

11. The method of claim 9 wherein step e) includes shortening progressively the duration of the prolonged consonant sounds.

12. The method of claim 9 wherein step e) includes shortening progressively the duration of the prolonged portion of the sounds.

13. A method of teaching the temporarily impaired to discriminate between the stimuli of at least two differing fast audio sounds, the method comprising the steps of:

a) separating the at least two differing sounds to provide an interstimulus interval of at least 100 milliseconds;

b) prolonging a portion of the sound in each of the audio sounds by a factor of at least thirty percent;

c) repeating the at least two differing sounds in random order until the temporally impaired individual is able to distinguish the order of each sound;

d) decreasing the interstimulus interval by at least a one percent factory;

e) repeating step c) with the decreased interstimulus interval until the temporally impaired individual is able to distinguish the order of each of the sounds; and

,

f) repeating steps c) through e).

14. A method of teaching an individual to discriminate between at least two sound stimuli, the method comprising:

a) separating the at least two sound stimuli to provide an interstimulus interval;

b) prolonging at least one of the sound stimuli;

c) repeating the at least two sound stimuli until the individual is able to distinguish the characteristics of each stimulus;

d) decreasing the interstimulus interval; and

e) repeating step c) with a decreased interstimulus interval until the individual is able to distinguish the characteristics of each stimulus

f) repeating steps c) through e).

15. The method of claim 14 wherein the at least two sound stimuli include a consonant sound and a vowel sound.

16. The method of claim 15 wherein prolonging includes prolonging a consonant sound.

17. The method of claim 16 and further including:

shortening a vowel sound.

18. A method of teaching an individual to discriminate between at least two sound stimuli, the method comprising:

a) separating the at least two sound stimuli to provide an interstimulus interval;

b) prolonging at least one of the sound stimuli;

c) repeating the at least two sound stimuli until the individual is able to distinguish the characteristics of each stimulus;

d) decreasing the length of the prolonged sound stimulus; and

e) repeating step c) with a decreased sound stimulus until the individual is able to distinguish the characteristics of each of the two sound stimuli

f) repeating steps c) through e).

19. The method of claim 18 wherein the at least two sound stimuli include a consonant sound and a vowel sound.

20. The method of claim 19 wherein prolonging includes prolonging a consonant sound.

21. The method of claim 20 and further including:

shortening a vowel sound.

22. The method of claim 19, wherein prolonging includes prolonging a consonant sound;

and wherein decreasing the length includes decreasing the length of the prolonged consonant sound.

23. A method of teaching an individual to discriminate between at least two sound stimuli, the method comprising:

a) providing at least two sound stimuli which include a consonant sound stimulus and a vowel sound stimulus;

b) prolonging at least one of the sound stimuli;

c) repeating the at least two sound stimuli until the individual is able to distinguish the characteristics of each stimulus;

d) decreasing the length of the prolonged sound stimulus; and

e) repeating step c) with a decreased length of prolonged sound stimulus until the individual is able to distinguish the characteristics of the at least two sound stimuli

f) repeating steps c) through e).

24. The method of claim 23 wherein prolonging includes prolonging a consonant sound stimulus.

25. The method of claim 24 and further including:

shortening a vowel sound stimulus.

26. A method of teaching an individual to discriminate between the characteristics of a sound stimulus, the method comprising:

a) providing a sound stimulus containing a portion having a rapid temporal change in frequency content;

b) emphasizing the energy level of the portion of the sound stimulus that contains the rapid temporal change in frequency content;

c) repeating the sound stimulus until the individual is able to distinguish the characteristics of the sound stimulus;

d) reducing the emphasis of the energy level of the portion of the sound stimulus that contains the rapid temporal change in frequency content;

e) repeating step c) until the individual is able to discriminate between the characteristics of a sound stimulus

f) repeating steps c) through e).

27. The method of claim 26 wherein the portion of the sound stimulus containing a rapid temporal change in frequency content is a consonant sound.

28. The method of claim 27 wherein the step of emphasizing the energy level of the portion of the sound stimulus that contains the rapid temporal change in frequency content is accomplished by increasing the energy level of portion of the sound stimulus that contains the rapid temporal change in frequency content.

29. The method of claim 28 wherein the step of emphasizing the energy level of the sound stimulus that contains the rapid temporal change in frequency content is accomplished by decreasing the energy level of the remaining portions of the sound stimulus that do not contain rapid temporal changes in frequency content.