Method and apparatus for training of sensory and perceptual systems in LLI systems

• US 6,019,607 A
• Filed: 12/17/1997
• Issued: 02/01/2000
• Est. Priority Date: 12/17/1997
• Status: Expired due to Term

• Current Assignee: Scientific Learning Corp. (Carnegie Learning, Inc.)
• Original Assignee: Scientific Learning Corp. (Carnegie Learning, Inc.)
• Inventors: Jenkins, William M., Merzenich, Michael M., Peterson, Bret E., Tallal, Paula, Miller, Steven Lamont
• Primary Examiner(s): Cheng, Joe H.
• Application Number:
  US08/992,071
• Time in Patent Office: 776 Days
• Field of Search: 434/116, 434/307 R, 434/308, 434/362, 434/118, 434/169, 434/185, 434/156, 434/157, 434/365, 434/323, 704/222, 704/270, 704/243, 704/265, 704/503, 704/504
• US Class Current: 434/116
• CPC Class Codes: G09B 19/04 Speaking with audible presentation of the material to be studied G09B5/04

Abstract

An apparatus and method for training the sensory perceptual system in a language learning impaired (LLI) subject is provided. The apparatus and method incorporates a number of different programs to be played by the subject. The programs artificially process selected portions of language elements, called phonemes, so they will be more easily distinguished by an LLI subject, and gradually improves the subject'"'"'s neurological processing of the elements through repetitive stimulation. The programs continually monitor a subject'"'"'s ability to distinguish the processed language elements, and adaptively configures the programs to challenge and reward the subject by altering the degree of processing. Through adaptive control and repetition of processed speech elements, and presentation of the speech elements in a creative fashion, a subject'"'"'s temporal processing of acoustic events common to speech are significantly improved.

Claims

1. A computerized adaptive method for improving a users audible discrimination, the method comprising:

a) displaying a plurality of graphical images, the graphical images associated with acoustic events that are modified by stretching in the time domain;

b) associating in pairs the plurality of graphical images with particular modified acoustic events such that two different graphical images are associated with a particular modified acoustic event;

c) upon selection of any of the plurality of graphical images, presenting its associated modified acoustic event; and

d) requiring the user to discriminate between the modified acoustic events by sequentially selecting the two different graphical images from among the plurality of graphical images, that are associated with the particular modified acoustic event.

2. The computerized adaptive method as recited in claim 1 wherein the modified acoustic events are speech elements common in spoken language.

3. The computerized adaptive method as recited in claim 1 wherein the plurality of graphical images comprise an even number of images such that every two graphical images are associated with a particular modified acoustic event.

4. The computerized adaptive method as recited in claim 1 wherein the modified acoustic events are short duration acoustic events that are stretched in the time domain only, while maintaining frequencies associated with unstretched acoustic events.

5. The computerized adaptive method as recited in claim 4 wherein the modified acoustic events have selected frequency envelopes that are emphasized to case discrimination between acoustically similar modified acoustic events.

6. The computerized adaptive method as recited in claim 5 wherein a first skill level within the method stretches the modified acoustic events by approximately 150% and emphasizes selected frequency envelopes by approximately 20 dB.

7. The computerized adaptive method as recited in claim 6 further comprising:

e) presenting a plurality of skill levels to the user, each one of the skill levels increasing in difficulty from said first skill level of approximately 150% stretching and 20 dB emphasis to a most difficult skill level having no stretching and no emphasis.

8. The computerized adaptive method as recited in claim 7 further comprising:

f) increasing the skill level presented to the user if the user correctly discriminates between the modified acoustic events by sequentially selecting the two different graphical images from among the plurality of graphical images, a predetermined number of times.

9. The computerized adaptive method as recited in claim 1 further comprising:

g) if the user correctly discriminates between the acoustic events by sequentially selecting the two different graphical images from among the plurality of graphical images, removing the two different graphical images from display.

10. The computerized adaptive method as recited in claim 1 wherein the modified acoustic events comprise a plurality of stimulus sets.

11. The computerized adaptive method as recited in claim 10 wherein each of the plurality of stimulus sets comprises a plurality of similarly pronounced words.

12. The computerized adaptive method as recited in claim 11 wherein the plurality of similarly pronounced words are each associated with a pair of different graphical images.

13. The computerized adaptive method as recited in claim 12 wherein the plurality of similarly pronounced words are stretched in the time domain to produce the modified acoustic events.

14. A computerized method for training a subject to discriminate between similar words common in spoken language, the method utilizing a computer for displaying images, for modifying the similar words, and for acoustically producing the modified similar words to the subject, the method comprising:

a) selecting a pair of words that have similar acoustic properties;

b) displaying a pair of graphical images representative of each of the pair of words;

c) modifying one of the pair of words by stretching it in the time domain;

d) acoustically producing the modified word to the subject; and

e) requiring the subject to select from the pair of graphical images, an image representative of the produced modified word.

15. The computerized method as recited in claim 14 wherein the pair words are part of a set of words having similar phonetic properties that are to be acoustically processed.

16. The computerized method as recited in claim 14 wherein

said step of displaying further comprises:

masking a portion of each of the graphical images prior to said step of acoustically producing; and

if the subject selects the image representative of the modified word that was acoustically produced, removing the masking from the image.

17. The computerized method as recited in claim 14 wherein

said step of modifying comprises:

processing one of the pair of words into a plurality of selectable acoustic files; and

selecting one of the plurality of selectable acoustic files to be produced to the subject.

18. The computerized method as recited in claim 17 wherein

said step of modifying one of the pair of words further comprises:

digitally altering the one of the pair of words in the time domain, without significantly altering its frequency components; and

producing a plurality of selectable acoustic files for the one of the pair of words, each file corresponding to the one of the pair of words digitally altered by a computer in the time domain between 100% and 150%

wherein each of the plurality of selectable acoustic files corresponds to a different skill level.

19. The computerized method as recited in claim 18 wherein

said step of producing a plurality of selectable acoustic files comprises:

determining a skill level for the subject; and

selecting from the plurality of selectable acoustic files, a file appropriate for the determined skill level of the subject.

20. The computerized method as recited in claim 14 further comprising:

after said step e) indicating to the subject whether the subject correctly selected the image representative of the produced modified word.

21. The computerized method as recited in claim 14 wherein

said step of modifying one of the pair of words further comprises:

modifying the one of the pair of words by emphasizing selected frequency envelopes within the word.

22. The computerized method as recited in claim 21 wherein

the selected frequency envelopes within the modified one of the pair of words are emphasized in a range of 0 to 20 dB.

23. The computerized method as recited in claim 21 wherein the amount of stretching and the amount of emphasis applied to the modified one of the pair of words depends on whether the subject has correctly selected images representative of previously modified words that were produced by said step d).

24. The computerized method as recited in claim 23 wherein if the subject has correctly selected images representative of the past 3 presentations of words modified by said step c), the amount of stretching applied to the modified one of the pair of words is reduced.

25. The computerized method as recited in claim 14 further comprising:

repeating said steps a) through e) after the subject selects an image.

26. The computerized method as recited in claim 25 wherein every time said steps a) through e) is repeated, a different pair of words are selected.

27. The computerized method as recited in claim 14 wherein said step of modifying modifies one of the pair of words at a particular skill level, until all word pairs within a processing set have been correctly recognized by the subject.