System and method for multimodal interactive speech and language training
First Claim
Patent Images
1. A method for training an individual to recognize and respond to at least one unfamiliar vocabulary element, the method comprising:
- selecting the at least one unfamiliar vocabulary element from a plurality of new and previously presented unfamiliar vocabulary elements;
automatically presenting a lesson for the at least one unfamiliar vocabulary element using a plurality of modalities corresponding to different sensory stimuli to present the at least one unfamiliar vocabulary element to the individual, the lesson including a preview exercise indicating a number of vocabulary elements to be presented, a comprehension exercise including a contextual presentation with the unfamiliar vocabulary element omitted, and a recall exercise including repeated presentation of vocabulary elements until a correct response is provided for each;
for each exercise;
pausing for a time sufficient for the individual to respond to the at least one unfamiliar vocabulary element;
receiving a response from the individual based on the at least one unfamiliar vocabulary element;
evaluating the response based on a predetermined desired response criteria; and
providing visual and audio feedback to the individual indicating correctness of the response, the visual feedback including an icon and the audio feedback including a synthesized voice.
1 Assignment
0 Petitions
Accused Products
Abstract
A system and method for multimodal interactive speech training include selecting a modality (10) corresponding to various sensory stimuli to present non-native vocabulary elements (12) to an individual to train the individual to immediately respond (16) to a presented word, situation, or data without performing a time-consuming literal translation or other complex cognitive process. The system and method include speech synthesis, speech recognition, and visual representations of non-native vocabulary elements to promote rapid comprehension through neuro-linguistic programming of the individual.
-
Citations
19 Claims
-
1. A method for training an individual to recognize and respond to at least one unfamiliar vocabulary element, the method comprising:
-
selecting the at least one unfamiliar vocabulary element from a plurality of new and previously presented unfamiliar vocabulary elements; automatically presenting a lesson for the at least one unfamiliar vocabulary element using a plurality of modalities corresponding to different sensory stimuli to present the at least one unfamiliar vocabulary element to the individual, the lesson including a preview exercise indicating a number of vocabulary elements to be presented, a comprehension exercise including a contextual presentation with the unfamiliar vocabulary element omitted, and a recall exercise including repeated presentation of vocabulary elements until a correct response is provided for each; for each exercise; pausing for a time sufficient for the individual to respond to the at least one unfamiliar vocabulary element; receiving a response from the individual based on the at least one unfamiliar vocabulary element; evaluating the response based on a predetermined desired response criteria; and providing visual and audio feedback to the individual indicating correctness of the response, the visual feedback including an icon and the audio feedback including a synthesized voice. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 18, 19)
-
-
11. A system for training an individual to recognize and respond to at least one unfamiliar vocabulary element, the system comprising:
-
a display device for providing a visual representation of the at least one unfamiliar vocabulary element; a speech synthesizer for providing an audio representation of the at least one unfamiliar vocabulary element; at least one input device for generating a signal indicative of a response of the individual to the at least one unfamiliar vocabulary element; and control logic in communication with the display device, the speech synthesizer and the at least one input device for selecting the at least one unfamiliar vocabulary element from a plurality of new and previously presented unfamiliar vocabulary elements, automatically presenting a lesson for the at least one unfamiliar vocabulary element using both the display device and the speech synthesizer, the lesson including a preview exercise indicating a quantity of vocabulary elements to be presented, a comprehension exercise including presentation of contextual information absent the unfamiliar vocabulary element, and a recall exercise, for each exercise pausing for a time sufficient for the individual to generate a response to the at least one unfamiliar vocabulary element, evaluating the response based on at least one desired response criterion, and providing visual and audio feedback to the individual using the display device and the speech synthesizer. - View Dependent Claims (12, 13, 14, 15, 16)
-
-
17. A system for rapidly training an individual to recognize and respond to at least one unfamiliar vocabulary element without requiring complex cognitive tasks, the system comprising:
-
a display device for providing a visual representation of the at least one unfamiliar vocabulary element; a speech synthesizer for providing an audio representation of the at least one unfamiliar vocabulary element; a keyboard for generating a signal indicative of a response of the individual to the at least one unfamiliar vocabulary element; a pointing device for generating a signal indicative of a response of the individual to the at least one unfamiliar vocabulary element; a microphone for converting audio responses of the individual to corresponding electrical speech signals; a speech recognition device in communication with the microphone for mapping the electrical signal to a predetermined vocabulary library; and a computer in communication with the display device, the speech synthesizer, the keyboard, the pointing device, the microphone, and the speech recognition device for presenting the at least one unfamiliar vocabulary element to the individual using both the display device and the speech synthesizer in a series of exercises defining a lesson, the exercises including a preview exercise which presents a graphic indicative of a quantity of unfamiliar vocabulary elements to be presented, a comprehension exercise, and a recall exercise wherein each exercise includes pausing for a time sufficient for the individual to generate a response to the at least one unfamiliar vocabulary element, evaluating the response based on a desired response criteria, and providing feedback to the individual using both the display device and the speech synthesizer.
-
Specification