Virtual challenge system and method for teaching a language

• US 6,234,802 B1
• Filed: 01/26/1999
• Issued: 05/22/2001
• Est. Priority Date: 01/26/1999
• Status: Expired due to Term

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Hale, Charles A., Pella, John P., Acker, Peter C., Cortese, Jason T., DeWolf, Quentin, Bondi, Victor J., April, Renée Louise
• Primary Examiner(s): Rovnak, John Edmund
• Application Number:
  US09/237,411
• Time in Patent Office: 847 Days
• Field of Search: 434/156, 434/157, 434/167, 434/169, 434/176, 434/178, 434/185
• US Class Current: 434/156
• CPC Class Codes: G09B 19/06 Foreign languages with audible presentation of material to be studied G09B5/04
• CPC Class Codes: G09B 5/065 Combinations of audio and video presentations, e.g. videotapes, videodiscs, television systems
• CPC Class Codes: G09B 7/04 characterised by modifying the teaching programme in response to a wrong answer, e.g. repeating the question, supplying a further explanation

Abstract

A method and system for teaching a language and evaluating language comprehension in a digitally synthesized, interactive three-dimensional graphical representation of an environment. Within the environment, the user is given opportunities to practice language skills by interacting with digital videos of people. As the user walks through the environment and encounters various people therein, the people set forth challenges in the form of scripted questions and tasks that require the user to comprehend the language in order to correctly respond. A speech recognition engine interprets verbal responses of the user, thereby further simulating a real-world environment. A set of one or more scripts controls various aspects of the environment while testing and evaluating the user'"'"'s comprehension of the language.

Claims

1. In a computer system a method for teaching language skills to a user, comprising:

rendering a graphical representation of an environment;

adjusting the graphical representation of the environment in response to user input to simulate moving in the environment;

encountering a representation of an object in the environment;

communicating a challenge from the object to the user, the challenge requiring comprehension of a language by the user to correctly respond thereto;

receiving information from the user in response to the challenge; and

in response to receiving the information from the user, automatically providing information to the user indicative of whether the user comprehended the challenge.

2. The method of claim 1 wherein the graphical representation of the environment is three-dimensional.

3. The method of claim 2 wherein adjusting the graphical representation of the environment includes changing the viewing perspective in response to the user input.

4. The method of claim 1 wherein communicating a challenge from the object to the user includes outputting full motion video information.

5. The method of claim 1 wherein communicating a challenge from the object to the user includes providing audio output to the user.

6. The method of claim 5 wherein communicating a challenge includes outputting full motion video information in conjunction with the audio output.

7. The method of claim 1 wherein encountering a representation of an object in the environment includes encountering a representation of a person.

8. The method of claim 1 wherein the challenge corresponds to a question, and wherein receiving information from the user in response to the challenge includes receiving an audible response from the user.

9. The method of claim 8 further comprising interpreting the audible response to determine whether the user properly responded to the question.

10. The method of claim 1 wherein the challenge corresponds to a task, and wherein receiving information from the user in response to the challenge includes receiving user input from a pointing device.

11. The method of claim 1 wherein providing information to the user indicative of whether the user comprehended the challenge includes outputting fill motion video information to the user.

12. The method of claim 1 wherein providing information to the user indicative of whether the user comprehended the challenge includes outputting audio information to the user.

13. The method of claim 1 further comprising, communicating a plurality of additional challenges to the user, and tracking the user'"'"'s comprehension of the challenges.

21. A computer-readable medium having computer executable instructions for performing the method of claim 1.

14. In a computer system, a system for teaching language skins to a user, comprising:

an engine configured to render a three-dimensional graphical representation of an environment and for adjusting the graphical representation of the environment in response to user input to simulate moving in the environment;

a detection mechanism configured to determine when a user encounters a representation of an object in the environment;

a video player configured to communicate an audiovisual challenge from the object to the user, the challenge requiring comprehension of a language by the user to correctly respond thereto;

a microphone configured to receive audio information from the user in response to the challenge;

a speech recognizer configured to interpret the audio information and provide information corresponding thereto; and

a script configured to evaluate the information provided by the speech recognizer to make a determination as to whether the user comprehended the challenge, and to automatically take action based on the determination.

15. The system of claim 14 further comprising a pointing device configured to provide user input to the engine to adjust the graphical representation of the environment.

16. The system of claim 14 wherein the speech recognizer is configured to return a value to the script indicative of whether the audio information corresponded to information previously sent from the script to the speech recognizer.

17. The system of claim 14 wherein the script is configured to maintain a score with respect to the comprehension of the challenge by the user.

18. The system of claim 14 wherein the script is configured to take action in response to the determination by providing information to the user indicative of whether the user comprehended the challenge.

19. A computer-readable medium having computer executable instructions comprising:

rendering a three-dimensional graphical representation of an environment;

adjusting the graphical representation of the environment in response to user input to simulate moving in the environment;

encountering a representation of a person in the environment;

communicating a verbal challenge from the person to the user, the challenge requiring comprehension of a language by the user to correctly respond thereto;

receiving an audible response from the user in response to the challenge; and

automatically interpreting the audible response to determine whether the user comprehended the challenge.

20. The computer-readable medium of claim 19 having further computer executable instructions for providing information to the user indicative of whether the user comprehended the challenge.