Audiovisual simulation system and method with dynamic intelligent prompts

• US 5,730,603 A
• Filed: 05/16/1996
• Issued: 03/24/1998
• Est. Priority Date: 05/16/1996
• Status: Expired due to Term

• Current Assignee: Interactive Drama Incorporated
• Original Assignee: Interactive Drama Incorporated
• Inventors: Harless, William G.
• Primary Examiner(s): Grieb, William H.
• Application Number:
  US08/648,831
• Time in Patent Office: 677 Days
• Field of Search: 434/308, 434/309, 434/323, 273/429, 273/430, 273/431, 273/432
• US Class Current: 434/308
• CPC Class Codes: G09B 23/28 for medicine
• CPC Class Codes: G09B 5/065 Combinations of audio and video presentations, e.g. videotapes, videodiscs, television systems
• CPC Class Codes: G09B 7/04 characterised by modifying the teaching programme in response to a wrong answer, e.g. repeating the question, supplying a further explanation

Abstract

An audiovisual simulation system and method facilitates simulated human interaction between a user and a prerecorded human character. It does so by providing dynamic intelligent prompts to guide users unobtrusively during simulated human interactions in order to support a continuous dialogue and sustain a natural conversational rhythm. Various interactive instructional learning tools are available to assist users of the system in maximizing learning opportunities.

Claims

1. An interactive audiovisual system for simulating a conversation between a user and a simulated video character relating to a plurality of topics, each topic corresponding to a different state, comprising:

first storing means for storing a plurality of prerecorded audiovisual scenes;

second storing means for storing a plurality of prompts categorized into states, the prompts representing suggested voice input from the user, the prompts being associated with the audiovisual scenes;

third storing means for storing a set of sound patterns;

means for receiving voice signals corresponding to a voice input from the user;

means, responsive to the receiving means and the third storing means, for associating the received voice signals with a corresponding one of the stored sound patterns;

first selecting means, responsive to the associating means, for selecting from the first storing means audiovisual scenes corresponding to the received voice signals;

second selecting means, responsive to the first selecting means, for selecting from the second storing means a predetermined number of stored prompts corresponding to the selected audiovisual scenes;

first displaying means, responsive to the first selecting means, for displaying the selected audiovisual scenes; and

second displaying means, responsive to the second selecting means, for sequentially displaying the selected prompts.

2. The system of claim 1 wherein the first selecting means includes

a segment table containing segment numbers, each segment number representing corresponding stored audiovisual scenes, and

an interrupt table pointing to one of the segment numbers of the segment table corresponding to the associated voice signals.

3. The system of claim 1 wherein the second selecting means includes means for choosing the plurality of prompts in accordance with a predetermined logic sequence of a current one of the states.

4. The system of claim 3 wherein the choosing means includes

means for storing a list of previously displayed audiovisual scenes, and

means for bypassing selection of a prompt that corresponds to one of the previously displayed audiovisual scenes in the stored list.

5. The system of claim 3 wherein the choosing means includes means for selecting a particular prompt in response to a corresponding previously displayed audiovisual scene.

6. The system of claim 3 wherein the choosing means includes means for prohibiting selection of a particular prompt in response to a corresponding previously displayed audiovisual scene.

7. The system of claim 3 wherein the choosing means includes means for accessing prompts from other states when prompts available for selection within the current state fall below the predetermined number.

8. The system of claim 1 wherein the second displaying means includes means for suppressing the display of prompts when the video simulation character is speaking.

9. An interactive audiovisual system for simulating a conversation between a user and a simulated video character relating to a plurality of topics, each topic corresponding to a different state, comprising:

first storing means for storing first and second groups of audiovisual scenes, each group including a plurality of prerecorded audiovisual scenes;

second storing means for storing a plurality of prompts categorized into states, the prompts representing suggested voice input from the user, the prompts being associated with the audiovisual scenes;

third storing means for storing a set of sound patterns;

means for receiving voice signals corresponding to a voice input from the user;

means, responsive to the receiving means and the third storing means, for associating the received voice signals with a corresponding one of the stored sound patterns;

means, responsive to the recognizing means and the first storing means, for selecting audiovisual scenes of the first group corresponding to the received voice signals;

means, responsive to the first selecting means, for displaying the selected audiovisual scenes; and

interactive instructional means for providing online learning tools by temporarily suspending the simulation and displaying the second group of audiovisual scene signals stored in the first storing means.

10. The system of claim 9 wherein the selecting means includes

a segment table containing segment numbers, each segment number representing corresponding stored audiovisual scenes, and

an interrupt table pointing to one of the segment numbers of the segment table corresponding to the associated voice signals.

11. The system of claim 9 wherein the interactive instructional means includes means for providing an interactive dialogue between a user of the system and a prerecorded human expert consultant to aid the user during the simulation.

12. The system of claim 11 wherein the interactive dialogue means includes means for sequentially displaying a predetermined number of prompts from the current state corresponding to the output scene signals.

13. The system of claim 9 wherein the interactive instructional means includes means for presenting instructional text.

14. The system of claim 9 wherein the interactive instructional means includes means for creating and updating a list of user-specified information for subsequent retrieval.

15. The system of claim 9 wherein the interactive instructional means includes means for storing segment numbers corresponding to previously displayed audiovisual scenes.

16. The system of claim 9 wherein the interactive instructional means includes means for storing a list of previously displayed prompts.

17. The system of claim 9 wherein the interactive instructional means includes means for storing a list of previously displayed instructional text.

18. The system of claim 15 wherein the interactive instructional means includes means for displaying the previously displayed audiovisual scenes corresponding to one of the stored segment numbers.

19. The system of claim 16 wherein the interactive instructional means includes means for displaying the stored list of previously displayed prompts.

20. The system of claim 17 wherein the interactive instructional means includes means for displaying the stored list of previously displayed instructional text.

21. The system of claim 9 wherein the interactive instructional means includes means for re-initiating the temporarily suspended simulation.

22. A method for simulating a conversation between a user and a simulated video character relating to a plurality of topics, each topic corresponding to a different state, comprising the steps of:

storing a set of sound patterns;

storing a plurality of prerecorded audiovisual scenes;

storing a plurality of prompts categorized into states, the prompts representing suggested voice input from the user, the prompts being associated with the audiovisual scenes;

receiving voice signals corresponding to a voice input from the user;

associating the received voice signals with a corresponding one of the stored sound patterns;

selecting one of the stored audiovisual scenes corresponding to the received voice signals;

selecting a predetermined number of the stored prompts corresponding to the selected audiovisual scenes;

displaying the selected audiovisual scenes; and

sequentially displaying the selected prompts.

23. The method of claim 22 wherein the step of selecting audiovisual scenes includes the steps of

determining a segment number corresponding to the associated voice signals, and

accessing the audiovisual scene corresponding to the determined segment number.

24. The method of claim 22 wherein the step of selecting prompts includes the step of choosing the plurality of prompts in accordance with a predetermined logic sequence of a current one of the states.

25. The method of claim 24 wherein the choosing step includes the steps of

storing a list of previously displayed audiovisual scenes, and

bypassing selection of a prompt that corresponds to one of the previously displayed audiovisual scenes in the stored list.

26. The method of claim 24 wherein the choosing step includes the step of selecting a particular prompt in response to a corresponding previously displayed audiovisual scene.

27. The method of claim 24 wherein the choosing step includes the step of prohibiting selection of a particular prompt in response to a corresponding previously displayed audiovisual scene.

28. The method of claim 24 wherein the choosing step includes the step of accessing prompts from other states when prompts available for selection within the current state fall below the predetermined number.

29. The method of claim 22 wherein the step of displaying prompts includes the step of suppressing the display of prompts when the video simulation character is speaking.

30. A method for simulating a conversation between a user and a simulated video character relating to a plurality of topics, each topic corresponding to a different state, comprising the steps of:

storing a set of sound patterns;

storing a first and second group of prerecorded audiovisual scenes each group including a plurality of prerecorded audiovisual scenes;

storing a plurality of prompts categorized into states, the prompts representing suggested voice input from the user, the prompts being associated with the audiovisual scenes;

receiving voice signals corresponding to a voice input from the user;

associating the received voice signals with a corresponding one of the stored sound patterns;

selecting one of the stored audiovisual scenes from the first group of audiovisual scenes corresponding to the received voice signals;

displaying the selected audiovisual scenes; and

providing online learning tools by temporarily suspending the simulation and displaying the second group of stored audiovisual scenes.

31. The method of claim 30 wherein the selecting step includes the steps of

determining a segment number corresponding to the associated voice signals, and

accessing the audiovisual scene corresponding to the determined segment number.

32. The method of claim 30 wherein the providing step includes the step of providing an interactive dialogue between a user of the system and a prerecorded human expert consultant to aid the user during the simulation.

33. The system of claim 32 wherein the providing step includes the steps of

selecting a predetermined number of stored prompts corresponding to the selected audiovisual scenes, and

interactive dialogue means includes means for sequentially displaying a predetermined number of prompts from the current state corresponding to the output scene signals.

34. The method of claim 30 wherein the providing step includes the step of presenting instructional text.

35. The method of claim 30 wherein the providing step includes the step of creating and updating a list of user-specified information for subsequent retrieval.

36. The method of claim 30 wherein the providing step includes the step of storing segment numbers corresponding to previously displayed audiovisual scenes.

37. The method of claim 30 wherein the providing step includes the step of storing a list of previously displayed prompts.

38. The method of claim 30 wherein the providing step includes the step of storing a list of previously displayed instructional text.

39. The method of claim 36 wherein the providing step includes the step of for displaying the previously displayed audiovisual scenes corresponding to one of the stored segment numbers.

40. The method of claim 37 wherein the providing step includes the step of displaying the stored list of previously displayed prompts.

41. The method of claim 38 wherein the providing step includes the step of displaying the stored list of previously displayed instructional text.

42. The method of claim 30 wherein the providing step includes the step of re-initiating the temporarily suspended simulation.