SYSTEMS AND METHODS FOR AUTOMATED ASSESSMENT WITHIN A VIRTUAL ENVIRONMENT

• US 20120215507A1
• Filed: 02/22/2012
• Published: 08/23/2012
• Est. Priority Date: 02/22/2011
• Status: Abandoned Application

• Current Assignee: Utah State University
• Original Assignee: Utah State University
• Inventors: Shelton, Brett E.
• Application Number:
  US13/402,801
• Publication Number:
  US 20120215507A1
• Time in Patent Office: Days
• US Class Current: 703/6
• CPC Class Codes: G09B 7/00 Electrically-operated teaching apparatus or devices working with questions and answers mechanically operated G09B3/00; computing arrangements G06F

Abstract

The present disclosure relates to systems and methods for automated assessment within a virtual environment. Interactive simulation systems have a variety of applications for education and/or training applications, including education, military, and corporate contexts. Evidence-based assessment models may be embedded into interactive simulation systems and may further enhance the utility of such systems by automating the assessment of the performance of participants in a simulation. Evidence-based assessments may be established using a variety of criteria, including completeness, accuracy of performance, timeliness of the learning task, etc.

Claims

1. A simulation system, comprising:

a processor;

a user console configured to allow a player to provide input to a simulation system and further configured to display a user interface comprising a simulation environment;

a computer-readable storage medium in communication with the processor and the user console, the computer-readable storage medium comprising;

a simulation engine module executable on the processor, the simulation engine module operable to receive input from the user console and to generate the simulation environment;

a user interface module executable on the processor, the user interface module operable to generate the user interface comprising the simulation environment;

an automated assessment module executable on the processor, the automated assessment module operable to identify a plurality of assessment-monitored events and to generate an evidence-based assessment associated with the plurality of assessment-monitored events based on one or more evaluated criteria; and

a simulation data file module executable on the processor, the simulation data file module operable to generate an automated assessment output file containing the evidence-based assessment.

2. The simulation system of claim 1, wherein the automated assessment module further comprises a decision tree including a plurality of nodes, the plurality of nodes corresponding to the plurality of assessment-monitored events.

3. The simulation system of claim 2, wherein at least one of the plurality of nodes comprises an indication of an evaluated criteria associated with the corresponding assessment-monitored event.

4. The simulation system of claim 2, wherein at least one of the plurality of nodes comprises an indication that the corresponding assessment-monitored event includes a dependent task to be performed in a specified sequence relative to the corresponding assessment-monitored event.

5. The simulation system of claim 1, wherein the evaluated criteria comprises accuracy of the user'"'"'s response to the assessment-monitored event, completeness of the user'"'"'s response to the assessment-monitored event, and timeliness of the user'"'"'s response to the assessment-monitored event.

6. The simulation system of claim 1, wherein the user interface module is further operable to display a log window comprising information related to the user'"'"'s actions within the simulation.

7. The simulation system of claim 6, wherein the user interface module is further operable to selectively display feedback to the user in the log window identifying a deficiency in the user'"'"'s performance of an assessment-monitored event.

8. The simulation system of claim 1, wherein the user interface module is further operable to display a visual indication to the user related to the user'"'"'s performance with respect to the plurality of assessment-monitored events.

9. The simulation system of claim 1, wherein the simulation engine module generates a three-dimensional and open-ended simulation environment.

10. The simulation system of claim 1, wherein the automated assessment output file is transferable to a second simulation system.

11. The simulation system of claim 1, wherein the computer-readable storage medium further comprises a regeneration module operable to regenerate a plurality of simulations at a plurality of regeneration points.

12. A method of assessing a user'"'"'s performance during a computer generated simulation, the method comprising:

generating a simulation environment responsive to input received from a user;

displaying the simulation environment to the user;

determining that a user has initiated an assessment-monitored event;

generating an evidence-based assessment associated with the assessment-monitored event; and

storing the result of the assessment-monitored event.

13. The method of claim 12, further comprising identifying a node in a decision tree associated with the initiated assessment-monitored event.

14. The method of claim 13, further comprising identifying an evaluated criteria in the node associated with the corresponding assessment-monitored event.

15. The method of claim 13, further comprising identifying a dependent task to be performed in a specified sequence relative to the corresponding assessment-monitored event.

16. The method of claim 12, wherein generating the evidence-based assessment associated with the assessment-monitored event comprises one of assessing the accuracy of the user'"'"'s response to the assessment-monitored event;

assessing the completeness of the user'"'"'s response to the assessment-monitored event; and

assessing the timeliness of the user'"'"'s response to the assessment-monitored event.

17. The method of claim 12, further comprising:

displaying a log window comprising information related to the user'"'"'s actions within the simulation.

18. The method of claim 17, further comprising:

displaying to the user a visual indication in the log window related to the user'"'"'s performance with respect to the plurality of assessment-monitored events.

19. The method of claim 12, further comprising:

transferring the automated assessment output file to a second simulation system.

20. A computer program product, comprising a non-transitory computer-readable medium having executable computer program code, the computer program product comprising:

a simulation engine module operable to receive input from a user console and to generate a simulation environment;

a user interface module operable to generate a user interface comprising the simulation environment;

an automated assessment module operable to identify a plurality of assessment-monitored events and to generate an evidence-based assessment associated with the plurality of assessment-monitored events based on one or more evaluated criteria; and

a simulation data file module operable to generate an automated assessment output file containing the evidence-based assessment.