Adaptive training system, method and apparatus

• US 9,786,193 B2
• Filed: 03/07/2014
• Issued: 10/10/2017
• Est. Priority Date: 09/01/2011
• Status: Active Grant

• Current Assignee: CAE USA Incorporated (CAE Incorporated)
• Original Assignee: L-3 Communications Corporation (L3Harris Technologies, Inc.)
• Inventors: Falash, Mark, Pollak, Eytan, Barnoske, Michael, Rovny, George, Stewart, Coy, Ducharme, Robert
• Primary Examiner(s): Egloff, Peter
• Application Number:
  US14/366,616
• Publication Number:
  US 20150050623A1
• Time in Patent Office: 1,313 Days
• CPC Class Codes: B65H 75/486 Arrangements or adaptations of the spring motor
• CPC Class Codes: G06F 3/04817 using icons graphical or visual programming using iconic symbols G06F8/34
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06Q 20/18 involving self-service terminals [SST], vending machines, kiosks or multimedia terminals
• CPC Class Codes: G06Q 20/202 Interconnection or interaction of plural electronic cash registers [ECR] or to host computer, e.g. network details, transfer of information from host to ECR or from ECR to ECR
• CPC Class Codes: G07F 17/0014 for vending, access and use of specific services not covered anywhere else in G07F17/00 meter-controlled dispensing of liquid, gas or electricity G07F15/00
• CPC Class Codes: G07F 17/0021 Access to services on a time-basis
• CPC Class Codes: G07F 9/10 Casings or parts thereof, e.g. with means for heating or cooling
• CPC Class Codes: G09B 5/065 Combinations of audio and video presentations, e.g. videotapes, videodiscs, television systems
• CPC Class Codes: G09B 7/00 Electrically-operated teaching apparatus or devices working with questions and answers mechanically operated G09B3/00; computing arrangements G06F
• CPC Class Codes: G09B 9/02 for teaching control of vehicles or other craft
• CPC Class Codes: G09B 9/24 including display or recording of simulated flight path
• CPC Class Codes: G09B 9/302 the image being transformed by computer processing, e.g. updating the image to correspond to the changing point of view
• CPC Class Codes: H02J 7/0045 concerning the insertion or the connection of the batteries

Abstract

A system and method for training a student employ a simulation station that displays output to the student and receives input. The computer system has a rules engine operating on it and computer accessible data storage storing (i) learning object data including learning objects configured to provide interaction with the student at the simulation system and (ii) rule data defining a plurality of rules accessed by the rules engine. The rules data includes, for each rule, respective (a) if-portion data defining a condition of data and (b) then-portion data defining an action to be performed at the simulation station. The rules engine causes the computer system to perform the action when the condition of data is present in the data storage. For at least some of the rules, the action comprises output of one of the learning objects so as to interact with the student. The system may be networked with middleware and adapters that map data received over the network to rules engine memory.

Claims

1. A system for training a student, said system comprising:

a training station configured to interact with the student, said training station displaying output to the student via at least one output device and receiving input via at least one input device;

a computer system having a rules engine operative continuously thereon and computer accessible data storage operatively associated therewith and storing the following electronically accessible data;

learning object data comprising a plurality of learning objects each configured to provide interaction with the student at the training station, and

rule data defining a plurality of rules accessed by the rules engine, said rules data including, for each rule, respective if-portion data defining a condition of data and then-portion data defining an action to be performed at the training station,

for at least some of said rules, the respective action comprising directing output at the training station of a respective one of the learning objects so as to interact with the student at said training station; and

said continuously-operative rules engine causing the computer system to perform the action substantially immediately when the condition of data is present in the data storage;

wherein the training station and the computer system with the rules engine are connected by a network operating pursuant to computer-executed communications software that controls the communication on the network such that computers on the network publish data packets each including a respective data field defining a topic name thereof that is transmitted only to other computers on the network that have subscribed to receive said data packets having data fields defining one or more specified topic names; and

said computer system with the rules engine being subscribed to receive data published by said training station, and storing data received therefrom in the computer accessible data storage;

wherein one or more of the rules have if-portions defining a condition of data that is based at least partly on some of the received data; and

the rules data comprises a plurality of assessment rules that makes a determination of a training level of the student based actual inputs of the student at the training station and updates performance data of the student stored in the data storage based on said determination;

wherein the rule data includes remediation rules that each has

an if-portion with a data condition that the performance data of the student indicates a KSA gap, and

a then-portion with an action that includes directing output at the training station of one of the learning objects to the student at the training station, wherein said learning object that is output includes remedial training output that is configured to remediate the KSA gap indicated by the performance data.

2. The system according to claim 1,

wherein some of the learning objects each comprise respective training output data configured so as to provide a respective training output video displayed to the student at the training station on a display device or training output audio played to the student at the simulation station by a sound output device;

and

wherein the data storage device or devices store student state data including data indicative of learning objects that have been output to the student, said data being updated on completion of output of the respective learning object; and

wherein the rule data defines at least one of said rules with a data condition that the data indicates that the training output data of a first prerequisite of said learning objects has been output to the student, and an action that causes the training station to provide the training output data of a second advanced learning object to the student; and

wherein the data condition of the predetermined level is a data flag value that is set to one of two values before output and another of the two values after output is completed.

3. The system according to claim 1,

wherein data storage also stores objective data defining respective acceptable inputs that are to be made by the student at the training station during training;

and

wherein some of said assessment rules having if-portions defining data conditions including data regarding presentation of learning objects that contain a test question or operational scenario the reaction to which is indicative of the training level of the student, and

wherein the rule data includes a rule that has an if-portion with a data condition that the performance data of the student is below a predetermined acceptable threshold, and a then-portion with an action that includes outputting one of the learning objects to the student at the training station, where said learning object includes remedial training output relating to the performance data;

wherein the performance data is a KSA assessment and the remedial training learning object is selected from a plurality of remedial training learning objects based on a KSA gap indicated by the performance data, said remedial training learning objects each configured to remediate a gap in, respectively, knowledge, skill and ability.

4. The system according to claim 3,

wherein the training output data includes audio and video that is output through a display device and an audio sound system of the training station, and wherein the video includes a display of a human avatar and the audio includes a speaking voice of the avatar;

and

wherein the training station further comprises a haptic output device.

5. The system according to claim 1,

wherein the training station simulates a vehicle, and the rules initiate an action of one of the learning objects that output virtual data that is displayed on a screen in the training station so that the screen displays virtual controls of the vehicle, and input can be entered by the student by touching the screen and interacting with the virtual controls thereby;

and

wherein the rules also initiate an action of another learning object that causes the training station to display to the student an out-the-widow view rendered in real time on a display screen of the simulator station corresponding to a simulated view from a calculated virtual location of the simulated vehicle in a virtual environment identified by the learning object data simulation initiated responsive to an action initiating the learning object.

6. The system according to claim 2,

wherein the student state data includes biometric data derived from monitoring the student with one or more input devices, and wherein the rules include one or more rules that initiate actions responsive to a data condition wherein the biometric data indicates circumstances for a break, circumstances indicating that the student is not being presented with adequately difficult objectives, or circumstances that the student is being presented with objectives that are too difficult, and said actions include starting a learning object offering the student a break, or starting learning objects that increase or reduce the difficulty of the training;

and

wherein the biometric data is provided by an eye tracker, a microphone, a respiration sensor, sensors capable of detecting posture of the student, or one or more brain sensors.

7. The system according to claim 2,

wherein the computer system includes

a computer connected with the input and output devices of the training station, said computer supporting the rules engine, said rules engine being configured to access data defining rules the data storage including a data storage device storing the learning object data, the rules data, the objective data, the student state data, and platform state data defining status of the operation of the simulation station for a lesson being given thereon;

and

a computerized learning management system communicating over a network with the computer, said learning management system having data storage storing lesson data, the lesson data including learning object data, objective data, and rules data for a plurality of lessons; and

a plurality of other computer systems each connected with the learning management system via the network and functioning as part of a respective training station having input and output devices for training a respective student;

said learning management system transmitting copies of lesson data for a selected lesson to each of the simulation stations.

8. The system according to claim 1, wherein the training station subscribes to data published by the rules engine computer system and receives data published thereby over the network, said published data causing the training station to take action in training the student.

9. The system according to claim 1, wherein a learning management computer connected with the network supports a learning management system, said learning management computer subscribing to a first topic transmitted from the training station, and the rules engine computer system subscribing to a second topic transmitted by the learning management system, such that the training station communicates student data about the student to the learning management system, and the learning management system transmits data to the rules engine computer system that satisfies the if-portions of one or more of the rules so that the rules management computer system causes the training station to provide to the student learning objects based on the student data.

10. The system according to claim 1,

wherein a computer with computer accessible data storage supporting a graph database is connected with the network, said graph database storing data according to a data model wherein the graph database has nodes and relationships that are created from predetermined template structures that constrain the relationships or properties that can be given to nodes being created or modified by a user using a computerized graph database editor system.

11. The system according to claim 1, wherein

the training station is a simulator having scene data stored therein defining a three-dimensional virtual environment in which the trainee or a virtual simulated vehicle operated by the trainee moves so as to have a location in the virtual environment defined by location data;

the simulator publishing data including the location data over the network;

a relative geometry computer system connected with the network and having storage storing at least some of the scene data content, said relative geometry computer system subscribing to the location data and receiving said location data;

the relative geometry computer system determining a proximity of the trainee or trainee vehicle in the virtual environment to a virtual sensor or a degree of deviation of the trainee or trainee vehicle from an ideal path based on the location data and the scene data content;

the relative geometry computer system publishing analysis data reflective of the proximity or degree of deviation on the network; and

the rules engine receiving the analysis data and determining therefrom a remedial course of training where the proximity or degree of deviation satisfy predetermined prerequisites therefor.

12. A method for providing computerized training to a student, said method comprising:

providing a training station connected with a computer system with computer-accessible data storage supporting a rules engine thereon;

storing lesson data in the data storage so as to be accessed continuously by the rules engine, said lesson data comprising

learning object data defining a number of learning objects that each, when activated by the rules engine, cause the training station to output visual imagery, audio or other output, and

rules data defining a plurality of rules on which the rules engine operates so as to administer the computerized training, said rules each having a data condition part and an action part, the data condition part defining a state of data in the data storage that, when present, causes the rules engine to direct the computerized system to take a predetermined action substantially immediately, at least some of said actions comprising activating at least some of the learning objects to interact with the student at the training station;

storing student state data in the data storage, said student state data including data defining an assessment measure of training of the student;

providing the computerized training to the student at the training station with the rules engine administering the training according to the rules stored in the data storage;

determining repeatedly or continually the assessment measure for the student based on input received from the student at the training station;

storing the determined assessment measure in the student state data;

wherein the rules data defines at least one rule that initiates the action thereof when a data condition that the student state data in the data storage defines an assessment measure below a predetermined value is present, the action including initiating operation on the training station of one of the stored learning objects; and

wherein the training station and the computer system with the rules engine are connected by a network operating pursuant to communications software that controls the communication on the network such that computers on the network publish data packets each including a respective data field defining a topic name thereof that is transmitted only to other computers on the network that have subscribed to receive said data packets having data fields defining one or more specified topic names;

said computer system with the rules engine subscribing to data published by said training station and receiving data therefrom; and

the method further comprising storing data received over the network from the training station in the computer accessible data storage of the computer system with the rules engine, wherein one or more of the rules have if-portions defining a condition of data that is based at least partly on some of the received data; and

the determining of the assessment measure of the student including a determination of a KSA gap between knowledge, skill and ability of the student based on some of the data received over the network and a level of knowledge, skill or ability defined by the objective data, and storing of data indicative of said KSA gap in the student state data;

wherein the rules engine has one or more rules that, responsive to a condition of the data indicative of said KSA gap, initiates remedial action comprising initiating one of the learning objects so as to output media content stored in the learning object to the student, the rules data including a plurality of rules each having a respective remedial action and a respective if-portion initiating the associated remedial action based on a different assessment of the KSA gap for the student in regard to the instructional area;

wherein one of said plurality of rules, when the KSA gap data shows a gap in knowledge, activates a knowledge-directed remedial learning object, another of said rules, when the KSA gap data shows a gap in skill, activates a skill-directed remedial learning object, and a third of said rules, when the KSA gap data shows a gap in ability, activates an ability-directed remedial learning object.

13. A method according to claim 12, wherein the student state data includes data identifying any of the learning objects that the student has completed.

14. A method according to claim 12, wherein the data storage further stores objective data that includes data defining input that should be received from the student interacting with the training station if training of the student is effective;

and

said determination of the KSA gap including providing computerized output of a learning object to the student and processing a reaction input or absence of reaction input from the student, said output comprising media presenting a test question output to the student, and the reaction input comprising an answering input, or the output comprising a presentation of an simulated condition of a simulated vehicle requiring the student to react by providing control input, the control input comprising an input using a simulated vehicle control panel or cockpit of the training station.

15. The method according to claim 12, wherein at least some of the learning objects include data defining video or audio media to be output to the student via the simulation station, or data defining virtual controls configured to be output on one or more interactive devices in the training station so that the training station may be employed to emulate different vehicles for different lessons.

16. The method according to claim 12, wherein at least one of the learning objects when initiated causes the simulation station to display imagery generated in real-time by an image generator of the computer system using a virtual environment identified by the learning object and showing a view thereof from a position of the student in said virtual world.

17. The method according to claim 12, wherein the computer system is connected via a network to a learning management computer system storing data corresponding to a plurality of lessons, and said method further comprises

downloading a second lesson from the learning management computer system over the network responsive to interactive communication between the training station and the learning management system over the network;

said second lesson comprising

data defining a plurality of learning objects comprising media to be output to the training station,

objective data defining responsive input to be received at the training station responsive to said media output and

rules data associated with said learning objects configured so as to present the learning objects, including rules causing the computer system of the training station to repeatedly assess effectiveness of training of the student in said second lesson and to store data indicative of the assessment in the student state data, and to take different actions in regard to presenting the learning objects to the student based on different data conditions of the adjusted assessment data;

whereby the training station is configured to present a different course of training from that of the first lesson.

18. The method of claim 12, and further comprising

receiving over the network at the learning management computer system data indicative of a new student at the training station;

and

transmitting second student data to the simulation station so as to be stored in the data storage so that the second student can be trained at the training station.

19. The method according to claim 12, wherein the training station subscribes to data published by the rules engine computer system and receives data published thereby over the network, said published data causing the training station to take action in training the student.

20. The method according to claim 12,

wherein a learning management computer connected with the network supports a learning management system, said learning management computer subscribing to the training station, and the rules engine computer system subscribing to the learning management system, and said method further comprising

transmitting student data about the student over the network from the training station to the learning management system;

transmitting data derived based on the student data over the network from the learning management system to the rules engine computer system that satisfies the if-portions of one or more of the rules;

transmitting over the network from the rules management computer system to the training station training data based on the then-portions of the one or more rules that causes the training station to provide to the student learning objects identified based on the student data.

21. The method according to claim 12, and further comprising

storing system data for a system of record for all computers on the network in a computer accessible data storage connected with a computer connected with the network, the system data being stored in a graph database, said graph database storing data according to a data model wherein the graph database has nodes and relationships that are created from predetermined template structures that constrain the relationships or properties that can be given to nodes being created or modified by a user using a computerized graph database editor system.

22. The method according to claim 12, wherein the training station is a simulator having scene data stored therein defining a three-dimensional virtual environment in which the trainee or a virtual simulated vehicle operated by the trainee moves so as to have a location in the virtual environment defined by location data;

publishing data including the location data from the simulator over the network;

receiving said location data at a relative geometry computer system connected with the network and subscribing to the location data, said relative geometry computer system having storage storing at least some of the scene data content;

determining at the relative geometry computer system, based on the location data and the scene data content, a proximity of the trainee or trainee vehicle in the virtual environment to a virtual sensor or a degree of deviation of the trainee or trainee vehicle from an ideal path;

publishing analysis data reflective of the proximity or degree of deviation from the relative geometry computer system on the network; and

receiving the analysis data at the rules engine and determining therefrom a remedial course of training where the proximity or degree of deviation satisfy predetermined prerequisites therefor.