SYSTEM AND METHOD FOR QUANTIFYING STUDENT'S SCIENTIFIC PROBLEM SOLVING EFFICIENCY AND EFFECTIVENESS
First Claim
1. A computer implemented method of evaluating problem solving skills, comprising:
- receiving and storing problem solving input data from a group of students for a series of problems attempted by the students, the data including problem solving status and use of online resource items by each student attempting the problems;
analyzing the collected problem solving status data to determine problem solving effectiveness for each problem attempted by each student;
analyzing the collected data on use of online resources for each problem attempted using a trained artificial neural network (ANN), the ANN analysis generating a problem solving efficiency value based on the selection frequency of each online resource item for each problem attempted by each student;
comparing the problem solving effectiveness values to the problem solving efficiency values;
using the comparison to generate a quantitative numeric value (QV) for each student'"'"'s problem solving proficiency for each problem in the series, the QV comprising a combination of problem solving efficiency and problem solving effectiveness;
storing the QV data;
using the stored QV data to generate problem solving reports including a report comparing QV values for all students and all problems, reports comparing QVs on a problem by problem basis, and reports comparing individual student QVs; and
providing the reports online as feedback to supervisors, whereby teaching strategies can be modified for students identified as having low QV scores.
1 Assignment
0 Petitions
Accused Products
Abstract
In a computer implemented system and method for analyzing problem solving abilities, analytic models are produced to quantify how students construct, modify and retain problem solving strategies as they learn to solve science problems online. Item response theory modeling is used to provide continually refined estimates of problem solving ability as students solve a series of simulations. In parallel, student'"'"'s strategies are modeled by self-organizing artificial neural network analysis, using the actions that students take during problem solving as the classifying inputs. This results in strategy maps detailing the qualitative and quantitative differences among problem solving approaches. The results are used to provide reports of strategic problem solving competency for a group of students so that teachers can modify teaching strategies to overcome noted deficiencies.
50 Citations
25 Claims
-
1. A computer implemented method of evaluating problem solving skills, comprising:
-
receiving and storing problem solving input data from a group of students for a series of problems attempted by the students, the data including problem solving status and use of online resource items by each student attempting the problems; analyzing the collected problem solving status data to determine problem solving effectiveness for each problem attempted by each student; analyzing the collected data on use of online resources for each problem attempted using a trained artificial neural network (ANN), the ANN analysis generating a problem solving efficiency value based on the selection frequency of each online resource item for each problem attempted by each student; comparing the problem solving effectiveness values to the problem solving efficiency values; using the comparison to generate a quantitative numeric value (QV) for each student'"'"'s problem solving proficiency for each problem in the series, the QV comprising a combination of problem solving efficiency and problem solving effectiveness; storing the QV data; using the stored QV data to generate problem solving reports including a report comparing QV values for all students and all problems, reports comparing QVs on a problem by problem basis, and reports comparing individual student QVs; and providing the reports online as feedback to supervisors, whereby teaching strategies can be modified for students identified as having low QV scores. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11)
-
-
12. A method of analyzing students problem solving ability, comprising
collecting problem solving input data from users for a series of different problems attempted by the students at different time intervals, the data including problem solving outcomes and problem solving resources used by the users in attempting each problem; -
processing the collected problem solving outcome data to generate outcome values which indicate problem solving effectiveness; processing the collected data on use of resources by each user in attempting each problem to generate strategic efficiency values for each user and problem, the strategic efficiency value being based on the resources used by the users in attempting each problem; comparing the outcome values with the strategic efficiency values; using the comparison to generate a set of at least four quantitative numeric values (QV scores) representing each student'"'"'s problem solving ability, the lowest QV score comprising user problem solving attempts with a low outcome combined with low use of resources and the highest QV score comprising user problem solving attempts with high outcome combined with low use of resources; and generating reports which indicate the number of users in each QV score category for each problem attempted, whereby the reports are a measure of user problem solving proficiency and can be used by supervisors to determine effectiveness of teaching strategies and to modify identified teaching strategies associated with low QV scores. - View Dependent Claims (13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24)
-
-
25. A computer implemented problem solving analysis system, comprising:
-
an input module which receives problem solving input data from students for a series of different problems attempted by the students, the data comprising problem solving outcome data and data on resources used by students in attempting to solve problems; a data storage module which stores problem solving input data for the students and associated student identifying data; a central processor which analyzes the stored data, the processor comprising a problem solving effectiveness module which processes the collected problem solving outcome data to generate outcome values representing problem solving effectiveness for each problem and student attempting the problem, a strategic efficiency module which processes the collected data on resources used by students for each problem to produce strategic efficiency values based on problem solving strategies, a comparison module which compares the outcome values with the strategic efficiency values, a quantitative value (QV) generating module which assigns a quantitative numeric value to each problem solving attempt on a student-by-student basis, and a report output module which generates reports comparing QVs for all problems attempted; and a display module which displays selected QV reports to users of the system on request.
-
Specification