Method for estimating examinee attribute parameters in cognitive diagnosis models
First Claim
1. A method for determining one or more examinee attribute mastery levels from an assessment, the method comprising:
- receiving an overall skill level for an examinee, wherein the overall skill level comprises a rating of the examinee'"'"'s performance on at least a portion of an assessment; and
for each of one or more attributes;
receiving a weight for the overall skill level, computing an examinee attribute value based on at least the overall skill level, the weight corresponding to the attribute and one or more responses made by the examinee to one or more questions pertaining to the attribute on the assessment, and assigning an examinee attribute mastery level for the examinee with respect to the attribute based on whether the examinee attribute value surpasses one or more thresholds.
1 Assignment
0 Petitions
Accused Products
Abstract
A method of determining a mastery level for an examinee from an assessment is disclosed. The method includes receiving one or more of an overall skill level for an examinee, a weight for the overall skill level, a covariate vector for an examinee, and a weight for the covariate vector. An examinee attribute value is computed using one or more of the received values for each examinee and each attribute. The computation of the examinee attribute values can include estimating the value using a Markov Chain Monte Carlo estimation technique. Examinee mastery levels are then assigned based on each examinee attribute level. Dichotomous or polytomous levels can be assigned based on requirements for the assessment.
-
Citations
56 Claims
-
1. A method for determining one or more examinee attribute mastery levels from an assessment, the method comprising:
-
receiving an overall skill level for an examinee, wherein the overall skill level comprises a rating of the examinee'"'"'s performance on at least a portion of an assessment; and
for each of one or more attributes;
receiving a weight for the overall skill level, computing an examinee attribute value based on at least the overall skill level, the weight corresponding to the attribute and one or more responses made by the examinee to one or more questions pertaining to the attribute on the assessment, and assigning an examinee attribute mastery level for the examinee with respect to the attribute based on whether the examinee attribute value surpasses one or more thresholds. - View Dependent Claims (2, 3, 4)
-
-
5. A method for determining one or more examinee attribute mastery levels from an assessment, the method comprising:
-
receiving a covariate vector for an examinee, wherein the covariate vector includes a value for each of one or more covariates for the examinee; and
for each of one or more attributes;
receiving a weighting vector for the covariate vector, computing an examinee attribute value based on at least the covariate vector, the weighting vector and one or more responses made by the examinee to one or more questions pertaining to the attribute on an assessment, and assigning an examinee attribute mastery level for the examinee with respect to the attribute based on whether the examinee attribute value surpasses one or more thresholds. - View Dependent Claims (6)
-
-
7. A method for determining examinee attribute mastery levels, the method comprising:
-
(a) for each item on an assessment, determining an estimated value for each of one or more item parameters;
(b) for each proficiency space parameter, determining an estimated value for the proficiency space parameter;
(c) for each examinee parameter, determining an estimated value for the examinee parameter for each examinee;
(d) repeating (a) through (c) a predetermined number of iterations; and
(e) determining one or more examinee attribute mastery levels based on the item parameters, proficiency space parameters, and examinee parameters. - View Dependent Claims (8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55)
-
-
56. A method of updating an estimate of a value from a moving window distribution, the method comprising:
-
receiving a prior estimate of a value;
receiving a base interval for a moving window distribution, wherein the interval includes an absolute lower limit and an absolute upper limit;
receiving a width for the moving window distribution;
determining a minimum selectable value equal to the maximum of i) the prior estimate of the value minus half of the width of the moving window distribution and ii) the absolute lower limit;
determining a maximum selectable value equal to the minimum of i) the prior estimate of the value plus half of the width of the moving window distribution and ii) the absolute upper limit;
selecting the estimate for the value from a uniform distribution between the minimum selectable value and the maximum selectable value.
-
Specification