Accessibility of testing within a validity framework
First Claim
1. A method of examining the validity of an assessment design for a test taker profile, the method comprising:
- determining a set of knowledge, skills and other attributes (KSAs) for an assessment design;
for each KSA, defining the KSA to be one of a focal KSA and an ancillary KSA;
defining a focal value for each focal KSA;
defining a test taker profile, wherein the test taker profile includes a profile value for each KSA;
assigning a targeted proficiency value to the test taker profile based on the profile value and the focal value for each focal KSA;
determining, for each KSA, a requirement imposed by the assessment design;
assigning an effective proficiency value to the test taker profile based on the profile value and the requirement for each KSA;
if the targeted proficiency value matches the effective proficiency value;
determining whether an indication of invalidity exists,if an indication of invalidity exists, assigning a problematic value to a validity variable, andif an indication of invalidity does not exist, selecting the assessment design as an assessment design alternative for the test taker profile;
if the targeted proficiency value does not match the effective proficiency value, assigning a problematic value to the validity variable; and
if the validity variable has a problematic value, modifying one or more of the assessment design and the test taker profile.
1 Assignment
0 Petitions
Accused Products
Abstract
Methods for designing an assessment and providing accessibility features for a test taker profile are disclosed. A test taker profile, including multiple knowledge, skill and other attribute(s) (KSAs), is defined in which each KSA has a specific level. Each KSA is designated as either a focal KSA (an essential part of the targeted proficiency to be measured) or an ancillary KSA (not an essential part). For each focal KSA, a focal value (the value that the test taker must have to possess a high level in the targeted proficiency) is defined. For a particular test design alternative (which may include an accessibility feature), a requirement is determined for each KSA. An accessibility feature is selected which avoids indications of invalidity, including: a mismatch between the targeted proficiency and the expected proficiency; the test taker profile does not satisfy all ancillary requirements; and focal requirements are either excessive or insufficient.
-
Citations
14 Claims
-
1. A method of examining the validity of an assessment design for a test taker profile, the method comprising:
-
determining a set of knowledge, skills and other attributes (KSAs) for an assessment design; for each KSA, defining the KSA to be one of a focal KSA and an ancillary KSA; defining a focal value for each focal KSA; defining a test taker profile, wherein the test taker profile includes a profile value for each KSA; assigning a targeted proficiency value to the test taker profile based on the profile value and the focal value for each focal KSA; determining, for each KSA, a requirement imposed by the assessment design; assigning an effective proficiency value to the test taker profile based on the profile value and the requirement for each KSA; if the targeted proficiency value matches the effective proficiency value; determining whether an indication of invalidity exists, if an indication of invalidity exists, assigning a problematic value to a validity variable, and if an indication of invalidity does not exist, selecting the assessment design as an assessment design alternative for the test taker profile; if the targeted proficiency value does not match the effective proficiency value, assigning a problematic value to the validity variable; and if the validity variable has a problematic value, modifying one or more of the assessment design and the test taker profile. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14)
-
Specification