Method and apparatus for evaluating educational performance
First Claim
Patent Images
1. A method of evaluating the knowledge or skill level of at least one individual and improving the knowledge or skill level of said at least one individual, comprising:
- providing a first plurality of questions, at least a portion of said questions being encoded using a plurality of parameters, wherein said act of encoding comprises encoding at least a portion of said questions with (i) primary topic category;
(ii) primary topic sub-category;
(iii) secondary topic category;
(iv) secondary topic sub-category; and
(v) question type classification;
administering said first plurality of questions to said at least one individual;
receiving responses to at least a portion of the questions from said at least one individual;
evaluating the performance of said at least one individual based at least in part on said responses to said at least portion of questions, and said plurality of parameters associated with respective ones of said at least portion of questions, said evaluating comprising identifying at least one question type or form that is problematic for said individual; and
generating a training routine comprising a second plurality of questions, said second plurality of questions being selected based at least in part on said act of evaluating the performance of said at least one individual.
0 Assignments
0 Petitions
Accused Products
Abstract
An improved method and apparatus for evaluating the performance of an individual. In one aspect, the invention includes a method of encoding questions used in an examination in order to accurately identify and evaluate deficiencies in an individual'"'"'s knowledge. In another aspect, an improved method of evaluating responses to the encoded questions is disclosed. Adaptive structuring of subsequent exam questions and/or topics is also provided. A computer program and associated apparatus for administering and evaluating performance is also described.
-
Citations
47 Claims
-
1. A method of evaluating the knowledge or skill level of at least one individual and improving the knowledge or skill level of said at least one individual, comprising:
-
providing a first plurality of questions, at least a portion of said questions being encoded using a plurality of parameters, wherein said act of encoding comprises encoding at least a portion of said questions with (i) primary topic category;
(ii) primary topic sub-category;
(iii) secondary topic category;
(iv) secondary topic sub-category; and
(v) question type classification;administering said first plurality of questions to said at least one individual; receiving responses to at least a portion of the questions from said at least one individual; evaluating the performance of said at least one individual based at least in part on said responses to said at least portion of questions, and said plurality of parameters associated with respective ones of said at least portion of questions, said evaluating comprising identifying at least one question type or form that is problematic for said individual; and generating a training routine comprising a second plurality of questions, said second plurality of questions being selected based at least in part on said act of evaluating the performance of said at least one individual. - View Dependent Claims (2, 3, 4, 5)
-
-
6. An evaluation apparatus, comprising:
-
a data processing device adapted to process data and run at least one computer program thereon; and a computer program operative to run on said data processing device and adapted to; (i) generate examination questions relating to at least one area of knowledge, said questions being encoded with a plurality of parameters; (ii) receive responses to said questions from at least one individual being evaluated; (iii) evaluate said responses based at least in part on said parameters, said evaluation comprising identifying at least one question type or form that is problematic for said at least one individual; and (iv) adaptively adjust the generation of examination questions, said adjustment of examination questions occurring in real-time based at least in part on step (iii). - View Dependent Claims (7, 8, 9, 10, 11, 12, 13, 14, 15, 16)
-
-
17. An information storage device, comprising:
-
a data storage medium; a plurality of data stored on said medium, said plurality of data comprising a computer program adapted to run on a processor, said computer program and processor being configured for evaluating the knowledge or skill level of at least one individual using the method comprising; (i) generating examination questions relating to at least one area of knowledge, said questions being encoded with a plurality of parameters; (ii) receiving responses to said questions from at least one individual being evaluated; (iii) evaluating said responses based at least in part on said parameters; wherein said evaluating comprises; identifying at least one type or form of said questions that is problematic for said at least one individual; and identifying one or more problematic topical areas for said at least one individual; and (iv) generating a training routine based at least in part on said act of evaluating, wherein said act of evaluating further comprises analyzing a third of said plurality of parameters, said third parameter being selected from the group consisting of;
(i) the number of times each response is changed, (ii) the number of “
right-to-wrong”
answer changes;
(iii) the number of “
wrong-to-right”
answer changes; and
(iv) the number of “
wrong-to-wrong”
changes. - View Dependent Claims (18, 19, 20, 21, 22)
-
-
23. A method of educating at least one individual, comprising:
-
administering at least one sequence of questions to said at least one individual, at least a portion of said questions being encoded using a plurality of parameters, said plurality of parameters each being different ones of parameters selected from the group consisting of;
ix, jx, kx, lx, and mx, where;ix comprises one or more principal topic categories; jx comprises one or more principal topic sub-categories; kx comprises one or more secondary topic categories; lx comprises one or more secondary topic sub-categories; and mx comprises the question type; evaluating the performance of said at least one individual using responses to the at least one encoded sequence of questions provided by said at least one individual and at least a portion of said plurality of parameters; identifying at least one topical area of potential improvement within said at least one individual based at least in part on said act of evaluating and answer changes made by said at least one individual;
said evaluating also comprising identifying at least one question type that is problematic for said individual;generating a training routine based on said at least one area of improvement; and administering said routine to said at least one individual to address said at least one area. - View Dependent Claims (24, 25, 26)
-
-
27. An evaluation system adapted to evaluate a plurality of individuals, comprising:
-
a plurality of testing devices each comprising; a data processing device adapted to process data and run at least one computer program thereon; and a computer program operative to run on said data processing device and adapted to; (i) generate examination questions relating to at least one area of knowledge, at least a portion of said questions being encoded with a plurality of parameters, said plurality of parameters comprising at least four of ix, jx, kx, lx, and mx, where; ix comprises one or more principal topic categories; jx comprises one or more principal topic sub-categories; kx comprises one or more secondary topic categories; lx comprises one or more secondary topic sub-categories; and mx comprises the question type; (ii) receive responses to said questions from at least one individual being evaluated; and (iii) evaluate at least one of said individuals based at least in part on said responses and said plurality of parameters;
evaluate to identify at least one question type that is problematic for the at least one of said individuals;a database adapted to compile data from said plurality of testing devices; and a data network operatively coupled to said plurality of testing devices. - View Dependent Claims (28, 29, 30, 31, 32, 33)
-
-
34. A method of evaluating the knowledge or skill level of at least one individual, comprising:
-
providing a plurality of questions, at least a portion of said questions being encoded using a plurality of parameters, said plurality of parameters comprising one or more principal topic categories, one or more principal topic sub-categories, one or more secondary topic categories and one or more secondary topic sub-categories; administering said plurality of questions to said at least one individual; receiving responses to at least a portion of the questions from said at least one individual; evaluating the performance of said at least one individual based at least in part on said responses to said at least portion of questions, and said plurality of parameters associated with respective ones of said at least portion of questions; wherein said evaluating comprises identifying one or more topical areas of difficulty for said at least one individual based at least in part on said plurality of parameters;
wherein said evaluating further comprises identifying at least one question type that is problematic for said at least one individual; andselecting at least one instructional module in response to said evaluation, wherein said at least one instructional module comprises a lesson plan adapted to address said one or more topical areas of difficulty.
-
-
35. An information storage device, comprising:
-
a data storage medium; a plurality of data stored on said medium, said plurality of data comprising a computer program adapted to run on a processor, said computer program and processor being configured for evaluating the knowledge or skill level of at least one individual using the method comprising; generating examination questions relating to at least one area of knowledge, said questions being encoded with a plurality of parameters according comprising (ix, jx, kx, lx, mx), where; ix comprises one or more principal topic categories; jx comprises one or more principal topic sub-categories; kx comprises one or more secondary topic categories; lx comprises one or more secondary topic sub-categories; and mx comprises the question type; receiving responses to said questions from at least one individual being evaluated; and evaluating said responses based at least in part on said parameters, said act of evaluating comprising applying at least one of the criteria selected from the group consisting of; where; C(x)=Correct response of type x T(x)=Total number of questions of type x said evaluating further comprising identifying at least one question type that is problematic for said at least one individual.
-
-
36. A method of evaluating the knowledge or skill level of at least one individual, comprising:
-
providing a plurality of questions, at least a portion of said questions being encoded using a plurality of parameters; administering said plurality of questions to said at least one individual; receiving responses to at least a portion of the questions from said at least one individual, said responses comprising at least some explanatory content provided by said user; evaluating the performance of said at least one individual based at least in part on said responses to said at least portion of questions, and said plurality of parameters associated with respective ones of said at least portion of questions; wherein said act of evaluating further comprises determining;
(i) at least one particular question type or form that said at least one individual has a higher incidence of improperly answering; and
(ii) at least one particular topical area that said at least one individual has a higher incidence of improperly answering questions relating thereto; andgenerating a training routine, said training routine adapted to improve said at least one individuals knowledge or skill by emphasizing the training of; (i) said at least one particular question type or form that said at least one individual has a higher incidence of improperly answering;
or(ii) said at least one particular topical area that said at least one individual has a higher incidence of improperly answering questions relating thereto. - View Dependent Claims (37)
-
-
38. A method of evaluating the knowledge or skill level of at least one individual and improving the knowledge or skill level of said at least one individual, comprising:
-
providing a first plurality of questions, at least a portion of said questions being encoded using a plurality of parameters; administering said first plurality of questions to said at least one individual; receiving responses to at least a portion of the questions from said at least one individual; and evaluating the performance of said at least one individual based at least in part on said responses to said at least portion of questions, and said plurality of parameters associated with respective ones of said at least portion of questions, said evaluating comprising identifying at least one question type or form that is problematic for said individual and identifying one or more problematic topical areas for said at least one individual. - View Dependent Claims (39)
-
-
40. An information storage device, comprising:
-
a data storage medium; a plurality of data stored on said medium, said plurality of data comprising a computer program adapted to run on a processor, said computer program and processor being configured for evaluating the knowledge or skill level of at least one individual using the method comprising; (i) administering examination questions relating to at least one area of knowledge, said questions being encoded with a plurality of parameters, said plurality of parameters comprise (ix, jx, kx, lx, mx), where; ix comprises one or more principal topic categories; jx comprises one or more principal topic sub-categories; kx comprises one or more secondary topic categories; lx comprises one or more secondary topic sub-categories; and mx comprises the question type; (ii) receiving responses to said questions from at least one individual being evaluated; (iii) evaluating said responses based at least in part on said parameters; wherein said evaluating comprises; identifying at least one type or form of said questions that is problematic for said at least one individual; and identifying one or more problematic topical areas for said at least one individual. - View Dependent Claims (41)
-
-
42. An evaluation apparatus, comprising:
-
a data processing device adapted to process data and run at least one computer program thereon; and a computer program operative to run on said data processing device and adapted to; (i) administer examination questions relating to at least one area of knowledge, said questions being encoded with a plurality of parameters; (ii) receive responses to said questions from at least one individual being evaluated, said responses including reasoning for why a specific response was chosen; and (iii) evaluate said responses based at least in part on said parameters and said reasoning, said evaluation comprising identifying at least one question type or form that is problematic for said at least one individual and identifying one or more problematic topical areas for said at least one individual. - View Dependent Claims (43, 44)
-
-
45. A method of evaluating the knowledge or skill level of at least one individual, comprising:
-
providing a plurality of questions, at least a portion of said questions being encoded using a plurality of parameters; administering said plurality of questions to said at least one individual; receiving responses to at least a portion of the questions from said at least one individual, said responses including reasoning for why a specific response was chosen; and evaluating the performance of said at least one individual based at least in part on said responses to said at least portion of questions, and said plurality of parameters associated with respective ones of said at least portion of questions; wherein said evaluating comprises identifying one or more topical areas of difficulty for said at least one individual based at least in part on said plurality of parameters, and identifying at least one type or form of said questions that is problematic for said at least one individual. - View Dependent Claims (46, 47)
-
Specification