Method and system for selective deployment of instruments within an assessment management system

• US 8,315,893 B2
• Filed: 04/12/2006
• Issued: 11/20/2012
• Est. Priority Date: 04/12/2005
• Status: Active Grant

• Current Assignee: Blackboard Incorporated
• Original Assignee: Blackboard Incorporated
• Inventors: Yaskin, David, Ritter, Greg
• Primary Examiner(s): MANSFIELD, THOMAS L
• Application Number:
  US11/404,512
• Publication Number:
  US 20060242003A1
• Time in Patent Office: 2,414 Days
• Field of Search: 705/7.11, 705/1.1
• US Class Current: 705/7.11
• CPC Class Codes: G06Q 10/06 Resources, workflows, human or project management; Enterprise or organisation planning; Enterprise or organisation modelling
• CPC Class Codes: G06Q 10/0637 Strategic management or analysis, e.g. setting a goal or target of an organisation; Planning actions based on goals; Analysis or evaluation of effectiveness of goals
• CPC Class Codes: G06Q 10/0639 Performance analysis of employees; Performance analysis of enterprise or organisation operations
• CPC Class Codes: G06Q 10/06395 Quality analysis or management
• CPC Class Codes: G06Q 10/10 Office automation; Time management
• CPC Class Codes: G06Q 30/0203 Market surveys; Market polls
• CPC Class Codes: G06Q 30/0204 Market segmentation

Abstract

A system of hardware and software provides a systematic and systemic method for performing assessment of the effectiveness of different levels within an institution. The system includes template driven definitions that span multiple tiers of hierarchically arranged operating units within the institution thereby providing flexibility and customization to handle a user-definable model of the institution'"'"'s organization. In particular, instruments may deployed selectively to a variety of different recipients. The selected group of recipients may be based on, for example, demographic, course, program, institution, section, education experience, and section-related criteria.

Claims

1. A method for selectively deploying an assessment instrument to a selected subset of a plurality of recipients, the method comprising the steps of:

receiving, by a computer, first input defining the assessment instrument;

receiving, by the computer, second input defining an assessment criteria, the assessment criteria related to a plurality of identifying attributes associated, respectively, with each of the plurality of recipients;

receiving a selection of user identifying accreditation attributes matching the assessment criteria;

identifying the selected subset based on those of the plurality of recipients associated with the selected user identifying accreditation attributes matching the assessment criteria; and

deploying the assessment instrument to the selected subset, of the plurality of recipients, having the selected user identifying accreditation attributes matching the assessment criteria.

2. The method of claim 1, wherein the assessment criteria relates to demographic attributes about the plurality of recipients.

3. The method of claim 1, wherein the assessment criteria relates to course-related attributes associated with one or more courses associated with the recipients.

4. The method of claim 1, wherein the assessment criteria relates to section-related attributes associated with sections associated with the recipients.

5. The method of claim 1, wherein the assessment criteria relates to educational experience-related attributes associated with one or more educational experiences associated with the recipients.

6. The method of claim 1, wherein the assessment criteria relates to program-related attributes associated with one or more programs associated with the recipients.

7. The method of claim 1, wherein the assessment criteria relates to operating unit-related attributes associated with one or more units with which the plurality of recipients may be associated.

8. The method of claim 7, wherein an operating unit comprises one of an institution, a college, a department, a program, and a course.

9. The method of claim 1, wherein the assessment instrument is one of a test, a survey, a course evaluation, and an evaluation portfolio.

10. The method of claim 1, wherein the assessment criteria relates to a combination of at least two of demographic attributes, program-related attributes, course-related attributes, educational experience related attributes, section-related attributes, and operating unit-related attributes.

11. The method of claim 1, wherein the step of deploying further comprises:

forwarding the assessment instrument to a separate computer-based system configured to disseminate information to the plurality of recipients.

12. The method of claim 11, wherein the separate computer-based system comprises a campus academic system.

13. The method of claim 12, wherein the campus academic system is configured to provide an environment to disseminate course-related information to a plurality of users of the institution.

14. A method for selectively deploying an assessment instrument to a selected subset of a plurality of recipients of an institution, the method comprising the steps of:

receiving, by a computer, first input defining the assessment instrument;

receiving, by the computer, second input defining an assessment criteria, the assessment criteria related to a plurality of user identifying accreditation attributes associated, respectively, with each of the plurality of recipients;

receiving a selection of user identifying accreditation attributes matching the assessment criteria; and

forwarding the assessment criteria, the selected user identifying accreditation attributes, and the assessment instrument to a separate computer-based system of the institution, wherein the separate computer-based system is configured to distribute the assessment instrument to the selected subset, of the plurality of recipients, having the selected user identifying accreditation attributes matching the assessment criteria.

15. The method of claim 14, wherein the separate computer-based system comprises a campus academic system.

16. The method of claim 15, wherein the campus academic system is configured to provide an environment to disseminate course-related information to a plurality of users of the institution.

18. The method of claim 16, wherein the assessment criteria relates to demographic attributes about the plurality of recipients.

17. A method for selectively deploying an assessment instrument to a selected subset of a plurality of recipients of an institution, the method comprising the steps of:

receiving, by a computer, first input defining an assessment criteria, the assessment criteria related to a plurality of user identifying accreditation attributes associated, respectively, with each of the plurality of recipients;

forwarding the first input to a first separate computer-based system of the institution;

in response, receiving a selection of attributes matching the assessment criteria that identify members of the selected subset; and

deploying the assessment instrument to the selected subset, of the plurality of recipients, having the selected user identifying accreditation attributes matching the assessment criteria.

19. The method of claim 17, wherein the assessment criteria relates to course-related attributes associated with courses associated with the recipients.

20. The method of claim 17, wherein the assessment criteria relates to section-related attributes associated with sections associated with the recipients.

21. The method of claim 17, wherein the assessment criteria relates to educational experience-related attributes associated with one or more educational experiences associated with the recipients.

22. The method of claim 17, wherein the assessment criteria relates to program attributes associated with one or more programs associated with the recipients.

23. The method of claim 17, wherein the assessment criteria relates to operating unit-related attributes associated with one or more units with which the plurality of recipients may be associated.

24. The method of claim 22, wherein an operating unit comprises one of an institution, a college, a department, a program, and a course.

25. The method of claim 17, wherein the assessment instrument is one of a test, a survey, a course evaluation, and an evaluation portfolio.

26. The method of claim 17, wherein the assessment criteria relates to a combination of at least two of demographic attributes, program-related attributes, course-related attributes, section-related attributes, educational experience-related attributes;

and operating unit-related attributes.

27. The method of claim 17, wherein the step of deploying further comprises:

forwarding the assessment instrument to a second separate computer-based system configured to disseminate information to the plurality of recipients.

28. The method of claim 27, wherein the second separate computer-based system comprises a campus academic system.

29. The method of claim 28, wherein the campus academic system is configured to provide an environment to disseminate course-related information to a plurality of users of the institution.

30. The method of claim 27, wherein the first and second separate computer-based system are the same system.

31. The method of claim 17, further comprising the step of:

receiving second input defining the assessment instrument.

32. The method of claim 31, wherein the second input includes selecting the assessment instrument from a list of available assessment instruments.

33. The method of claim 31, wherein the second input includes one or more modifications for a pre-existing assessment instrument.

34. The method of claim 17, wherein the first separate computer-based system comprises a student information system of the institution.

35. The method of claim 17, further comprising the step of:

storing the selected subset as a particular recipient list.

36. The method of claim 35, further comprising the steps of:

receiving second input identifying a subsequent assessment instrument;

receiving third input identifying a stored recipient list; and

deploying the subsequent assessment instrument to members of the stored recipient list.

37. The method of claim 17, further comprising the step of:

storing the assessment criteria as a particular criteria list.

38. The method of claim 36, further comprising the steps of:

receiving second input identifying a subsequent assessment instrument;

receiving third input identifying a stored assessment criteria list;

determining a new selected subset based on the stored assessment criteria list; and

limiting deployment of the subsequent assessment instrument to members of the new selected subset.

39. The method of claim 38, wherein the step of determining further comprises the step of:

identifying the new selected subset based on those of a different plurality of recipients having associated user identifying accreditation attributes matching the stored assessment criteria list, wherein at least one member of the different plurality of recipients is not a member of the plurality of recipients.

40. The method of claim 38, wherein the step of determining further comprises the step of:

identifying the new selected subset based on those of a different plurality of recipients having associated user identifying accreditation attributes matching the stored assessment criteria list, wherein at least one member of the plurality of recipients is not a member of the different plurality of recipients.

41. A system for selectively deploying an assessment instrument to a selected subset of a plurality of recipients comprising:

a programmable computer configured to;

receive first input defining the assessment instrument;

receive second input defining an assessment criteria, the criteria related to a plurality of user identifying accreditation attributes associated, respectively, with each of the plurality of recipients;

receive a selection of user identifying accreditation attributes matching the assessment criteria;

identify the selected subset based on those of the plurality of recipients associated with the user identifying accreditation attributes matching the assessment criteria; and

deploy the assessment instrument to the selected subset, of the plurality of recipients, having the selected user identifying accreditation attributes matching the assessment criteria.

42. The system of claim 41, wherein the assessment criteria relates to demographic attributes about the plurality of recipients.

43. The system of claim 41, wherein the assessment criteria relates to course-related attributes associated with one or more courses associated with the recipients.

44. The system of claim 41, wherein the assessment criteria relates to section-related attributes associated with sections associated with the recipients.

45. The system of claim 41, wherein the assessment criteria relates to educational experience-related attributes associated with one or more educational experiences associated with the recipients.

46. The system of claim 41, wherein the assessment criteria relates to program-related attributes associated with one or more programs associated with the recipients.

47. The system of claim 41, wherein the assessment criteria relates to operating unit-related attributes associated with one or more units with which the plurality of recipients may be associated.

48. The system of claim 47, wherein an operating unit comprises one of an institution, a college, a department, a program, and a course.

49. The system of claim 41, wherein the assessment instrument is one of a test, a survey, a course evaluation, and an evaluation portfolio.

50. The system of claim 41, wherein the assessment criteria relates to a combination of at least two of demographic attributes, program-related attributes, course-related attributes, educational experience related attributes, section attributes, and operating unit-related attributes.

51. The system of claim 41, wherein the programmable computer is further configured to:

forward the assessment instrument to a separate computer-based system configured to disseminate information to the plurality of recipients.

52. The system of claim 51, wherein the separate computer-based system comprises a campus academic system.

53. The system of claim 52, wherein the campus academic system is configured to provide an environment to disseminate course-related information to a plurality of users of the institution.

54. A system for selectively deploying an assessment instrument to a selected subset of a plurality of recipients of an institution, comprising:

a programmable computer configured to;

receive first input defining the assessment instrument;

receive second input defining an assessment criteria, the assessment criteria related to a plurality of user identifying accreditation attributes associated, respectively, with each of the plurality of recipients;

receive a selection of user identifying accreditation attributes matching the assessment criteria; and

forward the assessment criteria, the selected user identifying accreditation attributes, and the assessment instrument to a separate computer-based system of the institution, wherein the separate computer-based system is configured to distribute the assessment instrument to the selected subset, of the plurality of recipients, having the selected user identifying accreditation attributes matching the assessment criteria.

55. The system of claim 54, wherein the separate computer-based system comprises a campus academic system.

56. The system of claim 54, wherein the campus academic system is configured to provide an environment to disseminate course-related information to a plurality of users of the institution.

57. A system for selectively deploying an assessment instrument to a selected subset of a plurality of recipients of an institution, comprising:

a programmable computer configured to;

receive first input defining an assessment criteria, the assessment criteria related to a plurality of user identifying accreditation attributes associated, respectively, with each of the plurality of recipients;

forward the first input to a first separate computer-based system of the institution;

in response, receive a selection of attributes matching the assessment criteria that identify members of the selected subset; and

deploy the assessment instrument to the selected subset, of the plurality of recipients, having the selected user identifying accreditation attributes matching the assessment criteria.

58. The system of claim 57, wherein the assessment criteria relates to demographic attributes about the plurality of recipients.

59. The system of claim 57, wherein the assessment criteria relates to course-related attributes associated with courses available to the recipients.

60. The system of claim 57, wherein the assessment criteria relates to section-related attributes associated with sections associated with the recipients.

61. The system of claim 57, wherein the assessment criteria relates to program-related attributes associated with one or more programs associated with the recipients.

62. The system of claim 57, wherein the assessment criteria relates to educational experience-related attributes associated with one or more educational experiences associated with the recipients.

63. The system of claim 57, wherein the assessment criteria relates to operating unit-related attributes associated with one or more units with which the plurality of recipients may be associated.

64. The system of claim 63, wherein an operating unit comprises one of an institution, a college, a department, a program, and a course.

65. The system of claim 57, wherein the assessment instrument is one of a test, a survey, a course evaluation, and an evaluation portfolio.

66. The system of claim 57, wherein the assessment criteria relates to a combination of at least two of demographic attributes, course-related attributes, section-related attributes, educational experience-related attributes;

and operating unit-related attributes.

67. The system of claim 57, wherein the programmable computer is further configured to:

forward the assessment instrument to a second separate computer-based system configured to disseminate information to the plurality of recipients.

68. The system of claim 67, wherein the second separate computer-based system comprises a campus academic system.

69. The system of claim 68, wherein the campus academic system is configured to provide an environment to disseminate course-related information to a plurality of users of the institution.

70. The system of claim 67, wherein the first and second separate computer-based system are the same system.

71. The system of claim 57, wherein the programmable computer is further configured to:

receive second input defining the assessment instrument.

72. The system of claim 71, wherein the second input includes selecting the assessment instrument from a list of available assessment instruments.

73. The system of claim 71, wherein the second input includes one or more modifications for a pre-existing assessment instrument.

74. The system of claim 57, wherein the first separate computer-based system comprises a student information system of the institution.

75. The system of claim 57, wherein the programmable computer is further configured to:

store the selected subset as a particular recipient list.

76. The system of claim 75, wherein the programmable computer is further configured to:

receive second input identifying a subsequent assessment instrument;

receive third input identifying a stored recipient list; and

deploy the subsequent assessment instrument to essentially only members of the stored recipient list.

77. The system of claim 57, wherein the programmable computer is further configured to:

store the assessment criteria as a particular assessment criteria list.

78. The system of claim 77, wherein the programmable computer is further configured to:

receive second input identifying a subsequent assessment instrument;

receive third input identifying a stored assessment criteria list;

determine a new selected subset based on the stored assessment criteria list; and

limiting deployment of the subsequent assessment instrument to members of the new selected subset.

79. The system of claim 77, wherein the programmable computer is further configured to:

identify the new selected subset based on those of a different plurality of recipients having associated user identifying accreditation attributes matching the stored assessment criteria list, wherein at least one member of the different plurality of recipients is not a member of the plurality of recipients.

80. The system of claim 77, wherein the programmable computer is further configured to:

identify the new selected subset based on those of a different plurality of recipients having associated user identifying accreditation attributes matching the stored assessment criteria list, wherein at least one member of the plurality of recipients is not a member of the different plurality of recipients.

81. Computer readable media containing programming instructions for selectively deploying an assessment instrument to a selected subset of a plurality of recipients, that upon execution thereof, causes one or more processors to perform the steps of:

receiving first input defining the assessment instrument;

receiving second input defining an assessment criteria, the assessment criteria related to a plurality of user identifying accreditation attributes associated, respectively, with each of the plurality of recipients;

receiving a selection of user identifying accreditation attributes matching the assessment criteria;

identifying the selected subset based on those of the plurality of recipients having associated with the selected user identifying accreditation attributes matching the assessment criteria; and

deploying the assessment instrument to the selected subset, of the plurality of recipients, having the associated user identifying accreditation attributes matching the assessment criteria.

82. Computer readable media containing programming instructions for selectively deploying an assessment instrument to a selected subset of a plurality of recipients, that upon execution thereof, causes one or more processors to perform the steps of:

receiving first input defining the assessment instrument;

receiving second input defining an assessment criteria, the assessment criteria related to a plurality of user identifying accreditation attributes associated, respectively, with each of the plurality of recipients;

receiving a selection of user identifying accreditation attributes matching the assessment criteria; and

forwarding the assessment criteria, the selected user identifying accreditation attributes, and the assessment instrument to a separate computer-based system of the institution, wherein the separate computer-based system is configured to distribute the assessment instrument to the selected subset, of the plurality of recipients, having the selected user identifying accreditation attributes matching the assessment criteria.

83. Computer readable media containing programming instructions for selectively deploying an assessment instrument to a selected subset of a plurality of recipients, that upon execution thereof, causes one or more processors to perform the steps of:

receiving first input defining an assessment criteria, the assessment criteria related to a plurality of user identifying accreditation attributes associated, respectively, with each of the plurality of recipients;

forwarding the first input to a first separate computer-based system of the institution;

in response, receiving a selection of attributes matching the assessment criteria that identify members of the selected subset; and

deploying the assessment instrument to the selected subset, of the plurality of recipients, having the selected user identifying accreditation attributes matching the assessment criteria.