Educator effectiveness

• US 9,575,616 B2
• Filed: 12/20/2012
• Issued: 02/21/2017
• Est. Priority Date: 08/12/2011
• Status: Active Grant

• Current Assignee: Frontline Technologies Group LLC (Roper Technologies, Inc.)
• Original Assignee: School Improvement Network, LLC (Roper Technologies, Inc.)
• Inventors: Linton, Chet Dee
• Primary Examiner(s): Chang, Tom Y
• Application Number:
  US13/721,461
• Publication Number:
  US 20130111363A1
• Time in Patent Office: 1,524 Days
• Field of Search: 709/226
• US Class Current: 1/1
• CPC Class Codes: G06F 3/048 Interaction techniques based on graphical user interfaces [GUI]
• CPC Class Codes: G06Q 10/06 Resources, workflows, human or project management; Enterprise or organisation planning; Enterprise or organisation modelling
• CPC Class Codes: G06Q 50/20 Education
• CPC Class Codes: G06Q 50/205 Education administration or guidance
• CPC Class Codes: H04L 12/1813 for computer conferences, e.g. chat rooms instant messaging H04L51/04; protocols for multimedia communication H04L65/1101; arrangements for multi-party communication H04L65/403; telephonic conference arrangements H04M3/56; television conference systems H04N7/15
• CPC Class Codes: H04L 12/1818 Conference organisation arrangements, e.g. handling schedules, setting up parameters needed by nodes to attend a conference, booking network resources, notifying involved parties
• CPC Class Codes: H04L 12/1831 Tracking arrangements for later retrieval, e.g. recording contents, participants activities or behavior, network status
• CPC Class Codes: H04L 65/4025 where none of the additional parallel sessions is real time or time sensitive, e.g. downloading a file in a parallel FTP session, initiating an email or combinational services
• CPC Class Codes: H04L 65/403 Arrangements for multi-party communication, e.g. for conferences data switching systems for conference H04L12/18; arrangements for connecting several subscribers to a common circuit, i.e. affording conference facilities H04M3/56; television conferencing systems H04N7/15

Abstract

Various implementations for managing, monitoring, and promoting user development and effectiveness are described. In one example implementation, a system includes a management module, an assessment module, a content module, and a reporting module. The management module determines a goal for a plurality of users of an organization to meet and a workflow for achieving the goal. The assessment module determines an assessment of a first performance of the first user based on the workflow and personalizes an electronic resource to a need of the first user based on the assessment of the performance. The content module provides the first electronic resource to the first user for interaction and the reporting module generates a report describing the electronic resource and the assessment of the first performance.

Claims

1. A computer-implemented method comprising:

presenting, via a display of a user device, an interface for defining a workflow including a process template for defining an organization-wide development plan and an assessment template for evaluating performances of members in an organization, the process template including user-definable steps for achieving one or more organizational goals and tracking progress of a multiplicity of members of the organization relative to the one or more organizational goals, the assessment template including fields for assessing how the users are performing relative to the goals and fields for prescribing personalized electronic resources to address assessed needs of the members;

receiving, via an input device of the user device, input defining the user-definable steps of the process template including specific electronic resources for the multiplicity of members of the organization to consume and a schedule for completing consumption of the specific electronic resources;

receiving, via an input device of the user device, input defining the fields of the assessment template for assessing the members;

submitting the workflow including the process template and the assessment template as defined for storage in a non-transitory data store;

generating effectiveness analytics including effectiveness scores for the multiplicity of members of the organization using management data describing the workflow, and one or more of assessment data, achievement data, standards data, and interaction data associated with the multiplicity of members of the organization, the effectiveness scores respectively quantifying how effectively the multiplicity of members of the organization are meeting the steps of the process template including consumption of the electronic resources; and

generating and displaying a virtual dashboard, via the display of the user device, providing an administrator with a summary pages having a summary of one or more members of the organization including the one or more members progress over time effectiveness relative to the workflow, the virtual dashboard including one or more reports having the effectiveness scores of the multiplicity of members, effectiveness data regarding the electronic resources of the workflow, and one or more electronic resource recommendations generated based on the effectiveness analytics, the dashboard further including one or more user-selectable filters for viewing data in the one or more reports according to one or more granular segments.

2. The computer-implemented method of claim 1, wherein the workflow further includes one or more assessment templates for assessing how the multiplicity of members of the organizations are performing relative to the organizational goals of the workflow, the assessment template including includes assignment fields populated with the specific electronic resources defined by the process template, the method further, comprising:

receiving, using one or more computing devices, assessment data describing assessments performed by one or more observers using the one or more assessment templates specified by the workflow;

prescribing, using the one or more computing devices, a personalized electronic resource from the specific electronic resources to one or more of the members using at least one of the one or more assessment templates;

receiving, using the one or more computing devices, interaction data describing a consumption of the personalized electronic resource by the one or more of the members to which the personalized electronic resource is prescribed, the consumption of the personalized electronic resource reflecting a learning activity being performed by the one or more of the members;

performing, using the one or more computing devices, a subsequent assessment of each of the one or more of the members to determine whether the one or more of the members have progressed relative to the goal since consuming the personalized electronic resource, wherein the one or more effectiveness analytics are further generated to describe whether the personalized electronic resource was effective at helping the one or more of the members progress relative to the goal; and

personalizing the personalized electronic resource by determining the electronic resource based on one or more of the assessments of how the members are performing relative to the goal.

3. The computer-implemented method of claim 2, wherein personalizing the personalized electronic resource further includes adapting a content of the personalized electronic resource to address a need of the one or more of the members as reflected by the one or more of the assessments.

4. The computer-implemented method of claim 1, wherein the specific electronic resources of the workflow embody development tasks and the method further comprises:

tracking a consumption of the specific electronic resources by the multiplicity of members of the organization; and

determining a compliance of the members with the organizational goals of the workflow based on the consumption, wherein generating the effectiveness analytics is further based on the compliance of the members.

5. The computer-implemented method of claim 1, wherein the generating the effectiveness analytics includes calculating an organization effectiveness score based on the assessments of the members in the aggregate, wherein one or more of the reports are generated to include the organization effectiveness score.

6. The computer-implemented method of claim 1, wherein the one or more assessment template includes one or more standards that are related to the organizational goals of the workflow, the method further comprising providing the one or more assessment template to at least one observer of the one or more observers to populate with observation data reflecting observations made by the at least one observer of a proficiency of each of the members while observing the members.

7. The computer-implemented method of claim 1, comprising:

providing, using the one or more computing devices, the report for presentation to a user registered as the administrator of the members;

receiving, using the one or more computing devices, an instruction from the administrator based on the report; and

modifying, using the one or more computing devices, one or more of the goal and the workflow based on the instruction.

8. The computer-implemented method of claim 1, comprising:

aggregating, using the one or more computing devices, demographics data, wherein the one or more effectiveness analytics included in the report are segmented based on the demographics data.

9. The computer-implemented method of claim 1, wherein the process template includes a certain timeframe for the members to complete one or more development tasks.

10. The computer-implemented method of claim 9, wherein at least one of the one or more development tasks includes consumption by the members of one or more electronic resources that provide training related to the goal, the one or more electronic resources including at least one or more of an online course, an electronic book, a video, a podcast, and an online learning community.

11. A computer program product comprising a non-transitory computer-usable medium including instructions which, when executed by a computer, cause the computer to:

present, via a display of a user device, an interface for defining a workflow including a process template for defining an organization-wide development plan and an assessment template for evaluating performances of members in an organization, the process template including user-definable steps for achieving one or more organizational goals and tracking progress of a multiplicity of members of the organization relative to the one or more organizational goals, the assessment template including fields for assessing how the users are performing relative to the goals and fields for prescribing personalized electronic resources to address assessed needs of the members;

receive, via an input device of the user device, in put input defining the user-definable steps of the process template including specific electronic resources for the multiplicity of members of the organization to consume and a schedule for completing consumption of the specific electronic resources;

receive, via an input device of the user device, input defining the fields of the assessment template for assessing the members;

submit the workflow including the process template and the assessment template as defined for storage in a non-transitory data store;

generate effectiveness analytics including effectiveness scores for the multiplicity of members of the organization using management data describing the workflow, and one or more of assessment data, achievement data, standards data, and interaction data associated with the multiplicity of members of the organization, the effectiveness scores respectively quantifying how effectively the multiplicity of members of the organization are meeting the steps of the process template including consumption of the electronic resources; and

generate and display a virtual dashboard, via the display of the user device, providing an administrator with a summary pages having a summary of one or more members of the organization including the one or more members progress over time effectiveness relative to the workflow, the virtual dashboard including one or more reports having the effectiveness scores of the multiplicity of members, effectiveness data regarding the electronic resources of the workflow, and one or more electronic resource recommendations generated based on the effectiveness analytics, the dashboard further including one or more user-selectable filters for viewing data in the one or more reports according to one or more granular segments.

12. The computer program product of claim 11, wherein the workflow further includes one or more assessment templates for assessing how the multiplicity of members of the organizations are performing relative to the organizational goals of the workflow, the assessment templates including assignment fields populated with the specific electronic resources defined by the process template, wherein the instructions further cause the computer to:

receive assessment data describing assessments performed by one or more observers using the one or more assessment templates specified by the workflow;

prescribe a personalized electronic resource from the specific electronic resources to one or more of the members using at least one of the one or more assessment templates;

receive interaction data describing a consumption of the personalized electronic resource by the one or more of the members to which the personalized electronic resource is prescribed, the consumption of the personalized electronic resource reflecting a learning activity being performed by the one or more of the members;

perform a subsequent assessment of each of the one or more of the members to determine whether the one or more of the members have progressed relative to the goal since consuming the personalized electronic resource, wherein the one or more effectiveness analytics are further generated to describe whether the personalized electronic resource was effective at helping the one or more of the members progress relative to the goal; and

personalize the personalized electronic resource by determining the electronic resource based on one or more of the assessments of how the members are performing relative to the goal.

13. The computer program product of claim 12, wherein the specific electronic resources of the workflow embody development tasks and the instructions further cause the computer to:

track a consumption of the specific electronic resources by the multiplicity of members of the organization; and

determine a compliance of the members with the organizational goals of the workflow based on the consumption, wherein to generate the effectiveness analytics is further based on the compliance of the members.

14. The computer program product of claim 12, wherein:

to personalize the personalized electronic resource includes adapting a content of the personalized electronic resource to address a need of the one or more of the members as reflected by one or more of the assessments.

15. The computer program product of claim 11, wherein to generate the effectiveness analytics includes calculating an organization effectiveness score based on the assessments of the members in the aggregate, wherein one or more of the reports are generated to include the organization effectiveness score.

16. The computer program product of claim 11, wherein the one or more assessment template includes one or more standards that are related to the organizational goals of the workflow, wherein the instructions further cause the computer to provide the one or more assessment template to at least one observer of the one or more observers to populate with observation data reflecting observations made by the at least one observer of a proficiency of each of the members while observing the members.

17. The computer program product of claim 11, wherein the instructions further cause the computer to:

provide the report for presentation to a user registered as the administrator of the members;

receive an instruction from the administrator based on the report; and

modify one or more of the goal and the workflow based on the instruction.

18. The computer program product of claim 11, wherein the instructions further cause the computer to:

aggregate demographics data, wherein the one or more effectiveness analytics included in the report are segmented based on the demographics data.

19. The computer program product of claim 11, wherein the process template includes a certain timeframe for the members to complete one or more development tasks.

20. The computer program product of claim 19, wherein at least one of the one or more development tasks includes consumption by the members of one or more electronic resources that provide training related to the goal, the one or more electronic resources including at least one or more of an online course, an electronic book, a video, a podcast, and an online learning community.

21. A system comprising:

a processors, and;

a memory storing instructions that, when executed, cause the system to;

present, via a display of a user interface, an interface for defining a workflow including a process template for defining an organization-wide development plan and an assessment template for evaluating performances of members in an organization, the process template including user-definable steps for achieving one or more organizational goals and tracking progress of a multiplicity of members of the organization relative to the one or more organizational goals, the assessment template including fields for assessing how the users are performing relative to the goals and fields for prescribing personalized electronic resources to address assessed needs of the members;

receive, via an input device of a user device, input defining the user-definable steps of the process template including specific electronic resources for the multiplicity of members of the organization to consumer and a schedule for completing consumption of the specific electronic resources;

receive, via an input device of the user device, input defining the fields of the assessment template for assessing the members;

submit the workflow including the process template and the assessment template as defined for storage in a non-transitory data store;

generate effectiveness analytics including effectiveness scores for the multiplicity of members of the organization using management data describing the workflow, and one or more of assessment data, achievement data, standards data, and interaction data associated with the multiplicity of members of the organization, the effectiveness scores respectively quantifying how effectively the multiplicity of members of the organization are meeting the steps of the process template including consumption of the electronic resources; and

generate and display a virtual dashboard, via the display of the user device, providing an administrator with a summary pages having a summary of one or more members of the organization including the one or more members progress over time effectiveness relative to the workflow, the virtual dashboard including one or more reports having the effectiveness scores of the multiplicity of members, effectiveness data regarding the electronic resources of the workflow, and one or more electronic resource recommendations generated based on the effectiveness analytics, the dashboard further including one or more user-selectable filters for viewing data in the one or more reports according to one or more granular segments.

22. The system of claim 21, wherein the workflow further includes one or more assessment templates for assessing how the multiplicity of members of the organizations are performing relative to the organizational goals of the workflow, the assessment templates including assignment fields populated with the specific electronic resources defined by the process template, wherein the memory also stores instructions that, when executed, cause the system to:

receive assessment data describing assessments performed by one or more observers using the one or more assessment templates specified by the workflow;

prescribe a personalized electronic resource from the specific electronic resources to one or more of the members using at least one of the one or more assessment templates;

receive interaction data describing a consumption of the personalized electronic resource by one or more of the members to which the personalized electronic resource is prescribed, the consumption of the personalized electronic resource reflects a learning activity being performed by the one or more of the members;

perform a subsequent assessment of each of the one or more of the members to determine whether the one or more of the members have progressed relative to the goal since consuming the personalized electronic resource, wherein the one or more effectiveness analytics are further generated to describe whether the personalized electronic resource was effective at helping the one or more of the members progress relative to the goal; and

personalize the personalized electronic resource by determining the electronic resource based on one or more of the assessments of how the members are performing relative to the goal.

23. The system of claim 22, wherein the specific electronic resource of the workflow embody development tasks, wherein the memory also stores instructions that, when executed, cause the system to:

track a consumption of the specific electronic resources by the multiplicity of members of the organization; and

determine a compliance of the members with the organizational goals of the workflow based on the consumption, wherein generating the effectiveness analytics is further based on the compliance of the members.

24. The system of claim 22, wherein personalize the personalized electronic resource further includes adapting a content of the personalized electronic resource to address a need of the one or more of the members as reflected by the one or more of the assessments.

25. The system of claim 21, wherein generate effectiveness analytics includes calculating an organization effectiveness score based on the assessments of the members in the aggregate, wherein one or more of the reports are generated to include the organization effectiveness score.

26. The system of claim 21, wherein the process template includes a certain timeframe for the members to complete one or more development tasks.

27. The system of claim 26, wherein at least one of the one or more development tasks includes consumption by the members of one or more electronic resources that provide training related to the goal, the one or more electronic resources including at least one or more of an online course, an electronic book, a video, a podcast, and an online learning community.

28. The system of claim 26, wherein the memory also stores instructions that, when executed, cause the system to:

provide the report for presentation to a user registering as the administrator of the members;

receive an instruction from the administrator based on the report; and

modify one or more of the goal and the workflow based on the instruction.

29. The system of claim 21, wherein the one or more assessment template includes one or more standards that are related to the organizational goals of the workflow, wherein the memory also stores instructions that, when executed, cause the system to provide the one or more assessment template to at least one observer of the one or more observers to populate with observation data reflecting observations made by the at least one observer of a proficiency of each of the members while observing the users.

30. The system of claim 21, wherein the memory also stores instructions that, when executed, cause the system to:

aggregate demographics data,

wherein the one or more effectiveness analytics included in the report are segmented based on the demographics data.

31. A system comprising:

means for presenting, via a display of a user device, an interface for defining a workflow including a process template for defining an organization-wide development plan and an assessment template for evaluating performances of members in the organization, the process template including user-definable steps for achieving one or more organizational goals and tracking progress of a multiplicity of members of the organization relative to the one or more organizational goals, the assessment template including fields for assessing how the users are performing relative to the goals and fields for prescribing personalized electronic resources to address assessed needs of the members;

means for receiving, via an input device of the user device, input defining the user-definable steps of the process template including specific electronic resources for the multiplicity of members of the organization to consume and a schedule for completing consumption of the specific electronic resources;

means for receiving input defining the fields of the assessment template for assessing the members;

means for submitting the workflow including the process template and the assessment template as defined for storage in a non-transitory data store;

means for receiving assessment data describing assessments performed by one or more observers using the one or more assessment templates specified by the workflow, the assessments describing how the users of the organization are performing relative to the goal; and

means for generating a summary report with a summary of one or more members of the organization including one or more members progress over time, prescribed resources, and one or more effectiveness analytics reflecting how the users of the organization are collectively performing relative to the goal of the workflow based on the assessments described by the assessment data and the workflow described by management data;

means for generating a report based on the one or more effectiveness analytics.