Assessable natural interactions in formal course curriculums

• US 8,433,237 B2
• Filed: 06/15/2009
• Issued: 04/30/2013
• Est. Priority Date: 06/15/2009
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Lloyd, Clifford Huw
• Primary Examiner(s): MOSSER, KATHLEEN MICHELE
• Application Number:
  US12/484,927
• Publication Number:
  US 20100316985A1
• Time in Patent Office: 1,415 Days
• Field of Search: 434/322, 434/350, 434/362, 434/323
• US Class Current: 434/362
• CPC Class Codes: G09B 7/00 Electrically-operated teaching apparatus or devices working with questions and answers mechanically operated G09B3/00; computing arrangements G06F

Abstract

A natural interactions academic course designer system and method that allows an educator to integrate a natural interactions forum (such as discussion boards, blogs, and collaborative wikis) into a formal curriculum. Embodiments of the system and method include a natural interactions integration module, which allows an educator to select a type of natural interaction forum and attaches a rubric, and a natural interactions provisioning module that creates the forum, determines the participants, and the learners to be assessed. Embodiments of the system and method also include an assessment module that assesses a validated learner using one or more of three different metrics. These metrics include a participation metric, a tagging metric, and a natural language processing metric. The assessment module then creates a raw score from the metrics used. Embodiments of the system and method also include a learner tracking module that generates a single final score for the assignment.

Claims

1. A method implemented on a computing device having a processor for designing an academic course, comprising:

using the computing device having the processor to perform the following;

selecting a natural interaction forum;

attaching a rubric to the selected natural interaction forum, wherein the rubric is a template used for assessing the learner'"'"'s knowledge of the topic;

assigning to the learner a natural interaction assignment in the selected natural interaction forum to assess the learner'"'"'s knowledge of the topic;

creating tags for the learner'"'"'s posts in the natural interaction forum that matches information in the learner'"'"'s posts to topics in the rubric;

assessing the learner'"'"'s knowledge of the topic with the natural interaction assignment to generate assessment results based at least in part on the created tags for the learner'"'"'s posts; and

computing a final score of the learner on the natural interaction assignment from the assessment results.

2. The method of claim 1, further comprising provisioning the selected natural interaction forum to those learners that have been assigned the natural interaction assignment.

3. The method of claim 2, further comprising:

limiting participation in the selected natural interaction forum to those learners who are enrolled in the academic course and who have been given the natural interaction assignment; and

creating a list of participants in the selected natural interactions forum to be assessed.

4. The method of claim 2, further comprising creating a list of learners to assess, wherein the list includes those learners who are enrolled in the academic course and who have been given the natural interaction assignment.

5. The method of claim 1, further comprising using at least one of a participation metric, or a tagging metric, or a natural language metric to assess the learner and generate the assessment results.

6. The method of claim 5, further comprising:

computing a single score from the assessment results; and

normalizing the single score to obtain the final score of the learner on the natural interaction assignment.

7. The method of claim 1, further comprising overlaying statistical data on the natural interaction forum to measure a participation of the learner in the natural interaction forum to obtain participation numerical data.

8. The method of claim 7, further comprising:

creating a communication network visualization that graphically visualizes a communication network of the natural interaction forum; and

displaying the communication network visualization.

9. The method of claim 1, further comprising accumulating each of the tags associated with the learner to define the tagging metric for the learner.

10. The method of claim 1, further comprising:

using a natural language technique to examine the learner'"'"'s posts in the natural interaction forum for specific topics and keywords contained in the rubric; and

defining results of the examination with the natural language technique as the natural language metric.

11. A method implemented on a computing device having a processor for determining a learner'"'"'s final grade in an academic course, comprising:

using the computing device having the processor to perform the following;

selecting a type of natural interaction forum to assess a learner'"'"'s knowledge of subject matter;

attaching a rubric to the selected natural interaction forum, the rubric being used as a benchmark for assessing the learner'"'"'s knowledge;

assigning to the learner a natural interaction assignment that uses the selected natural interaction forum;

assessing the learner'"'"'s knowledge based on the learner'"'"'s posts in the selected natural interaction forum using a participation metric that measures both statistically and visually a participation of the learner in the natural interactions forum to generate assessment results for the learner;

computing a single score from the assessment results corresponding to the learner'"'"'s grade on the natural interaction assignment;

integrating the learner'"'"'s grade on the natural interaction assignment into a formal gradebook; and

producing a final grade for the learner based at least on the learner'"'"'s grade on the natural interaction assignment.

12. The method of claim 11, further comprising:

provisioning the selected natural interaction forum by using a security model to allow participation in the selected natural interaction forum only by those learners who are enrolled in the academic course and who have been given the natural interaction assignment; and

creating a list of learners in the academic course to assess from participants in the selected natural interaction forum.

13. The method of claim 11, further comprising creating a list of learners in the academic class to assess, wherein the list includes only those learners who are enrolled in the academic course and who have been given the natural interaction assignment.

14. The method of claim 11, further comprising:

overlaying statistical data on the selected natural interaction forum that measures the learner'"'"'s participation in the selected natural interaction forum to obtain participation numerical data;

creating a communication network visualization that graphically illustrates a communication network of the selected natural interaction forum; and

combining the participation numerical data and the communication network visualization to obtain a participation metric.

15. The method of claim 11, further comprising:

tagging a learner'"'"'s posts in the selected natural interaction forum with tags that match information in the learner'"'"'s posts to topics in the rubric;

accumulating each of the tags associated with the learner to define a tagging metric; and

assessing the learner'"'"'s knowledge using the tagging metric.

16. The method of claim 11, further comprising:

using a natural language processing technique to examine learner'"'"'s post in the selected natural interaction forum for specific topics and keywords that are contained in the rubric;

defining results of examination using the natural language processing technique as a natural language processing metric; and

assessing the learner'"'"'s knowledge using the natural language processing metric.

17. A computer-implemented method for integrating a natural interaction forum into a formal curriculum for an academic course, comprising:

selecting a natural interaction forum to use in an assessment of a learner'"'"'s knowledge of subject matter taught in the academic course;

attaching a rubric to the selected natural interaction forum, wherein the rubric is a benchmark to assess a learner'"'"'s posts in the selected natural interaction forum;

assigning to the learner a natural interaction assignment that uses the natural interaction forum;

provisioning the selected natural interaction forum to the learner and other participants;

seeding the natural interaction forum with a topic for discussion by participants in the selected natural interaction forum;

assessing the learner'"'"'s knowledge of the topic to generate assessment results by using any combination of one or more of a participation metric, a tagging metric, and a natural language processing metric;

creating a communication network visualization that graphically visualizes a communication network of the selected natural interaction forum;

displaying the communication network visualization;

computing a single score corresponding to the learner'"'"'s grade on the natural interaction assignment using the assessment results; and

integrating the learner'"'"'s grade on the natural interaction assignment into a formal gradebook.

18. The computer-implemented method of claim 17, further comprising assessing a learner'"'"'s knowledge of the topic using the participation metric that includes statistical data corresponding to any combination of a number of times the learner started a thread, a number of times the learner ended a thread, a number of times the learner had another participant in the selected natural interaction forum respond to the learner'"'"'s post, a number of times the learner responded to another participant'"'"'s post, and a complexity of the learner'"'"'s post.

19. A method implemented on a computing device having a processor, comprising:

using the computing device having the processor to perform the following;

selecting a natural interaction forum;

attaching a rubric to the selected natural interaction forum, wherein the rubric is a template used for assessing the learner'"'"'s knowledge of the topic;

assigning to the learner a natural interaction assignment in the selected natural interaction forum to assess the learner'"'"'s knowledge of the topic;

assessing the learner'"'"'s knowledge of the topic with the natural interaction assignment to generate assessment results based at least in part on the attached rubric, wherein assessing the learner'"'"'s knowledge includes using at least one of a participation metric, or a tagging metric, or a natural language metric to assess the learner and generate the assessment results; and

computing a final score of the learner on the natural interaction assignment from the assessment results, wherein computing the final score includes computing a single score from the assessment results and normalizing the single score to obtain the final score of the learner on the natural interaction assignment.

20. The method of claim 19, further comprising provisioning the selected natural interaction forum to those learners that have been assigned the natural interaction assignment.

21. The method of claim 19, further comprising overlaying statistical data on the natural interaction forum to measure a participation of the learner in the natural interaction forum to obtain participation numerical data.

22. The method of claim 21, further comprising:

creating a communication network visualization that graphically visualizes a communication network of the natural interaction forum; and

displaying the communication network visualization.

23. The method of claim 19, further comprising creating tags for the learner'"'"'s posts in the natural interaction forum that matches information in the learner'"'"'s posts to topics in the rubric.

24. The method of claim 23, further comprising accumulating each of the tags associated with the learner to define the tagging metric for the learner.

25. The method of claim 19, further comprising:

using a natural language technique to examine a learner'"'"'s post in the natural interaction forum for specific topics and keywords contained in the rubric; and

defining results of the examination with the natural language technique as the natural language metric.