User evaluation in a collaborative online forum
First Claim
1. One or more processor-accessible hardware storage media, comprising processor-executable instructions for user evaluation in a collaborative online forum, wherein the processor-executable instructions, when executed, direct one or more devices to perform acts comprising:
- evaluating multiple users automatically and without manual intervention based on a combination of post scores of one or more posts submitted to the collaborative online forum and on user interactions in the collaborative online forum, the user interactions being derived from the one or more posts among the multiple users being evaluated for contributing in the one or more posts, the one or more posts comprise content that reflects user ideas represented by user entered phrases of adjacent words discussing a topic relevant to a leading post in a thread and a sub-forum in the collaborative online forum, the evaluating comprising;
accessing the one or more posts that are associated with the multiple users;
ascertaining the post scores for the one or more posts based on one or more features, wherein the one or more features include a relevance feature group comprising at least;
(i) a first feature that measures whether a given post is on thread topic and (ii) a second feature that measures whether the given post is on sub-forum topic;
analyzing the user interactions with regard to the one or more posts to identify relationships among the multiple users and the content included in the one or more posts; and
evaluating the combination of the post scores and the user interactions to determine respective collaboration scores for respective users of the multiple users responsive to multiple metrics; and
presenting a user interface that provides access to the collaboration scores via a supervisor dashboard that displays interactivity graphs reflecting interactions between and among at least selected ones of the multiple users.
2 Assignments
0 Petitions
Accused Products
Abstract
Users of a collaborative online forum may be evaluated automatically with the results made available to a supervisor. In an example embodiment, a method involves accessing multiple posts that are associated with multiple users, with each post of the multiple posts including content. Post scores for the multiple posts are ascertained based on one or more features. User interactions are analyzed with regard to the multiple posts to identify relationships among the multiple users and the content included in the multiple posts. The post scores and the user interactions are evaluated to determine respective collaboration scores for respective users of the multiple users. A user interface that provides access to the collaboration scores is presented to a supervisor.
16 Citations
19 Claims
-
1. One or more processor-accessible hardware storage media, comprising processor-executable instructions for user evaluation in a collaborative online forum, wherein the processor-executable instructions, when executed, direct one or more devices to perform acts comprising:
-
evaluating multiple users automatically and without manual intervention based on a combination of post scores of one or more posts submitted to the collaborative online forum and on user interactions in the collaborative online forum, the user interactions being derived from the one or more posts among the multiple users being evaluated for contributing in the one or more posts, the one or more posts comprise content that reflects user ideas represented by user entered phrases of adjacent words discussing a topic relevant to a leading post in a thread and a sub-forum in the collaborative online forum, the evaluating comprising; accessing the one or more posts that are associated with the multiple users; ascertaining the post scores for the one or more posts based on one or more features, wherein the one or more features include a relevance feature group comprising at least;
(i) a first feature that measures whether a given post is on thread topic and (ii) a second feature that measures whether the given post is on sub-forum topic;analyzing the user interactions with regard to the one or more posts to identify relationships among the multiple users and the content included in the one or more posts; and evaluating the combination of the post scores and the user interactions to determine respective collaboration scores for respective users of the multiple users responsive to multiple metrics; and presenting a user interface that provides access to the collaboration scores via a supervisor dashboard that displays interactivity graphs reflecting interactions between and among at least selected ones of the multiple users. - View Dependent Claims (2, 3, 4)
-
-
5. A method, which is implemented by one or more devices, for user evaluation in a collaborative online forum, the method comprising acts of:
evaluating multiple users automatically based on a combination of post scores, calculated without manual intervention, of one or more posts submitted to the collaborative online forum and on user interactions, derived from the one or more posts, among the multiple users being evaluated for contributing in the one or more posts, the one or more posts comprise content that reflects user ideas represented by user entered phrases of adjacent words discussing a topic relevant to a leading post in a particular thread, and a sub-forum in the collaborative online forum, the evaluating comprising; accessing one or more posts that are associated with the multiple users; ascertaining the post scores for the one or more posts based on one or more features, wherein the one or more features include a relevance feature group comprising at least;
(i) a first feature that measures whether a given post is on thread topic and (ii) a second feature that measures whether the given post is on sub-forum topic;analyzing the user interactions with regard to the one or more posts to identify relationships among the multiple users and the content included in the one or more posts; evaluating the post scores and the user interactions by a processor to determine respective collaboration scores for respective users of the multiple users; and presenting a user interface that provides access to the collaboration scores. - View Dependent Claims (6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16)
-
17. A device for evaluating users in a collaborative online forum, the device comprising:
-
one or more memories operatively coupled to one or more processors providing; a collaboration evaluator to evaluate multiple users automatically by accessing a combination of post scores of one or more posts that are associated with multiple users being evaluated for contributing in the one or more posts and user interactions among the multiple users, each post of the one or more posts including content, the content reflects user ideas represented by user entered phrases of adjacent words discussing a topic relevant to a leading post in a thread and a sub-forum in the collaborative online forum;
the collaboration evaluator including;a post score ascertainer to ascertain the post scores for the one or more posts automatically using a classifier based on one or more features including at least a measure of matching between the user entered phrases and words of the leading post, wherein the one or more features include a relevance feature group comprising at least;
(i) a first feature that measures whether a given post is on thread topic and (ii) a second feature that measures whether the given post is on sub-forum topic;a user interactions analyzer to analyze the user interactions with regard to the one or more posts using natural language processing to identify relationships among the multiple users and the content included in the one or more posts; and a collaboration score determiner to receive metrics corresponding to the post scores and the user interactions and evaluate the combination of the post scores and the user interactions to determine respective collaboration scores for respective users of the multiple users; and a dashboard creator to present a user interface that provides access to the collaboration scores. - View Dependent Claims (18, 19)
-
Specification