Ranking of users who report abuse

• US 8,856,165 B1
• Filed: 06/16/2010
• Issued: 10/07/2014
• Est. Priority Date: 03/26/2010
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google Inc. (Alphabet Inc.)
• Inventors: Cierniak, Michal
• Primary Examiner(s): Hwa, Shyue Jiunn
• Application Number:
  US12/816,719
• Time in Patent Office: 1,574 Days
• Field of Search: 707/767
• US Class Current: 707/767
• CPC Class Codes: G06Q 10/10 Office automation; Time management

Abstract

A method, performed by one or more server devices, includes receiving an abuse report from a user, where the abuse report indicates that a comment associated with a document violates a policy associated with providing comments to users; retrieving a trust score of the user, where the trust score is based on a difference between a quantity of valid abuse reports previously generated by the user and a quantity of invalid abuse reports previously generated by the user; generating or adjusting a removal score of the comment based on the retrieved trust score of the user; comparing the removal score to a removal threshold; and removing the comment from further presentation to users if the removal score of the comment is greater than the removal threshold.

Claims

1. A computer-implemented method performed by one or more server devices, the method comprising:

receiving, by one or more processors associated with the one or more server devices, an abuse report from a user,

the abuse report indicating that a comment, associated with a document or associated with a content of the document, violates a policy associated with providing comments to users;

determining, by the one or more processor associated with the one or more server devices, a quantity of valid abuse reports previously generated by the user;

determining, by the one or more processor associated with the one or more server devices, a quantity of invalid abuse reports previously generated by the user;

determining, by the one or more processors associated with the one or more server devices, a trust score of the user,

the trust score being based on a difference between the quantity of valid abuse reports and the quantity of invalid abuse reports;

generating or adjusting, by the one or more processors associated with the one or more server devices, a removal score of the comment based on the trust score of the user;

comparing, by the one or more processors associated with the one or more server devices, the removal score to a removal threshold;

removing, by the one or more processors associated with the one or more server devices, the comment from further presentation to users when the removal score of the comment satisfies the removal threshold;

generating, by the one or more processors associated with the one or more server devices, an abuse record for the comment when the removal score of the comment does not satisfy the removal threshold;

placing, by the one or more processors associated with the one or more server devices, the abuse record for the comment in a queue for review;

providing, by the one or more processors associated with the one or more server devices, the abuse record to a review interface;

receiving, by the one or more processors associated with the one or more server devices and from the review interface, an indication of whether the abuse report is valid; and

adjusting, by the one or more processors associated with the one or more server devices, the trust score based on the received indication.

2. The method of claim 1, further comprising:

determining that the removal score of the comment satisfies a suspension threshold that does not satisfy the removal threshold; and

temporarily suspending the comment from being provided to users based on determining that the removal score of the comment satisfies the suspension threshold.

3. The method of claim 1, further comprising:

receiving an abuse report about the comment from another user;

retrieving a trust score of the other user; and

adjusting the removal score of the comment based on the retrieved trust score of the other user.

4. The method of claim 3, where adjusting the removal score of the comment based on the retrieved trust score associated with the other user includes:

adding the trust score of the other user to the removal score of the comment.

5. The method of claim 1, further comprising:

adjusting the trust score of the user based on an author score of the user, where the author score of the user is based on at least one of;

ratings, of comments authored by the user, by other users, or

a quantity of times comments, authored by the user, are accessed by other users.

6. The method of claim 1, further comprising:

adjusting the trust score of the user based on a rater score of the user, where the rater score of the user is based on how often the user gives a particular comment a same rating as a majority of other users that have rated the particular comment.

7. The method of claim 1, further comprising:

adjusting the trust score of the user based on a publisher score of the user, where the publisher score of the user is based on at least one of;

a rank score of a second document associated with the user, or

a number of times that a third document associated with the user is accessed by other users.

8. The method of claim 1, further comprising:

adjusting the trust score of the user based on a certification of the user, where the certification of the user is an indication of the user'"'"'s knowledge of policies associated with providing comments to users.

9. The method of claim 1, where the trust score of the user is based on a logistic function that takes as an input the difference between the quantity of valid abuse reports previously generated by the user and the quantity of invalid abuse reports previously generated by the user.

10. A device comprising:

a memory to store a user profile that includes a trust score of a user,

the trust score being based on a difference between a quantity of valid abuse reports previously generated by the user and a quantity of invalid abuse reports previously generated by the user; and

a processor to;

implement an abuse report review queue,

the abuse report review queue receiving an abuse record and providing the abuse record to a review interface;

implement the review interface,

the review interface providing an abuse report to an operator and receiving an indication whether the abuse report is valid;

receive the abuse report,

the abuse report indicating that a comment, associated with a document or associated with a content of the document, violates a policy associated with providing comments to users;

determine the quantity of valid abuse reports previously generated by the user;

determine the quantity of invalid abuse reports previously generated by the user;

determine the trust score of the user from the user profile,

the trust score being based on a difference between the quantity of valid abuse reports and the quantity of invalid abuse reports;

generate or adjust a removal score of the comment based on the retrieved trust score of the user;

provide an indication to delete the comment without review by an operator when the removal score of the comment satisfies a removal threshold;

generate an abuse record and provide the abuse record to the abuse report review queue when the removal score of the comment does not satisfy the removal threshold;

receive another abuse report about the comment from another user;

retrieve a trust score of the other user from a user profile associated with the other user; and

adjust the removal score of the comment by combining the trust score of the other user to the removal score of the comment.

11. The device of claim 10, where

the review interface is to provide the indication whether the abuse report is valid to the processor, and

the processor is to adjust the trust score of the user based on whether the abuse report is valid.

12. The device of claim 10, where the processor is further to:

determine that the removal score of the comment satisfies a suspension threshold, where the suspension threshold does not satisfy the removal threshold; and

label the comment for temporary removal based on determining that the removal score of the comment satisfies the suspension threshold.

13. The device of claim 10, where the processor is further to:

adjust the trust score of the user based on an author score of the user, where the author score of the user is based on at least one of;

ratings of comments, authored by the user, by other users, or

a quantity of times comments, authored by the user, are accessed by other users.

14. The device of claim 10, where the processor is further to:

adjust the trust score of the user based on a rater score of the user, where the rater score of the user is based on how often the user gives a particular comment a same rating as a majority of other users that have rated the particular comment.

15. The device of claim 10, where the processor is further to:

adjust the trust score of the user based on a publisher score of the user, where the publisher score of the user is based on at least one of;

a rank score of a second document associated with the user, or

a number of times a third document, associated with the user, is accessed by other users.

16. The device of claim 10, where the processor is further to:

adjust the trust score of the user based on a certification of the user, where the certification of the user is an indication of the user'"'"'s knowledge of policies associated with providing comments to users.

17. One or more non-transitory memory devices comprising instructions executable by one or more processors, the instructions comprising:

one or more instructions to receive an abuse report from a user,

the abuse report indicating that a comment, associated with a document or associated with a content of the document, violates a policy associated with providing comments to users;

one or more instructions to determine a quantity of valid abuse reports previously generated by the user;

one or more instructions to determine a quantity of invalid abuse reports previously generated by the user;

one or more instructions to determine a trust score of the user,

the trust score being based on a difference between the quantity of valid abuse reports and the quantity of invalid abuse reports;

one or more instructions to generate or adjust a removal score of the comment based on the retrieved trust score of the user;

one or more instructions to determine whether the removal score of the comment satisfies a removal threshold;

one or more instructions to delete the comment without input from an operator when the removal score of the comment satisfies the removal threshold;

one or more instructions to determine whether the removal score of the comment satisfies a suspension threshold when the removal score of the comment does not satisfy the removal threshold, the suspension threshold not satisfying the removal threshold;

one or more instructions to temporarily suspend the comment from being provided to users when the removal score of the comment satisfies the suspension threshold;

one or more instructions to generate an abuse record for the comment and place the abuse record for the comment in an abuse report review queue when the removal score of the comment does not satisfy the removal threshold;

one or more instructions to provide the abuse record to an operator;

one or more instructions to receive, from the operator, an indication whether the abuse report is valid; and

one or more instructions to adjust the trust score of the user based on the received indication.

18. The one or more memory devices of claim 17, where the instructions further include:

one or more instructions to adjust the trust score of the user based on;

an author score of the user, where the author score of the user is based on at least one of;

ratings of comments, authored by the user, by other users, or

a quantity of times comments, authored by the user, are accessed by other users.

19. The one or more memory devices of claim 17, where the instructions further include:

one or more instructions to adjust the trust score of the user based on;

a rater score of the user, where the rater score of the user is based on how often the user gives a particular comment a same rating as a majority of other users that have rated the particular comment.

20. The one or more memory devices of claim 17, where the instructions further include:

one or more instructions to adjust the trust score of the user based on;

a publisher score of the user, where the publisher score of the user is based on at least one of;

a rank score of a second document associated with the user, or

a number of times a third document, associated with the user, is accessed by other users.

21. The one or more memory devices of claim 17, where the instructions further include:

one or more instructions to adjust the trust score of the user based on;

a certification of the user, where the certification of the user is an indication of the user'"'"'s knowledge of policies associated with providing comments to users.