Rate limiting in a moderation framework of a database system

• US 10,346,370 B2
• Filed: 09/22/2016
• Issued: 07/09/2019
• Est. Priority Date: 08/30/2016
• Status: Active Grant

• Current Assignee: Salesforce.com, Inc.
• Original Assignee: Salesforce.com, Inc.
• Inventors: Ko, Kenneth Chung Kay, Luft-Glidden, Joshua, Pfister, Lucas
• Primary Examiner(s): Hoffman, Brandon S
• Assistant Examiner(s): Woldemariam, Nega
• Application Number:
  US15/273,217
• Publication Number:
  US 20180060363A1
• Time in Patent Office: 1,020 Days
• Field of Search: 726 10
• CPC Class Codes: G06F 16/21 Design, administration or maintenance of databases
• CPC Class Codes: G06Q 50/01 Social networking

Abstract

Some external users in a public on-line community may post excessive numbers of items, causing annoyance to others and unnecessary loading on database resources. A robust moderation framework enables an individual community moderator or admin to specify a set of rules and actions to mitigate this problem. Scalable, performant rate limiting rules employ windowed counters, separately for each rule, with the counters maintained in cache memory resources outside the main database.

Claims

1. A rate-limiting method for a database system that implements a main database and implements a public community feed that enables members of the public community to post items to the feed over a network, to moderate the posting of items to the feed, the method comprising the steps of:

creating a set of at least one rate-limiting rule associated with the public community feed;

wherein the rate-limiting rule specifies a type of user, a repeating time interval, an item count limit, and an action;

storing the set of rate-limiting rules in a cache system in the database system outside of the main database;

selecting and loading at least one of the rate-limiting rules from the cache system for execution, wherein execution of the selected rule includes—

provisioning a tracker for the repeating time interval, wherein the tracker is implemented in the cache system outside of the main database, and the tracker is configured to automatically track the number of items posted to the feed during each time interval by each user of the specified type, utilizing windowed counters so as to reset each user'"'"'s posted item count upon expiration of each time interval, each windowed counter utilizing a time bucket field based on the repeating time interval; and

upon detecting that a first user'"'"'s posted count meets or exceeds the item count limit in the selected rule, executing the action specified in the rule with regard to the first user.

2. The method of claim 1 wherein the rule specifies a type of user to which the rule applies, wherein the type of user is selected to include at least one of customer users and internal users.

3. The method of claim 1 wherein the rule specifies target users based on a time elapsed since the user was created.

4. The method of claim 1 wherein the rule specifies at least one type of item entity to be moderated by the rule.

5. The method of claim 1 wherein the rule includes at least one action, wherein each action is triggered by the first user'"'"'s posted count exceeding a corresponding rate limit.

6. The method of claim 1 wherein the actions may include at least one of the following actions:

notification, freeze user, block, replace, premoderate and flag.

7. The method of claim 1 using transient windowed counters to track and react to patterns of user behavior.

8. The method of claim 7 wherein the windowed counters are realized in cache memory, the time bucket field is part of a corresponding cache key for each cache counter, wherein upon expiration of the current time interval, the key changes to a new value, generating a new key that points to the next cache counter for the next time interval, thus automatically resetting the count to zero.

9. The method of claim 8 including implementing the cache memory in at least a two-phase cache, wherein a first level of the cache is stored in local memory in an application server, and flushing the first level cache periodically to a cache server outside of the main database.

10. A system for moderating items posted in a network operating within a database system, comprising:

a hardware processor; and

memory storing one or more stored sequences of instructions which, when executed by the processor, cause the processor to carry out the steps of—

displaying a rate limiting rule template to selectively associate a rate limiting rule with the network, the rule limiting the rate at which items can be posted in the network;

displaying in the rule template one or more user criteria lists to selectively associate with the rule, the user criteria lists identifying types of users associated with the network;

displaying in the rule template one or more rule conditions to selectively associate with the rule, the rule conditions selecting at least one type of items to which the rule applies;

displaying in the rule template one or more content criteria lists to selectively associate with the rule, the content criteria lists identifying content to which the rule applies;

displaying in the rule template input fields for entering a rate limit, the rate limit comprising a repeating time interval and an associated item count limit;

displaying one or more actions in the rule template to selectively associate with the rule, the specified action(s) to be applied when the item count limit of the rule is met or exceeded within the associated repeating time interval;

storing the rate limiting rule as created or modified by inputs to the rule template;

provisioning a tracker for the repeating time interval of the rate limiting rule; and

configuring the tracker to automatically track the number of items posted in the network during each time interval by a user of a specified type, with one or more windowed counters that reset the user'"'"'s posted item count upon expiration of each time interval, each windowed counter utilizing a time bucket field based on the repeating time interval.

11. The system of claim 10, wherein the instructions further cause the processor to carry out the steps of:

loading one or more rate-limiting rules associated with the network from a database into a local memory;

comparing the user criteria lists associated with each rate-limiting rule to the types of users posting the items;

discarding each rule with associated user criteria lists that do not match the types of users posting the content;

applying each loaded rule that is applicable to a user posting items;

including

executing the specified action(s) for each rule when the rule'"'"'s limit is met or exceeded by the rule'"'"'s counter.

12. The system of claim 10, wherein the rate limiting rule has a time interval that is measured from a time that the user created an account in the network, so that the rule limits a number of items that may be posted during the specified time interval elapsed since the user created the account.

13. The system of claim 10, wherein the rate limiting rule has a time interval that is measured backward from a current time.

14. The system of claim 10, wherein the specified action includes a notification.

15. The system of claim 14, wherein the notification is sent to one or more moderators of the network community.

16. The system of claim 10, wherein the specified action includes at least one of the following actions:

notification, freeze user, block, replace, premoderate and flag.

17. The system of claim 10, and further comprising updating a log based on the rule violation, the log accessible to one or more moderators of the network community.

18. A moderation platform for moderating items to be posted in a network operating within a database system, comprising:

user profiles stored in the database system to identify user categories for users belonging to the network;

one or more user criteria lists stored in the database system, the user criteria lists identifying at least one of the user categories;

one or more content criteria lists stored in the database system, the content criteria lists identifying selected content;

one or more rate-limiting rules to control the rates at which a user may post items to a community in the network;

a rule template to create or edit rate-limiting rules, the rule template including;

a user criteria field to display the user criteria lists and receive selections of the displayed user criteria lists to link to the rate-limiting rules,

a rule criteria field to display and receive selections of types of items to be subject to the rules,

a content criteria field to display and receive selections of the displayed content lists to incorporate into the rules,

a rate limit field to receive selections of a repeating time interval and associated count limit value, and an action field to display actions and receive selections of the actions to associate with the rate-limiting rules, wherein the rate-limiting rules as defined by the template are stored in the database system;

a rule controller to select applicable rules, and to apply the corresponding actions based on a user'"'"'s posting activity meeting the criteria of a selected rule; and

a tracker for the repeating time interval of each of the one or more rate-limiting rules, each tracker configured to automatically track the number of items posted to the community during each time interval by a user of a specified category, with one or more windowed counters that reset the user'"'"'s posted item count upon expiration of each time interval, each windowed counter utilizing a time bucket field based on the repeating time interval.

19. The moderation platform of claim 18, wherein the user categories identified by the user criteria lists include new users joining the network within an identified period of time.

20. The moderation platform of claim 18, wherein the rules are cached outside of the main database in transient cache memory for use.