Systems and methods for API rate limiting and distribution
First Claim
1. A method, comprising:
- receiving, by an application programming interface (API) proxy system embodied on a cluster of server machines, a client request from an API client;
the API proxy system calculating a quota of requests allowed for the API client for a current time window based at least in part on a number of active API clients during the current time window and a tunable scaling factor, wherein the quota of requests allowed for the API client for the current time window is calculated using an exponential distribution function, wherein the exponential distribution function is formulated as;
4 Assignments
0 Petitions
Accused Products
Abstract
An API rate limiting system may receive a client request from an API client associated with a tenant, formulate a proxied request with an internal authentication specific to the tenant, and send the proxied request to API endpoints (tenant resources) at a store. The store fulfills the request, accessing and modifying local database(s) as needed, and returns a response to the system. The system returns the response to the API client along with information about the API client'"'"'s quota for the current time window. The system may calculate the quota based on a resource limit with respect to a number of clients accessing a resource. In some embodiments, the system may implement an exponential distribution function in making a determination on a quota per API client per time window.
17 Citations
15 Claims
-
1. A method, comprising:
-
receiving, by an application programming interface (API) proxy system embodied on a cluster of server machines, a client request from an API client; the API proxy system calculating a quota of requests allowed for the API client for a current time window based at least in part on a number of active API clients during the current time window and a tunable scaling factor, wherein the quota of requests allowed for the API client for the current time window is calculated using an exponential distribution function, wherein the exponential distribution function is formulated as; - View Dependent Claims (2, 3, 4, 5)
-
-
6. An application programming interface (API) proxy system, comprising:
-
at least one processor; non-transitory computer memory; instructions embodied on the non-transitory computer memory and translatable by the at least one processor to perform; receiving a client request from an API client; calculating a quota of requests allowed for the API client for a current time window based at least in part on a number of active API clients during the current time window and a tunable scaling factor, wherein the quota of requests allowed for the API client for the current time window is calculated using an exponential distribution function, wherein the exponential distribution function is formulated as; - View Dependent Claims (7, 8, 9, 10)
-
-
11. A computer program product comprising at least one non-transitory computer readable medium storing instructions translatable by at least one processor to perform:
-
receiving a client request from an API client; calculating a quota of requests allowed for the API client for a current time window based at least in part on a number of active API clients during the current time window and a tunable scaling factor, wherein the quota of requests allowed for the API client for the current time window is calculated using an exponential distribution function, wherein the exponential distribution function is formulated as; - View Dependent Claims (12, 13, 14, 15)
-
Specification