×

Systems and methods for API rate limiting and distribution

  • US 10,666,770 B2
  • Filed: 07/23/2018
  • Issued: 05/26/2020
  • Est. Priority Date: 02/10/2014
  • Status: Active Grant
First Claim
Patent Images

1. A method, comprising:

  • receiving, by an application programming interface (API) proxy system embodied on a cluster of server machines running in a multi-tenant computing environment, a client request from an API client associated with a tenant of the multi-tenant computing environment, the tenant having an application running on a website, the application limited to resources defined for the tenant, the client request referencing a resource of the resources;

    calculating, by the API proxy system using an exponential distribution function, a quota of requests allowed for the API client for a current time window, the calculating performed by the API proxy system based on a resource limit with respect to a number of API clients that are currently connected to the API proxy system and that are requesting the resource in the current time window, wherein the exponential distribution function is configured for exponentially scaling the quota of requests allowed for the API client in the current time window utilizing a growth factor and a multiplier, wherein the growth factor is tunable up or down depending upon the number of API clients requesting the resource in the current window, and wherein the multiplier multiplies the growth factor such that the quota of requests thus calculated by the API proxy system for the API client for the current time window also scales exponentially up or down depending upon the number of API clients that are currently connected to the API proxy system and that are requesting the resource in the current time window; and

    responsive to receiving an API request from another API client to access the resource, updating, by the API proxy system, the quota of requests calculated for the API client for the current time window.

View all claims
  • 3 Assignments
Timeline View
Assignment View
    ×
    ×