System and method for managing concurrent events

• US 9,495,227 B2
• Filed: 02/11/2013
• Issued: 11/15/2016
• Est. Priority Date: 02/10/2012
• Status: Active Grant

• Current Assignee: Twilio, Inc.
• Original Assignee: Twilio, Inc.
• Inventors: Cooke, Evan, Stratton, Frank, Conroy, Kyle
• Primary Examiner(s): CAO, DIEM K
• Application Number:
  US13/764,594
• Publication Number:
  US 20130212603A1
• Time in Patent Office: 1,373 Days
• Field of Search: None
• US Class Current: 1/1
• CPC Class Codes: G06F 2209/504 Resource capping
• CPC Class Codes: G06F 9/5027 the resource being a machine, e.g. CPUs, Servers, Terminals
• CPC Class Codes: G06F 9/542 Event management; Broadcasting; Multicasting; Notifications
• CPC Class Codes: Y02D 10/00 Energy efficient computing, e.g. low power processors, power management or thermal management

Abstract

A system and method that includes receiving an API request to a type of API resource; retrieving an API concurrency value for the API request; determining a comparison status associated with a comparison of the API concurrency value to a concurrency threshold; if the comparison status is within the concurrency threshold, transmitting the API request to an API processing resource; if the comparison status indicates the concurrency threshold is not satisfied, impeding processing of the API request; accounting for an increase in the API concurrency value if the API request is transmitted to an API processing resource; and accounting for a decrease in the API concurrency value at a time associated with the API processing resource completing processing of the API request.

Claims

1. A method comprising:

at a multi-tenant telephony application programming interface (API) platform system;

receiving a REST application programming interface (API) request to a type of API resource data, the API request specifying an account of a plurality of accounts of the telephony API platform system, the type of API resource data including at least one of telephony call data and telephony messaging data;

retrieving an API concurrency value for the type of API resource data;

determining a comparison status associated with a comparison of the API concurrency value to a concurrency limit associated with the concurrency value;

in a first condition based at least in part on if the comparison status satisfies the concurrency limit, transmitting the API request to an API processing resource;

in a second condition based at least in part on if the comparison status indicates the concurrency limit is not satisfied, impeding processing of the API request;

accounting for an increase in the API concurrency value if the API request is transmitted to an API processing resource; and

accounting for a decrease in the API concurrency value at a time associated with the API processing resource completing processing of the API request,

wherein in a case where the type of API resource data is telephony call data, the retrieved API concurrency value is a telephony call data API concurrency value,

wherein in a case where the type of API resource data is telephony messaging data, the retrieved API concurrency value is a telephony messaging data API concurrency value,

wherein the telephony call data includes telephony call records, and the telephony messaging data includes telephony message records,

wherein the API concurrency value is a current number of API requests being concurrently processed by an API processing resource, and

wherein the concurrency limit is a maximum number of API requests that are permitted to be concurrently processed by an API processing resource.

2. The method of claim 1, wherein the received API request is a request from an account;

and wherein the retrieved API concurrency value is a value maintained for API concurrency usage of the account.

3. The method of claim 1, wherein the retrieved API concurrency value is a value maintained for API concurrency usage for API requests to the API resource data type.

4. The method of claim 1, wherein the received API request is a request from an account;

and wherein the retrieved API concurrency value is a value associated with a measure of usage of at least one API resource data type by the account.

5. The method of claim 1, wherein retrieving an API concurrency value is further retrieved based on state of available resources to process the API request.

6. The method of claim 1, wherein the received API request is a request from an account;

and wherein the concurrency limit is uniquely computed for the account.

7. The method of claim 6, wherein the concurrency limit is dynamically calculated.

8. The method of claim 1, wherein impeding processing of the API request comprises transmitting an error message in an API response.

9. The method of claim 1, wherein the concurrency limit is dynamically adjusted based on capacity of API processing resources.

10. The method of claim 1, further comprising if after a timeout period a response to a processed API request is not transmitted, accounting for a decrease in API concurrency.

11. The method of claim 1, wherein accounting for an increase in the API concurrency value comprises updating the API concurrency value for the specified account in a rate value database, and wherein accounting for a decrease in the API concurrency value comprises updating the API concurrency value for the specified account in the rate value database.

12. The method of claim 1, wherein the API concurrency value is retrieved based on the specified account and the type of API resource data, and wherein the concurrency limit is retrieved based on the specified account and the type of API resource data.

13. The method of claim 12,

wherein a database system of the telephony API platform system stores:

the telephony call data API concurrency value of the account,

a telephony call data API concurrency limit for the account,

the telephony messaging data API concurrency value for the account, and

a telephony messaging data API concurrency limit for the account,

wherein in a case where the type of API resource data is telephony call data, determining a comparison status comprises;

determining a comparison status associated with a comparison of the telephony call data API concurrency value to the telephony call data API concurrency limit, and

wherein in a case where the type of API resource data is telephony messaging data, determining a comparison status comprises;

determining a comparison status associated with a comparison of the telephony messaging data API concurrency value to the telephony messaging data API concurrency limit.

14. The method of claim 13, wherein the telephony call data API concurrency limit is different from the telephony messaging data API concurrency limit.

15. The method of claim 13,

wherein the telephony call data API concurrency value of the account is a value maintained for API concurrency usage of the account for call data API requests, and

wherein the telephony messaging data API concurrency value of the account is a value maintained for API concurrency usage of the account for messaging data API requests.

16. The method of claim 15,

wherein the telephony call data API concurrency limit for the account is dynamically calculated for the account, and

wherein the telephony messaging data API concurrency limit for the account is dynamically calculated for the account.

17. The method of claim 16,

wherein the telephony call data API concurrency limit for the account is dynamically calculated for the account based on capacity of API processing resources of the platform system, and

wherein the telephony messaging data API concurrency limit for the account is dynamically calculated for the account based on capacity of API processing resources of the platform system.

18. A method comprising:

at a multi-tenant telephony application programming interface (API) platform system;

receiving a REST application programming interface (API) request to a type of API resource data, the API request specifying an account of a plurality of accounts of the telephony API platform system, the type of API resource data including telephony call data;

retrieving an API concurrency value for the type of API resource data;

determining a comparison status associated with a comparison of the API concurrency value to a concurrency limit associated with the concurrency value;

in a first condition based at least in part on if the comparison status satisfies the concurrency limit, transmitting the API request to an API processing resource;

in a second condition based at least in part on if the comparison status indicates the concurrency limit is not satisfied, impeding processing of the API request;

accounting for an increase in the API concurrency value if the API request is transmitted to an API processing resource; and

accounting for a decrease in the API concurrency value at a time associated with the API processing resource completing processing of the API request,

wherein the retrieved API concurrency value is a telephony call data API concurrency value,

wherein the telephony call data includes telephony call records,

wherein the API concurrency value is a current number of API requests being concurrently processed by an API processing resource, and

wherein the concurrency limit is a maximum number of API requests that are permitted to be concurrently processed by an API processing resource.