System and method for managing concurrent events

• US 10,467,064 B2
• Filed: 10/12/2016
• Issued: 11/05/2019
• Est. Priority Date: 02/10/2012
• Status: Active Grant

• Current Assignee: Twilio, Inc.
• Original Assignee: Twilio, Inc.
• Inventors: Cooke, Evan, Stratton, Frank, Conroy, Kyle
• Primary Examiner(s): Cao, Diem K
• Application Number:
  US15/291,386
• Publication Number:
  US 20170031736A1
• Time in Patent Office: 1,119 Days
• Field of Search: None
• CPC Class Codes: G06F 2209/504 Resource capping
• CPC Class Codes: G06F 9/5027 the resource being a machine, e.g. CPUs, Servers, Terminals
• CPC Class Codes: G06F 9/542 Event management; Broadcasting; Multicasting; Notifications
• CPC Class Codes: Y02D 10/00 Energy efficient computing, e.g. low power processors, power management or thermal management

Abstract

A system and method that includes receiving an API request to a type of API resource; retrieving an API concurrency value for the API request; determining a comparison status associated with a comparison of the API concurrency value to a concurrency threshold; if the comparison status is within the concurrency threshold, transmitting the API request to an API processing resource; if the comparison status indicates the concurrency threshold is not satisfied, impeding processing of the API request; accounting for an increase in the API concurrency value if the API request is transmitted to an API processing resource; and accounting for a decrease in the API concurrency value at a time associated with the API processing resource completing processing of the API request.

Claims

1. A method comprising:

receiving, from an external system associated with a first platform account on a communication platform system, a communication data application programming interface (API) request;

in response to receiving the communication data API request, determining a first data API concurrency value that indicates a number of communication data API requests being concurrently processed by an API processing resource of the platform system at a first point in time;

determining that the first data API concurrency value transgresses a data API concurrency threshold, the API concurrency threshold indicating a maximum number of communication data API requests that are permitted to be concurrently processed by the API processing resource;

in response to determining that the first data API concurrency value transgresses the data API concurrency threshold, delaying processing of the communication data API request;

after delaying processing of the communication data API request, determining a second data API concurrency value that indicates an estimated number of communication data API requests being concurrently processed by the API processing resource of the platform system at a second point in time, the second point in time being after the first point in time, wherein the second data API concurrency value is determined based on a determination that at least one API request being processed by the API processing resource is near completion;

determining that the second data API concurrency value does not transgress the data API concurrency threshold; and

in response to determining that the second data API concurrency value does not transgress the data API concurrency threshold, transmitting the communication data API request to the API procession resource to be processed.

2. The method of claim 1, wherein the first data API concurrency value indicates a current number of communication API requests being concurrently processed for the first platform account by the API processing resource of the platform system.

3. The method of claim 1, wherein the first data API concurrency value indicates a current number of communication data API requests being concurrently processed by the API processing resource of the platform system for a plurality of platform accounts including the first platform account.

4. The method of claim 1, wherein the communication data API request is a request for telephony call data for the first platform account.

5. The method of claim 4, wherein the telephony call data includes at least one telephony call record for the first platform account.

6. The method of claim 1, further comprising:

accounting for an increase in the first data API concurrency value responsive to transmitting the communication data API request to the API processing resource.

7. The method of claim 1, further comprising:

accounting for a decrease in the first data API concurrency value responsive to the API processing resource completing processing of the communication data API request.

8. The method of claim 1, further comprising:

responsive to transmitting the communication data API request to the API processing resource, providing the external system with communication data of the first platform account.

9. The method of claim 8, wherein the communication data includes at least one telephony call record for the first platform account.

10. The method of claim 1, wherein the communication data application programming interface (API) request is a Representational State Transfer (RESTful) API request.

11. A platform system comprising:

one or more computer processors; and

one or more computer-readable mediums storing instructions that, when executed by the one or more computer processors, cause the platform system to perform operations comprising;

receiving, from an external system associated with a first platform account on a communication platform system, a communication data application programming interface (API) request;

in response to receiving the communication data API request, determining a first data API concurrency value that indicates a number of communication data API requests being concurrently processed by an API processing resource of the platform system at a first point in time;

determining that the first data API concurrency value transgresses a data API concurrency threshold, the API concurrency threshold indicating a maximum number of communication data API requests that are permitted to be concurrently processed by the API processing resource;

in response to determining that the first data API concurrency value tansgresses the data API concurrency threshold, delaying processing of the communication data API request;

after delaying processing of the communication data API request, determining a second data API concurrency value that indicates an estimated number of communication data API requests being concurrently processed by the API processing resource of the platform system at a second point in time, the second point in time being after the first point in time, wherein the second data API concurrency value is determined based on a determination that at least one API request being processed by the API processing resource is near completion;

determining that the second data API concurrency value does not transgress the data API concurrency threshold; and

in response to determining that the second data API concurrency value does not transgress the data API concurrency threshold, transmitting the communication data API request to the API procession resource to be processed.

12. The platform system of claim 11, wherein the first data API concurrency value indicates a current number of communication API requests being concurrently processed for the first platform account by the API processing resource of the platform system.

13. The platform system of claim 11, wherein the first data API concurrency value indicates a current number of communication data API requests being concurrently processed by the API processing resource of the platform system for a plurality of platform accounts including the first platform account.

14. The platform system of claim 11, wherein the communication data API request is a request for telephony call data for the first platform account.

15. The platform system of claim 14, wherein the telephony call data includes at least one telephony call record for the first platform account.

16. The platform system of claim 11, the operations further comprising:

accounting for an increase in the first data API concurrency value responsive to transmitting the communication data API request to the API processing resource.

17. The platform system of claim 11, the operations further comprising:

accounting for a decrease in the first data API concurrency value responsive to the API processing resource completing processing of the communication data API request.

18. The platform system of claim 11, the operations further comprising:

responsive to transmitting the communication data API request to the API processing resource, providing the external system with communication data of the first platform account.

19. The platform system of claim 18, wherein the communication data includes at least one telephony call record for the first platform account.

20. The platform system of claim 11, wherein the communication data application programming interface (API) request is a Representational State Transfer (RESTful) API request.

21. A non-transitory computer-readable medium storing instructions that, when executed by one or more computer processors of the platform system, cause the platform system to perform operations comprising:

receiving, from an external system associated with a first platform account on a communication platform system, a communication data application programming interface (API) request;

in response to receiving the communication data API request, determining a first data API concurrency value that indicates a number of communication data API requests being concurrently processed by an API processing resource of the platform system at a first point in time;

determining that the first data API concurrency value transgresses a data API concurrency threshold, the API concurrency threshold indicating a maximum number of communication data API requests that are permitted to be concurrently processed by the API processing resource;

in response to determining that the first data API concurrency value transgresses the data API concurrency threshold, delaying processing of the communication data API request;

after delaying processing of the communication data API request, determining a second data API concurrency value that indicates an estimated number of communication data API requests being concurrently processed by the API processing resource of the platform system at a second point in time, the second point in time being after the first point in time, wherein the second data API concurrency value is determined based on a determination that at least one API request being processed by the API processing resource is near completion;

determining that the second data API concurrency value does not transgress the data API concurrency threshold; and

in response to determining that the second data API concurrency value does not transgress the data API concurrency threshold, transmitting the communication data API request to the API procession resource to be processed.

22. The non-transitory computer-readable medium of claim 21, wherein the first data API concurrency value indicates a current number of communication API requests being concurrently processed for the first platform account by the API processing resource of the platform system.

23. The non-transitory computer-readable medium of claim 21, wherein the communication data application programming interface (API) request is a Representational State Transfer (RESTful) API request.