Adaptive service timeouts

• US 10,263,876 B2
• Filed: 03/21/2016
• Issued: 04/16/2019
• Est. Priority Date: 09/18/2012
• Status: Active Grant

• Current Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Original Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Inventors: Kraev, Kaloyan K.
• Primary Examiner(s): Huynh, Kim
• Assistant Examiner(s): Chang, Eric
• Application Number:
  US15/075,898
• Publication Number:
  US 20160205010A1
• Time in Patent Office: 1,121 Days
• CPC Class Codes: G06F 1/14 Time supervision arrangements, e.g. real time clock
• CPC Class Codes: G06F 2209/504 Resource capping
• CPC Class Codes: G06F 9/5022 Mechanisms to release resources
• CPC Class Codes: H04L 43/024 by adaptive sampling
• CPC Class Codes: H04L 43/106 using time related information in packets, e.g. by adding timestamps
• CPC Class Codes: H04L 43/16 Threshold monitoring
• CPC Class Codes: Y02D 10/00 Energy efficient computing, e.g. low power processors, power management or thermal management

Abstract

Disclosed are various embodiments for a timeout management application. Latency data for executing services is obtained. The used service capacity is calculated. If the service capacity is outside of a predefined range, the timeout of a selected service is reconfigured.

Claims

1. A system, comprising:

at least one computing device configured to at least;

monitor a first latency corresponding to a first service;

monitor a second latency corresponding to a second service; and

reconfigure a timeout associated with a pair of services including the first and second services based at least in part on the first and second latencies, the timeout defining a maximum time to complete a call to the first service of the pair of services when called by the second service of the pair of services.

2. The system of claim 1, wherein the at least one computing device is further configured to at least calculate an aggregate latency relative to a time interval based at least in part on the first latency and second lantency, and the timeout is further based at least in part on the aggregate latency.

3. The system of claim 1, wherein the at least one computing device is further configured to at least reconfigure the timeout further based at least in part on an amount of used service capacity.

4. The system of claim 3, wherein the at least one computing device is further configured to at least increase the timeout in response to the amount of used service capacity relative to a total service capacity falling below a threshold.

5. The system of claim 3, wherein the at least one computing device is further configured to at least decrease the timeout in response to the amount of used service capacity relative to a total service capacity exceeding a threshold.

6. The system of claim 3, wherein the at least one computing device is further configured to at least select the first service of the pair of services based at least in part on a subset of the amount of the service capacity used by the first service.

7. The system of claim 1, wherein the at least one computing device is further configured to at least select the first service of the pair of services based at least in part on a service priority list.

8. The system of claim 1, wherein the at least one computing device is further configured to at least select the first service of the pair of services based at least in part on a reliability threshold.

9. The system of claim 1, wherein the at least one computing device is further configured to at leas monitor the first and second latencies by obtaining log data from the first and second services.

10. A method, comprising:

monitoring, by at least one computing device, a first latency corresponding to a first service;

monitoring, by the at least one computing device, a second latency corresponding to a second service; and

reconfiguring, by the at least one computing device, a timeout associated with a pair of services including and first and second services based at least in part on the first and second latencies, the timeout defining a maximum time to complete a call to the first service of the pair of services when called by the second service of the pair of services.

11. The method of claim 10, further comprising calculating, by the at least one computing device, an aggregate latency relative to a time interval based at least in part on the first latency and the second latency, wherein the timeout is further based at least in part on the aggregate latency.

12. The method of claim 10, wherein the timeout is further based at least in part on an amount of used service capacity.

13. The method of claim 12, wherein the timeout is increased in response to the amount of used service capacity relative to a total service capacity falling below a threshold.

14. The method of claim 12, wherein the timeout is decreased in response to the amount of used service capacity relative to a total service capacity exceeding a threshold.

15. The method of claim 12, further comprising selecting, by the at least one computing device, the first service of the pair of services based at least in part on a subset of the amount of the service capacity used by the first service.

16. The method of claim 10, further comprising selecting, by the at least one computing device, the first service of the pair of services based at least in part on a service priority list, wherein the timeout is associated with the selected one of the services.

17. The method of claim 10, further comprising selecting, by the at least one computing device, the first service of the pair of services based at least in part on a reliability threshold.

18. A non-transitory computer-readable medium embodying a program executable in at least one computing device, the program, when executed, causing the at least one computing device to at least:

obtain a first set of information from a first service, the first set of information indicating at least first latency data associated with processing requests with the first service and a first current capacity of the first service; and

obtain a second set of information from a second service, the second set of information indicating second latency data associated with processing requests with the second service, and a second current capacity of the second service;

determine, for a time interval, a first timeout value for the first service based at least in part on the first set of information obtained and a second timeout value for the second service based at least in part on the second set of information obtained, the first timeout value for the first service defining a maximum time to complete a call to the first service when called by the second service; and

send, for the time interval, the first timeout value to the first service and the second timeout value to the second service, wherein the first service is configured to adjust a first timeout based at least in part on the first timeout value and the second service is configured to adjust a second timeout threshold based at least in part on the second timeout value.

19. The non-transitory computer-readable medium of claim 18, wherein the program further causes the at least one computing device to select the first service or the second service based at least in part on a reliability threshold.

20. The non-transitory computer-readable medium of claim 18, wherein at least one of the first timeout value or the second timeout value is based at least in part on an amount of used service capacity.