Cost determination of a service call

• US 10,783,002 B1
• Filed: 01/24/2017
• Issued: 09/22/2020
• Est. Priority Date: 06/07/2013
• Status: Active Grant

• Current Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Original Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Inventors: Dubey, Gaurav, Fewtrell, Zachary Ganwise, Jadhav, Manoj Bhagwan
• Primary Examiner(s): Patel, Hiren P
• Application Number:
  US15/413,575
• Time in Patent Office: 1,337 Days
• Field of Search: None
• CPC Class Codes: G06F 11/3003 Monitoring arrangements specially adapted to the computing system or computing system component being monitored
• CPC Class Codes: G06F 11/3006 where the computing system is distributed, e.g. networked systems, clusters, multiprocessor systems multiprogramming arrangements G06F9/46; allocation of resources G06F9/50
• CPC Class Codes: G06F 11/302 where the computing system component is a software system
• CPC Class Codes: G06F 11/3072 where the reporting involves data filtering, e.g. pattern matching, time or event triggered, adaptive or policy-based reporting
• CPC Class Codes: G06F 11/3082 the data filtering being achieved by aggregating or compressing the monitored data
• CPC Class Codes: G06F 11/34 Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation ; Recording or statistical evaluation of user activity, e.g. usability assessment
• CPC Class Codes: G06F 11/3409 for performance assessment
• CPC Class Codes: G06F 11/3428 Benchmarking
• CPC Class Codes: G06F 11/3452 Performance evaluation by statistical analysis
• CPC Class Codes: G06F 2201/81 Threshold
• CPC Class Codes: G06F 2201/865 Monitoring of software
• CPC Class Codes: G06F 9/5005 to service a request
• CPC Class Codes: G06Q 30/04 Billing or invoicing

Abstract

Computing platforms may enable clients to use services to perform data processing jobs. A given job may utilize several services in a service call pattern. Each of these services consumes resources during execution. Described herein are systems, devices, and methods for determining costs associated with performance of a service call pattern. Weight data may be generated for each service using various metrics. As service calls are made in the service call pattern, an accumulated weight value is generated which is indicative of the weight data of the services in the service call pattern. The accumulated weight data may represent metrics such as amounts of resources consumed, latency, and transactions per second.

Claims

1. A method performed by one or more computing devices,

the method comprising:

performing, with a first service, a first task that produces first service data;

generating, with the first service, first weight data indicative of the performance of the first task;

providing the first service data and the first weight data to a second service;

performing, with the second service, a second task that uses at least a portion of the first service data to generate second service data;

generating, with the second service, second weight data indicative of the performance of the second task;

generating, with the second service, accumulated weight data based on the first weight data and the second weight data; and

providing the second service data and the accumulated weight data to a third service that performs a third task.

2. The method of claim 1, further comprising:

generating, with the third service, third service data; and

generating response data comprising the third service data and the accumulated weight data.

3. The method of claim 2, further comprising:

receiving a first service call from a first computing device, wherein the performing of the first task is responsive to the first service call;

generating a second service call comprising the first service data and the first weight data, wherein the performing of the second task is responsive to the second service call;

generating a third service call comprising the second service data and the accumulated weight data, wherein the third service generates the third service data responsive to the third service call; and

sending the response data to the first computing device.

4. The method of claim 1, wherein one or more of the first weight data or the second weight data are indicative of one or more of:

processor cycles consumed during data processing,

latency associated with the data processing,

transactions per second associated with the data processing,

disk usage associated with the data processing, or

number of cache lookups associated with the data processing.

5. A system, comprising:

at least one memory storing computer-executable instructions; and

at least one processor in communication with the at least one memory, the at least one processor configured to access the at least one memory and execute the computer-executable instructions to;

generate first weight data using a first service configured to perform first data processing of a first request, wherein the first weight data is indicative of performance of a first computational task by the first service;

generate second weight data using a second service configured to perform second data processing dependent on a response to the first request, wherein the second weight data is indicative of performance of a second computational task by the second service;

generate accumulated weight data using the second service, wherein the accumulated weight data is generated based on the first weight data and the second weight data, the accumulated weight data comprising information indicative of resource usage associated with the first data processing and the second data processing; and

provide the accumulated weight data to a third service configured to perform a third computational task.

6. The system of claim 5, wherein:

the first service is executed by a first server;

the second service is executed by a second server; and

the second weight data is indicative of one or more of;

processor cycles consumed,

latency associated with the second data processing,

transactions per second associated with the second data processing,

disk usage associated with the second data processing, or

number of cache lookups associated with the second data processing.

7. The system of claim 5, further comprising computer-executable instructions to:

generate metric data during the performance of the second data processing; and

generate the second weight data using the metric data.

8. The system of claim 5, further comprising computer-executable instructions to:

generate metric data that includes a plurality of metric values representative of a plurality of metrics associated with the second data processing; and

generate the second weight data by applying predetermined weight factors to the plurality of metric values.

9. The system of claim 5, wherein the resource usage includes at least one of memory usage or processor usage.

10. The system of claim 5, further comprising computer-executable instructions to:

generate third weight data using the third service; and

update, using the third service, the accumulated weight data using the third weight data.

11. The system of claim 5, further comprising computer-executable instructions to:

receive first service data from the first service;

generate second service data using the first service data, the second service data comprising a result of the second computational task; and

transmit the second service data to the third service.

12. The system of claim 11, wherein the second service data is transmitted separately from the accumulated weight data.

13. The system of claim 5, further comprising computer-executable instructions to:

determine that a value associated with the accumulated weight data is equal to or greater than a threshold value; and

generate alarm data indicating an occurrence of the value associated with the accumulated weight data being equal to or greater than the threshold value.

14. The system of claim 5, further comprising computer-executable instructions to:

allocate resources based on the accumulated weight data, the resources including at least one of memory or processor.

15. The system of claim 5, further comprising computer-executable instructions to:

generate, using the accumulated weight data, invoice data representing one or more costs associated with the first data processing and the second data processing.

16. The system of claim 5, further comprising computer-executable instructions to:

generate the accumulated weight data at one or more of a predetermined time or one or more random time periods.

17. The system of claim 5, wherein a fourth service provides third weight data to the second service, and the accumulated weight data is further generated based on the third weight data.

18. A system, comprising:

at least one memory storing computer-executable instructions; and

at least one processor in communication with the at least one memory, the at least one processor configured to access the at least one memory and execute the computer-executable instructions to;

at a first point in time with a first service processing a first computational task, receive first weight data associated with a predecessor computational task of the first computational task;

generate, with the first service, first accumulated weight data associated with the first computational task, the first accumulated weight data based on the first weight data and a first amount of resources consumed by the first service to perform the first computational task at the first point in time;

provide the first accumulated weight data to a second service configured to perform a second computational task;

at a second point in time with the first service, receive second weight data associated with the predecessor computational task;

generate, with the first service, second accumulated weight data based on the second weight data and a second amount of resources consumed by the first service to perform the first computational task at the second point in time;

compare the first accumulated weight data and the second accumulated weight data; and

generate alarm data based on the comparison.

19. The system of claim 18, further comprising second computer-executable instructions, the at least one processor further configured to access the at least one memory and the second computer-executable instructions to:

calculate a difference between the first accumulated weight data and the second accumulated weight data; and

generate the alarm data further based at least in part on the difference meeting or exceeding a threshold value.

20. The system of claim 18, further comprising second computer-executable instructions, the at least one processor further configured to access the at least one memory and the second computer-executable instructions to receive the first plurality of weight data after an occurrence of a predetermined number of service calls.