Method and system for dynamically tagging metrics data

• US 8,429,187 B2
• Filed: 03/21/2011
• Issued: 04/23/2013
• Est. Priority Date: 03/21/2011
• Status: Active Grant

• Current Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Original Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Inventors: Theimer, Marvin M., Brandwine, Eric J., Brown, David, Brooker, Marc J., Fuller, Erik J.
• Primary Examiner(s): NGUYEN, KIM T
• Application Number:
  US13/053,143
• Publication Number:
  US 20120246157A1
• Time in Patent Office: 764 Days
• Field of Search: 707/769, 717/127
• US Class Current: 707/769
• CPC Class Codes: G06F 11/3409 for performance assessment
• CPC Class Codes: G06F 11/3476 Data logging G06F11/14, G06F11/2205 take precedence
• CPC Class Codes: G06F 2201/815 Virtual middleware or OS functionality using virtual machines to implement generic software techniques for error detection or fault masking G06F11/1484
• CPC Class Codes: G06F 8/77 Software metrics

Abstract

Embodiments of systems and methods are described for dynamically tagging metrics data by a provider of computing resources. In some implementations, a requesting user or application can request the provider of computing resources to tag the metrics based on configurations and/or settings specified by the requesting user or application. The tagged metrics data can then be processed by a processing user or application at a later time.

Claims

1. A system for tagging metrics, the system comprising:

a computer system comprising computer hardware, the computer system managing a virtualization infrastructure generated on behalf of multiple users, wherein the computer system comprises one or more computing nodes and is programmed to implement;

a default tagging module configured to tag metrics related to performance of the one or more computing nodes with default tags comprising key and value pairs, by at least associating the default tags with the metrics;

an acquisition module configured to receive at least one additional tag comprising a key and one or more criteria for the at least one additional tag from a requesting user or application, wherein the at least one additional tag has a different key than the default tags;

a processing module configured to analyze the at least one additional tag to determine one or more computing nodes to communicate with in order to dynamically tag the metrics with the at least one additional tag based at least in part on the one or more criteria for the at least one additional tag; and

a tagging module configured to communicate with the determined one or more computing nodes to request tagging of the one or more metrics with the at least one additional tag, thereby producing tagged metrics that may subsequently be aggregated, wherein tagging of the one or more metrics comprises;

associating the at least one additional tag dynamically with each metric in a subset of the metrics if the one or more criteria for the at least one additional tag are satisfied by each metric in the subset of metrics, and

assigning a dynamic value to the at least one additional tag for each metric in the subset of metrics that the at least one additional tag is associated with, based at least in part on the key of the at least one additional tag.

2. The system of claim 1, wherein the acquisition module is further configured to receive at least one of the at least one additional tags from the requesting user.

3. The system of claim 2, wherein at least one of the tags received from the requesting user relates to a billing identifier associated with the requesting user.

4. The system of claim 1, wherein the tagging module is further configured to tag the one or more metrics by communicating with the plurality of computing nodes.

5. The system of claim 1, wherein the tagged metrics are configured to be aggregated by a processing user or application.

6. The system of claim 1, wherein the acquisition module is further configured to enable a user to specify the at least one additional tag.

7. The system of claim 6, wherein the acquisition module is further configured to enable a user to specify the key of the at least one additional tag.

8. A method of tagging metrics, the method comprising:

by one or more computer systems comprising computer hardware;

tagging one more metrics with default tags comprising key and value pairs;

receiving at least one additional tag comprising a key and one or more criteria for the at least one additional tag from a requesting user or application, wherein the at least one additional tag has a different key than the default tags;

analyzing the at least one additional tag to determine one or more computing nodes to communicate with in order to tag the one or more metrics with the at least one additional tag based at least in part on the one or more criteria for the at least one additional tag; and

communicating with the determined one or more computing nodes to request tagging of the one or more metrics with the at least one additional tag, thereby producing tagged metrics to subsequently be processed, wherein tagging of the one or more metrics with the at least one additional tag comprises;

associating the at least one additional tag dynamically with each metric in a subset of the one or more metrics if the one or more criteria for the at least one additional tag are satisfied by each metric in the subset of one or more metrics, and

assigning a dynamic value to the at least one additional tag for each metric in the subset of one or more metrics that the at least one additional tag is associated with, based at least in part on the key of the at least one additional tag.

9. The method of claim 8, further comprising communicating with the plurality of computing nodes using an application programming interface.

10. The method of claim 8, further comprising receiving at least one modification to the at least one additional tag from the requesting user or application and performing the analyzing and communicating steps based at least upon the at least one modification.

11. The method of claim 8, wherein at least one of the computing nodes comprises one or more of the following:

a load balancer, a firewall, a physical machine, a virtual machine, a storage node, and a database server.

12. The method of claim 8, wherein the tagged metrics are processed by a processing user or application.

13. The method of claim 12, further comprising outputting the tagged metrics to the processing user or the processing application.

14. The method of claim 12, wherein at least one of the at least one additional tags is from the requesting application.

15. The method of claim 14, wherein the requesting application and processing application are different.

16. The method of claim 12, wherein at least one of the at least one additional tags is from the requesting user.

17. The method of claim 16, wherein the requesting user and processing user are different.

18. Non-transitory physical storage comprising executable instructions stored thereon, the executable instructions configured to cause a computing system to at least:

receive at least one tag to be used in tagging data and one or more criteria for the at least one tag from a requesting user or application, wherein the at least one tag comprises at least one key;

analyze the at least one tag to determine one or more computing nodes to communicate with in order to tag the data with the tags based at least in part on the one or more criteria for the at least one tag; and

communicate with the determined one or more computing nodes to request tagging of the data with the tags, thereby producing tagged data to subsequently be processed, wherein tagging of the data comprises;

associating the at least one tag dynamically with the data if the one or more criteria for the at least one tag are satisfied by the data, and

assigning a dynamic value to the at least one tag, based at least in part on the key of the at least one tag.

19. The non-transitory physical storage of claim 18, wherein the tagged data is configured to be processed by a processing user or application.

20. The non-transitory physical storage of claim 19, further comprising outputting the tagged data to the processing user or the processing application.

21. The non-transitory physical storage of claim 19, wherein at least one of the at least one tag is received from the requesting application.

22. The non-transitory physical storage of claim 21, wherein the requesting application and processing application are different.

23. The non-transitory physical storage of claim 19, wherein at least one of the at least one tag is received from the requesting user.

24. The non-transitory physical storage of claim 23, wherein the requesting user and processing user are different.

25. The non-transitory physical storage of claim 18, in combination with a computing device that is configured to execute the executable instructions.

26. A method of tagging metrics, the method comprising:

by a computer system comprising computer hardware;

receiving at least one additional tag to be used in tagging metrics and one or more criteria for the at least one additional from a requesting user or application, wherein the at least one additional tag comprises at least one key that is different than keys of default tags associated with the metrics;

tagging metrics with the at least one additional tag based at least in part on the one or more criteria for the at least one additional tag, wherein tagging the metrics comprises;

associating the at least one additional tag dynamically with each metric in a subset of the metrics if the one or more criteria for the at least one additional tag are satisfied by each metric in the subset of metrics, and

assigning a dynamic value to the at least one additional tag for each metric in the subset of metrics that the at least one additional tag is associated with; and

outputting the tagged metrics and the at least one additional tag.

27. The method of claim 26, wherein the tagged metrics are outputted to a processing user or application.

28. The method of claim 26, wherein at least one of the at least one additional tags is from the requesting application.

29. The method of claim 26, wherein the computing system comprises a plurality of computing devices.