Systems and methods of implementing tracking of resource usage for a cloud-based system

• US 10,397,309 B2
• Filed: 05/13/2015
• Issued: 08/27/2019
• Est. Priority Date: 05/13/2015
• Status: Active Grant

• Current Assignee: Salesforce.com, Inc.
• Original Assignee: Salesforce.com, Inc.
• Inventors: Wunderlich, James Bock, Junod, Forrest, Fee, Gregory D., Boilen, Mike, Chen, Nicholas Chun Yuan
• Primary Examiner(s): Chang, Tom Y
• Application Number:
  US14/711,485
• Publication Number:
  US 20160337215A1
• Time in Patent Office: 1,567 Days
• CPC Class Codes: H04L 41/22 comprising specially adapted graphical user interfaces [GUI]
• CPC Class Codes: H04L 41/5096 wherein the managed service relates to distributed or central networked applications
• CPC Class Codes: H04L 43/091 Measuring contribution of individual network components to actual service level
• CPC Class Codes: H04L 67/10 in which an application is distributed across nodes in the network software deployment G06F8/60; multiprogramming arrangements G06F9/46

Abstract

The technology disclosed describes systems and methods for implementing global profiling to track resource usage and performance for multiple threads across multiple servers for a cloud-based system. This disclosed technology provides global profiling to track resource usage across any part of a transaction as it passes between layers of a computing stack regardless of the language being executed, on logically different virtual machines across multiple servers. After data collection stops, the disclosed technology combines the results into a configurable profile view that accurately represents the order of execution of applications and methods, as though they ran on one machine. The disclosed technology builds multiple formats of the data files for different display visualizations.

Claims

1. A method comprising:

setting filters to control a scope of tracking at least one of service entry data and service exit data, across multiple services running on multiple hardware instances, wherein the setting the filters comprises configuring transaction invocations to invoke cascading service invocations of the multiple services;

running an interpreter, configured to be run as an instance on the multiple hardware instances, to specify a profiled service, profiled method, or profiled class, corresponding to the service entry data or the service exit data for tracking as set in the filters, to receive a transaction ID among the multiple services, and to spawn an autonomous log unit upon entry or exit of any of the multiple services that correspond to the profiled service, profiled method, or profiled class, at an event boundary corresponding to the entrance or the exit;

applying the filters so that the autonomous log unit records at least one of the entry and exit of the multiple services corresponding to the profiled service, profiled method, or profiled class,

wherein, as a result of a given transaction invocation of the transaction invocations, the data captured by the autonomous log unit comprises;

a transaction ID configured to span services and classes invoked following the given transaction invocation,

a URI for the given transaction invocation,

an identifier for the service or class entered or exited,

a time stamp of a given service entry of the service entries or a given service exit of the service exits; and

a CPU time corresponding to the given transaction invocation;

analyzing performance of at least some of the transaction invocations by organizing the data captured by the autonomous log unit across the multiple services, organizing the autonomous log unit into nested service invocations by corresponding transaction IDs of the transaction invocations, and generating a single profile view of performance metrics of the cascading service invocations;

persisting results of the analyzing;

implementing service protection process that comprises determining, based on the single profile view, that the CPU time corresponding to the given transaction invocation exceeds a maximum CPU time corresponding to the given transaction; and

upon the determining that the CPU time corresponding to the given transaction invocation exceeds a maximum CPU time corresponding to the given transaction invocation, enforcing the governor limit for the given transaction invocation via the interpreter, wherein the maximum CPU time is determined based at least in part on whether the given transaction invocation corresponds to a synchronous process or to an asynchronous process.

2. The method of claim 1, wherein service invocation wrappers invoke the autonomous log unit for the multiple services.

3. The method of claim 1, further comprising receiving a selection of a test profile and setting the filters with values from the test profile.

4. The method of claim 1, wherein the maximum CPU time corresponding to the given transaction invocation is a predetermined value depending on whether the given transaction invocation corresponds to a synchronous process or an asynchronous process.

5. The method of claim 1, wherein setting the filters further includes setting a selected user ID, and wherein the captured data for each service entered further includes the selected user ID.

6. The method of claim 1, wherein setting the filters further includes setting a selected organization ID, and the captured data for each service entered further includes the selected organization ID.

7. The method of claim 1, wherein the captured data for each service entered further includes an identifier for a calling service that invoked the service entered.

8. The method of claim 1, wherein the captured data for each service entered further includes a URI for the service entered.

9. The method of claim 1, wherein the filters include a minimum elapsed time threshold to be met before invoking the autonomous log unit.

10. The method of claim 1, wherein the filters include a set of server IDs for servers from which the multiple services are configured to capture data.

11. The method of claim 1, wherein a scope of profile reporting is limited by an option to mark a service or class as a terminal profiling level, whereby child services or classes invoked by the marked service or class are hidden when reporting the results of analyzing the performance.

12. A computer implemented system applied to tracking resource usage of a cloud based system, the computer implemented system including:

a processor; and

memory coupled to the processor, wherein the processor is configured to perform operations comprising;

setting filters to control a scope of tracking at least one of service entry data and service exit data across multiple services running on multiple hardware instances, wherein the setting the filters comprises configuring transaction invocations to invoke cascading service invocations of the multiple services;

running an interpreter, configured to be run as an instance on the multiple hardware instances, to specify a profiled service, profiled method, or profiled class, corresponding to the service entry data or the service exit data for tracking as set in the filters, to receive a transaction ID among the multiple services, and to spawn an autonomous log unit upon entry or exit of any of the multiple services that correspond to the profiled service, profiled method, or profiled class, at an event boundary corresponding to the entrance or the exit;

applying the filters so that the autonomous log unit records at least one of the entry and exit of the multiple services corresponding to the profiled service, profiled method, or profiled class,

wherein, as a result of a given transaction invocation of the transaction invocations, the data captured by the autonomous log unit comprises;

a transaction ID configured to span services and classes invoked following the given transaction invocation,

a URI for the given transaction invocation,

an identifier for the service or class entered or exited,

a time stamp of a given service entry of the service entries or a given service exit of the service exits; and

a CPU time corresponding to the given transaction invocation;

analyzing performance of at least some of the transaction invocations, by organizing the data captured by the autonomous log unit across the multiple services, organizing the autonomous log unit into nested service invocations by corresponding transaction IDs of the transaction invocations, and generating a single profile view of performance metrics of the cascading service invocations;

persisting results of the analyzing;

implementing service protection process that comprises determining, based on the single profile view, that the CPU time corresponding to the given transaction invocation exceeds a maximum CPU time corresponding to the given transaction; and

upon the determining that the CPU time corresponding to the given transaction invocation exceeds a maximum CPU time corresponding to the given transaction invocation, enforcing the governor limit for the given transaction invocation via the interpreter, wherein the maximum CPU time is determined based at least in part on whether the given transaction invocation corresponds to a synchronous process or to an asynchronous process.

13. The computer implemented system of claim 12, wherein service invocation wrappers invoke the autonomous log unit for the multiple services.

14. The computer implemented system of claim 12, wherein the maximum CPU time corresponding to the given transaction invocation is a predetermined value depending on whether the given transaction invocation corresponds to a synchronous process or an asynchronous process.

15. The computer implemented system of claim 12, wherein the setting the filters further includes setting a selected user ID, and wherein the captured data for each service entered further includes the selected user ID.

16. The computer implemented system of claim 12, wherein setting the filters further includes setting a selected organization ID, and the captured data for each service entered further includes the selected organization ID.

17. The computer implemented system of claim 12, wherein the captured data for each service entered further includes a URI for the service entered.

18. The computer implemented system of claim 12, wherein the filters include a minimum elapsed time threshold to be met before invoking the autonomous log unit.

19. A non-transitory computer-readable storage medium that stores program instructions that implement tracking resource usage of a cloud based system, wherein the instructions, when executed by at least one processor, cause the at least one processor to perform operations including:

setting filters to control a scope of tracking at least one of service entry data and service exit data across multiple services running on multiple hardware instances, wherein the setting the filters comprises configuring transaction invocations to invoke cascading service invocations of the multiple services;

running an interpreter, configured to be run as an instance, on the multiple hardware instances, to specify a profiled service, profiled method, or profiled class, corresponding to the service entry data or the service exit data for tracking as set in the filters, to receive a transaction ID among the multiple services, and to spawn an autonomous log unit upon entry or exit of profiled services or classes, at an event boundary corresponding to the entrance or the exit;

applying the filters so that the autonomous log unit records at least one of the entry and exit of the multiple services corresponding to the profiled service, profiled method, or profiled class,

wherein, as a result of a given transaction invocation of the transaction invocations, the data captured by the autonomous log unit comprises;

a transaction ID configured to span services and classes invoked following the given transaction invocation,

a URI for the given transaction invocation,

an identifier for the service or class entered or exited,

a time stamp of a given service entry of the service entries or a given service exit of the service exits; and

a CPU time corresponding to the given transaction invocation;

analyzing performance of at least some of the transaction invocations organizing the data captured by the autonomous log unit across the multiple services, organizing the autonomous log unit into nested service invocations by corresponding transaction IDs of the transaction invocations, and generating a single profile view of performance metrics of the cascading service invocations;

persisting results of the analyzing;

implementing service protection process that comprises determining, based on the single profile view, that the CPU time corresponding to the given transaction invocation exceeds a maximum CPU time corresponding to the given transaction; and

upon the determining that the CPU time corresponding to the given transaction invocation exceeds a maximum CPU time corresponding to the given transaction invocation, enforcing the governor limit for the given transaction invocation via the interpreter, wherein the maximum CPU time is determined based at least in part on whether the given transaction invocation corresponds to a synchronous process or to an asynchronous process.

20. The non-transitory computer-readable storage medium of claim 19, wherein service invocation wrappers invoke the autonomous log unit for the multiple services.

21. The non-transitory computer-readable storage medium of claim 19, further comprising receiving a selection of a test profile and setting the filters with values from the test profile.

22. The non-transitory computer-readable storage medium of claim 19, wherein setting the filters further includes setting a selected user ID, and wherein the captured data for each service entered further includes the selected user ID.

23. The non-transitory computer-readable storage medium of claim 19, wherein setting the filters further includes setting a selected organization ID, and the captured data for each service entered further includes the selected organization ID.

24. The non-transitory computer-readable storage medium of claim 19, wherein the captured data for each service entered further includes an identifier for a calling service that invoked the service entered.

25. The non-transitory computer-readable storage medium of claim 19, wherein the filters include a set of server IDs for servers from which the multiple services are configured to capture data.