Cloud services load testing and analysis

• US 9,491,072 B2
• Filed: 07/09/2013
• Issued: 11/08/2016
• Est. Priority Date: 07/09/2013
• Status: Active Grant

• Current Assignee: Oracle International Corporation (Oracle Corporation)
• Original Assignee: Oracle International Corporation (Oracle Corporation)
• Inventors: Raghunathan, Kavitha, Balch, Nick, Masterson, John
• Primary Examiner(s): DAILEY, THOMAS J
• Application Number:
  US13/937,344
• Publication Number:
  US 20150019706A1
• Time in Patent Office: 1,218 Days
• Field of Search: None
• US Class Current: 1/1
• CPC Class Codes: G06F 11/3414 Workload generation, e.g. scripts, playback
• CPC Class Codes: G06F 11/3466 Performance evaluation by tracing or monitoring
• CPC Class Codes: G06F 11/3664 Environments for testing or debugging software
• CPC Class Codes: G06F 16/24578 using ranking
• CPC Class Codes: G06F 16/248 Presentation of query results
• CPC Class Codes: G06F 2201/875 Monitoring of systems including the internet
• CPC Class Codes: G06F 8/65 Updates security arrangements therefor G06F21/57
• CPC Class Codes: H04L 43/04 Processing captured monitoring data, e.g. for logfile generation
• CPC Class Codes: H04L 43/067 using time frame reporting

Abstract

Embodiments of the invention provide systems and methods for providing services related to managing computer systems. More specifically, embodiments of the present invention provide for providing load testing services to remote computer systems. Generally speaking, such a service can allow a customer to capture and replay realistic workloads from production to test systems. The service can help the customer evaluate the impact of change on their system performance (e.g., upgrades, patches, application changes, schema changes, impact of adding more users, hardware changes, etc.) with a real-life workload captured from production and replayed on comparable test system restored to a captured “point in time.” More specifically, the load testing service can setup and capture workloads from production systems and re-execute them with high fidelity on test copies of production databases which have the changes implemented.

Claims

1. A method for providing load testing services to one or more remote computer systems, the method comprising:

initiating by a service provider computer system one or more load testing services;

capturing by the service provider computer system through a gateway a set of data related to performance of the one or more remote computer systems;

performing by the service provider computer system one or more tests on the captured set of data;

capturing workloads by the service provider computer system through the gateway;

creating by the service provider computer system a point-in-time clone of a set of production data of the one or more remote computer systems;

generating by the service provider computer system one or more recommendations based at least in part on results of replaying the captured workloads on the point-in-time clone; and

providing by the service provider computer system through a portal a first set of one or more reports based at least in part on results of the performing the one or more tests on the captured set of data;

wherein the first set of one or more reports comprises a plurality of detected issues along with corresponding indications of severity and the one or more recommendations based at least in part on results of replaying captured workloads on the point-in-time clone.

2. The method of claim 1, wherein initiating the one or more load testing services comprises:

providing by the service provider computer system access to the one or more load testing services through the portal;

receiving by the service provider computer system through the portal a customer selection of at least one of the one or more load testing services and an indication of the one or more remote computer systems as targets of the selected at least one of the one or more load testing services; and

installing by the service provider computer system the gateway on the one or more remote computer systems indicated as targets if the gateway is not yet installed on the one or more remote computer systems indicated as targets.

3. The method of claim 2, wherein capturing the set of data related to performance of the one or more remote computer systems comprises:

monitoring by the service provider computer system through the gateway the one or more remote computer systems indicated as targets for a period of time to identify periods of peak loads for the one or more remote computer systems indicated as targets within the period of time; and

capturing by the service provider computer system through the gateway tuning set data at the identified periods of peak loads.

4. The method of claim 3, wherein identifying periods of peak loads for the one or more remote computer systems indicated as targets within the period of time further comprises:

providing by the service provider computer system through the portal an indication of the periods of peak loads for the one or more remote computer systems indicated as targets; and

receiving by the service provider computer system through the portal an indication of acceptance of the identified periods of peak loads for the one or more remote computer systems indicated as targets.

5. The method of claim 3, wherein the performing the one or more tests on the captured set of data comprises executing one or more analysis tool on the captured tuning set data.

6. The method of claim 5, wherein the providing the first set of one or more reports based at least in part on results of performing the one or more tests on the captured set of data comprises generating a report of results of executing the one or more analysis tools on the captured tuning set data and wherein the report includes one or more recommendations associated with the results.

7. The method of claim 3, wherein the performing the one or more tests on the captured set of data comprises replaying the captured workloads on the point-in-time clone of the set of production data of the one or more remote computer systems indicated as targets.

8. The method of claim 1, further comprising capturing a second set of data related to performance of the one or more remote computer systems and performing one or more additional tests on the captured second set of data, and providing through the portal a second set of one or more reports based at least in part on results of the performing the one or more additional tests on the captured second set of data after adjustments have been made to the one or more remote computer systems.

9. A system comprising:

a processor; and

a memory coupled with and readable by the processor and storing a set of instruction which, when executed by the processor, causes the processor to provide load testing services to one or more remote computer systems by;

initiating one or more load testing services;

capturing through a gateway a set of data related to performance of the one or more remote computer systems;

performing one or more tests on the captured set of data;

capturing workloads through the gateway;

creating a point-in-time clone of a set of production data of the one or more remote computer systems;

generating one or more recommendations based at least in part on results of replaying the captured workloads on the point-in-time clone; and

providing through a portal a first set of one or more reports based at least in part on results of the performing the one or more tests on the captured set of data;

wherein the first set of one or more reports comprises a plurality of detected issues along with corresponding indications of severity.

10. The system of claim 9, wherein initiating the one or more load testing services comprises:

providing access to the one or more load testing services through the portal;

receiving through the portal a customer selection of at least one of the one or more load testing services and an indication of the one or more remote computer system as targets of the selected at least one of the one or more load testing services; and

installing the gateway on the one or more remote computer systems indicated as targets if the gateway is not yet installed on the one or more remote computer systems indicated as targets.

11. The system of claim 10, wherein capturing the set of data related to performance of the one or more remote computer systems comprises:

monitoring through the gateway the one or more remote computer systems indicated as targets for a period of time to identify periods of peak loads for the one or more remote computer systems indicated as targets within the period of time; and

capturing through the gateway tuning set data at the identified periods of peak loads.

12. The system of claim 11, wherein identifying periods of peak loads for the one or more remote computer systems indicated as targets within the period of time further comprises:

providing through the portal an indication of the periods of peak loads for the one or more remote computer systems indicated as targets; and

receiving through the portal an indication of acceptance of the identified periods of peak loads for the one or more remote computer systems indicated as targets.

13. The system of claim 9, further comprising capturing a second set of data related to performance of the one or more remote computer systems and performing one or more additional tests on the captured second set of data, and providing through the portal a second set of one or more reports based at least in part on results of the performing the one or more additional tests on the captured second set of data after adjustments have been made to the one or more remote computer systems.

14. A computer-readable memory comprising a set of instruction which, when executed by a processor, causes the processor to provide load testing services to one or more remote computer systems by:

initiating one or more load testing services;

capturing through a gateway a set of data related to performance of the one or more remote computer systems;

performing one or more tests on the captured set of data;

capturing workloads through the gateway;

creating a point-in-time clone of a set of production data of the one or more remote computer systems;

generating one or more recommendations based at least in part on results of replaying the captured workloads on the point-in-time clone; and

providing through a portal a first set of one or more reports based at least in part on results of the performing the one or more tests on the captured set of data;

wherein the first set of one or more reports comprises a plurality of detected issues along with corresponding indications of severity.

15. The computer-readable memory of claim 14, wherein initiating the one or more load testing services comprises:

providing access to the one or more load testing services through the portal;

receiving through the portal a customer selection of at least one of the one or more load testing services and an indication of the one or more remote computer system as targets of the selected at least one of the one or more load testing services; and

installing the gateway on the one or more remote computer systems indicated as targets if the gateway is not yet installed on the one or more remote computer systems indicated as targets.

16. The computer-readable memory of claim 15, wherein capturing the set of data related to performance of the one or more remote computer systems comprises:

monitoring through the gateway the one or more remote computer systems indicated as targets for a period of time to identify periods of peak loads for the one or more remote computer systems indicated as targets within the period of time; and

capturing through the gateway tuning set data at the identified periods of peak loads.

17. The computer-readable memory of claim 16, wherein identifying periods of peak loads for the one or more remote computer systems indicated as targets within the period of time further comprises:

providing through the portal an indication of the periods of peak loads for the one or more remote computer systems indicated as targets; and

receiving through the portal an indication of acceptance of the identified periods of peak loads for the one or more remote computer systems indicated as targets.