FRAMEWORK FOR TESTING DISTRIBUTED SYSTEMS

• US 20200042432A1
• Filed: 07/31/2018
• Published: 02/06/2020
• Est. Priority Date: 07/31/2018
• Status: Active Grant

• Current Assignee: Nutanix Incorporated
• Original Assignee: Nutanix Incorporated
• Inventors: SHAH, Manan Hemantkumar, SAIGAL, Jagpreet Kaur, SURJAN, Kilol
• Granted Patent: US 10,642,718 B2
• Time in Patent Office: Days
• CPC Class Codes: G06F 11/263 Generation of test inputs, e.g. test vectors, patterns or sequences ; with adaptation of the tested hardware for testability with external testers
• CPC Class Codes: G06F 11/2733 Test interface between tester and unit under test
• CPC Class Codes: G06F 11/3414 Workload generation, e.g. scripts, playback
• CPC Class Codes: G06F 11/3664 Environments for testing or debugging software
• CPC Class Codes: G06F 11/3672 Test management
• CPC Class Codes: G06F 2009/45583 Memory management, e.g. access or allocation
• CPC Class Codes: G06F 2201/815 Virtual middleware or OS functionality using virtual machines to implement generic software techniques for error detection or fault masking G06F11/1484
• CPC Class Codes: G06F 9/45558 Hypervisor-specific management and integration aspects
• CPC Class Codes: G06F 9/5011 the resources being hardware resources other than CPUs, Servers and Terminals
• CPC Class Codes: G06F 9/505 considering the load

Abstract

Disclosed is an improved approach to implement testing for distributed computing systems. A switchboard framework is provided that allows tests to be dynamically generated and executed against a system under test.

Claims

1. A method, comprising:

providing a switchboard interface that displays a plurality of test workloads from a workload catalog;

generating a first configuration for one or more workloads from the plurality of test workloads selected from the switchboard interface;

generating a second configuration for a system under test that executes the one or more workloads;

allocating computing resources according to the second configuration to form the system under test;

allocating one or more processing entities according to the second configuration with regards to the one or more workloads; and

using the one or more processing entities to execute the one or more workloads to perform testing in the system under test.

2. The method of claim 1, further comprising generating a third configuration that corresponds to a test-specific configuration, the third configuration applied to configure the system under test or to configure execution of the one or more workloads to perform the testing in the system under test.

3. The method of claim 1, wherein the testing corresponds to disaster recovery testing, and the third configuration corresponds to configuration parameters specific to the disaster recovery testing.

4. The method of claim 1, wherein the first configuration for the one or more workloads includes at least one of (a) attributes specific to a particular workflow;

(b) scheduling parameters, (c) failure and success parameters, or (d) iteration parameters.

5. The method of claim 1, wherein the testing is stepped to different levels of resources usage to test the system under test with different conditions and resource allocation coverages.

6. The method of claim 1, wherein the one or more processing entities are child processes managed by a master process.

7. The method of claim 1, wherein a constraint resolver procedure is applied to check for incompatibilities between selected workflow jobs.

8. The method of claim 7, wherein the incompatibilities between the selected workflow jobs are corrected by changing a size of one or more configuration parameters.

9. The method of claim 1, wherein the system under test corresponds to a virtualization system having one or more virtual machines and one or more computing nodes configured using the first configuration.

10. A computer program product embodied on a computer usable medium, the computer readable medium having stored thereon a sequence of instructions which, when executed by a processor causes the processor to execute a method, the method comprising:

providing a switchboard interface that displays a plurality of test workloads from a workload catalog;

generating a first configuration for one or more workloads from the plurality of test workloads selected from the switchboard interface;

generating a second configuration for a system under test that executes the one or more workloads;

allocating computing resources according to the second configuration to form the system under test;

allocating one or more processing entities according to the second configuration with regards to the one or more workloads; and

using the one or more processing entities to execute the one or more workloads to perform testing in the system under test.

11. The computer program product of claim 10, wherein the computer readable medium further includes instructions for generating a third configuration that corresponds to a test-specific configuration, the third configuration applied to configure the system under test or to configure execution of the one or more workloads to perform the testing in the system under test.

12. The computer program product of claim 10, wherein the testing corresponds to disaster recovery testing, and the third configuration corresponds to configuration parameters specific to the disaster recovery testing.

13. The computer program product of claim 10, wherein the first configuration for the one or more workloads includes at least one of (a) attributes specific to a particular workflow;

(b) scheduling parameters, (c) failure and success parameters, or (d) iteration parameters.

14. The computer program product of claim 10, wherein the testing is stepped to different levels of resources usage to test the system under test with different conditions and resource allocation coverages.

15. The computer program product of claim 10, wherein the one or more processing entities are child processes managed by a master process.

16. The computer program product of claim 10, wherein a constraint resolver procedure is applied to check for incompatibilities between selected workflow jobs.

17. The computer program product of claim 16, wherein the incompatibilities between the selected workflow jobs are corrected by changing a size of one or more configuration parameters.

18. The computer program product of claim 10, wherein the system under test corresponds to a virtualization system having one or more virtual machines and one or more computing nodes configured using the first configuration.

19. A system, comprising:

a processor;

a memory for holding programmable code; and

wherein the programmable code includes instructions providing a switchboard interface that displays a plurality of test workloads from a workload catalog;

generating a first configuration for one or more workloads from the plurality of test workloads selected from the switchboard interface;

generating a second configuration for a system under test that executes the one or more workloads;

allocating computing resources according to the second configuration to form the system under test;

allocating one or more processing entities according to the second configuration with regards to the one or more workloads; and

using the one or more processing entities to execute the one or more workloads to perform testing in the system under test.

20. The system of claim 19, wherein the programmable code further comprises instructions for generating a third configuration that corresponds to a test-specific configuration, the third configuration applied to configure the system under test or to configure execution of the one or more workloads to perform the testing in the system under test.

21. The system of claim 19, wherein the testing corresponds to disaster recovery testing, and the third configuration corresponds to configuration parameters specific to the disaster recovery testing.

22. The system of claim 19, wherein the first configuration for the one or more workloads includes at least one of (a) attributes specific to a particular workflow;

(b) scheduling parameters, (c) failure and success parameters, or (d) iteration parameters.

23. The system of claim 19, wherein the one or more processing entities are child processes managed by a master process.

24. The system of claim 19, wherein a constraint resolver procedure is applied to check for incompatibilities between selected workflow jobs.