Testing a cloud service

• US 10,671,508 B2
• Filed: 11/19/2014
• Issued: 06/02/2020
• Est. Priority Date: 09/25/2014
• Status: Active Grant

• Current Assignee: The Conundrum IP LLC (UiPath Inc.)
• Original Assignee: Hewlett Packard Enterprise Development LP (Hewlett-Packard Enterprise Company)
• Inventors: Gopu, Upendra, Kadambala, Anusha, Manickam, Siva Subramaniam
• Primary Examiner(s): Chang, Jungwon
• Application Number:
  US15/500,005
• Publication Number:
  US 20170242774A1
• Time in Patent Office: 2,022 Days
• Field of Search: 709224, 717124
• CPC Class Codes: G06F 11/3006 where the computing system is distributed, e.g. networked systems, clusters, multiprocessor systems multiprogramming arrangements G06F9/46; allocation of resources G06F9/50
• CPC Class Codes: G06F 11/3409 for performance assessment
• CPC Class Codes: G06F 11/3433 for load management allocation of a server based on load conditions G06F9/505; load rebalancing G06F9/5083; redistributing the load in a network by a load balancer H04L67/1029
• CPC Class Codes: G06F 11/3688 for test execution, e.g. scheduling of test suites
• CPC Class Codes: H04L 41/06 Management of faults, events, alarms or notifications
• CPC Class Codes: H04L 41/50 Network service management, e.g. ensuring proper service fulfilment according to agreements
• CPC Class Codes: H04L 43/08 Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters
• CPC Class Codes: H04L 67/10 in which an application is distributed across nodes in the network software deployment G06F8/60; multiprogramming arrangements G06F9/46

Abstract

Some examples described herein relate to testing of a cloud service. In an example, a cloud service to be tested may be deployed in a cloud system. A test load may be applied to the cloud service. Upon application of the test load to the cloud service, a determination may be made whether a performance metric related to the cloud service meets a pre-configured criterion. If the performance metric related to the cloud service meets a pre-configured criterion, the cloud service may be scaled. Operations of applying, determining, and scaling may iterated until an end condition is met, wherein the test load applied to the cloud service may vary after each iteration operation.

Claims

1. A method of testing a cloud service, comprising:

deploying a cloud service to be tested in a cloud system;

applying a test load to the cloud service, wherein the test load relates to a number of users accessing the cloud service;

determining, upon application of the test load to the cloud service, whether a performance metric related to the cloud service meets a pre-configured criterion;

if the performance metric related to the cloud service meets the pre-configured criterion, scaling the cloud service by increasing the number of users to a next level on a pre-defined scale; and

iterating the applying, the determining, and the scaling until an end condition is met, wherein the test load applied to the cloud service varies after each iteration, and wherein iterated test loads simulate different field usage patterns.

2. The method of claim 1, wherein the end condition comprises achieving a final level on the pre-defined scale used for scaling the cloud service.

3. The method of claim 1, wherein the end condition comprises expiration of a time period.

4. The method of claim 1, wherein the end condition comprises triggering of a monitoring alarm.

5. The method of claim 1, further comprising monitoring resources deploying the cloud service.

6. The method of claim 5, wherein the monitored resources are underlying hardware resources for deploying the cloud service.

7. The method of claim 6, further comprising triggering a monitoring alarm responsive to a failure of the underlying hardware resources during application of the test load to the cloud service.

8. A system for testing a cloud service, comprising:

a deployment module to deploy a cloud service to be tested in a cloud system;

a test module to apply a test load to the cloud service, wherein the test load relates to a number of users accessing the cloud service;

a metric module to determine, upon application of the test load to the cloud service, whether a performance metric related to the cloud service meets a pre-configured criterion;

a scaling module to scale the cloud service by increasing the number of users to a next level on a pre-defined scale if the performance metric meets the pre-configured criterion; and

an iteration module to iterate operations of applying, determining, and scaling until an end condition is met, wherein the test load applied to the cloud service varies after each iteration, and wherein iterated test loads simulate different field usage patterns.

9. The system of claim 8, wherein the pre-configured criterion varies after each iteration operation.

10. The system of claim 8, wherein the cloud service is a cloud-based application.

11. The system of claim 8, wherein the cloud system is one of a public cloud, a private cloud, and a hybrid cloud.

12. The system of claim 8, wherein to apply the test load to the cloud service comprises configuring a pre-determined number of users to access the cloud service in the cloud system.

13. The system of claim 8, wherein the end condition comprises triggering of a monitoring alarm responsive to a failure of monitored resources for deploying the cloud service.

14. A non-transitory machine-readable storage medium

storing instructions for testing a cloud service, the non-transitory machine-readable storage medium comprising:

instructions to deploy a cloud service to be tested in a cloud system;

instructions to apply a test load to the cloud service, wherein the test load relates to a number of users accessing the cloud service;

instructions to determine, upon application of the test load to the cloud service, whether a performance metric related to the cloud service meets a pre-configured criterion;

instructions to scale the cloud service by increasing the number of users to a next level on a pre-defined scale if the performance metric meets the pre-configured criterion; and

instructions to iterate the instructions to apply, the instructions to determine, and the instructions to scale until an end condition is met, wherein a different test load is applied to the cloud service after each iteration, and wherein iterated test loads simulate different field usage patterns.

15. The storage medium of claim 14, wherein the performance metric comprises a response time metric related to an interface of the cloud service.

16. The storage medium of claim 15, wherein the interface includes one of a user interface, an application programming interface, and a command line interface.

17. The storage medium of claim 14, wherein the end condition comprises one of achieving a final level on the pre-defined scale, expiration of a time period, and triggering of a monitoring alarm.

18. The storage medium of claim 14, wherein the pre-defined scale is changeable during the iterate operations of applying, determining, and scaling.

19. The storage medium of claim 14, wherein the end condition comprises triggering of a monitoring alarm responsive to a failure of monitored resources for deploying the cloud service.