Load adaptation architecture framework for orchestrating and managing services in a cloud computing system

• US 10,374,971 B2
• Filed: 08/21/2017
• Issued: 08/06/2019
• Est. Priority Date: 08/20/2014
• Status: Active Grant

• Current Assignee: Shopify Incorporated
• Original Assignee: AT&T Intellectual Property I LP (AT&T, Inc.)
• Inventors: Parikh, Anisa, Afshar, Siroos K., Bajpay, Paritosh, Khowash, Pradeep, Klein, Reuben
• Primary Examiner(s): Luu, Le H
• Application Number:
  US15/681,498
• Publication Number:
  US 20170373986A1
• Time in Patent Office: 715 Days
• CPC Class Codes: H04L 43/0811 by checking connectivity
• CPC Class Codes: H04L 43/0876 Network utilisation, e.g. volume of load or congestion level
• CPC Class Codes: H04L 43/20 the monitoring system or the monitored elements being virtualised, abstracted or software-defined entities, e.g. SDN or NFV
• CPC Class Codes: H04L 47/125 by balancing the load, e.g. traffic engineering
• CPC Class Codes: H04L 47/76 using dynamic resource allocation, e.g. in-call renegotiation requested by the user or requested by the network in response to changing network conditions
• CPC Class Codes: H04L 47/762 triggered by the network
• CPC Class Codes: H04L 47/78 Architectures of resource allocation
• CPC Class Codes: H04L 47/782 Hierarchical allocation of resources, e.g. involving a hierarchy of local and centralised entities
• CPC Class Codes: H04L 47/788 Autonomous allocation of resources
• CPC Class Codes: H04L 47/828 Allocation of resources per group of connections, e.g. per group of users
• CPC Class Codes: H04L 47/83 based on usage prediction

Abstract

According to one aspect of the concepts and technologies disclosed herein, a cloud computing system can include a load adaptation architecture framework that performs operations for orchestrating and managing one or more services that may operate within at least one of layers 4 through 7 of the Open Systems Interconnection (“OSI”) communication model. The cloud computing system also can include a virtual resource layer. The virtual resource layer can include a virtual network function that provides, at least in part, a service. The cloud computing system also can include a hardware resource layer. The hardware resource layer can include a hardware resource that is controlled by a virtualization layer. The virtualization layer can cause the virtual network function to be instantiated on the hardware resource so that the virtual network function can be used to support the service.

Claims

1. A computer-readable storage medium comprising computer-executable instructions that, when executed by a cloud computing system, cause the cloud computing system to perform operations comprising:

detecting, in a monitored region comprising a virtual network function, that connections to a service at least meet a threshold;

in response to detecting that the connections to the service at least meet the threshold, determining that a new virtual network function should be instantiated to handle a load created by the connections, wherein the virtual network function is unable to handle the load; and

instantiating the new virtual network function in the monitored region to handle the load.

2. The computer-readable storage medium of claim 1, wherein the operations further comprise retrieving a template that specifies attributes for the new virtual network function;

and wherein instantiating the new virtual network function in the monitored region to handle the load comprises instantiating the new virtual network function in accordance with the template.

3. The computer-readable storage medium of claim 2, wherein the operations further comprise configuring the new virtual network function to provide, at least in part, the service.

4. The computer-readable storage medium of claim 1, wherein the operations further comprise predicting a demand for the virtual network function.

5. The computer-readable storage medium of claim 4, wherein the operations further comprise receiving usage data;

and wherein predicting the demand for the virtual network function is based, at least in part, upon the usage data.

6. The computer-readable storage medium of claim 4, wherein predicting the demand for the virtual network function is based, at least in part, upon a usage trend.

7. The computer-readable storage medium of claim 4, wherein predicting the demand for the virtual network function is based, at least in part, upon a scheduled event.

8. The computer-readable storage medium of claim 4, wherein predicting the demand for the virtual network function is based, at least in part, upon a cyclic event.

9. The computer-readable storage medium of claim 4, wherein predicting the demand for the virtual network function is based, at least in part, upon a condition of a hardware resource utilized, at least in part, by the virtual network function.

10. The computer-readable storage medium of claim 9, wherein the operations further comprise:

detecting a failure of the hardware resource or detecting a failure of connectivity associated with the hardware resource; and

in response to detecting the failure of the hardware resource or detecting the failure of connectivity associated with the hardware resource, moving the service to a new hardware resource.

11. A computer-readable storage medium comprising computer-executable instructions that, when executed by a cloud computing system, cause the cloud computing system to perform operations comprising:

collecting data associated with a load experienced by a virtualized resource that provides, at least in part, a service;

determining how to scale a virtualized resource pool that comprises the virtualized resource based, at least in part, upon a policy and the load;

instructing an elasticity management component to scale the virtualized resource pool in accordance with a scaling decision regarding how to scale the virtualized resource pool; and

scaling the virtualized resource pool to accommodate the load in accordance with the policy.

12. The computer-readable storage medium of claim 11, wherein collecting the data associated with the load comprises collecting the data from a monitoring component that monitors utilization of the virtualized resource pool.

13. The computer-readable storage medium of claim 11, wherein the policy comprises a threshold number of incoming connections to the service;

and wherein determining how to scale the virtualized resource pool that comprises the virtualized resource based, at least in part, upon the policy and the load comprises determining whether a number of incoming connections at least meets the threshold number of incoming connections.

14. The computer-readable storage medium of claim 11, wherein determining how to scale the virtualized resource pool is further based upon a business rule.

15. A method comprising:

collecting, by a cloud computing system comprising a processor, data associated with a load experienced by a virtualized resource that provides, at least in part, a service;

determining, by the cloud computing system, how to scale a virtualized resource pool that comprises the virtualized resource based, at least in part, upon a policy and the load;

instructing, by the cloud computing system, an elasticity management component to scale the virtualized resource pool in accordance with a scaling decision regarding how to scale the virtualized resource pool; and

scaling the virtualized resource pool to accommodate the load in accordance with the policy.

16. The method of claim 15, wherein collecting the data associated with the load comprises collecting the data from a monitoring component that monitors utilization of the virtualized resource pool.

17. The method of claim 15, wherein the policy comprises a threshold number of incoming connections to the service;

and wherein determining how to scale the virtualized resource pool that comprises the virtualized resource based, at least in part, upon the policy and the load comprises determining whether a number of incoming connections at least meets the threshold number of incoming connections.

18. The method of claim 15, wherein determining how to scale the virtualized resource pool is further based upon a business rule.

19. The method of claim 15, wherein the load is associated, at least in part, with a mass calling event.

20. The method of claim 15, wherein the service comprises a real-time service;

and wherein the policy is based upon a request queue length or a number of active calls.