Predictively provisioning cloud computing resources for virtual machines

• US 10,078,531 B2
• Filed: 08/31/2017
• Issued: 09/18/2018
• Est. Priority Date: 09/11/2015
• Status: Active Grant

• Current Assignee: Kyndryl Incorporated
• Original Assignee: International Business Machines Corporation
• Inventors: Feng, Zhong Qi, Li, Jiang Tao, Wang, Yi Bin, Yu, Chao, Zhang, Qing Feng
• Primary Examiner(s): Swift, Charles M
• Application Number:
  US15/692,618
• Publication Number:
  US 20170364383A1
• Time in Patent Office: 383 Days
• Field of Search: None
• CPC Class Codes: G06F 11/008 Reliability or availability analysis
• CPC Class Codes: G06F 11/30 Monitoring
• CPC Class Codes: G06F 11/3006 where the computing system is distributed, e.g. networked systems, clusters, multiprocessor systems multiprogramming arrangements G06F9/46; allocation of resources G06F9/50
• CPC Class Codes: G06F 11/3433 for load management allocation of a server based on load conditions G06F9/505; load rebalancing G06F9/5083; redistributing the load in a network by a load balancer H04L67/1029
• CPC Class Codes: G06F 11/3452 Performance evaluation by statistical analysis
• CPC Class Codes: G06F 2009/45562 Creating, deleting, cloning virtual machine instances
• CPC Class Codes: G06F 2009/4557 Distribution of virtual machine instances; Migration and load balancing
• CPC Class Codes: G06F 2009/45575 Starting, stopping, suspending or resuming virtual machine instances
• CPC Class Codes: G06F 2009/45591 Monitoring or debugging support
• CPC Class Codes: G06F 2009/45595 Network integration; Enabling network access in virtual machine instances
• CPC Class Codes: G06F 2201/815 Virtual middleware or OS functionality using virtual machines to implement generic software techniques for error detection or fault masking G06F11/1484
• CPC Class Codes: G06F 9/455 Emulation; Interpretation; Software simulation, e.g. virtualisation or emulation of application or operating system execution engines
• CPC Class Codes: G06F 9/45533 Hypervisors; Virtual machine monitors
• CPC Class Codes: G06F 9/45558 Hypervisor-specific management and integration aspects
• CPC Class Codes: G06F 9/48 Program initiating; Program switching, e.g. by interrupt
• CPC Class Codes: G06F 9/4881 Scheduling strategies for dispatcher, e.g. round robin, multi-level priority queues
• CPC Class Codes: G06F 9/4887 involving deadlines, e.g. rate based, periodic
• CPC Class Codes: G06F 9/50 Allocation of resources, e.g. of the central processing unit [CPU]
• CPC Class Codes: G06F 9/5005 to service a request
• CPC Class Codes: G06F 9/5011 the resources being hardware resources other than CPUs, Servers and Terminals
• CPC Class Codes: G06F 9/5016 : the resource being the memory
• CPC Class Codes: G06F 9/5027 : the resource being a machine, e.g. CPUs, Servers, Terminals
• CPC Class Codes: G06F 9/5038 : considering the execution order of a plurality of tasks, e.g. taking priority or time dependency constraints into consideration scheduling strategies G06F9/4881 and subgroups
• CPC Class Codes: G06F 9/5044 : considering hardware capabilities
• CPC Class Codes: G06F 9/505 : considering the load
• CPC Class Codes: G06F 9/5055 : considering software capabilities, i.e. software resources associated or available to the machine
• CPC Class Codes: G06F 9/5061 : Partitioning or combining of resources
• CPC Class Codes: G06F 9/5072 : Grid computing
• CPC Class Codes: G06F 9/5077 : Logical partitioning of resources; Management or configuration of virtualized resources specific details on emulation or internal functioning of virtual machines G06F9/455
• CPC Class Codes: G06F 9/5083 : Techniques for rebalancing the load in a distributed system
• CPC Class Codes: G06F 9/5088 : involving task migration
• CPC Class Codes: G06N 20/00 : Machine learning
• CPC Class Codes: G06N 5/00 : Computing arrangements using knowledge-based models
• CPC Class Codes: H04L 67/1097 : for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
• CPC Class Codes: H04L 67/131 : Protocols for games, networked simulations or virtual reality
• CPC Class Codes: H04L 67/535 : Tracking the activity of the user network monitoring arrangements H04L43/00; recording of computer activity G06F11/34

Abstract

Methods, computer program products, and systems are presented. The methods include, for instance: predictively provisioning, by one or more processor, cloud computing resources of a cloud computing environment for at least one virtual machine; and initializing, by the one or more processor, the at least one virtual machine with the provisioned cloud computing resources of the cloud computing environment. In one embodiment, the predictively provisioning may include: receiving historical utilization information of multiple virtual machines of the cloud computing environment, the multiple virtual machines having similar characteristics to the at least one virtual machine; and determining the cloud computing resources for the at least one virtual machine using the historical utilization information of the multiple virtual machines. In another embodiment, the predictively may include updating a provisioning database with the historical utilization information of the multiple virtual machines of the cloud computing environment.

Claims

1. A method comprising:

predictively provisioning, by one or more processor, cloud computing resources of a cloud computing environment for at least one virtual machine, wherein the predictively provisioning includes receiving historical utilization information of multiple virtual machines of the cloud computing environment, the multiple virtual machines having similar characteristics to the at least one virtual machine, and determining the cloud computing resources for the at least one virtual machine using the historical utilization information of multiple virtual machines;

triggering, by the one or more processor, initializing the at least one virtual machine with the provisioned cloud computing resources of the cloud computing environment; and

wherein the predictively provisioning cloud computing resources of a cloud computing environment for at least one virtual machine includes predictively provisioning a certain virtual machine for miming a certain program, wherein the receiving historical utilization information of multiple virtual machines of the cloud computing environment includes receiving historical utilization information of multiple virtual machines running the certain program, wherein the determining the cloud computing resources for the at least one virtual machine includes determining provisioning resources for the certain virtual machine, wherein the triggering initializing the at least one virtual machine includes triggering initializing the certain virtual machine with the provisioning resources for the certain virtual machine, wherein the determining provisioning resources for the certain virtual machine includes determining predicted resource needs of the certain virtual machine based on a growth rate of the certain virtual machine determined using a historical growth rate of the multiple virtual machines running the certain program.

2. The method of claim 1, wherein the determining provisioning resources for the certain virtual machine includes matching the predicted resource needs to a hosting region of the cloud computing environment having current available capacity according to the predicted resource needs.

3. The method of claim 1, wherein the predictively provisioning further comprises updating a provisioning database with the historical utilization information of multiple virtual machines of the cloud computing environment.

4. The method of claim 3, wherein the determining further comprises data mining the provisioning database to determine the cloud computing resources, the data mining comprising using at least one of regression or constraint analysis of the provisioning database.

5. The method of claim 1, wherein the predictively provisioning comprises:

receiving a provisioning request, the provisioning request comprising at least processor, memory, storage, or tenant requirements of the at least one virtual machine; and

comparing the processor, memory, storage, or tenant requirements of the at least one virtual machine with available resources of the cloud computing environment to provision the cloud computing resources for the at least one virtual machine; and

wherein the predictively provisioning further comprises;

calculating available cloud computing resources of the cloud computing environment;

filtering the available cloud computing resources to determine the cloud computing resources for the at least one virtual machine, the filtering comprising using at least one of real-time data, empirical data, or prediction data of the cloud computing environment.

6. The method of claim 1, wherein the receiving historical utilization information of multiple virtual machines of the cloud computing environment includes receiving a table with a real-time CPU memory and disk utilization for each of the multiple virtual machines on a periodic basis, and wherein the receiving historical utilization information of multiple virtual machines of the cloud computing environment includes receiving historical utilization information of a first virtual machine at a first data center and receiving historical utilization information of a second virtual machine at a second data center external to the first data center, and wherein the initializing the at least one virtual machine includes initializing at least one virtual machine of the second data center.

7. The method of claim 1, wherein the predictively provisioning cloud computing resources of a cloud computing environment for at least one virtual machine includes predictively provisioning a certain virtual machine for miming a certain program, wherein the receiving historical utilization information of multiple virtual machines of the cloud computing environment includes receiving historical utilization information of multiple virtual machines running the certain program, wherein the determining the cloud computing resources for the at least one virtual machine includes determining provisioning resources for the certain virtual machine, wherein the triggering initializing the at least one virtual machine includes triggering initializing the certain virtual machine with the provisioning resources for the certain virtual machine, wherein the determining provisioning resources for the certain virtual machine includes determining predicted resource needs of the certain virtual machine based on a growth rate of the certain virtual machine determined using a historical growth rate of the multiple virtual machines miming the certain program and wherein the determining provisioning resources for the certain virtual machine includes matching the predicted resource needs to a hosting region of the cloud computing environment having current available capacity according to the predicted resource needs.

8. A computer program product comprising:

a computer readable storage medium readable by one or more processor and storing instructions for execution by the one or more processor for performing a method comprising;

predictively provisioning, by the one or more processor, cloud computing resources of a cloud computing environment for at least one virtual machine, wherein the predictively provisioning includes receiving historical utilization information of multiple virtual machines of the cloud computing environment, the multiple virtual machines having similar characteristics to the at least one virtual machine, and determining the cloud computing resources for the at least one virtual machine using the historical utilization information of multiple virtual machines;

triggering, by the one or more processor, initializing the at least one virtual machine with the provisioned cloud computing resources of the cloud computing environment; and

wherein the predictively provisioning cloud computing resources of a cloud computing environment for at least one virtual machine includes predictively provisioning a certain virtual machine for running a certain program, the certain virtual machine being of a certain type, wherein the receiving historical utilization information of multiple virtual machines of the cloud computing environment includes receiving historical utilization information of multiple virtual machines running the certain program, the certain virtual machine being of a certain type, wherein the determining the cloud computing resources for the at least one virtual machine includes determining provisioning resources for the certain virtual machine, wherein the triggering initializing the at least one virtual machine includes triggering initializing the certain virtual machine with the provisioning resources for the certain virtual machine, wherein the method includes storing into a provisioning database historical utilization information of multiple virtual machines of the certain type, wherein the provisioning database includes historical utilization information of a prior virtual machine of the certain type for running the certain program, the prior virtual machine no longer operating in the environment, wherein the determining provisioning resources for the certain virtual machine includes, prior to receiving a provisioning request to provision the certain virtual machine, determining and storing trend information, wherein determining the trend information includes using the historical utilization information of the prior virtual machine of the certain type for running the certain program, the prior virtual machine no longer operating in the environment, wherein the method includes receiving the provisioning request to provision the certain virtual machine, and wherein the method includes responding to the provisioning request to provision the certain virtual machine using the trend information determined prior to the receiving the provisioning request.

9. The computer program product of claim 8, wherein the determining provisioning resources for the certain virtual machine includes determining predicted disk utilization resource needs of the certain virtual machine based on a growth rate of the certain virtual machine determined using a historical disk utilization growth rate of the multiple virtual machines running the certain program, wherein the triggering initializing the at least one virtual machine includes transmitting a message to a hosting computing requesting that the hosting computing node perform initializing of the certain virtual machine to launch the certain virtual machine, wherein the receiving historical utilization information of multiple virtual machines of the cloud computing environment includes receiving historical utilization information of multiple virtual machines of the type of the certain virtual machine running the certain program and receiving historical utilization information of multiple virtual machines that are of types other than the certain virtual machine.

10. The computer program product of claim 8, wherein the method includes storing into a provisioning database first information including historical utilization information of multiple virtual machines of the type of the certain virtual machine miming the certain program and storing into the provisioning database second information including historical utilization information of multiple virtual machines that are of types other than a type of the certain virtual machine.

11. A system comprising:

a memory;

one or more processor in communication with the memory; and

program instructions executable by the one or more processor via the memory to perform a method, the method comprising;

predictively provisioning, by one or more processor, cloud computing resources of a cloud computing environment for at least one virtual machine, wherein the predictively provisioning includes receiving historical utilization information of multiple virtual machines of the cloud computing environment, the multiple virtual machines having similar characteristics to the at least one virtual machine, and determining the cloud computing resources for the at least one virtual machine using the historical utilization information of multiple virtual machines;

triggering, by the one or more processor, initializing the at least one virtual machine with the provisioned cloud computing resources of the cloud computing environment; and

wherein the cloud computing environment comprises multiple hypervisors, the predictively provisioning comprises selecting the cloud computing resources associated with a hypervisor of the multiple hypervisors, and the triggering initializing comprises sending an initialization request to the hypervisor associated to the selected cloud computing resources.

12. The system of claim 11, wherein each of the multiple virtual machines and the at least one virtual machine subject to the initializing run different instances of the same program.

13. The system of claim 11, wherein the receiving historical utilization information of multiple virtual machines of the cloud computing environment includes receiving a table with a real-time CPU memory and disk utilization for each of the multiple virtual machines on a periodic basis, wherein the receiving historical utilization information of multiple virtual machines of the cloud computing environment includes receiving historical utilization information of a first virtual machine at a first data center and receiving historical utilization information of a second virtual machine at a second data center external to the first data center, and wherein the initializing the at least one virtual machine includes initializing at least one virtual machine of the second data center, and wherein each of the multiple virtual machine and the at least one virtual machine subject to the initializing run different instances of the same program.

14. The system of claim 11, wherein the predictively provisioning cloud computing resources of a cloud computing environment for at least one virtual machine includes predictively provisioning a certain virtual machine for running a certain program, wherein the receiving historical utilization information of multiple virtual machines of the cloud computing environment includes receiving historical utilization information of multiple virtual machines of the type of the certain virtual machine running the certain program and receiving historical utilization information of multiple virtual machines that are of types other than the certain virtual machine, wherein the determining the cloud computing resources for the at least one virtual machine includes determining provisioning resources for the certain virtual machine, wherein the triggering initializing the at least one virtual machine includes triggering initializing the certain virtual machine with the provisioning resources for the certain virtual machine, wherein the method includes storing into a provisioning database first information including historical utilization information of multiple virtual machines of the type of the certain virtual machine running the certain program and storing into the provisioning database second information including historical utilization information of multiple virtual machines that are of types other than a type of the certain virtual machine, wherein the determining provisioning resources for the certain virtual machine include using the first information of the provisioning database preferentially to using the second information of the provisioning database.

15. The system of claim 11, wherein the predictively provisioning cloud computing resources of a cloud computing environment for at least one virtual machine includes predictively provisioning a certain virtual machine for running a certain program, wherein the receiving historical utilization information of multiple virtual machines of the cloud computing environment includes receiving historical utilization information of multiple virtual machines of the type of the certain virtual machine running the certain program and receiving historical utilization information of multiple virtual machines that are of types other than the certain virtual machine, wherein the determining the cloud computing resources for the at least one virtual machine includes determining provisioning resources for the certain virtual machine, wherein the triggering initializing the at least one virtual machine includes triggering initializing the certain virtual machine with the provisioning resources for the certain virtual machine, wherein the method includes storing into a provisioning database first information including historical utilization information of multiple virtual machines of the type of the certain virtual machine running the certain program and storing into the provisioning database second information including historical utilization information of multiple virtual machines that are of types other than a type of the certain virtual machine, wherein the determining provisioning resources for the certain virtual machine includes, prior to receiving a provisioning request to provision the certain virtual machine, determining and storing trend information based on the first information for use in provisioning the certain virtual machine, wherein the method includes receiving the provisioning request to provision the certain virtual machine, and wherein the method includes responding to the provisioning request to provision the certain virtual machine using the trend information determined prior to the receiving the provisioning request.

16. The system of claim 11, wherein the predictively provisioning cloud computing resources of a cloud computing environment for at least one virtual machine includes predictively provisioning a certain virtual machine for running a certain program, wherein the receiving historical utilization information of multiple virtual machines of the cloud computing environment includes receiving historical utilization information of multiple virtual machines of the type of the certain virtual machine running the certain program and receiving historical utilization information of multiple virtual machines that are of types other than the certain virtual machine, wherein the determining the cloud computing resources for the at least one virtual machine includes determining provisioning resources for the certain virtual machine, wherein the triggering initializing the at least one virtual machine includes triggering initializing the certain virtual machine with the provisioning resources for the certain virtual machine, wherein the method includes storing into a provisioning database first information including historical utilization information of multiple virtual machines of the type of the certain virtual machine running the certain program and storing into the provisioning database second information including historical utilization information of multiple virtual machines that are of types other than a type of the certain virtual machine, wherein the provisioning database includes historical utilization information of a virtual machine of the certain type running the certain program that is no longer operating in the environment, wherein the determining provisioning resources for the certain virtual machine includes, prior to receiving a provisioning request to provision the certain virtual machine, determining and storing trend information based on the first information for use in provisioning the certain virtual machine, wherein determining the trend information based on the first information includes using the historical utilization information of the virtual machine of the certain type running the certain program that is no longer operating in the environment, wherein the method includes receiving the provisioning request to provision the certain virtual machine, and wherein the method includes responding to the provisioning request to provision the certain virtual machine using the trend information determined prior to the receiving the provisioning request.

17. The system of claim 11, wherein the predictively provisioning cloud computing resources of a cloud computing environment for at least one virtual machine includes predictively provisioning a certain virtual machine for running a certain program, wherein the receiving historical utilization information of multiple virtual machines of the cloud computing environment includes receiving historical utilization information of multiple virtual machines running the certain program, wherein the determining the cloud computing resources for the at least one virtual machine includes determining provisioning resources for the certain virtual machine, and wherein the triggering initializing the at least one virtual machine includes triggering initializing the certain virtual machine with the provisioning resources for the certain virtual machine.

18. The system of claim 11, wherein the predictively provisioning cloud computing resources of a cloud computing environment for at least one virtual machine includes predictively provisioning a certain virtual machine for running a certain program, wherein the receiving historical utilization information of multiple virtual machines of the cloud computing environment includes receiving historical utilization information of multiple virtual machines running the certain program, wherein the determining the cloud computing resources for the at least one virtual machine includes determining provisioning resources for the certain virtual machine, wherein the triggering initializing the at least one virtual machine includes triggering initializing the certain virtual machine with the provisioning resources for the certain virtual machine, wherein the determining provisioning resources for the certain virtual machine includes determining predicted disk utilization resource needs of the certain virtual machine based on a growth rate of the certain virtual machine determined using a historical disk utilization growth rate of the multiple virtual machines running the certain program.

19. The system of claim 11, wherein the predictively provisioning cloud computing resources of a cloud computing environment for at least one virtual machine includes predictively provisioning a certain virtual machine for running a certain program, wherein the receiving historical utilization information of multiple virtual machines of the cloud computing environment includes receiving historical utilization information of multiple virtual machines running the certain program, wherein the determining the cloud computing resources for the at least one virtual machine includes determining provisioning resources for the certain virtual machine, wherein the triggering initializing the at least one virtual machine includes triggering initializing the certain virtual machine with the provisioning resources for the certain virtual machine, and wherein the triggering initializing the at least one virtual machine includes transmitting a message to a hosting computing requesting that the hosting computing node perform initializing of the certain virtual machine to launch the certain virtual machine.

20. The system of claim 11, wherein the predictively provisioning cloud computing resources of a cloud computing environment for at least one virtual machine includes predictively provisioning a certain virtual machine for miming a certain program, wherein the receiving historical utilization information of multiple virtual machines of the cloud computing environment includes receiving historical utilization information of multiple virtual machines running the certain program, wherein the determining the cloud computing resources for the at least one virtual machine includes determining provisioning resources for the certain virtual machine, wherein the triggering initializing the at least one virtual machine includes triggering initializing the certain virtual machine with the provisioning resources for the certain virtual machine, wherein the determining provisioning resources for the certain virtual machine includes determining predicted disk utilization resource needs of the certain virtual machine based on a growth rate of the certain virtual machine determined using a historical disk utilization growth rate of the multiple virtual machines running the certain program, wherein the triggering initializing the at least one virtual machine includes transmitting a message to a hosting computing requesting that the hosting computing node perform initializing of the certain virtual machine to launch the certain virtual machine, wherein the receiving historical utilization information of multiple virtual machines of the cloud computing environment includes receiving historical utilization information of multiple virtual machines of the type of the certain virtual machine running the certain program and receiving historical utilization information of multiple virtual machines that are of types other than the certain virtual machine, wherein the method includes storing into a provisioning database first information including historical utilization information of multiple virtual machines of the type of the certain virtual machine running the certain program and storing into the provisioning database second information including historical utilization information of multiple virtual machines that are of types other than a type of the certain virtual machine, wherein the provisioning database includes historical utilization information of a virtual machine of the certain type and running the certain program that is no longer operating in the environment, wherein the determining provisioning resources for the certain virtual machine includes, prior to receiving a provisioning request to provision the certain virtual machine, determining and storing trend information based on the first information for use in provisioning the certain virtual machine, wherein determining the trend information based on the first information includes using the historical utilization information of the virtual machine of the certain type running the certain program that is no longer operating in the environment, wherein the method includes receiving the provisioning request to provision the certain virtual machine, and wherein the method includes responding to the provisioning request to provision the certain virtual machine using the trend information determined prior to the receiving the provisioning request.