Virtual server agent load balancing

• US 9,977,687 B2
• Filed: 06/29/2016
• Issued: 05/22/2018
• Est. Priority Date: 01/08/2013
• Status: Active Grant

• Current Assignee: CommVault Systems Incorporated
• Original Assignee: CommVault Systems Incorporated
• Inventors: Kottomtharayil, Rajiv, Pawar, Rahul S., Sancheti, Ashwin Gautamchand, Deshpande, Sumer Dilip, Bhagi, Sri Karthik, Dornemann, Henry Wallace, Venkatesha, Ananda
• Primary Examiner(s): Sun, Charlie
• Application Number:
  US15/196,739
• Publication Number:
  US 20160306642A1
• Time in Patent Office: 692 Days
• CPC Class Codes: G06F 2209/5022 Workload threshold
• CPC Class Codes: G06F 9/45533 Hypervisors; Virtual machine monitors
• CPC Class Codes: G06F 9/505 considering the load
• CPC Class Codes: G06F 9/5083 Techniques for rebalancing the load in a distributed system

Abstract

Virtual machine (VM) proliferation may be reduced through the use of Virtual Server Agents (VSAs) assigned to a group of VM hosts that may determine the availability of a VM to perform a task. Tasks may be assigned to existing VMs instead of creating a new VM to perform the task. Furthermore, a VSA coordinator may determine a grouping of VMs or VM hosts based on one or more factors associated with the VMs or the VM hosts, such as VM type or geographical location of the VM hosts. The VSA coordinator may also assign one or more VSAs to facilitate managing the group of VM hosts. In some embodiments, the VSA coordinators may facilitate load balancing of VSAs during operation, such as during a backup operation, a restore operation, or any other operation between a primary storage system and a secondary storage system.

Claims

1. A method of grouping virtual machines, the method comprising:

identifying, by a virtual server agent coordinator comprising computer hardware, a set of virtual machine provider systems in a primary storage system, each of the virtual machine provider systems including a virtual machine monitor and configured to host a set of virtual machines;

accessing, by the virtual server agent coordinator, metadata for each of the virtual machine provider systems from the set of virtual machine provider systems;

grouping, by the virtual server agent coordinator, the virtual machine provider systems into one or more groups based at least partially on the metadata for each of the virtual machine provider systems;

assigning, by the virtual server agent coordinator, a set of virtual server agents to each group of virtual machine provider systems, wherein each virtual server agent is configured to back up data from at least one virtual machine in the primary storage system to a secondary storage system, wherein assignment of the set of virtual server agents among each group of virtual machine provider systems is based at least in part on a number of data streams available to each virtual server agent, and wherein a first virtual server agent associated with less data streams than a second virtual server agent is assigned to a first group of virtual machine provider systems that host smaller virtual machines than virtual machines hosted by a second group of virtual machine provider systems; and

backing up the data from the at least one virtual machine in the primary storage system to the secondary storage system.

2. The method of claim 1, wherein the metadata comprises at least an identity of features available from the virtual machine provider system.

3. The method of claim 2, wherein grouping the virtual machine provider systems further comprises grouping the virtual machine provider systems based at least partially on the features for each of the virtual machine provider systems.

4. The method of claim 1, wherein the metadata comprises one or more of the following:

a geographic location of the virtual machine provider system;

a network location of the virtual machine provider system;

an age of the virtual machine provider system;

a capacity of the virtual machine provider system;

or a security level associated with the virtual machine provider system.

5. The method of claim 1, further comprising:

receiving an identity of an additional virtual machine provider system;

accessing metadata for the additional virtual machine provider system;

identifying a group from the one or more groups of virtual machine provider systems based at least in part on the metadata; and

assigning the additional virtual machine provider system to the identified group.

6. The method of claim 1, further comprising:

detecting a change to metadata associated with a virtual machine provider system from the set of virtual machine provider systems;

reassigning the virtual machine provider system to another group from the one or more groups of virtual machine provider systems based at least in part on the changed metadata; and

updating assignment information for a set of virtual server agents assigned to said another group to include the virtual machine provider system.

7. The method of claim 1, wherein a virtual machine provider system from the set of virtual machine provider systems is included in a plurality of groups of virtual machine provider systems.

8. The method of claim 7, wherein the virtual machine provider system hosts a plurality of virtual machines, and wherein at least a first virtual machine from the plurality of virtual machines is included in a first group from the plurality of groups and at least a second virtual machine from the plurality of virtual machines is included in a second group from the plurality of groups.

9. The method of claim 1, wherein at least one virtual server agent from the set of virtual server agents is configured to back UP the data from the at least one virtual machine using one or more streams between the at least one virtual server agent and one or more media agents in the secondary storage system.

10. The method of claim 1, wherein at least one virtual server agent is assigned to multiple groups of virtual machine provider systems.

11. A system for grouping virtual machines, the system comprising:

a plurality of virtual server agents programmed to back up the data from at least one virtual machine in a primary storage system to a secondary storage system; and

a virtual server agent coordinator comprising one or more hardware processors, the virtual server agent coordinator programmed to;

identify a set of virtual machine provider systems in the primary storage system, each of the virtual machine provider systems including a virtual machine monitor and configured to host a set of virtual machines;

access metadata for each of the virtual machine provider systems from the set of virtual machine provider systems;

group the virtual machine provider systems into one or more groups based at least partially on the metadata for each of the virtual machine provider systems; and

assign a set of the virtual server agents to each group of virtual machine provider systems, wherein each virtual server agent is configured to back up data from at least one virtual machine in the primary storage system to the secondary storage system, wherein assignment of the set of virtual server agents is distributed among the group of virtual machine provider systems based at least in part on a number of data streams available to each virtual server agent and a size of the virtual machines hosted by the virtual machine provider systems, wherein a first virtual machine provider system hosting virtual machines of a smaller size than virtual machines hosted by a second virtual machine provider system is assigned to a first virtual server agent and the second virtual machine provider system is assigned to a second virtual server agent, and wherein the first virtual server agent has a smaller number of data streams than the second virtual server agent.

12. The system of claim 11, wherein the metadata comprises at least an identity of features available from the virtual machine provider system.

13. The system of claim 11, wherein the virtual server agent coordinator is further programmed to access a set of grouping rules for grouping the virtual machine provider systems.

14. The system of claim 13, wherein the virtual server agent coordinator is further programmed to group the virtual machine provider systems into the one or more groups based at least partially on the grouping rules.

15. The system of claim 11, wherein the virtual server agent coordinator is further programmed to:

receive an identity of an additional virtual machine provider system;

access metadata for the additional virtual machine provider system;

identify a group from the one or more groups of virtual machine provider systems based at least in part on the metadata; and

assign the additional virtual machine provider system to the identified group.

16. The system of claim 11, wherein the virtual server agent coordinator is further programmed to:

detect a change to metadata associated with a virtual machine provider system from the set of virtual machine provider systems;

reassign the virtual machine provider system to another group from the one or more groups of virtual machine provider systems based at least in part on the changed metadata; and

update assignment information for a set of virtual server agents assigned to said another group to include the virtual machine provider system.

17. The system of claim 11, wherein the virtual server agent coordinator is further programmed to include a virtual machine provider system from the set of virtual machine provider systems in a plurality of groups of virtual machine provider systems.

18. The system of claim 17, wherein the virtual machine provider system hosts a plurality of virtual machines, and wherein at least a first virtual machine from the plurality of virtual machines is included in a first group from the plurality of groups and at least a second virtual machine from the plurality of virtual machines is included in a second group from the plurality of groups.

19. The system of claim 11, wherein the at least one virtual server agent from the set of virtual server agents is configured to back up the data from the at least one virtual machine using one or more streams between the at least one virtual server agent and one or more media agents in the secondary storage system.

20. The system of claim 11, wherein at least one virtual server agent is assigned to multiple groups of virtual machine provider systems.