System and Method for Metadata Discovery and Metadata-Aware Scheduling

• US 20130238785A1
• Filed: 06/08/2012
• Published: 09/12/2013
• Est. Priority Date: 03/06/2012
• Status: Abandoned Application

• Current Assignee: Rackspace US Incorporated (Apollo Global Management, Inc.)
• Original Assignee: Rackspace US Incorporated (Apollo Global Management, Inc.)
• Inventors: Hawk, Ryan, Mick, Jason L., Kelly, William, Breu, Joseph
• Application Number:
  US13/491,866
• Publication Number:
  US 20130238785A1
• Time in Patent Office: Days
• US Class Current: 709/224
• CPC Class Codes: G06F 2009/4557 Distribution of virtual machine instances; Migration and load balancing
• CPC Class Codes: G06F 2009/45575 Starting, stopping, suspending or resuming virtual machine instances
• CPC Class Codes: G06F 3/126 Job scheduling, e.g. queuing, determine appropriate device
• CPC Class Codes: G06F 9/5072 Grid computing
• CPC Class Codes: G06F 9/5077 Logical partitioning of resources; Management or configuration of virtualized resources specific details on emulation or internal functioning of virtual machines G06F9/455

Abstract

A cloud computing system including a plurality of computing devices configured to host virtual machine instances, each computing device in the plurality of computing devices including a monitor operable to collect metadata about the associated computing device. The system also includes a registry operable to receive and store the metadata from the plurality of computing devices and a scheduler operable to select a host computing device out of the plurality of computing devices on which to instantiate a virtual machine instance based on the metadata stored in the registry.

Claims

1. A cloud computing system, comprising:

a plurality of computing devices configured to host virtual machine instances, each computing device in the plurality of computing devices including a monitor operable to collect metadata about the associated computing device;

a registry operable to receive and store the metadata from the plurality of computing devices; and

a scheduler operable to select a host computing device out of the plurality of computing devices on which to instantiate a virtual machine instance based on the metadata stored in the registry.

2. The cloud computing system of claim 1, wherein the plurality of computing devices are non-homogeneous.

3. The cloud computing system of claim 1, wherein each monitor is operable to collect static metadata describing hardware configurations of the associated computing device.

4. The cloud computing system of claim 1, wherein each monitor is operable to collect dynamic metadata describing operating conditions of the associated computing device.

5. The cloud computing system of claim 4, wherein each monitor is operable to collect dynamic metadata describing one of bandwidth availability, processor availability, memory usage, and hard disk utilization of the associated computing device.

6. The cloud computing system of claim 1, wherein each monitor is operable to collect metadata associated with a virtual machine instance hosted on the associated computing device.

7. The cloud computing system of claim 6, wherein each monitor is operable to collect metadata describing network conditions as they appear to the virtual machine instance.

8. The cloud computing system of claim 1,

further including a plurality of virtual machine instances executing within the plurality of computing devices;

and

wherein the scheduler is further operable to select one of the virtual machine instances on which to schedule a compute job based on the metadata stored in the registry.

9. The cloud computing system of claim 1,

wherein the virtual machine image includes criteria for a host computing device;

wherein the scheduler is operable to assign costs to selecting each of the plurality of computing devices based on how closely each of the plurality of computing devices meets the criteria as described by the metadata associated with the plurality of computing devices; and

wherein the scheduler is operable to select a computing device out of the plurality of computing devices on which to instantiate the virtual machine instance based on the cost of associated with the selected computing device.

10. A cloud computing system, the system comprising:

a plurality of non-homogeneous computing devices configured to host virtual machine instances, each computing device in the plurality of computing devices including a monitor operable to collect metadata about the associated computing device, the metadata describing a characteristic of the computing devices;

a registry operable to receive and store the metadata from the plurality of computing devices; and

a scheduler operable to define an availability zone within the plurality of computing devices based on the collected metadata, the availability zone including the computing devices within the plurality of computing devices that have the characteristic;

wherein the scheduler is further operable to select a host computing device out of the plurality of computing devices on which to instantiate a virtual machine instance based on whether the host computing device is within the availability zone.

11. The cloud computing system of claim 10,

wherein the availability zone is defined to include computing devices having a specific hardware configuration;

and

wherein the scheduler is operable to place within the availability zone any computing devices in the plurality of computing devices that have the hardware configuration as described by the collected metadata.

12. The cloud computing system of claim 10,

wherein the availability zone is defined to include computing devices having a specific operating condition;

and

wherein the scheduler is operable to dynamically place within the availability zone any computing devices in the plurality of computing devices that have the operating condition as described by the collected metadata.

13. The cloud computing system of claim 12, wherein the availability zone is defined to include the computing devices in the plurality of computing devices that have one of a bandwidth availability below a first threshold, a processor usage below a second threshold, a memory usage below a third threshold, and a hard disk usage below a fourth threshold.

14. The cloud computing system of claim 10, wherein each monitor is operable to collect metadata describing characteristics of a virtual machine instance hosted on the associated computing device;

wherein the scheduler is operable to define a second availability zone within the plurality of computing devices based on the collected virtual machine metadata.

15. A method of efficiently utilizing a cloud computing system, comprising:

collecting metadata associated with a plurality of computing devices with a plurality of monitors respectively associated with the plurality of computing devices, the plurality of computing devices being operable to host virtual machine instances;

storing the metadata from the plurality of computing devices in a registry; and

selecting a host computing device out of the plurality of computing devices on which to instantiate a virtual machine instance based on the metadata stored in the registry.

16. The method of claim 15, wherein the plurality of computing devices are non-homogeneous.

17. The method of claim 15, wherein collecting metadata includes:

collecting metadata upon bootup of each of the plurality of computing devices; and

collecting metadata upon bootup of a virtual machine instantiation hosted on any of the plurality of computing devices.

18. The method of claim 15, wherein collecting metadata includes collecting one of static metadata describing hardware configurations of the plurality of computing devices and dynamic metadata describing operating conditions of the plurality of computing devices.

19. The method of claim 15, wherein collecting metadata includes collecting dynamic metadata describing network conditions as they appear to a virtual machine instance.

20. The method of claim 15,

further including defining an availability zone within the plurality of computing devices based on the collected metadata, the availability zone including any computing devices within the plurality of computing devices that have a specific characteristic;

and

wherein the selecting the host computing device includes selecting based upon whether the host computing device is within the availability zone.