Consolidation of idle virtual machines on idle logical processors

• US 9,804,874 B2
• Filed: 04/20/2011
• Issued: 10/31/2017
• Est. Priority Date: 04/20/2011
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: Fahrig, Thomas
• Primary Examiner(s): Rashid, Wissam
• Assistant Examiner(s): Chu Joy-Davila, Jorge A
• Application Number:
  US13/090,633
• Publication Number:
  US 20120272235A1
• Time in Patent Office: 2,386 Days
• CPC Class Codes: G06F 2009/45591 Monitoring or debugging support
• CPC Class Codes: G06F 9/45558 Hypervisor-specific management and integration aspects
• CPC Class Codes: G06F 9/5077 Logical partitioning of resources; Management or configuration of virtualized resources specific details on emulation or internal functioning of virtual machines G06F9/455
• CPC Class Codes: G06F 9/5094 where the allocation takes into account power or heat criteria power management in computers in general G06F1/3203; thermal management in computers in general G06F1/206
• CPC Class Codes: Y02D 10/00 Energy efficient computing, e.g. low power processors, power management or thermal management

Abstract

Idle virtual machine partitions in a virtualized computing environment are consolidated onto one or more idle logical processors. A hypervisor monitors the individual utilization of multiple virtual machine partitions in a computing environment and determines which virtual machine partitions are idle. The hypervisor also monitors the individual utilization of multiple logical processors in the computing environment and determines which logical processors are idle. The hypervisor schedules all of the idle virtual machine partitions on one or more of the idle logical processors. This can improve the performance for work-generating partitions and ensure compliance with service level agreements. At the same time, it can provide efficient power management in that is consolidates idle virtual machines onto a smaller subset of logical processors.

Claims

1. A method for use by a hypervisor operating in a computer system which comprises a plurality of partitions operating on a plurality of logical processors, the method comprising:

monitoring utilization levels of the plurality of partitions;

determining that a subset of the plurality of partitions are idle based on the utilization level of the subset of the plurality of partitions being below a threshold;

monitoring utilization levels of the plurality of logical processors;

determining that a subset of logical processors of the plurality of the logical processors are idle based on the monitored utilization level of the subset of the plurality of logical processors being below an idle logical processor threshold percentage;

scheduling partitions of the subset of idle partitions on at least one of the logical processors in the subset of idle logical processors.

2. The method of claim 1, wherein the monitored utilization levels of the plurality of logical processors comprise a utilization level based on the utilization of non-idle partitions, and wherein determining that the subset of logical processors are idle comprises comparing the monitored utilization level of each of the plurality of logical processors based on the utilization of non-idle partitions to an idle logical processor threshold.

3. The method of claim 2, wherein the idle logical processor threshold is a predetermined logical processor utilization percentage.

4. The method of claim 2, wherein determining that the subset of the plurality of partitions are idle comprises comparing the monitored utilization level of each of the plurality of partitions to an idle partition threshold.

5. The method of claim 1, wherein determining that the subset of the plurality of partitions is idle comprises comparing the monitored utilization level of each of the plurality of partitions to an idle partition threshold.

6. The method of claim 5, wherein the idle partition threshold is a predetermined partition utilization percentage.

7. The method of claim 6, wherein each of the plurality of partitions which is not idle is scheduled on a different one of the plurality of logical processors.

8. The method of claim 1, further comprising:

changing a power state of at least one of the plurality of logical processors based on the scheduling of each of the determined at least one idle partition.

9. The method of claim 1, wherein any partition of the plurality of partitions determined to be idle is scheduled onto one or more logical processors determined to be idle.

10. The method of claim 9, wherein any partition of the plurality of partitions that is not determined to be idle is scheduled onto the one or more logical processors determined to be idle.

11. A computing system, comprising:

at least one physical processor;

a plurality of partitions operating in the computing system;

a plurality of logical processors capable of hosting one or more of the plurality of partitions, each of the plurality of logical processors operating on the at least one physical processor; and

a hypervisor, wherein the hypervisor is configured to;

monitor utilization levels of the plurality of partitions and utilization levels of the plurality of logical processors operating on the at least one physical processor,

determine that a subset of the plurality of partitions are idle based on the monitored utilization levels of the subset of the plurality of partitions being below a threshold,

determine that a subset of logical processors of the plurality of logical processors are idle based on the monitored utilization levels of the subset of the plurality of logical processors being below an idle logical processor threshold percentage,

schedule partitions of the subset of idle partitions on at least one of the logical processors in the subset of idle logical processors.

12. The computing system of claim 11, wherein the hypervisor is configured to monitor the utilization levels of the plurality of logical processors by monitoring a utilization level of each of the plurality of logical processors based on the utilization of non-idle partitions, and wherein the hypervisor is configured to determine that the subset of logical processors are idle by comparing the monitored utilization level of each of the plurality of logical processors based on the utilization of non-idle partitions to an idle logical processor threshold.

13. The computing system of claim 12, wherein the idle logical processor threshold is a predetermined logical processor utilization percentage.

14. The computing system of claim 12, wherein the hypervisor is configured to determine that at least one partition of the plurality of partitions is idle by comparing the monitored utilization level of each of the plurality of partitions to an idle partition threshold.

15. The computing system of claim 11, wherein the hypervisor is configured to determine that at least one partition of the plurality of partitions is idle by comparing the monitored utilization level of each of the plurality of partitions to an idle partition threshold.

16. The computing system of claim 15, wherein the idle partition threshold is a predetermined partition utilization percentage.

17. A computer readable storage device excluding signals per se tangibly embodying computer readable instructions of a hypervisor for execution in a computing environment comprising a plurality of logical processors and a plurality of partitions, the instructions comprising:

instructions to monitor utilization levels of the plurality of partitions;

instructions to monitor utilization levels of the plurality of logical processors;

instructions to determine that a subset of the plurality of partitions are idle based on the utilization levels of the subset of the plurality of partitions being below a threshold;

instructions to determine that a subset of logical processors of the plurality of logical processors are idle based on the monitored utilization levels of the subset of the plurality of logical processors being below an idle logical processor threshold percentage;

instructions to schedule partitions of the subset of idle partitions on at least one of the logical processors in the subset of idle logical processors.

18. The computer readable storage device excluding signals per se of claim 17, wherein the instructions to monitor utilization levels of the plurality of logical processors comprise instructions to monitor a utilization level of each of the plurality of logical processors based on the utilization of non-idle partitions, and wherein the instructions to determine that a subset of the plurality of logical processors are idle comprise instructions to compare the monitored utilization level of each of the plurality of logical processors based on the utilization of non-idle partitions to an idle logical processor threshold.

19. The computer readable storage device excluding signals per se of claim 17, wherein instructions to determine that a subset of the plurality of partitions are idle comprise instructions to compare the monitored utilization level of each of the plurality of partitions to an idle partition threshold.