Certification for flexible resource demand applications

• US 9,183,019 B2
• Filed: 04/25/2012
• Issued: 11/10/2015
• Est. Priority Date: 04/25/2012
• Status: Expired due to Fees

• Current Assignee: Invincible IP LLC (IP Edge LLC)
• Original Assignee: Empire Technology Development LLC (Allied Inventors Management, LLC)
• Inventors: Kruglick, Ezekiel
• Primary Examiner(s): Zhen, Li B
• Assistant Examiner(s): Soltanzadeh, Amir
• Application Number:
  US13/635,395
• Publication Number:
  US 20130290941A1
• Time in Patent Office: 1,294 Days
• Field of Search: None
• US Class Current: 1/1
• CPC Class Codes: G06F 2009/4557 Distribution of virtual machine instances; Migration and load balancing
• CPC Class Codes: G06F 9/45516 Runtime code conversion or optimisation
• CPC Class Codes: G06F 9/4552 Involving translation to a different instruction set architecture, e.g. just-in-time translation in a JVM
• CPC Class Codes: G06F 9/45558 Hypervisor-specific management and integration aspects

Abstract

Technologies are generally provided for optimizing virtual machine performances at a datacenter and managing sudden resource demand changes by co-residing applications on same virtual machines through a flexible resource demand certification approach. A flexible resource demand certificate may be generated for applications including predetermined operating compilation architectures that run well but have different resource demands. A Just-In-Time (JIT) compiler may be directed to selected target settings for a combination of operational parameter settings such that the co-residing applications can share resources without overloading system resources. Applications to be migrated to a new datacenter or a new virtual machine at a datacenter may be assigned and adjusted according to their and potential co-residing applications'"'"' certificates providing optimized resource usage.

Claims

1. A method to employ flexible resource demand certificates for applications in virtual machine management, the method comprising:

in response to receiving a message that indicates an imminent arrival of an application scheduled to migrate to a virtual machine of a datacenter, analyzing, by a virtual machine manager, a flexible resource demand certificate associated with a resident application of the virtual machine to determine resource demands for the resident application for one or more operational parameters, wherein the flexible resource demand certificate includes indications of predetermined operational compilation architectures for the resident application that are complimentary but include different resource demands such that the resource demands are altered to prevent the resource demands from conflicting upon arrival of the application;

selecting, by the virtual machine manager, an initial operating point target based on the analysis;

providing, by a virtual machine manager, the operational parameters to a flexible demand manager that is configured to direct a dynamic compiler to targeted settings for the provided operational parameters, wherein the targeted settings for the operational parameters are established in an optimization loop of a Just-In-Time compilation at runtime, and a compilation approach of the dynamic compiler is altered such that the resident application is directed into two forms, each of the two forms comprising an inner loop and an outer loop having substantially different execution stacks and memory allotment and usage that are employed in a different manner by each of the two forms, wherein a first form uses memory extensively and a second form trades memory usage for processor usage; and

preparing, by the virtual machine manager, the resident application by altering the resource demands for the resident application with the established targeted settings for the one or more operational parameters prior to the application migrating to the virtual machine.

2. The method according to claim 1, wherein the Just-In-Time compilation is used to optimize performance for co-located tenants in the virtual machine that are in distinct operating systems or in response to a datacenter management command.

3. The method according to claim 1, wherein the operational parameters are associated with one or more of a memory availability, a processor type, a number of available processors, or a power consumption.

4. The method according to claim 1, wherein the flexible resource demand certificate provides a mapping of different optimal performance areas for the application to enable shifting resource demands rapidly.

5. The method according to claim 1, further comprising:

selecting the operational parameters from an N-dimensional parameter space; and

selecting different optimization points to operate substantially near a maximum performance.

6. The method according to claim 1, wherein the flexible resource demand certificates are associated with one or more virtual machine instances.

7. The method according to claim 1, further comprising:

receiving an indication to employ the flexible resource demand certificate; and

when resources are available to ensure optimized performance, varying control parameters to explore an optimization space and determining suitable operating points to generate the flexible resource demand certificate.

8. The method according to claim 7, further comprising:

providing a billing credit to a user to offset a performance penalty such that the user is not penalized for being resource flexible.

9. A server to manage flexible resource demand certificates for applications in virtual machine management, the server comprising:

a memory configured to store instructions; and

a processing unit configured to execute a virtual machine manager in conjunction with the instructions, wherein the virtual machine manager is configured to;

analyze a flexible resource demand certificate associated with an application, wherein the flexible resource demand certificate includes indications of predetermined operational compilation architectures for the application that are complimentary but include different resource demands such that the resource demands are altered to prevent the resource demands from conflicting;

select an initial operating point target based on the analysis;

select operational parameters from an N-dimensional parameter space;

select different optimization points to operate substantially near a maximum performance;

provide the operational parameters to a flexible demand manager that is configured to direct a dynamic compiler to targeted settings for the provided operational parameters; and

alter a compilation approach of the dynamic compiler such that a same application is directed into two forms, each of the two forms comprising an inner loop and an outer loop having substantially different execution stacks and memory allotment and usage that are employed in a different manner by each of the two forms, wherein a first form uses memory extensively and a second form trades memory usage for processor usage.

10. The server according to claim 9, wherein the targeted settings for the operational parameters are established in an optimization loop of a Just-In-Time compilation at runtime.

11. The server according to claim 9, wherein the optimization points are included in a parameter table within the flexible resource demand certificate.

12. The server according to claim 9, wherein the dynamic compiler is configured to accept messages to alter the optimization points.

13. The server according to claim 12, wherein the messages are passed as one or more of system flags, thread messages, or network messages.

14. The server according to claim 12, wherein the messages are one of datacenter infrastructure management (DCIM) messages, load balancing messages, or local exchange messages from virtual machine management that are interpreted by a central system that also holds the flexible resource demand certificates for a datacenter.

15. The server according to claim 14, wherein the virtual machine manager is further configured to:

enable the central system to prepare a resident application ahead of time by altering a resource mix employed by the resident application as a new application is being placed on a same virtual machine as the resident application.

16. The server according to claim 9, wherein the flexible resource demand certificates are associated with one or more virtual machine instances.

17. The server according to claim 9, wherein the virtual machine manager is further configured to:

receive an indication to employ the flexible resource demand certificate; and

when resources are available to ensure optimized performance, vary control parameters to explore an optimization space and determine suitable operating points to generate the flexible resource demand certificate.

18. The server according to claim 17, wherein the virtual machine manager is further configured to:

provide a billing credit to a user to offset a performance penalty such that the user is not penalized for being resource flexible.

19. A non-transitory computer-readable storage medium having instructions stored thereon to employ flexible resource demand certificates for applications in virtual machine management, the instructions comprising:

in response to receiving a message that indicates an imminent arrival of an application scheduled to migrate to a virtual machine of a datacenter, analyzing a flexible resource demand certificate associated with a resident application of the virtual machine to determine resource demands for the resident application for one or more operational parameters, wherein the flexible resource demand certificate includes indications of predetermined operational compilation architectures for the resident application that are complimentary but include different resource demands such that the resource demands are altered to prevent the resource demands from conflicting upon arrival of the application, and is associated with an instance of the virtual machine allowing resource demand information to be associated with the virtual machine, while further being available to a central management system such that the central management system has visibility to resource demands of multiple applications to enable new levels of resource demand control without load balancing virtual machine transfers;

selecting an initial operating point target based on the analysis;

providing the one or more operational parameters to a flexible demand manager that is configured to direct a dynamic compiler to targeted settings for the provided operational parameters, wherein the targeted settings for the one or more operational parameters are established in an optimization loop of a Just-In-Time compilation at runtime, and a compilation approach of the dynamic compiler is altered such that the resident application is directed into two forms, each of the two forms comprising an inner loop and an outer loop having substantially different execution stacks and memory allotment and usage that are employed in a different manner by each of the two forms, wherein a first form uses memory extensively and a second form trades memory usage for processor usage; and

preparing the resident application by altering the resource demands for the resident application with the established targeted settings for the one or more operational parameters prior to the application migrating to the virtual machine.

20. The non-transitory computer-readable storage medium according to claim 19, wherein the instructions further comprise:

receiving an indication to employ the flexible resource demand certificate;

when resources are available to ensure optimized performance, varying control parameters to explore an optimization space and determining suitable operating points to generate the flexible resource demand certificate; and

providing a billing credit to a user to offset a performance penalty such that the user is not penalized for being resource flexible, wherein the flexible resource demand certificate further includes billing credit information to capture discounts for offering flexible demand.