Data-driven feedback control system for real-time application support in virtualized networks

• US 9,898,321 B2
• Filed: 07/23/2015
• Issued: 02/20/2018
• Est. Priority Date: 07/23/2015
• Status: Expired due to Fees

• Current Assignee: AT&T Intellectual Property I LP (AT&T, Inc.)
• Original Assignee: AT&T Intellectual Property I LP (AT&T, Inc.)
• Inventors: Wu, Tsong-Ho, Li, Wen-Jui
• Primary Examiner(s): Lee, Adam
• Application Number:
  US14/806,906
• Publication Number:
  US 20170024234A1
• Time in Patent Office: 943 Days
• Field of Search: None
• CPC Class Codes: G06F 2009/45595 Network integration; Enabling network access in virtual machine instances
• CPC Class Codes: G06F 9/45533 Hypervisors; Virtual machine monitors
• CPC Class Codes: G06F 9/45558 Hypervisor-specific management and integration aspects
• CPC Class Codes: G06F 9/466 Transaction processing
• CPC Class Codes: G06F 9/4887 involving deadlines, e.g. rate based, periodic

Abstract

Concepts and technologies disclosed herein are directed to data-driven feedback control systems for an acceptable level of real-time application transaction completion rate in virtualized networks, while maximizing virtualized server utilization. According to one aspect disclosed herein, a network virtualization platform (“NVP”) includes a plurality of hardware resources, a virtual machine (“VM”), and a virtual machine monitor (“VMM”). The VMM can track an execution state of each of a plurality of applications associated with the VM. The VMM can measure a real-time application transaction completion rate of the VM. The VMM can determine whether a trigger condition exists for priority scheduling of real-time applications based upon the real-time application transaction completion rate and a pre-set threshold value. The VMM can, in response to determining that the trigger condition exists, apply a priority control schedule to instruct the VM to perform priority processing of a real-time application over a non-real-time application.

Claims

1. A network virtualization platform comprising:

a plurality of hardware resources;

a virtual machine; and

a virtual machine monitor comprising a plurality of data-driven feedback control modules that, when executed by a compute resource of the plurality of hardware resources, causes the virtual machine monitor to perform operations comprising

tracking an execution state of each of a plurality of applications associated with the virtual machine,

measuring a real-time application transaction completion rate of the virtual machine, wherein the real-time application transaction completion rate is equal to a number of real-time application transactions being successfully processed divided by a number of real-time application transactions entering the network virtualization platform in a given time period,

determining whether a trigger condition exists by comparing the real-time application transaction completion rate and a pre-set threshold value, and

in response to determining that the trigger condition exists, applying a priority control schedule to instruct the virtual machine to perform priority processing of a real-time application of the plurality of applications over a non-real-time application of the plurality of applications.

2. The network virtualization platform of claim 1, wherein the plurality of data-driven feedback control modules comprises a virtual machine fair scheduling module, and wherein the operations further comprise applying a fair control schedule to instruct the virtual machine to perform baseline processing of the plurality of applications.

3. The network virtualization platform of claim 2, wherein the plurality of data-driven feedback control modules comprises an application execution state monitoring module and a priority scheduling trigger module, and wherein tracking the execution state of each of the plurality of applications associated with the virtual machine comprises:

determining whether an application transaction of the real-time application is in a processing queue for execution by the virtual machine;

in response to determining that the application transaction of the real-time application is in the processing queue for execution by the virtual machine, recording a state change from a ready/wait execution state to a run execution state;

determining whether the application transaction of the real-time application completed successfully;

if the application transaction completed successfully, incrementing a successful application transaction completion counter and reporting the successful application transaction completion counter to the priority scheduling trigger module of the plurality of data-driven feedback control modules; and

if the application transaction did not complete successfully, incrementing an unsuccessful application transaction completion counter and reporting the unsuccessful application transaction completion counter to the priority scheduling trigger module of the plurality of data-driven feedback control modules.

4. The network virtualization platform of claim 3, wherein the plurality of data-driven feedback control modules comprises a priority scheduling trigger module and a priority scheduling control module, and wherein determining whether the trigger condition exists comprises:

receiving the successful application transaction completion counter and the unsuccessful application transaction completion counter from the application execution state monitoring module;

determining a critical condition that specifies when the real-time application transaction completion rate drops below the pre-set threshold value; and

in response to determining that the critical condition exists, notifying the priority scheduling control module of the critical condition.

5. The network virtualization platform of claim 4, wherein applying the priority control schedule to instruct the virtual machine to perform priority processing of the real-time application of the plurality of applications over the non-real-time application of the plurality of applications is in response to receiving notification from the priority scheduling trigger module.

6. The network virtualization platform of claim 5, wherein applying the priority control schedule to instruct the virtual machine to perform priority processing of the real-time application of the plurality of applications over the non-real-time application of the plurality of applications comprises:

resetting a first execution state of the non-real-time application on the virtual machine to ready/wait; and

setting a second execution state of the real-time application on the virtual machine to run.

7. The network virtualization platform of claim 6, wherein resetting the first execution state of the non-real-time application on the virtual machine to ready/wait comprises resetting the first execution state of the non-real-time application on the virtual machine to ready/wait prior to a time-out.

8. A method comprising:

tracking, by a virtual machine monitor executed by a compute resource of a plurality of hardware resources of a network virtualization platform, an execution state of each of a plurality of applications associated with a virtual machine;

measuring, by the virtual machine monitor, a real-time application transaction completion rate of the virtual machine, wherein the real-time application transaction completion rate is equal to a number of real-time application transactions being successfully processed divided by a number of real-time application transactions entering the network virtualization platform in a given time period;

determining, by the virtual machine monitor, whether a trigger condition exists by comparing the real-time application transaction completion rate and a pre-set threshold value; and

in response to determining that the trigger condition exists, applying, by the virtual machine monitor, a priority control schedule to instruct the virtual machine to perform priority processing of a real-time application of the plurality of applications over a non-real-time application of the plurality of applications.

9. The method of claim 8, further comprising applying a fair control schedule to instruct the virtual machine to perform baseline processing of the plurality of applications.

10. The method of claim 9, wherein tracking the execution state of each of the plurality of applications associated with the virtual machine comprises:

determining whether an application transaction of the real-time application is in a processing queue for execution;

in response to determining that the application transaction of the real-time application is in the processing queue for execution, recording a state change from a ready/wait execution state to a run execution state;

determining whether the application transaction of the real-time application completed successfully;

if the application transaction completed successfully, incrementing a successful application transaction completion counter and reporting the successful application transaction counter; and

if the application transaction did not complete successfully, incrementing an unsuccessful application transaction completion counter and reporting the unsuccessful application transaction completion counter.

11. The method of claim 10, wherein determining whether the trigger condition exists comprises:

receiving the successful application transaction completion counter and the unsuccessful application transaction completion counter; and

determining that a critical condition exists, wherein the critical condition specifies when the application transaction completion rate drops below a threshold value.

12. The method of claim 11, wherein applying the priority control schedule to instruct the virtual machine to perform priority processing of the real-time application of the plurality of applications over the non-real-time application of the plurality of applications is in response to receiving notification that the critical condition exists.

13. The method of claim 12, wherein applying the priority control schedule to instruct the virtual machine to perform priority processing of the real-time application of the plurality of applications over the non-real-time application of the plurality of applications comprises:

resetting a first execution state of the non-real-time application on the virtual machine to ready/wait; and

setting a second execution state of the real-time application on the virtual machine to run.

14. The method of claim 13, wherein resetting the first execution state of the non-real-time application on the virtual machine to ready/wait comprises resetting the first execution state of the non-real-time application on the virtual machine to ready/wait prior to a time-out.

15. A computer-readable storage medium having instructions stored thereon that, when executed by a compute resource of a network virtualization platform, cause the compute resource to perform operations comprising:

tracking an execution state of each of a plurality of applications associated with a virtual machine operating within the network virtualization platform;

measuring a real-time application transaction completion rate of the virtual machine, wherein the real-time application transaction completion rate is equal to a number of real-time application transactions being successfully processed divided by a number of real-time application transactions entering the network virtualization platform in a given time period;

determining whether a trigger condition exists by comparing the real-time application transaction completion rate and a pre-set threshold value; and

in response to determining that the trigger condition exists, applying a priority control schedule to instruct the virtual machine to perform priority processing of a real-time application of the plurality of applications over a non-real-time application of the plurality of applications.

16. The computer-readable storage medium of claim 15, wherein the operations further comprise applying a fair control schedule to instruct the virtual machine to perform baseline processing of the plurality of applications.

17. The computer-readable storage medium of claim 16, wherein tracking the execution state of each of the plurality of applications associated with the virtual machine comprises:

determining whether an application transaction of the real-time application is in a processing queue for execution;

in response to determining that the application transaction of the real-time application is in the processing queue for execution, recording a state change from a ready/wait execution state to a run execution state;

determining whether the application transaction of the real-time application completed successfully;

if the application transaction completed successfully, incrementing a successful application transaction completion counter and reporting the successful application transaction completion counter; and

if the application transaction did not complete successfully, incrementing an unsuccessful application transaction completion counter and reporting the unsuccessful application transaction completion counter.

18. The computer-readable storage medium of claim 17, wherein determining whether the trigger condition exists comprises:

receiving the successful application transaction completion counter and the unsuccessful application transaction completion counter;

determining a critical condition exists, wherein the critical condition specifies when the real-time application transaction completion rate drops below the pre-set threshold value.

19. The computer-readable storage medium of claim 18, wherein applying the priority control schedule to instruct the virtual machine to perform priority processing of the real-time application of the plurality of applications over the non-real-time application of the plurality of applications is in response to receiving notification that the critical condition exists.

20. The computer-readable storage medium of claim 19, wherein applying the priority control schedule to instruct the virtual machine to perform priority processing of the real-time application of the plurality of applications over the non-real-time application of the plurality of applications comprises:

resetting a first execution state of the non-real-time application on the virtual machine to ready/wait; and

setting a second execution state of the real-time application on the virtual machine to run.