Load management to reduce communication signaling latency in a virtual machine environment
First Claim
Patent Images
1. A computer implemented method of optimizing an internet signaling protocol latency of an application server, the computer implemented method comprising:
- receiving a plurality of application memory requests at a load balancer associated with the application server;
calculating, at the load balancer, an automatic memory management latency based on an automatic memory management activity in response to receiving each of the application memory requests;
evaluating, at the load balancer, based on the calculated automatic memory management latency, whether the automatic memory management latency is within a specified threshold that is acceptable for the internet signaling protocol latency of the application server, wherein the internet signaling protocol latency is based on the automatic memory management latency; and
throttling an application memory request acceptance rate of the application memory requests at the load balancer based on a result of the evaluation which indicates the automatic memory management latency exceeds the specified threshold.
5 Assignments
0 Petitions
Accused Products
Abstract
A computer implemented method for reducing communication signaling protocol latency. An acceptable level of latency is specified. Automatic memory management activities are monitored based on specified parameters to calculate a level of activity that determines whether a reduction of activity is required.
-
Citations
16 Claims
-
1. A computer implemented method of optimizing an internet signaling protocol latency of an application server, the computer implemented method comprising:
-
receiving a plurality of application memory requests at a load balancer associated with the application server; calculating, at the load balancer, an automatic memory management latency based on an automatic memory management activity in response to receiving each of the application memory requests; evaluating, at the load balancer, based on the calculated automatic memory management latency, whether the automatic memory management latency is within a specified threshold that is acceptable for the internet signaling protocol latency of the application server, wherein the internet signaling protocol latency is based on the automatic memory management latency; and throttling an application memory request acceptance rate of the application memory requests at the load balancer based on a result of the evaluation which indicates the automatic memory management latency exceeds the specified threshold. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12)
-
-
13. A method for accepting application memory requests for an application server at a load balancer associated with the application server, the application memory requests consuming heap memory associated with the application server, the method comprising:
-
receiving an application memory request at the load balancer; determining a first function related to an expected garbage collection latency based on an amount of heap that needs to be scanned during a garbage collection event; determining a second function related to an expected garbage collection latency based on a number of objects in the heap that are not collected during the garbage collection event; and wherein determining the first and second functions are performed at the load balancer; rejecting the application memory request at the load balancer when the first and second functions exceed respective first and second thresholds; and accepting the application memory request at the load balancer when the first and second functions are under the first and second thresholds, respectively. - View Dependent Claims (14, 15, 16)
-
Specification