Systems and methods for providing dynamic connection spillover among virtual servers
First Claim
1. A method for an appliance to direct handling of transport layer connection requests from a first virtual server of the appliance managing a first plurality of services to a second virtual server of the appliance managing a second plurality of services upon exceeding, by the first virtual server, a maximum connection threshold determined dynamically from a status of the first plurality of services, the method comprising:
- (a) establishing, on an appliance, a first virtual server which directs transport layer connection requests from a plurality of clients to a first plurality of services;
(b) establishing, via the appliance, a first dynamic threshold identifying a maximum number of active transport layer connections for the first virtual server, the first dynamic threshold comprising a sum of a predetermined transport layer connection capacity for each of the plurality of services that is currently identified as available, wherein the predetermined transport layer connection capacity of a particular service comprises a predetermined number of transport layer connections the particular service is configured to process;
(c) monitoring, by the appliance, a status for each of the plurality of services;
(d) determining, by the appliance, the status of a service of the plurality of services indicates the service is not available;
(e) adjusting, by the appliance in response to the determination, the first dynamic threshold to comprise the sum of the predetermined transport layer connection capacity for each of the plurality of services having a status of available, the adjusted first dynamic threshold excluding the predetermined transport layer connection capacity of the service that is not available;
(f) determining, by the appliance, a number of active transport layer connections to the first virtual server exceeds the first dynamic threshold;
(g) establishing, by the appliance in response to the determination, a second virtual server which directs transport layer connection requests from the plurality of clients to a second plurality of services;
(h) establishing, via the appliance, a second dynamic threshold identifying a maximum number of active transport layer connections for the second virtual server, the second dynamic threshold comprising a sum of a predetermined transport layer connection capacity for each of the plurality of services of the second virtual server that is currently identified as available; and
(i) providing, via the appliance, a transport layer connection request received by the appliance to the second virtual server responsive to determining that a number of active transport layer connections to the first virtual server exceeds the first dynamic threshold.
8 Assignments
0 Petitions
Accused Products
Abstract
A method for an appliance to switch handling of transport layer connection requests from a first virtual server of the appliance managing a first plurality of services to a second virtual server of the appliance managing a second plurality of services upon exceeding, by the first virtual server, a maximum connection threshold determined dynamically from a status of the first plurality of services. The method includes the steps of: establishing, on an appliance, a first virtual server which directs transport layer connection requests from a plurality of clients to a first plurality of services; establishing, via the appliance, a predetermined threshold identifying a maximum active transport layer connection capacity for the first virtual server, the predetermined threshold comprising a sum of a predetermined connection capacity for each of the plurality of services; monitoring, by the appliance, a status for each of the plurality of services; determining, by the appliance, the status of a service of the plurality of services indicates the service is not available; and adjusting, by the appliance in response to the determination, the predetermined threshold to comprise the sum of the predetermined connection capacity for each of the plurality of services having a status of available. Corresponding systems are also described.
-
Citations
24 Claims
-
1. A method for an appliance to direct handling of transport layer connection requests from a first virtual server of the appliance managing a first plurality of services to a second virtual server of the appliance managing a second plurality of services upon exceeding, by the first virtual server, a maximum connection threshold determined dynamically from a status of the first plurality of services, the method comprising:
-
(a) establishing, on an appliance, a first virtual server which directs transport layer connection requests from a plurality of clients to a first plurality of services; (b) establishing, via the appliance, a first dynamic threshold identifying a maximum number of active transport layer connections for the first virtual server, the first dynamic threshold comprising a sum of a predetermined transport layer connection capacity for each of the plurality of services that is currently identified as available, wherein the predetermined transport layer connection capacity of a particular service comprises a predetermined number of transport layer connections the particular service is configured to process; (c) monitoring, by the appliance, a status for each of the plurality of services; (d) determining, by the appliance, the status of a service of the plurality of services indicates the service is not available; (e) adjusting, by the appliance in response to the determination, the first dynamic threshold to comprise the sum of the predetermined transport layer connection capacity for each of the plurality of services having a status of available, the adjusted first dynamic threshold excluding the predetermined transport layer connection capacity of the service that is not available; (f) determining, by the appliance, a number of active transport layer connections to the first virtual server exceeds the first dynamic threshold; (g) establishing, by the appliance in response to the determination, a second virtual server which directs transport layer connection requests from the plurality of clients to a second plurality of services; (h) establishing, via the appliance, a second dynamic threshold identifying a maximum number of active transport layer connections for the second virtual server, the second dynamic threshold comprising a sum of a predetermined transport layer connection capacity for each of the plurality of services of the second virtual server that is currently identified as available; and (i) providing, via the appliance, a transport layer connection request received by the appliance to the second virtual server responsive to determining that a number of active transport layer connections to the first virtual server exceeds the first dynamic threshold. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 24)
-
-
12. A system to direct handling of transport layer connection requests from a first virtual server of the appliance managing a first plurality of services to a second virtual server of the appliance managing a second plurality of services upon exceeding, by the first virtual server, a maximum connection threshold determined dynamically from a status of the first plurality of services, the system comprising:
-
a first virtual server executing on a network appliance that directs transport layer connection requests from a plurality of clients to a first plurality of services and establishes, a dynamic threshold identifying a maximum number of active transport layer connections for the first virtual server, the dynamic threshold comprising a sum of a predetermined transport layer connection capacity for each of the plurality of services that is currently identified as available, wherein the predetermined transport layer connection capacity of a particular service comprises a predetermined number of transport layer connections the particular service is configured to process; a monitor executing on the network appliance that monitors a status for each of the plurality of services and determines the status of a service of the plurality of services indicates the service is not available; and wherein the network appliance adjusts in response to the determination, the dynamic threshold to comprise the sum of the predetermined transport layer connection capacity for each of the plurality of services having a status of available, the adjusted dynamic threshold excluding the predetermined transport layer connection capacity of the service that is not available; wherein the network appliance determines a number of active transport layer connections to the first virtual server exceeds the dynamic threshold; and
in response to the determination, the appliance establishes a second virtual server which directs transport layer connection requests from a plurality of clients to a second plurality of services;wherein the network appliance establishes a second dynamic threshold identifying a maximum number of active transport layer connections for the second virtual server, the second dynamic threshold comprising a sum of a predetermined transport layer connection capacity for each of the plurality of services of the second virtual server that is currently identified as available; wherein the network appliance provides a transport layer connection request received by the network appliance to the second virtual server responsive to determining that a number of active transport layer connections to the first virtual server exceeds the first dynamic threshold. - View Dependent Claims (13, 14, 15, 16, 17, 18, 19, 20, 21)
-
-
22. A method for an appliance to direct handling of transport layer connection requests from a first virtual server of the appliance managing a first plurality of services to a second virtual server of the appliance managing a second plurality of services upon exceeding, by the first virtual server, a maximum connection threshold determined dynamically from a status of each service in the first plurality of services, the method comprising:
-
(a) establishing, on an appliance, a first virtual server which directs transport layer connection requests from a plurality of clients to a first plurality of services; (b) establishing, via the appliance, a predetermined threshold identifying a maximum active transport layer connection capacity for the first virtual server, the predetermined threshold comprising a sum of a predetermined transport layer connection capacity for each of the plurality of services that is identified as currently available, a first service having a first predetermined transport layer connection capacity and a second service having a second predetermined transport layer connection capacity, the second service is currently unavailable, wherein the predetermined transport layer connection capacity of a particular service comprises a predetermined number of transport layer connections the particular service is configured to process; (c) monitoring, by the appliance, a status for the first service and the second service of the plurality of services; (d) determining, by the appliance, the status of the first service indicates the first service is not available and that the status of the second service indicates the second service is available; (e) adjusting, by the appliance in response to the determination, the predetermined threshold by subtracting the first predetermined transport layer connection capacity of the first service from the predetermined threshold and adding the second predetermined transport layer connection capacity of the second service to the predetermined threshold; (f) determining, by the appliance, a number of active transport layer connections to the first virtual server exceeds the dynamic threshold; and (g) establishing, by the appliance in response to the determination, a second virtual server which directs transport layer connection requests from a plurality of clients to a second plurality of services; (h) establishing, via the appliance, a second dynamic threshold identifying a maximum number of active transport layer connections for the second virtual server, the second dynamic threshold comprising a sum of a predetermined transport layer connection capacity for each of the plurality of services of the second virtual server that is currently identified as available; and (i) providing, via the appliance, a transport layer connection request received by the appliance to the second virtual server responsive to determining that a number of active transport layer connections to the first virtual server exceeds the first dynamic threshold. - View Dependent Claims (23)
-
Specification