Systems and methods for providing dynamic spillover of virtual servers based on bandwidth

• US 8,312,120 B2
• Filed: 03/12/2007
• Issued: 11/13/2012
• Est. Priority Date: 08/22/2006
• Status: Active Grant

• Current Assignee: Citrix Systems, Inc. (Cloud Software Group)
• Original Assignee: Citrix Systems, Inc. (Cloud Software Group)
• Inventors: Ram, Maruthi, Suganthi, Josephine, Verzunov, Sergey, Kamath, Sandeep
• Primary Examiner(s): HIGA, BRENDAN Y
• Application Number:
  US11/685,186
• Publication Number:
  US 20080049786A1
• Time in Patent Office: 2,073 Days
• Field of Search: 709220-222, 709223-226, 709227-229, 709238-244, 718104-105
• US Class Current: 709/223
• CPC Class Codes: G06F 9/5083 Techniques for rebalancing the load in a distributed system
• CPC Class Codes: H04L 67/1001 for accessing one among a plurality of replicated servers
• CPC Class Codes: H04L 67/1008 based on parameters of servers, e.g. available memory or workload monitoring of computer activity G06F11/30
• CPC Class Codes: H04L 67/101 based on network conditions
• CPC Class Codes: H04L 67/1012 based on compliance of requirements or conditions with available server resources
• CPC Class Codes: H04L 67/1029 using data related to the state of servers by a load balancer
• CPC Class Codes: H04L 67/2871 Implementation details of single intermediate entities
• CPC Class Codes: H04L 67/288 Distributed intermediate devices, i.e. intermediate devices for interaction with other intermediate devices on the same level
• CPC Class Codes: H04L 67/563 Data redirection of data network streams
• CPC Class Codes: H04L 67/59 Providing operational support to end devices by off-loading in the network or by emulation, e.g. when they are unavailable
• CPC Class Codes: H04L 67/63 Routing a service request depending on the request content or context

Abstract

The present solution provides a spillover management technique for virtual servers of an appliance based on bandwidth. A network administrator may configure a bandwidth threshold for one or more virtual servers, such as virtual servers providing acceleration or load balancing for one or more services. The bandwidth threshold may be specified as a number of bytes transferred via the virtual server. The bandwidth threshold may also be specified as a round trip time or derivative thereof. A user may specify the bandwidth threshold via a configuration interface. Otherwise, the appliance may establish the bandwidth threshold. The appliance monitors the bandwidth used by a first virtual server. In response to detecting the bandwidth reaching or exceeding the bandwidth threshold, the appliance dynamically directs client requests to a second virtual server.

Claims

1. A method comprising:

(a) establishing, via an appliance, a bandwidth threshold for a first virtual server executing on the appliance for directing connection requests from a plurality of clients to a first plurality of services;

(b) monitoring, by the appliance, a number of bytes transferred via the first virtual server;

(c) determining, by the appliance, a status of a service of the first plurality of services indicates the service is not available;

(d) adjusting, by the appliance, the bandwidth threshold to account for the status of the service;

(e) determining, by the appliance, the monitored number of bytes transferred via the first virtual server exceeds the bandwidth threshold; and

(f) directing, by the appliance in response to the determination, a connection request of a client to a second virtual server executing on the appliance.

2. The method of claim 1, comprising identifying, via the appliance, the second virtual server as a backup virtual server for the first virtual server.

3. The method of claim 1, comprising establishing, by the appliance in response to the determination, the second virtual server.

4. The method of claim 1, wherein step (b) comprises determining, by the appliance, a number of bytes per second transferred from the first virtual server to the first plurality of services.

5. The method of claim 1, wherein step (b) comprises determining, by the appliance, a number of bytes per second transferred from the first virtual server to the plurality of clients.

6. The method of claim 1, wherein step (b) comprises determining, by the appliance, a number of bytes per second received by the first virtual server.

7. The method of claim 1, wherein step (b) comprises determining, by the appliance, a number of bytes per second transmitted by the first virtual server.

8. The method of claim 1, comprising transmitting, by the second virtual server, the connection request to a service of the first plurality of services.

9. The method of claim 1, comprising determining, by the appliance via monitoring, the bandwidth used by the first virtual server falls below the bandwidth threshold.

10. The method of claim 9, comprising directing, by the appliance in response to the determination, connection requests to the first virtual server instead of the second virtual server.

11. The method of claim 9, comprising receiving, by the appliance a request from the client via a connection established via the second virtual server, and providing the request to the second virtual server.

12. The method of claim 1, comprising receiving, by the appliance a request from a client via a connection established with the first virtual server, and providing the request to the first virtual server.

13. The method of claim 1, wherein step (b) comprises monitoring, by the appliance, the bandwidth used by the first virtual server at a predetermined frequency.

14. The method of claim 1, comprising determining, by the appliance, bandwidth used by the second virtual server exceeds a second bandwidth threshold, and directing client requests to a third virtual server instead of the second virtual server.

15. The method of claim 1, wherein step (f) comprises identifying, by the appliance, bandwidth used by the second virtual server is within a second bandwidth threshold.

16. The method of claim 1, comprising adjusting, by the appliance, the bandwidth threshold based on one of a performance or operational characteristics of the first virtual server.

17. The method of claim 1, comprising monitoring, by the appliance, a number of connections of the first virtual server.

18. The method of claim 17, comprising determining, by the appliance, to direct a connection request of the client to the second virtual server based on the number of connections of the first virtual server and the bandwidth used by the first virtual server.

19. The method of claim 1, comprising determining, by the appliance, bandwidth used by the first virtual server exceeds the bandwidth threshold, and redirecting the request of the client to one of a second appliance, a server or a service.

20. The method of claim 19, wherein the appliance uses a redirect uniform resource locator configured for the first virtual server to redirect the request of the client.

21. The method of claim 1, comprising determining, by the appliance, bandwidth used by the first virtual server exceeds the bandwidth threshold, and providing the client with a redirect uniform resource locator to one of a second appliance, a server or a service.

22. The method of claim 1, wherein the bandwidth threshold comprises a predetermined number of bytes per second.

23. An appliance comprising:

a virtual server switching mechanism determining to direct requests from clients to a virtual server of a plurality of virtual servers;

a first virtual server executing on the appliance for directing connection requests from a plurality of clients to a first plurality of services;

a monitoring agent determining a status of a service of the first plurality of services indicates the service is not available; and

wherein the load monitor adjusts a bandwidth threshold to account for the status of the service, determines a number of bytes transferred via the first virtual service exceeds the bandwidth threshold, and in response to the determination, the virtual server switching mechanism directs a connection request for a client to a second virtual server executing on the appliance.

24. The appliance of claim 23, comprising a configuration interface receiving information from a user identifying the second virtual server as a backup virtual server for the first virtual server.

25. The appliance of claim 23, wherein the appliance establishes the second virtual server in response to the determination the bandwidth used by the first virtual server exceeds the bandwidth threshold.

26. The appliance of claim 23, wherein the load monitor determines a number of bytes per second transferred from the first virtual server to the first plurality of services.

27. The appliance of claim 23, wherein the load monitor determines a number of bytes per second transferred from the first virtual server to the plurality of clients.

28. The appliance of claim 23, wherein the load monitor determines a number of bytes per second received by the first virtual server.

29. The appliance of claim 23, wherein the load monitor determines a number of bytes per second transmitted by the first virtual server.

30. The appliance of claim 23, comprising a configuration information interface receiving information from a user identifying the bandwidth threshold as one of a predetermined number of kilobytes or a predetermined number of megabytes.

31. The appliance of claim 23, wherein the second virtual server transmits the connection request to a service of the first plurality of services.

32. The appliance of claim 31, wherein the load monitor determines bandwidth used by the first virtual server falls below the bandwidth threshold.

33. The appliance of claim 32, wherein the virtual server switching mechanism, in response to the determination, directs connection requests to the first virtual server instead of the second virtual server.

34. The appliance of claim 32, wherein the virtual server switching mechanism receives a request from a client via a connection established via the second virtual server, and provides the request to the second virtual server.

35. The appliance of claim 23, wherein the virtual server switching mechanism receives a request from a client via a connection established via the first virtual server, and provides the request to the first virtual server.

36. The appliance of claim 23, wherein the load monitor monitors the bandwidth used by the first virtual server at a predetermined frequency.

37. The appliance of claim 23, wherein the load monitor determines bandwidth used by the second virtual server exceeds a second bandwidth threshold, and in response to the load monitor, the virtual server switching mechanism directs client requests to a third virtual server instead of the second virtual server.

38. The appliance of claim 37, wherein the load monitor determines bandwidth used by the second virtual server is within a second bandwidth threshold.

39. The appliance of claim 23, wherein the bandwidth detector adjusts the bandwidth threshold based on one of a performance or operational characteristics of the first virtual server.

40. The appliance of claim 23, wherein the load monitor monitors a number of connections of the first virtual server.

41. The appliance of claim 40, wherein the virtual server switching mechanism determines to direct a connection request of the client to the second virtual server based on the number of connections of the first virtual server and the bandwidth used by the first virtual server.

42. The appliance of claim 23, wherein the load monitor determines bandwidth used by the first virtual server exceeds the bandwidth threshold, and in response to the determination, the virtual server switching mechanism redirects the request of the client to one of a second appliance, a server or a service.

43. The appliance of claim 42, wherein the appliance uses a redirect uniform resource locator configured for the first virtual server to redirect the request of the client.

44. The appliance of claim 23, wherein the load monitor determines, bandwidth used by the first virtual server exceeds the bandwidth threshold, and in response to the determination, the virtual server switching mechanism provides the client with a redirect uniform resource locator to one of a second appliance, a server or a service.

45. The appliance of claim 23, wherein the bandwidth threshold comprises a predetermined number of bytes per second.