Load Balancing for Network Devices

• US 20120271964A1
• Filed: 04/20/2011
• Published: 10/25/2012
• Est. Priority Date: 04/20/2011
• Status: Active Grant

• Current Assignee: CA, Inc. (d/b/a CA Technologies) (Broadcom, Inc.)
• Original Assignee: Blue Coat Systems Incorporated (Gen Digital Inc.)
• Inventors: Porter, Kevin
• Granted Patent: US 9,705,977 B2
• Time in Patent Office: Days
• US Class Current: 709/235
• CPC Class Codes: H04L 67/1008 based on parameters of servers, e.g. available memory or workload monitoring of computer activity G06F11/30
• CPC Class Codes: H04L 67/568 Storing data temporarily at an intermediate stage, e.g. caching

Abstract

In one embodiment, an electronic device receives a request; obtains a current state from each of a plurality of electronic devices; and selects one of the plurality of electronic devices to service the request based on the current state of each of the plurality of electronic devices. The current state of each of the plurality of electronic devices is one of a plurality of states in a state model. Each of the plurality of states in the state model indicates a discrete level of workload for the plurality of electronic devices.

Claims

1. A method comprising:

by an electronic device,

receiving a request;

obtaining a current state from each of a plurality of electronic devices, wherein;

the current state of each of the plurality of electronic devices is one of a plurality of states in a state model; and

each of the plurality of states in the state model indicates a discrete level of workload for the plurality of electronic devices; and

selecting one of the plurality of electronic devices to service the request based on the current state of each of the plurality of electronic devices.

2. The method of claim 1, wherein the one electronic device selected to service the request is an electronic device currently having a lowest level of workload, as indicated by the state model, among the plurality of electronic devices.

3. The method of claim 1, wherein:

the state model is represented as a Simple Network Management Protocol (SNMP) variable; and

the current state of each of the plurality of electronic devices is obtained from the electronic device using a SNMP command.

4. The method of claim 1, wherein the current state of each of the plurality of electronic devices is obtained from the electronic device using a Hypertext Transfer Protocol (HTTP) command.

5. The method of claim 1, wherein each of the plurality of electronic devices determines its own current state based on one or more resource metrics of the electronic device.

6. The method of claim 1, wherein each of the plurality of electronic devices determines its own current state based on one or more workload metrics of the electronic device.

7. The method of claim 1, wherein the plurality of electronic devices is a plurality of intermediary network devices.

8. The method of claim 1, wherein the plurality of electronic devices is a plurality of proxy devices.

9. The method of claim 1, wherein:

the plurality of electronic devices is a plurality of caching devices; and

the request is a request for cached content.

10. The method of claim 1, further comprising forwarding the request to the selected one electronic device.

11. The method of claim 1, wherein the plurality of states comprises a state indicating that an electronic device is in the process of halting or shutting down.

12. A system comprising:

a memory comprising instructions executable by one or more processors; and

the one or more processors coupled to the memory and operable to execute the instructions, the one or more processors being operable when executing the instructions to;

receive a request;

obtain a current state from each of a plurality of systems, wherein;

the current state of each of the plurality of systems is one of a plurality of states in a state model; and

each of the plurality of states in the state model indicates a discrete level of workload for the plurality of systems; and

select one of the plurality of systems to service the request based on the current state of each of the plurality of systems.

13. The system of claim 12, wherein the one system selected to service the request is a system currently having a lowest level of workload, as indicated by the state model, among the plurality of systems.

14. The system of claim 12, wherein:

the state model is represented as a Simple Network Management Protocol (SNMP) variable; and

the current state of each of the plurality of systems is obtained from the system using a SNMP command.

15. The system of claim 12, wherein the current state of each of the plurality of systems is obtained from the system using a Hypertext Transfer Protocol (HTTP) command.

16. The system of claim 12, wherein each of the plurality of systems determines its own current state based on one or more resource metrics of the system.

17. The system of claim 12, wherein each of the plurality of systems determines its own current state based on one or more workload metrics of the system.

18. The system of claim 12, wherein the plurality of systems is a plurality of intermediary network devices.

19. The system of claim 12, wherein the plurality of systems is a plurality of proxy devices.

20. The system of claim 12, wherein:

the plurality of systems is a plurality of caching devices; and

the request is a request for cached content.

21. The system of claim 12, wherein the one or more processors are further operable when executing the instructions to forward the request to the selected one system.

22. The system of claim 12, wherein the plurality of states comprises a state indicating that an electronic device is in the process of halting or shutting down.

23. One or more computer-readable non-transitory storage media embodying software operable when executed by a computer system to:

receive a request;

obtain a current state from each of a plurality of computer systems, wherein;

the current state of each of the plurality of computer systems is one of a plurality of states in a state model; and

each of the plurality of states in the state model indicates a discrete level of workload for the plurality of computer systems; and

select one of the plurality of computer systems to service the request based on the current state of each of the plurality of computer systems.

24. The media of claim 23, wherein the one computer system selected to service the request is a computer system currently having a lowest level of workload, as indicated by the state model, among the plurality of computer systems.

25. The media of claim 23, wherein:

the state model is represented as a Simple Network Management Protocol (SNMP) variable; and

the current state of each of the plurality of computer systems is obtained from the computer system using a SNMP command.

26. The media of claim 23, wherein the current state of each of the plurality of computer systems is obtained from the computer system using a Hypertext Transfer Protocol (HTTP) command.

27. The media of claim 23, wherein each of the plurality of computer systems determines its own current state based on one or more resource metrics of the computer system.

28. The media of claim 23, wherein each of the plurality of computer systems determines its own current state based on one or more workload metrics of the computer system.

29. The media of claim 23, wherein the plurality of computer systems is a plurality of intermediary network devices.

30. The media of claim 23, wherein the plurality of computer systems is a plurality of proxy devices.

31. The media of claim 23, wherein:

the plurality of computer systems is a plurality of caching devices; and

the request is a request for cached content.

32. The media of claim 23, wherein the software is further operable when executed by the computer systems to forward the request to the selected one computer system.

33. The media of claim 23, wherein the plurality of states comprises a state indicating that an electronic device is in the process of halting or shutting down.