User load balancing systems and methods thereof

• US 20070260732A1
• Filed: 05/03/2006
• Published: 11/08/2007
• Est. Priority Date: 05/03/2006
• Status: Active Grant

• Current Assignee: BlueTie, Inc.
• Original Assignee: BlueTie, Inc.
• Inventors: Koretz, David
• Granted Patent: US 8,260,924 B2
• Time in Patent Office: Days
• US Class Current: 709/226
• CPC Class Codes: H04L 67/1001 for accessing one among a plurality of replicated servers
• CPC Class Codes: H04L 67/1008 based on parameters of servers, e.g. available memory or workload monitoring of computer activity G06F11/30
• CPC Class Codes: H04L 67/1012 based on compliance of requirements or conditions with available server resources
• CPC Class Codes: H04L 67/1095 Replication or mirroring of data, e.g. scheduling or transport for data synchronisation between network nodes

Abstract

A method, computer readable medium and system for user load balancing includes identifying when an overall load in at least one of two or more servers exceeds one or more thresholds that are related to one or more user loads. One or more of the user loads in the identified overall load in one of the servers are transferred to one or more of the other servers when the one or more thresholds is exceeded.

Claims

1. A method for user load balancing, the method comprising:

identifying when an overall load in at least one of two or more servers exceeds one or more thresholds that are related to one or more user loads; and

transferring one or more of the user loads in the identified overall load in one of the servers to one or more of the other servers when the one or more thresholds is exceeded.

2. The method as set forth in claim 1 wherein the two or more servers comprise at least one of a storage server and an application server.

3. The method as set forth in claim 1 wherein the overall load in at least one of the two or more servers comprises stateful data.

4. The method as item forth in claim 1 wherein the one or more thresholds comprise at least one of processor utilization with respect to one of the overall loads exceeding a first percentage for greater than a first period of time, disk space utilization with respect to one of the overall loads exceeding a second percentage, RAM utilization with respect to one of the overall loads exceeding a third percentage for a greater than a second period of time, and at least one of I/O read/writes and I/O transactions per second with respect to one of the overall loads at greater than a fourth percentage for greater than a third period of time.

5. The method as item forth in claim 1 wherein the one or more thresholds comprise at least one of processor utilization with respect to one of the overall loads exceeding a first percentage average for greater than a first period of time, disk space utilization with respect to one of the overall loads exceeding a second percentage, RAM utilization with respect to one of the overall loads exceeding a third percentage average for a greater than a second period of time, and I/O read/writes with respect to one of the overall loads at greater than a fourth percentage for greater than a third period of time.

6. The method as item forth in claim 1 wherein the transferring further comprises:

determining which of the one or more user loads in the identified overall load to move to one or more of the other servers;

determining which of the one or more other servers to move each of the determined one or more user loads; and

moving the determined one or more user loads in the identified overall load in the at least one of the servers to the determined one or more other servers.

7. The method as item forth in claim 6 wherein the moving the determined one or more user loads further comprises:

transferring the one or more determined user loads to the determined one or more other servers; and

obtaining a verification that each of the one or more transferred user loads is identical to the corresponding one of the determined one or more user loads.

8. The method as item forth in claim 7 wherein the moving the determined one or more user loads further comprises:

identifying any differences between the one or more transferred user loads and the one or more the determined one or more user loads which occurred after the transferring; and

updating the one or more transferred user loads with the identified differences.

9. The method as item forth in claim 8 further comprising updating a directory with a new location to the determined one or more other servers for each of the one or more transferred user loads.

10. The method as item forth in claim 6 wherein the determining which of the one or more user loads in the identified overall load in the at least one of the servers to move to one or more of the other servers further comprises:

determining an order for moving the determined one or more user loads based on one or more characteristics; and

moving the determined one or more user loads in accordance with the determined order.

11. The method as item forth in claim 10 wherein the one or more characteristics comprise at least one of the user loads which is currently inactive, which caused the identified overall load in the at least one of the servers to exceed the one or more thresholds, which is the largest in the identified overall load in the at least one server, and which has a last login date to an application.

12. The method as item forth in claim 6 wherein the transferring further comprises placing the determined one or more user loads to move in a queue which is read only accessible until the moving the determined one or more user loads is completed.

13. The method as item forth in claim 6 wherein the determining which of the one or more other servers to move each of the determined one or more user loads further comprises determining which of the other servers has a lowest average utilization of at least one of processor space and memory space and moving the determined one or more user loads to the determined server with the lowest average utilization of at least one of processor space and memory space.

14. The method as item forth in claim 6 wherein the determining which of the one or more other servers to move each of the determined one or more user loads further comprises determining which of the one or more other servers need to receive one or more of the user loads from the identified overall load in the at least one of the servers to balance the stored load between the servers and moving the determined one or more user loads to the determined one or more other servers to balance the stored load.

15. The method as item forth in claim 6 wherein the determining which of the one or more other servers to move each of the determined one or more user loads further comprises identifying when another server has been added to the one or more other servers before the determining which of the one or more other servers to move each of the determined one or more user loads.

16. The method as item forth in claim 1 wherein the transferring further comprises deleting the transferred one or more of the user loads in the identified overall load in the at least one of the servers after the transferring.

17. A computer readable medium having stored thereon instructions for user load balancing comprising machine executable code which when executed by at least one processor, causes the processor to perform steps comprising:

identifying when an overall load in at least one of two or more servers exceeds one or more thresholds that are related to one or more user loads; and

transferring one or more of the user loads in the identified overall load in one of the servers to one or more of the other servers when the one or more thresholds is exceeded.

18. The medium as set forth in claim 17 wherein the two or more servers comprise at least one of a storage server and an application server.

19. The medium as set forth in claim 17 wherein the overall load in at least one of the two or more servers comprises stateful data.

20. The medium as item forth in claim 17 wherein the one or more thresholds comprise at least one of processor utilization with respect to one of the overall loads exceeding a first percentage for greater than a first period of time, disk space utilization with respect to one of the overall loads exceeding a second percentage, RAM utilization with respect to one of the overall loads exceeding a third percentage for a greater than a second period of time, and at least one of I/O read/writes and I/O transactions per second with respect to one of the overall loads at greater than a fourth percentage for greater than a third period of time.

21. The medium as item forth in claim 17 wherein the one or more thresholds comprise at least one of processor utilization with respect to one of the overall loads exceeding a first percentage average for greater than a first period of time, disk space utilization with respect to one of the overall loads exceeding a second percentage, RAM utilization with respect to one of the overall loads exceeding a third percentage average for a greater than a second period of time, and I/O read/writes with respect to one of the overall loads at greater than a fourth percentage for greater than a third period of time.

22. The medium as item forth in claim 17 wherein the transferring further comprises:

determining which of the one or more user loads in the identified overall load to move to one or more of the other servers;

determining which of the one or more other servers to move each of the determined one or more user loads; and

moving the determined one or more user loads in the identified overall load in the at least one of the servers to the determined one or more other servers.

23. The medium as item forth in claim 22 wherein the moving the determined one or more user loads further comprises:

transferring the one or more determined user loads to the determined one or more other servers; and

obtaining a verification that each of the one or more transferred user loads is identical to the corresponding one of the determined one or more user loads.

24. The medium as item forth in claim 23 wherein the moving the determined one or more user loads further comprises:

identifying any differences between the one or more transferred user loads and the one or more the determined one or more user loads which occurred after the transferring; and

updating the one or more transferred user loads with the identified differences.

25. The medium as item forth in claim 24 further comprising updating a directory with a new location to the determined one or more other servers for each of the one or more transferred user loads.

26. The medium as item forth in claim 22 wherein the determining which of the one or more user loads in the identified overall load in the at least one of the servers to move to one or more of the other servers further comprises:

determining an order for moving the determined one or more user loads based on one or more characteristics; and

moving the determined one or more user loads in accordance with the determined order.

27. The medium as item forth in claim 26 wherein the one or more characteristics comprise at least one of the user loads which is currently inactive, which caused the identified overall load in the at least one of the servers to exceed the one or more thresholds, which is the largest in the identified overall load in the at least one server, and which has a last login date to an application.

28. The medium as item forth in claim 22 wherein the transferring further comprises placing the determined one or more user loads to move in a queue which is read only accessible until the moving the determined one or more user loads is completed.

29. The medium as item forth in claim 22 wherein the determining which of the one or more other servers to move each of the determined one or more user loads further comprises determining which of the other servers has a lowest average utilization of at least one of processor space and memory space and moving the determined one or more user loads to the determined server with the lowest average utilization of at least one of processor space and memory space.

30. The medium as item forth in claim 22 wherein the determining which of the one or more other servers to move each of the determined one or more user loads further comprises determining which of the one or more other servers need to receive one or more of the user loads from the identified overall load in the at least one of the servers to balance the stored load between the servers and moving the determined one or more user loads to the determined one or more other servers to balance the stored load.

31. The medium as item forth in claim 22 wherein the determining which of the one or more other servers to move each of the determined one or more user loads further comprises identifying when another server has been added to the one or more other servers before the determining which of the one or more other servers to move each of the determined one or more user loads.

32. The medium as item forth in claim 17 wherein the transferring further comprises deleting the transferred one or more of the user loads in the identified overall load in the at least one of the servers after the transferring.

33. A user load balancing system comprising:

a threshold system that identifies when an overall load in at least one of two or more servers exceeds one or more thresholds, wherein each of the overall loads comprises one or more user loads and each of the one or more thresholds is based on the user loads; and

a transfer system that initiates a transfer of one or more of the user loads in the identified overall load in one of the servers to one or more of the other servers when the one or more thresholds is exceeded.

34. The system as set forth in claim 33 wherein the two or more servers comprise at least one of a storage server and an application server.

35. The system as set forth in claim 33 wherein the overall load in at least one of the two or more servers comprises stateful data.

36. The system as item forth in claim 33 wherein the one or more thresholds comprise at least one of processor utilization with respect to one of the overall loads exceeding a first percentage for greater than a first period of time, disk space utilization with respect to one of the overall loads exceeding a second percentage, RAM utilization with respect to one of the overall loads exceeding a third percentage for a greater than a second period of time, and at least one of I/O read/writes and I/O transactions per second with respect to one of the overall loads at greater than a fourth percentage for greater than a third period of time.

37. The system as item forth in claim 33 wherein the one or more thresholds comprise at least one of processor utilization with respect to one of the overall loads exceeding a first percentage average for greater than a first period of time, disk space utilization with respect to one of the overall loads exceeding a second percentage, RAM utilization with respect to one of the overall loads exceeding a third percentage average for a greater than a second period of time, and I/O read/writes with respect to one of the overall loads at greater than a fourth percentage for greater than a third period of time.

38. The system as item forth in claim 33 wherein the transfer system further comprises a balancing processing system that determines which of the one or more user loads in the identified overall load in the at least one of the servers to move to one or more of the other servers and that determines which of the one or more other servers to move each of the determined one or more user loads, wherein the transfer system moves the determined one or more user loads in the identified overall load in the at least one of the servers to the determined one or more other servers.

39. The system as item forth in claim 38 wherein the transfer system transfers the one or more determined user loads to the determined one or more other servers and a verification system obtains a verification that each of the one or more transferred user loads is identical to the corresponding one of the determined one or more user loads,.

40. The system as item forth in claim 39 wherein the transfer system further comprises:

an difference identification system that identifies any differences between the one or more transferred user loads and the one or more the determined one or more user loads which occurred after the copying and before the transferring; and

an update system that updates the one or more transferred user loads with the identified differences.

41. The system as item forth in claim 40 further comprising a directory system which contains a directory for the location of the user loads and updates the directory with a new location to the determined one or more other servers for each of the one or more copied user loads.

42. The system as item forth in claim 38 wherein the balancing processing system determines an order for moving the determined one or more user loads based on one or more characteristics and the transfer system moves the determined one or more user loads in accordance with the determined order.

43. The system as item forth in claim 42 wherein the one or more characteristics comprise at least one of the user loads which is currently inactive, which caused the identified overall load in the at least one of the servers to exceed the one or more thresholds, which is the largest in the identified overall load in the at least one server, and which has a last login date to an application.

44. The system as item forth in claim 38 wherein the transfer system further comprises at least one memory storage device in which the determined one or more user loads are placed and which is read only accessible until the moving the determined one or more user loads is completed.

45. The system as item forth in claim 38 wherein the balancing processing system determines which of the other servers has a lowest average utilization of at least one of processor space and memory space and the transfer system moves the determined one or more user loads to the determined server with the lowest average utilization.

46. The system as item forth in claim 38 wherein the balancing processing system determines which of the one or more other servers need to receive one or more of the user loads from the identified overall load in the at least one of the servers to balance the stored load between the servers and the transfer system moves the determined one or more user loads to the determined one or more other servers to balance the stored load.

47. The system as item forth in claim 38 wherein the balancing processing system identifies when another server has been added to the one or more other servers before the balancing processing system determines which of the one or more other servers to move each of the determined one or more user loads.

48. The system as item forth in claim 33 wherein the transfer system deletes the transferred one or more of the user loads in the identified overall load in the at least one of the servers after the transferring.