LOAD BALANCING ENGINE, CLIENT, DISTRIBUTED COMPUTING SYSTEM, AND LOAD BALANCING METHOD

• US 20200137151A1
• Filed: 12/23/2019
• Published: 04/30/2020
• Est. Priority Date: 06/30/2017
• Status: Abandoned Application

• Current Assignee: Huawei Technologies Co., Ltd. (Huawei Investment & Holding Co., Ltd.)
• Original Assignee: Huawei Technologies Co., Ltd. (Huawei Investment & Holding Co., Ltd.)
• Inventors: CHI, Jianchun, ZHENG, Wei, WANG, Kemin
• Application Number:
  US16/725,854
• Publication Number:
  US 20200137151A1
• Time in Patent Office: Days
• CPC Class Codes: H04L 67/1008 based on parameters of servers, e.g. available memory or workload monitoring of computer activity G06F11/30
• CPC Class Codes: H04L 67/1023 based on a hash applied to IP addresses or costs
• CPC Class Codes: H04L 67/1029 using data related to the state of servers by a load balancer
• CPC Class Codes: H04L 67/51 Discovery or management thereof, e.g. service location protocol [SLP] or web services
• CPC Class Codes: H04L 67/563 Data redirection of data network streams
• CPC Class Codes: H04L 67/5682 Policies or rules for updating, deleting or replacing the stored data
• CPC Class Codes: H04L 67/5683 Storage of data provided by user terminals, i.e. reverse caching
• CPC Class Codes: H04L 67/61 taking into account QoS or priority requirements
• CPC Class Codes: H04L 67/63 Routing a service request depending on the request content or context

Abstract

A distributed computing system including a load balancing engine is disclosed. The load balancing engine includes: a load information management module for obtaining global load information of the system; a service information management module for obtaining global service information of the system; a policy computing module for performing load balancing computing for a first service type by using the global load information and the global service information, to generate a first load balancing policy corresponding to the first service type; and a policy release module for releasing the first load balancing policy to a client.

Claims

1. A load balancing engine comprising:

a processor; and

a memory coupled to the processor, the processor configured to execute codes or instructions stored in the memory to;

obtain global load information of a distributed computing system, wherein the global load information indicates a respective load of M computing nodes in the distributed computing system;

obtain global service information of the distributed computing system, wherein the global service information indicates types of services provided by the M computing nodes, and M is a number greater than 1;

perform load balancing computing for a first service type by using the global load information and the global service information, to generate a first load balancing policy corresponding to the first service type, wherein the first service type is at least one of the types of the services provided by the M computing nodes, and the first load balancing policy indicates distribution information of a service message corresponding to the first service type in the M computing nodes; and

release the first load balancing policy to a client.

2. The load balancing engine according to claim 1, wherein the load balancing engine further comprises a global service view for obtaining a service calling relationship between the M computing nodes;

and

wherein, the processor is configured to perform load balancing computing for the first service type by using the global load information, the global service information, and the service calling relationship, to generate the first load balancing policy.

3. The load balancing engine according to claim 2, wherein the processor is further configured to:

determine, from the M computing nodes based on the global service information, a target computing node that provides a service of the first service type;

determine, from the M computing nodes based on the service calling relationship, a related computing node that has a calling relationship with the service that is of the first service type and that is provided by the target computing node; and

determine, based on the global load information, the load of the target computing node and the related computing node, and perform load balancing computing, to generate the first load balancing policy.

4. The load balancing engine according to claim 2, wherein the processor is further configured to perform load balancing computing based on a preset service delay and by using the global load information, the global service information, and the service calling relationship, to generate a second load balancing policy, wherein the second load balancing policy is used to instruct the M computing nodes to perform service adjustment;

and

release the second load balancing policy to the M computing nodes.

5. The load balancing engine according to claim 4, wherein the second load balancing policy instructs adjusting a service message distribution ratio between at least two computing nodes that have a service calling relationship.

6. The load balancing engine according to claim 4, wherein the second load balancing policy instructs adjusting a service location between computing nodes that have a service calling relationship.

7. The load balancing engine according to claim 4, wherein the second load balancing policy instructs adding or deleting a service between computing nodes that have a service calling relationship.

8. The load balancing engine according to claim 1, wherein the global load information, the global service information, and the service calling relationship are periodically obtained;

and the processor is further configured to periodically compute the first load balancing policy or the second load balancing policy, and periodically release the first load balancing policy or the second load balancing policy.

9. A client comprising:

a local cache configured to cache a first load balancing policy released by a load balancing engine, wherein the first load balancing policy indicates distribution information of a service message of a first service type;

a network interface configured to receive a first service request; and

a processor configured to;

query the local cache;

determine, from M computing nodes based on the distribution information indicated by the first load balancing policy, a target computing node matching the first service request when the first load balancing policy stored in the local cache matches the first service request; and

send, via the network interface, a service message corresponding to the first service request to the target computing node.

10. A load balancing method comprising:

obtaining global load information of a distributed computing system, wherein the global load information indicates a respective load of M computing nodes in the distributed computing system;

obtaining global service information of the distributed computing system, wherein the global service information indicates types of services provided by the M computing nodes, and M is a number greater than 1;

performing load balancing computing for a first service type by using the global load information and the global service information to generate a first load balancing policy corresponding to the first service type, wherein the first service type is at least one of the types of the services provided by the M computing nodes, and the first load balancing policy indicates distribution information of a service message corresponding to the first service type; and

releasing the first load balancing policy to a client.

11. The load balancing method according to claim 10, wherein the method further comprises:

obtaining a service calling relationship between the M computing nodes; and

the operation of performing load balancing computing for a first service type by using the global load information and the global service information to generate a first load balancing policy corresponding to the first service type comprises;

performing load balancing computing for the first service type by using the global load information, the global service information, and the service calling relationship, to generate the first load balancing policy.

12. The load balancing method according to claim 11, wherein the operation of performing load balancing computing for the first service type by using the global load information, the global service information, and the service calling relationship, to generate the first load balancing policy, comprises:

determining, from the M computing nodes based on the global service information, a target computing node that provides a service of the first service type;

determining, from the M computing nodes based on the service calling relationship, a related computing node that has a calling relationship with the service that is of the first service type that is provided by the target computing node; and

determining, based on the global load information, the load of the target computing node and the related computing node, and performing load balancing computing, to generate the first load balancing policy.

13. The load balancing method according to claim 11, further comprising:

performing load balancing computing based on a preset service delay and by using the global load information, the global service information, and the service calling relationship, to generate a second load balancing policy, wherein the second load balancing policy is used to instruct the M computing nodes to perform service adjustment; and

releasing the second load balancing policy to the M computing nodes.

14. The load balancing method according to claim 13, wherein the second load balancing policy instructs adjusting a service message distribution ratio between at least two computing nodes that have a service calling relationship.

15. The load balancing method according to claim 13, wherein the second load balancing policy instructs adjusting a service location between computing nodes that have a service calling relationship.

16. The load balancing method according to claim 13, wherein the second load balancing policy instructs adding or deleting a service between computing nodes that have a service calling relationship.