Method and apparatus for providing a single system image in a clustered environment

• US 7,051,115 B2
• Filed: 04/19/2001
• Issued: 05/23/2006
• Est. Priority Date: 04/19/2001
• Status: Active Grant

• Current Assignee: Lenovo PC International Limited (Lenovo Group Ltd.)
• Original Assignee: Lenovo Singapore Pte Limited (Lenovo Group Ltd.)
• Inventors: Chen, Ying, Reed, Benjamin Clay
• Primary Examiner(s): Etienne, Ario
• Assistant Examiner(s): NANO, SARGON N
• Application Number:
  US09/839,794
• Publication Number:
  US 20020165964A1
• Time in Patent Office: 1,860 Days
• Field of Search: 709/202, 709/205, 709/223, 709/224, 709/226, 709/229, 709/238
• US Class Current: 709/245
• CPC Class Codes: H04L 12/1886 with traffic restrictions for efficiency improvement, e.g. involving subnets or subdomains
• CPC Class Codes: H04L 45/46 Cluster building
• CPC Class Codes: H04L 61/35 involving non-standard use of addresses for implementing network functionalities, e.g. coding subscription information within the address or functional addressing, i.e. assigning an address to a function
• CPC Class Codes: H04L 61/5069 for group communication, multicast communication or broadcast communication
• CPC Class Codes: H04L 67/06 specially adapted for file transfer, e.g. file transfer protocol [FTP]
• CPC Class Codes: H04L 67/10 in which an application is distributed across nodes in the network software deployment G06F8/60; multiprogramming arrangements G06F9/46
• CPC Class Codes: H04L 69/329 in the application layer [OSI layer 7]
• CPC Class Codes: H04L 9/40 Network security protocols

Abstract

A method of providing a single system image in a clustered environment. An internet protocol (IP) address is assigned as a cluster IP address. The cluster IP address is bound to a node in a cluster. A client request directed to the cluster IP address is received in the node. The node multicasts the request to all nodes in the cluster. A dynamically adjustable workload distribution function filters the request, wherein the function is configured to allow a single node to process the client request. A response to the request is obtained. A cluster media access control (MAC) address is inserted into the response and the response is sent from the single node to the client.

Claims

1. A method of providing a single system image in a clustered environment comprising:

(a) assigning an internet protocol (IP) address as a cluster IP address;

(b) binding the cluster IP address to a node in a cluster;

(c) receiving a client request directed to the cluster IP address;

(d) multicasting the request to all nodes in the cluster;

(e) each node in the cluster filtering the request based on a dynamically adjustable workload distribution function on each node, wherein the function is configured to allow a single node to process the client request, and wherein the function distributes the workload by;

(i) representing a total workload observed by the cluster as a bitmap with a number of bits k;

(ii) obtaining a bit m by performing a mod operation of a source IP address of the client by the number of bits k; and

(iii) assigning the client request to a cluster node that has a specified value at bit m;

(f) a single node in the cluster obtaining a response to the request;

(g) the single node inserting a cluster media access control (MAC) address into the response; and

(h) sending the response from the single node to the client.

2. The method of claim 1 further comprising informing other nodes in the cluster of the cluster IP address and a media access control (MAC) address associated with the node that is bound to the cluster IP address.

3. The method of claim 1 further comprising:

(a) forming a virtual local area network (VLAN) comprising;

(1) a master node wherein the master node is the node that is bound to the cluster IP address;

(2) at least one network interface for each node in the cluster; and

(b) wherein multicasting comprises packet forwarding and processing the client request from the master node to the other nodes in the VLAN.

4. The method of claim 1 further comprising:

forming a multicasting group comprising all of the cluster nodes; and

wherein the multicasting comprises automatically multicasting the request to all of the cluster nodes in the multicasting group.

5. The method of claim 4 wherein the multicasting group is formed by setting the MAC addresses of network interface cards of nodes in the cluster to be a multicast MAC address.

6. The method of claim 5 wherein the MAC addresses are set by setting a first bit of a first byte to a certain value.

7. The method of claim 1 wherein the workload distribution function is installed in a driver on each node in the cluster.

8. The method of claim 1 wherein the workload distribution function filters the client request based on workload distribution and whether a packet header of the client request indicates that destination MAC and IP addresses are the cluster IP and cluster MAC addresses.

9. The method of claim 1 wherein the response is sent from the single node to the client without multicasting.

10. The method of claim 1 wherein the workload distribution function distributes the workload by performing a mod operation of a source IP address with a number of nodes in the cluster.

11. The method of claim 1 wherein the workload distribution function distributes the workload based on workload statistics that are periodically collected by at least one cluster node.

12. The method of claim 11 wherein cluster nodes periodically exchange workload statistics information.

13. The method of claim 1 further comprising:

adjusting a number of nodes in the cluster;

recomputing a workload distribution based on the number of nodes in the cluster; and

redistributing the workload among nodes in the cluster based on the recomputation.

14. An apparatus for providing a single system image in a clustered environment comprising:

(a) a master node in a storage cluster, wherein a node in the storage cluster is designated as the master node by assigning an internet protocol (IP) address as a cluster IP address and binding the cluster IP address to the master node, wherein the master node is configured to;

(1) receive a client request directed to the cluster IP address;

(2) multicast the request to all nodes in the cluster;

(b) at least one additional node in the storage cluster; and

(c) a dynamically adjustable workload distribution function installed on each node in the cluster, wherein the function is configured to filter the client request by allowing a single node to process the client request and wherein the function is configured to distribute the workload by;

(1) representing a total workload observed by the cluster as a bitmap with a number of bits k;

(2) obtaining a bit m performing a mod operation of a source IP address of the client by the number of bits k; and

(3) assigning the client request to a cluster node that has a specified value at bit m;

wherein each node in the cluster is configured to;

obtain a response to the request;

insert a cluster media access control (MAC) address into the response; and

send the response from the single node to the client.

15. The apparatus of claim 14 wherein the master node is further configured to inform the other nodes in the cluster of the cluster IP address and a media access control (MAC) address associated with the master node.

16. The apparatus of claim 14 wherein:

the storage cluster comprises a virtual local area network (VLAN); and

the master node is configured to multicast the request by packet forwarding and processing the client request from the master node to the other nodes in the VLAN.

17. The apparatus of claim 14 wherein:

the storage cluster comprises a multicasting group comprising all of the cluster nodes; and

the master node is configured to multicast by automatically multicasting the request to all of the cluster nodes in the multicasting group.

18. The apparatus of claim 17 wherein the multicasting group is formed by setting the MAC addresses of network interface cards of nodes in the cluster to be a multicast MAC address.

19. The apparatus of claim 18 wherein the MAC addresses are set by setting a first bit of a first byte to a certain value.

20. The apparatus of claim 14 wherein the workload distribution function is installed in a driver on each node in the cluster.

21. The apparatus of claim 14 wherein the workload distribution function filters the client request based on workload distribution and whether a packet header of the client request indicates that destination MAC and IP addresses are the cluster IP and cluster MAC addresses.

22. The apparatus of claim 14 wherein the response is sent from the single node to the client without multicasting.

23. The apparatus of claim 14 wherein the workload distribution function distributes the workload by performing a mod operation of a source IP address with a number of nodes in the cluster.

24. The apparatus of claim 14 wherein the workload distribution function distributes the workload based on workload statistics that are periodically collected by at least one cluster node.

25. The apparatus of claim 24 wherein cluster nodes periodically exchange workload statistics information.

26. The apparatus of claim 14 wherein the workload distribution function is further configured to adjust a number of nodes in the cluster by:

recomputing a workload distribution based on the number of nodes in the cluster; and

redistributing the workload among nodes in the cluster based on the recomputation.

27. An article of manufacture, embodying logic to perform a method of providing a single system image in a clustered environment, the method comprising:

(a) assigning an internet protocol (IP) address as a cluster IP address;

(b) binding the cluster IP address to a node in a cluster;

(c) receiving a client request directed to the cluster IP address;

(d) multicasting the request to all nodes in the cluster;

(e) each node in the cluster filtering the request based on a dynamically adjustable workload distribution function on each node, wherein the function is configured to allow a single node to process the client request, and wherein the function distributes the workload by;

(i) representing a total workload observed by the cluster as a bitmap with a number of bits k;

(ii) obtaining a bit m by performing a mod operation of a source IP address of the client by the number of bits k; and

(iii) assigning the client request to a cluster node that has a specified value at bit m;

(f) a single node in the cluster obtaining a response to the request;

(g) the single node inserting a cluster media access control (MAC) address into the response; and

(h) sending the response from the single node to the client.

28. The article of manufacture of claim 27 wherein the method further comprises informing other nodes in the cluster of the cluster IP address and a media access control (MAC) address associated with the node bound to the cluster IP address.

29. The article of manufacture of claim 27, the method further comprising:

(a) forming a virtual local area network (VLAN) comprising;

(1) a master node wherein the master node is the node that is bound to the cluster IP address;

(2) at least one network interface for each node in the cluster; and

(b) wherein multicasting comprises packet forwarding and processing the client request from the master node to the other nodes in the VLAN.

30. The article of manufacture of claim 27, the method further comprising:

forming a multicasting group comprising all of the cluster nodes; and

wherein the multicasting comprises automatically multicasting the request to all of the cluster nodes in the multicasting group.

31. The article of manufacture of claim 30 wherein the multicasting group is formed by setting the MAC addresses of network interface cards of nodes in the cluster to be a multicast MAC address.

32. The article of manufacture of claim 31 wherein the MAC addresses are set by setting a first bit of a first byte to a certain value.

33. The article of manufacture of claim 27 wherein the workload distribution function is installed in a driver on each node in the cluster.

34. The article of manufacture of claim 27 wherein the workload distribution function filters the client request based on workload distribution and whether a packet header of the client request indicates that destination MAC and IP addresses are the cluster IP and cluster MAC addresses.

35. The article of manufacture of claim 27 wherein the response is sent from the single node to the client without multicasting.

36. The article of manufacture of claim 27 wherein the workload distribution function distributes the workload by performing a mod operation of a source IP address with a number of nodes in the cluster.

37. The article of manufacture of claim 27 wherein the workload distribution function distributes the workload based on workload statistics that are periodically collected by at least one cluster node.

38. The article of manufacture of claim 37 wherein cluster nodes periodically exchange workload statistics information.

39. The article of manufacture of claim 27, the method further comprising:

adjusting a number of nodes in the cluster;

recomputing a workload distribution based on the number of nodes in the cluster; and

redistributing the workload among nodes in the cluster based on the recomputation.