Cluster destination address table—IP routing for clusters

• US 6,993,034 B1
• Filed: 10/15/1998
• Issued: 01/31/2006
• Est. Priority Date: 10/15/1998
• Status: Expired due to Fees

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Miller, Robert, Block, Timothy Roy
• Primary Examiner(s): Pezzlo, John
• Application Number:
  US09/173,090
• Time in Patent Office: 2,665 Days
• Field of Search: 709/249, 709/227, 709/217, 709/245, 709/703, 709/229, 709/203, 370/255, 370/386, 370/399, 370/401, 370/389, 370/392, 370/390, 379/242, 379/397, 364/200, 711/148, 711/120, 714/11
• US Class Current: 370/401
• CPC Class Codes: H04L 45/46 Cluster building
• CPC Class Codes: H04L 45/54 Organization of routing tables
• CPC Class Codes: H04L 61/35 involving non-standard use of addresses for implementing network functionalities, e.g. coding subscription information within the address or functional addressing, i.e. assigning an address to a function

Abstract

According to the present invention, a communications protocol supporting cluster configurations more complex than a single LAN is disclosed. A cluster destination address table (CDAT) is used in conjunction with a network message servicer to communicate between computer systems in a cluster. Each computer system preferably contains a cluster servicer, a CDAT, and a network message servicer. The CDAT contains network addresses, status and adapter information for each computer system in a cluster. Although computer systems may have alternate network addresses when they have multiple adapters, the CDAT indexes primary and alternate address information under a single named system. Thus, redundant connections amongst computer systems are identified, while still using the numeric addresses upon which the network message servicer is based. To send a message using the methods of the present invention, the cluster servicer retrieves a network address for a computer system from a CDAT. A message to be sent and the retrieved address are passed to the network message servicer, preferably an Internet Protocol suite. The network message servicer formats the information into a packet and routes the packet.

Claims

1. An apparatus, said apparatus being a member of a cluster, said apparatus comprising:

at least one processor;

a memory coupled to at least one processor;

a cluster servicer residing in said memory, said cluster servicer facilitating cluster messaging, with at least one other apparatus within said cluster, without requiring an intervening dedicated local area network to said at least one other apparatus.

2. The apparatus of claim 1 further comprising a network message servicer residing in said memory, said network message servicer routing at least one cluster message from said cluster servicer to said at least one other apparatus.

3. The apparatus of claim 2 wherein said network message servicer comprises:

a User Datagram Protocol, said User Datagram Protocol formatting said at least one cluster message to be sent to said at least one other apparatus;

an Internet Protocol, said Internet Protocol routing said at least one formatted cluster message to said at least one other apparatus without requiring an intervening dedicated local area network to said at least one other apparatus.

4. The apparatus of claim 2 wherein said cluster servicer includes a cluster destination address table, said cluster destination address table comprising at least one network address for said at least one other apparatus, and wherein said cluster servicer retrieves said at least one network address for said at least one other apparatus from said cluster destination address table to facilitate cluster messaging with said at least one other apparatus without requiring an intervening dedicated local area network to said at least one other apparatus.

5. The apparatus of claim 4 wherein said cluster destination address table further comprises cluster status information for said at least one other apparatus.

6. The apparatus of claim 4 wherein said cluster destination address table further comprises adapter information for said at least one other apparatus.

7. An apparatus comprising:

at least one processor;

a memory coupled to at least one processor;

a network message servicer residing in said memory; and

a cluster servicer residing in said memory, said cluster servicer including a cluster destination address table, said cluster destination address table including at least one address for at least one other apparatus within said cluster, wherein a message to one of said at least one other apparatus can be sent by said cluster servicer retrieving said at least one address for said at least one other apparatus from said cluster destination address table and passing said retrieved address and said message to said network servicer, wherein said network servicer routes said message to said at least one other apparatus without requiring an intervening dedicated local area network to said at least one other apparatus.

8. The apparatus of claim 7 wherein said cluster destination address table further comprises adapter information for each of said at least one address for at least one other apparatus networked to said apparatus.

9. The apparatus of claim 7 wherein said cluster destination address table further comprises status information for each of said at least one address for at least one other apparatus networked to said apparatus.

10. The apparatus of claim 7 operating as a computer cluster, said computer cluster comprising at least one other apparatus networked to said apparatus, wherein each apparatus in said computer cluster comprises:

at least one processor;

a memory coupled to at least one processor;

a User Datagram Protocol residing in said memory, said User Datagram Protocol formatting at least one packet to be sent between apparatuses in said computer cluster;

an Internet Protocol residing in said memory, said Internet Protocol routing said at least one packet between apparatuses in said computer cluster; and

a cluster servicer residing in said memory, said cluster servicer including a cluster destination address table, said cluster destination address table including at least one Internet address for said each apparatus in said computer cluster, wherein a message can be sent to one of said each apparatus in said computer cluster by said cluster servicer determining one of said at least one Internet address of said one of said each apparatus in said computer cluster from said cluster destination address table and passing said determined Internet address and said message to said User Datagram Protocol, wherein said User Datagram Protocol formats said determined Internet address and said message into at least one packet and passes said at least one packet to said Internet Protocol, wherein said Internet Protocol routes said at least one packet to said one of said each apparatus in said computer cluster.

11. The apparatus of claim 7 wherein said cluster destination address table includes at least one Internet address for said at least one other apparatus networked to said apparatus, and wherein a message to one of said at least one other apparatus can be sent by said cluster servicer retrieving said at least one Internet address for said at least one other apparatus from said cluster destination address table and passing said retrieved Internet address and said message to said network servicer.

12. The apparatus of claim 11 wherein said network message servicer comprises:

a User Datagram Protocol which formats at least one packet from said message and said retrieved Internet address; and

an Internet Protocol, said Internet protocol routing said at least one packet to said one of said at least one other apparatus networked to said apparatus.

13. The apparatus of claim 12 wherein said at least one other apparatus networked to said apparatus is networked through a plurality of routers, and wherein said Internet Protocol comprises specific routing directions indicating which router of said plurality of routers should be used for routing said at least one packet to said at least one other apparatus.

14. A cluster of computers, each computer in said cluster of computers comprising:

at least one processor;

at least one network adapter;

a memory coupled to said at least one processor;

a User Datagram Protocol residing in said memory, said User Datagram Protocol formatting at least one packet to be sent between computers in said cluster of computers;

an Internet Protocol suite residing in said memory, said Internet Protocol routing said at least one packet between computers in said cluster of computers; and

a cluster servicer residing in said memory, said cluster servicer including a cluster destination address table, said cluster destination address table including a cluster destination address table entry for each computer in said cluster of computers, said each cluster destination address table entry comprising;

an Internet address for each of said at least one network adapter;

status information for each of said at least one network adapter; and

adapter information for each of said at least one network adapter;

wherein said cluster servicer sends a cluster message to a destination computer in said cluster of computers by determining an Internet address for said destination computer from said cluster destination address table entry for said destination computer and passing said determined Internet address of said destination computer and said cluster message to said User Datagram Protocol, wherein said User Datagram Protocol formats said determined Internet address and said cluster message into a packet and passes said packet to said Internet Protocol, wherein said Internet Protocol routes said packet to said destination computer, said Internet Protocol routing said packet to said destination computer without requiring an intervening dedicated local area network to said destination computer.

15. The cluster of computers of claim 14 wherein said Internet Protocol on said each computer in said cluster of computers includes a routing table, said routing table including at least one routing table entry, said at least one routing table entry including a subnet address and corresponding routing direction for said subnet address, and wherein at least one additional routing table entry exists in said routing table for each computer in said cluster of computers that is attached to a plurality of routers, said at least one additional routing table entry including a subnet address and corresponding routing direction for said subnet address that specifies to which router of said plurality of routers to route said at least one packet.

16. The cluster of computers of claim 14 wherein said cluster servicer in each computer in said cluster of computers can employ said cluster destination address table, said User Datagram Protocol, and said Internet Protocol to route all cluster messages necessary to maintain said cluster of computers.

17. The cluster of computers of claim 14 wherein said cluster servicer can determine from said status information in said cluster destination address table whether a network adapter for one of said each computer in said cluster of computers is reachable or unreachable.

18. The cluster of computers of claim 14 wherein said cluster servicer can determine from said adapter information in said cluster destination address table how to assign cluster responsibilities to said each computer in said cluster of computers.

19. The cluster of computers of claim 14 wherein said cluster servicer can determine from said adapter information in said cluster destination address table how to size cluster messages to each network adapter on said each computer in said cluster of computers.

20. The cluster of computers of claim 14 wherein at least one computer in said cluster of computers has a plurality of network adapters, and wherein each cluster destination address table entry corresponding to said at least one computer in said cluster of computers with a plurality of network adapters includes an Internet address for each of said plurality of network adapters, said plurality of Internet addresses ordered preferentially in said cluster destination address table entry, and wherein said cluster servicer can send a cluster message to a destination computer with a plurality of adapters by determining a primary Internet address for said destination computer with a plurality of adapters from said cluster destination address table entry corresponding to said destination computer with a plurality of network adapters.

21. The cluster of computers of claim 20 wherein said cluster servicer can send a cluster message to a destination computer with a plurality of adapters by determining an alternate Internet address for said destination computer with a plurality of adapters from said cluster destination address table corresponding to said destination computer with a plurality of adapters, when a timely response from said destination computer with a plurality of adapters is not received after sending a cluster message addressed to said primary Internet address for said destination computer with a plurality of adapters.

22. A method comprising the steps of:

creating network address information for each computer in a cluster configuration;

storing said network address information on said each computer in said cluster configuration; and

employing said network address information in conjunction with a network message servicer for cluster communications in said cluster configuration beyond a single local area network.

23. The method of claim 22 further comprising the steps of:

creating routing information for each computer connected to a plurality of routers in said cluster configuration, said routing information identifying which router of said plurality of routers to employ in communicating between said each computer connected to said plurality of routers in said cluster configuration; and

storing said routing information on each said computer connected to said plurality of routers in said cluster configuration.

24. The method of claim 22 wherein the step of creating network address information for said each computer in said cluster configuration comprises the step of creating a cluster destination address table on said each computer in said cluster configuration, wherein the step of creating said cluster destination address table comprises creating a cluster destination address table entry for said each computer in said cluster configuration, said cluster destination address table entry including at least one network address for a computer in said cluster configuration corresponding to said cluster destination address table entry.

25. The method of claim 24 wherein the step of employing said network address information in conjunction with a network message servicer for cluster communications in said cluster configuration beyond a single local area network comprises the steps of:

retrieving said at least one network address from at least one cluster destination address table entry corresponding to at least one computer in said cluster configuration;

employing said network message servicer to send at least one cluster message to said at least one computer in said cluster configuration by passing said retrieved at least one network address for said at least one computer in said cluster configuration along with said at least one cluster message to a network message servicer, said network message servicer routing said at least one cluster message to said at least one computer in said cluster configuration using said retrieved at least one network address.

26. The method of claim 25 wherein the step of employing said network message servicer to send at least one cluster message to said at least one computer in said cluster configuration comprises the step of passing said retrieved at least one network address for said at least one computer in said cluster configuration along with said at least one cluster message to a User Datagram Protocol, said User Datagram Protocol formatting said retrieved at least one network address for said at least one computer in said cluster configuration and said at least one cluster message into at least one packet, said User Datagram Protocol passing said at least one packet to an Internet Protocol, said Internet Protocol routing said at least one packet to said at least one computer in said cluster configuration.

27. The method of claim 24 wherein the step of creating a cluster destination address table for said each computer in said cluster configuration comprises the step of creating a cluster destination address table entry for said each computer in said cluster configuration, said cluster destination address table entry including a primary network address and at least one alternate network address for said computer in said cluster configuration corresponding to said cluster destination address table entry.

28. The method of claim 27 wherein the step of employing said network address information in conjunction with a network message servicer for cluster communications in said cluster configuration beyond a single local area network comprises the steps of:

retrieving at least one network address from at least one cluster destination address table entry corresponding to at least one computer in said cluster configuration;

employing said network message servicer to send at least one cluster message to said at least one computer in said cluster configuration by passing said primary network address for said at least one computer in said cluster configuration along with said at least one cluster message to a network message servicer, said network message servicer routing said at least one cluster message to said at least one computer in said cluster configuration using said primary network address;

awaiting a reply to said at least one cluster message sent to said at least one computer in said cluster configuration using said primary network address; and

employing said network message servicer to send at least one cluster message to said at least one computer in said cluster configuration by passing said at least one alternate network address for said at least one computer in said cluster configuration along with said at least one cluster message to a network message servicer, said network message servicer routing said at least one cluster message to said at least one computer in said cluster configuration using said at least one alternate network address, when said reply to said at least one cluster message sent to said at least one computer in said cluster configuration using said primary network address is not received in a timely manner.

29. The method of claim 22 wherein the step of storing said network address information on said each computer in said cluster configuration comprises the step of storing a copy of said network address information on a first computer in said cluster configuration, said first computer updating said network address information with adapter information about said first computer;

said first computer sending a copy of updated network address information to each other computer in said cluster configuration;

said each other computer in said cluster configuration updating said network address information with adapter information about said each other computer in said cluster configuration;

said each computer in said cluster configuration exchanging said updated network address information such that said each computer in said cluster configuration receives an identical copy of said updated network address information.

30. The method of claim 29 wherein the steps of:

updating said network address information about said first computer comprises the step of updating said network address information with adapter type, maximum transmission unit, subnet mask, and class of service for said first computer; and

updating said network address information about said each other computer in said cluster configuration comprises the step of updating said network address information with adapter type, maximum transmission unit, subnet mask, and class of service for each other computer in said cluster configuration.

31. A method of communicating between computers in a cluster comprising the steps of:

creating a cluster destination address table on said each computer in said cluster, said cluster destination address table including a cluster destination address table entry for said each computer in said cluster, said cluster destination address table entry including a primary network address and at least one alternate network address for said computer in said cluster corresponding to said cluster destination address table entry;

storing said cluster destination address table on said each computer in said cluster; and

employing said cluster destination address table in conjunction with a network message servicer for communicating between computers in said cluster without requiring an intervening dedicated local area network.

32. The method of claim 31 further comprising the steps of:

adding routing information to said network message servicer for each computer connected to a plurality of routers in said cluster, said routing information identifying which router of said plurality of routers to employ in communicating between said each computer connected to said plurality of routers in said cluster.

33. The method of claim 31 wherein the step of employing said cluster destination address table in conjunction with a network message servicer for communicating between computers in said cluster without requiring an intervening dedicated local area network comprises the steps of:

retrieving at least one primary network address from at least one cluster destination address table entry corresponding to at least one computer in said cluster; and

employing said network message servicer to communicate with at least one computer in said cluster by passing said retrieved at least one primary network address for said at least one computer in said cluster along with at least one cluster message to said network message servicer, said network message servicer routing said at least one cluster message to said at least one computer in said using said retrieved at least one primary network address.

34. The method of claim 33 wherein the step of employing said network message servicer to communicate with at least one computer in said cluster comprises the step of passing said retrieved at least one primary network address for said at least one computer in said cluster along with at least one cluster message to a User Datagram Protocol, said User Datagram Protocol formatting said retrieved at least one primary network address for said at least one computer in said cluster and said at least one cluster message into at least one packet, said User Datagram Protocol passing said at least one packet to an Internet Protocol, said Internet Protocol routing said at least one packet to said at least one computer in said cluster.

35. The method of claim 31 wherein the step of storing said cluster destination address table on said each computer in said cluster comprises the step of storing a copy of said cluster destination address table on a first computer in said cluster, said first computer updating said cluster destination address table with adapter information about said first computer;

said first computer sending a copy of an updated cluster destination address table to each other computer in said cluster;

said each other computer in said cluster updating said cluster destination address table with adapter information about said each other computer in said cluster;

said each computer in said cluster exchanging said updated cluster destination address table such that said each computer in said cluster receives an identical copy of said updated cluster destination address table.

36. The method of claim 35 wherein the steps of:

updating said cluster destination address table with adapter information about said first computer comprises the step of updating said cluster destination address table with adapter type, maximum transmission unit, subnet mask, and class of service for each said primary network address and said each at least one alternate network address for said first computer; and

updating said cluster destination address table with adapter information about said each other computer in said cluster comprises the step of updating said cluster destination address table with adapter type, maximum transmission unit, subnet mask, and class of service for each said primary network address and said each at least one alternate network address for said each other computer in said cluster.

37. A program product stored on a computer readable medium that stores the computer code comprising:

(A) a cluster servicer, said cluster servicer facilitating cluster messaging with at least one other computer without requiring an intervening dedicated local area network to said at least one other computer; and

(B) signal bearing media bearing said cluster servicer.

38. The program product of claim 37 wherein said signal bearing media comprises transmission media.

39. The program product of claim 37 wherein said signal bearing media comprises recordable media.

40. The program product of claim 37 further comprising a network message servicer, said network message servicer routing at least one cluster message from said cluster servicer to said at least one other computer.

41. The program product of claim 40 wherein said network message servicer comprises:

a User Datagram Protocol, said User Datagram Protocol formatting said at least one cluster message to be sent to said at least one other computer;

an Internet Protocol, said Internet Protocol routing said at least one formatted cluster message to said at least one other computer without requiring an intervening dedicated local area network to said at least one other computer.

42. The program product of claim 40 wherein said cluster servicer includes a cluster destination address table, said cluster destination address table comprising at least one network address for said at least one other computer, and wherein said cluster servicer retrieves said at least one network address for said at least one other computer from said cluster destination address table to facilitate cluster messaging with said at least one other computer without requiring an intervening dedicated local area network to said at least one other computer.

43. The program product of claim 42 wherein said cluster destination address table further comprises cluster status information for said at least one other computer.

44. The program product of claim 42 wherein said cluster destination address table further comprises adapter information for said at least one other computer.

45. A program product stored on a computer readable medium that stores the computer code comprising:

(A) a network message servicer;

(B) a cluster servicer, said cluster servicer including a cluster destination address table, said cluster destination address table including at least one address for each of a plurality of apparatuses in a computer cluster, wherein a message to one of said plurality of apparatuses can be sent by said cluster servicer retrieving one of said at least one address for said one of said plurality of apparatuses from said cluster destination address table and passing said retrieved address and said message to said network servicer, wherein said network servicer routes said message to said one of said plurality of apparatuses without requiring an intervening dedicated local area network to said one of said plurality of apparatuses; and

(C) signal bearing media bearing said network message servicer and said cluster servicer.

46. The program product of claim 45 wherein said signal bearing media comprises transmission media.

47. The program product of claim 45 wherein said signal bearing media comprises recordable media.

48. The program product of claim 45 wherein said cluster destination address table further comprises adapter information for said each of said plurality of apparatuses.

49. The program product of claim 45 wherein said cluster destination address table further comprises status information for said each of said plurality of apparatuses.

50. The program product of claim 45 comprising:

a User Datagram Protocol, said User Datagram Protocol formatting at least one packet to be sent between said plurality of apparatuses in said computer cluster;

an Internet Protocol, said Internet Protocol routing said at least one packet between said plurality of apparatuses in said computer cluster; and

a cluster servicer, said cluster servicer including a cluster destination address table, said cluster destination address table including at least one Internet address for each of said plurality of apparatuses in said computer cluster, wherein a message can be sent to one of said plurality of apparatuses in said computer cluster by said cluster servicer determining one of said at least one Internet address for said one of said plurality of apparatuses in said computer cluster from said cluster destination address table and passing said determined Internet address and said message to said User Datagram Protocol, wherein said User Datagram Protocol formats said determined Internet address and said message into at least one packet and passes said at least one packet to said Internet Protocol, wherein said Internet Protocol routes said at least one packet to said one of said plurality of apparatuses in said computer cluster.

51. The program product of claim 45 wherein said cluster destination address table includes at least one Internet address for said each of said plurality of apparatuses in said computer cluster, and wherein a message to one of said plurality of apparatuses can be sent by said cluster servicer retrieving one of said at least one Internet address for said one of said plurality of apparatuses from said cluster destination address table and passing said retrieved Internet address and said message to said network servicer.

52. The program product of claim 51 wherein said network message servicer comprises:

a User Datagram Protocol which formats at least one packet from said message and said retrieved Internet address; and

an Internet Protocol, said Internet protocol routing said at least one packet to said one of said plurality of apparatuses networked to said apparatus.

53. The program product of claim 52 wherein said at least two of said plurality of apparatuses in said computer cluster are networked through a plurality of routers, and wherein said Internet Protocol comprises specific routing directions indicating which router of said plurality of routers should be used for routing said at least one packet between said two of said plurality of apparatuses in said computer cluster networked together through a plurality of routers.

54. A program product stored on a computer readable medium that stores the computer code comprising:

a User Datagram Protocol, said User Datagram Protocol formatting at least one packet to be sent between computers in a cluster of computers;

an Internet Protocol suite, said Internet Protocol routing said at least one packet between computers in said cluster of computers; and

a cluster servicer, said cluster servicer including a cluster destination address table, said cluster destination address table including a cluster destination address table entry for each computer in said cluster of computers, said each cluster destination address table entry comprising;

an Internet address for each network adapter;

status information for said each network adapter; and

adapter information for said each network adapter;

wherein said cluster servicer sends a cluster message to a destination computer in said cluster of computers by determining an Internet address for said destination computer from said cluster destination address table entry for said destination computer and passing said determined Internet address of said destination computer and said cluster message to said User Datagram Protocol, wherein said User Datagram Protocol formats said determined Internet address and said cluster message into a packet and passes said packet to said Internet Protocol, wherein said Internet Protocol routes said packet to said destination computer without requiring an intervening dedicated local area network to said destination computer.

55. The program product of claim 54 wherein said signal bearing media comprises transmission media.

56. The program product of claim 54 wherein said signal bearing media comprises recordable media.

57. The program product of claim 54 wherein said Internet Protocol includes a routing table, said routing table including at least one routing table entry, said at least one routing table entry including a subnet address and corresponding routing direction for said subnet address, and wherein at least one additional routing table entry exists in said routing table for each computer in said cluster of computers that is attached to a plurality of routers, said at least one additional routing table entry including a subnet address and corresponding routing direction for said subnet address that specifies to which router of said plurality of routers to route said at least one packet.

58. The program product of claim 54 wherein said cluster servicer can employ said cluster destination address table, said User Datagram Protocol, and said Internet Protocol to route all cluster messages necessary to maintain said cluster of computers.

59. The program product of claim 54 wherein said cluster servicer can determine from said status information in said cluster destination address table whether a network adapter for one of said each computer in said cluster of computers is reachable or unreachable.

60. The program product of claim 54 wherein said cluster servicer can determine from said adapter information in said cluster destination address table how to assign cluster responsibilities to said each computer in said cluster of computers.

61. The program product of claim 54 wherein said cluster servicer can determine from said adapter information in said cluster destination address table how to size cluster messages to each network adapter on said each computer in said cluster of computers.

62. The program product of claim 54 wherein at least one computer in said cluster of computers has a plurality of network adapters, and wherein each cluster destination address table entry corresponding to said at least one computer in said cluster of computers with a plurality of network adapters includes an Internet address for each of said plurality of network adapters, said plurality of Internet addresses ordered preferentially in said cluster destination address table entry, and wherein said cluster servicer can send a cluster message to a destination computer with a plurality of adapters by determining a primary Internet address for said destination computer with a plurality of adapters from said cluster destination address table entry corresponding to said destination computer with a plurality of network adapters.

63. The program product of claim 62 wherein said cluster servicer can send a cluster message to a destination computer with a plurality of adapters by determining an alternate Internet address for said destination computer with a plurality of adapters from said cluster destination address table corresponding to said destination computer with a plurality of adapters, when a timely response from said destination computer with a plurality of adapters is not received after sending a cluster message addressed to said primary Internet address for said destination computer with a plurality of adapters.