Address translation for shared-memory multiprocessor clustering

• US 5,940,870 A
• Filed: 05/21/1996
• Issued: 08/17/1999
• Est. Priority Date: 05/21/1996
• Status: Expired due to Term

• Current Assignee: Transpacific IP Group Limited
• Original Assignee: Industrial Technology Research Institute
• Inventors: Chan, Cheng-Sheng, Maa, Yeong-Chang, Chi, Hsin-Chou
• Primary Examiner(s): Cabeca, John W.
• Assistant Examiner(s): Encarnacion, Yamir
• Application Number:
  US08/651,150
• Time in Patent Office: 1,183 Days
• Field of Search: 711/206, 711/209, 711/148, 711/153, 711/202, 711/147, 711/152, 711/170, 711/173, 711/203, 709/213, 709/214, 709/215, 709/216, 712/800.14, 712/800.28
• US Class Current: 711/206
• CPC Class Codes: G06F 12/0692 Multiconfiguration, e.g. local and global addressing
• CPC Class Codes: G06F 12/0813 with a network or matrix configuration
• CPC Class Codes: G06F 2212/2542 Non-uniform memory access [NUMA] architecture

Abstract

An address translation method for use in a system including a plurality of cluster nodes and including the steps of: at a source node, receiving over a first network a communication with a first destination address having an index portion and an offset portion, wherein the index portion includes a partition number portion; providing an address mapping table which maps a plurality of indexes to a corresponding plurality of node ID'"'"'s, each of the plurality of node ID'"'"'s identifying a different one of the plurality of cluster nodes; using the index portion from the first destination address as an index into the address mapping table to identify a node ID, wherein the identified node ID identifies a destination node; appending the identified node ID to the first destination address to generate a second destination address; and using the second destination address to send information to a second network of the destination node.

Claims

1. A method of managing memory addressing in a system including a plurality of cluster nodes interconnected by a network, wherein each of the cluster nodes has an associated local physical memory that is accessible over an associated local network, said method comprising the steps of:

for each node, defining an address space that comprises a local address space and a global address space, wherein the local address space for each node maps to the local physical memory for that node;

at each cluster node, dividing the local address space into a private memory address space and a near global memory address space, wherein the private memory space of all of the cluster nodes is accessed exclusively by the cluster node with which that local physical memory is associated and wherein the near global memory space is accessible by all cluster nodes among said plurality of cluster nodes;

partitioning the global address space into a plurality of global memory address space partitions; and

mapping the plurality of partitions to the near global memory address spaces of the cluster nodes so that each partition is mapped to the near global memory address space of a different one of said plurality of cluster nodes.

2. The method of claim 1 wherein the plurality of partitions is equal in number to the plurality of cluster nodes.

3. The method of claim 1 further comprising:

in any one of said plurality of cluster nodes, in response to detecting a communication with a destination address that falls within the global address space, determining which node stores the partition of global memory containing that destination address; and

directing the communication to the node which stores the partition of global memory containing that destination address.

4. An address translation method for use in a system including a plurality of cluster nodes, the system having a global address space shared by different cluster nodes, said method comprising the steps of:

at a source node, receiving over a first network a communication with a first destination address in the global address space having an index portion and an offset portion, said source node being one of said plurality of cluster nodes and said index portion including a partition number portion that identifies a partition of global memory residing on a cluster node;

providing an address mapping table which maps a plurality of indexes to a corresponding plurality of node ID'"'"'s, each of said plurality of node ID'"'"'s identifying a different one of said plurality of cluster nodes;

using the index portion from the first destination address as an index into the address mapping table to identify a node ID, wherein the identified node ID identifies a destination node, said destination node being one of said plurality of cluster nodes and having physical memory containing a near global memory space defined therein;

appending the identified node ID to the first destination address to generate a second destination address; and

using the second destination address to send information to a second network of the destination node.

5. The method of claim 4 wherein the plurality of indexes is equal in number than the plurality of node ID'"'"'s so that the address mapping table contains a one-to-one mapping of indexes to node ID'"'"'s.

6. The method of claim 4 wherein the plurality of indexes is greater in number than the plurality of node ID'"'"'s so that for each of at least some of the plurality of node ID'"'"'s multiple of said plurality of indexes are mapped to that node ID.

7. The method of claim 4 wherein the partition number portion is less than the index portion.

8. The method of claims 4, 5, 6, or 7 further comprising the steps of:

at the destination node, removing the node ID from the second destination address;

setting the partition number portion in the second destination address equal to a preselected number to produce a first address; and

using the first address to access the near global memory space at the destination node.

9. The method of claim 8 further comprising the steps of:

adding a predetermined address to the first address to produce a second address; and

using the second address to access the near global memory space at the destination node.

10. The method of claim 9 wherein the predetermined address is a starting address for near global memory address space within a local physical memory.

11. The method of claim 8 wherein the preselected number is zero.

12. An address translation method for use in a system including a plurality of cluster nodes, the system having a global address space shared by different cluster nodes, said method comprising the steps of:

at a destination node, receiving from a source node a communication which includes a destination address in the global address space containing a node ID, an index portion, and an offset portion, the index portion having a partition number portion that identifies a partition of global memory residing on a cluster node, said destination node and source nodes being members of said plurality of cluster nodes and having physical memory containing a near global memory space defined therein;

removing the node ID from the destination address;

setting the partition number portion in the destination address equal to a preselected number to produce a first address; and

using the first address to access the near global memory space at the destination node.

13. The method of claim 12 wherein the preselected number is zero.

14. The method of claim 12 wherein the plurality of indexes is equal in number than the plurality of node ID'"'"'s so that the address mapping table contains a one-to-one mapping of indexes to node ID'"'"'s.

15. The method of claim 12 wherein the plurality of indexes is greater in number than the plurality of node ID'"'"'s so that for each of at least some of the plurality of node ID'"'"'s multiple of said plurality of indexes are mapped to that node ID.

16. The method of claim 12 wherein the partition number portion is less than the index portion.

17. The method of claims 12, 13, 14, 15, or 16 further comprising the steps of:

adding a predetermined address to the first address to produce a second address; and

using the second address to access the near global memory space at the destination node.

18. The method of claim 17 wherein the predetermined address is a starting address for near global memory address space within a local physical memory.

19. A cluster interface for use in a system including a plurality of cluster nodes which are connected by a main network, the system having a global address space shared by different cluster nodes, said cluster interface comprising:

first means for receiving over a local network a communication having a first destination address in the global address space, said first destination address including an index portion and an offset portion;

an address mapping table which maps a plurality of indexes to a corresponding plurality of destination node ID'"'"'s, wherein each destination node ID identifies a different one of the cluster nodes among said plurality of cluster nodes;

second means for converting the first destination address to a second destination address, said second means generating the second destination address by appending an identified destination node ID from the address mapping table to said first destination address; and

third means for sending the communication over a second network using the second destination address.

20. A cluster interface for use in a cluster node which is connected by a main network to a plurality of other cluster nodes and which is connected to a local memory that is partitioned into local memory space and a near global memory space, the cluster nodes sharing a global address space, said cluster interface comprising:

means for receiving from a source node a communication which includes a destination address in the global address space containing a node ID, an index portion, and an offset portion, the index number portion having a partition number portion that identifies a partition of global memory residing on a cluster node, said destination node and source nodes being members of said plurality of cluster nodes;

means for removing the node ID from the destination address;

means for setting the partition number portion in the destination address equal to a preselected number to produce a first address; and

means for using the first address to access the near global memory space.