Hierarchical virtual model of a cache hierarchy in a multiprocessor system

• US 20040123045A1
• Filed: 12/19/2002
• Published: 06/24/2004
• Est. Priority Date: 12/19/2002
• Status: Active Grant

• Current Assignee: Intel Corporation
• Original Assignee: Intel Corporation
• Inventors: Goodman, James R., Hum, Herbert H. J.
• Granted Patent: US 7,111,128 B2
• Time in Patent Office: Days
• US Class Current: 711/141
• CPC Class Codes: G06F 12/0813 with a network or matrix configuration
• CPC Class Codes: G06F 12/0815 Cache consistency protocols
• CPC Class Codes: G06F 2212/2542 Non-uniform memory access [NUMA] architecture

Abstract

The cache coherency protocol described herein can be used to maintain a virtual model of a system, where the virtual model does not change as the system configuration changes. In general, the virtual model is based on the assumption that each node in the system can directly communicate with some number of other nodes in the system. In one embodiment, for each cache line, the address of the cache line is used to designate a node as the “home” node and all other nodes as “peer” nodes. The protocol specifies one set of messages for communication with the line'"'"'s home node and another set of messages for communication with the line'"'"'s peer nodes.

Claims

1. An apparatus comprising:

a first plurality of nodes, each node having at least a cache memory, wherein the nodes are coupled together and interact according to a predetermined cache coherency protocol;

a peer agent coupled with the first plurality of nodes to represent a second plurality of nodes coupled with the peer agent, wherein the first plurality of nodes interact with the peer agent using the predetermined cache coherency protocol; and

a home agent coupled with the first plurality of nodes to represent at least one remote node.

2. The apparatus of claim 1 wherein a node comprises:

a processor;

at least one cache memory coupled with the processor; and

non-cache memory coupled with the processor.

3. The apparatus of claim 1 wherein each of the first plurality of nodes operates as a home node for a predetermined range of addresses such that the home node for requested data having an address within the respective predetermined range provides a copy of the requested data from non-cache memory if a valid, cached copy of the requested data is not available.

4. The apparatus of claim 3 wherein the home agent represents a plurality of remote nodes that operate as home nodes for respective predetermined ranges of addresses and further wherein, wherein the first plurality of nodes interact with the home agent using the predetermined cache coherency protocol.

5. An apparatus comprising:

a control circuit;

a local cluster interface coupled with the control circuit to communicate with a plurality of nodes of a cluster, wherein the local cluster interface receives a message from one or more of the nodes of the cluster and forwards the message to the control circuit, the control circuit to determine whether a remote entity can satisfy requirements of the message and to selectively forward messages from the local cluster interface to the system interface; and

a system interface coupled with the control circuit to communicate with the remote entity with respect to the cluster, the system interface to communicate messages determined by the control circuit to be satisfied by the remote entity to the remote entity.

6. The apparatus of claim 5 wherein the remote entity comprises a node.

7. The apparatus of claim 5 wherein the remote entity comprises an agent.

8. The apparatus of claim 5 wherein the message comprises a request for a block of data.

9. The apparatus of claim 5 wherein the message comprises a response message indicating a status of a block of data with respect to a sending node.

10. The apparatus of claim 5 wherein each node of the cluster comprises:

a processor;

at least one cache memory coupled with the processor; and

non-cache memory coupled with the processor.

11. An apparatus comprising:

a first plurality of nodes, each node having at least a cache memory, wherein the nodes are coupled together and interact according to a predetermined cache coherency protocol; and

means for representing a second plurality of nodes coupled with the first plurality of nodes, wherein the first plurality of nodes interact with the second plurality of nodes using the predetermined cache coherency protocol.

12. The apparatus of claim 11 wherein each of the first plurality of nodes operates as a home node for a predetermined range of addresses such that the home node for requested data having an address within the respective predetermined range provides a copy of the requested data from non-cache memory if a valid, cached copy of the requested data is not available.

13. The apparatus of claim 11 wherein at least one of the second plurality of nodes comprises an agent.

14. A method comprising:

receiving a cache protocol message from a node of a cluster;

analyzing the message to determine whether the message can be satisfied by a remote entity;

selectively routing the message to the remote entity;

receiving a response from the remote entity; and

forwarding the response to the node.

15. The method of claim 14 wherein the message is received via a local interface coupled with the node.

16. The method of claim 14 wherein the remote entity comprises a node.

17. The method of claim 14 wherein the remote entity comprises an agent.

18. A system comprising:

one or more agents;

a first cluster coupled with the one or more agents, the first cluster having a first set of nodes, each of which has at least a cache memory, a node of the first cluster to transmit a request message to the one or more agents; and

a second cluster coupled with the one or more agents, the second cluster having a second set of nodes, each of which has at least a cache memory;

wherein the one or more agents selectively forward request messages from the first cluster to the second cluster, and further wherein the one or more agents forward response messages from one or more nodes of the second cluster to the node of the first cluster that transmitted the request message.

19. The system of claim 18 wherein the one or more agents comprise:

a home agent to represent one or more remote home entities; and

a peer agent to represent one or more remote peer entities.

20. The system of claim 19 wherein the one or more remote home entities comprises a node.

21. The system of claim 19 wherein the one or more remote home entities comprises an agent.

22. The system of claim 19 wherein the one or more remote peer entities comprises a node.

23. The system of claim 19 wherein the one or more remote peer entities comprises an agent.

24. The system of claim 18, wherein one or more nodes of the first cluster further comprise a processor.

25. The system of claim 18 wherein the first cluster further comprises at least one peer agent and at least one home agent.

26. The system of claim 18 wherein the node of the first cluster that transmits the request message to the one or more agents also transmits the request message to one or more other nodes of the first cluster.

27. The system of claim 18 wherein the second cluster further comprises a home agent and a peer agent.

28. The system of claim 18 wherein the one or more agents selectively answer the request messages from the node of the firs cluster on behalf of one or more nodes of the second cluster.

29. The system of claim 18 wherein the first set of nodes and the second set of nodes are mutually exclusive.

30. The system of claim 18 further comprising a third cluster having a third set of nodes, each having at least a cache memory, coupled with the one or more agents, wherein the one or more agents selectively forward request messages from the first cluster to the third cluster, and further wherein the one or more agents forward response messages from one or more nodes of the third cluster to the node of the first cluster that transmitted the request message.

31. The system of claim 18 further comprising:

a second agent coupled with the one or more agents; and

a third cluster coupled with the second agent, the third cluster having a third set of nodes, each of which has at least a cache memory;

wherein the one or more agents and the second agent selectively forward request messages from the first cluster to the third cluster, and further wherein the second agent and the one or more agents forward response messages from one or more nodes of the third cluster to the node of the first cluster than transmitted the request message.