Methods and apparatus for providing cache state information

• US 7,334,089 B2
• Filed: 05/20/2003
• Issued: 02/19/2008
• Est. Priority Date: 05/20/2003
• Status: Expired due to Term

• Current Assignee: Sanmina-SCI Corporation
• Original Assignee: Newisys, Inc. (Sanmina-SCI Corporation)
• Inventors: Glasco, David Brian
• Primary Examiner(s): Peugh, Brian R.
• Application Number:
  US10/442,845
• Publication Number:
  US 20040236912A1
• Time in Patent Office: 1,736 Days
• Field of Search: None
• US Class Current: 711/143
• CPC Class Codes: G06F 12/0817 using directory methods

Abstract

According to the present invention, methods and apparatus are provided for increasing the efficiency of data access in a multiple processor, multiple cluster system. Mechanisms for allowing a variety of transactions to complete locally are implemented by providing remote data caches associated with the various clusters in the system. The remote data caches receive data and state information for memory lines held in remote clusters. State information is provided to the remote data cache using various mechanisms including a coherence directory and augmented source done messages.

Claims

1. A computer system, comprising:

a request cluster including a first plurality of nodes and a request cache coherence controller, the first plurality of nodes having a first plurality of processors and a first plurality of caches associated with the first plurality of processors, the request cache coherence controller associated with a remote data cache, wherein the remote data cache includes data in memory lines of remote clusters, wherein data is written to the remote data cache in a pending state after the cache coherence controller receives a write back from one of the first plurality of processors;

a home cluster including a second plurality of processors and a request cache coherence controller, the second plurality of processors interconnected in a point-to-point architecture.

2. The computer system of claim 1, wherein nonrequest clusters comprise the home cluster and one or more remote clusters.

3. The computer system of claim 1, wherein the remote data cache is used to cache memory lines associated with remote clusters when memory lines holding data and are evicted from the first plurality of caches.

4. The computer system of claim 1, wherein a writeback is generated when memory lines holding dirty data are evicted from the first plurality of caches.

5. The computer system of claim 4, wherein memory lines hold dirty data when the memory lines are held in a modified or owned state.

6. The computer system of claim 4, wherein evicting a memory lines comprises writing dirty data back to memory.

7. The computer system of claim 1, wherein a plurality of remote data caches are associated with a plurality of cache coherence controllers in the computer system.

8. The computer system of claim 1, wherein data can be held in the remote data cache in states of modified, exclusive, owned, shared, and invalid.

9. The computer system of claim 1, wherein data is written to the remote data cache in the invalid state after a source done is received from one of the first plurality of processors if the source done indicates that the memory line was invalidated.

10. The computer system of claim 1, wherein data is written to the remote data cache in the modified, exclusive, owned, or shared state after a source done is received from one of the first plurality of processors if the source done indicates that the memory line was not invalidated.

11. The computer system of claim 1, wherein the request cache coherence controller receives information indicating whether the memory line was held in a shared or owned state from the home cluster.

12. The computer system of claim 1, wherein data is written to the remote data cache in the shared state after the home cluster responds to a read block request.

13. A method for maintaining coherency, the method comprising:

receiving a write back at a request cache coherence controller from a request cluster processor, the write back associated with a memory line evicted from a cache corresponding to the request cluster processor;

writing data associated with the memory line into a remote data cache, wherein the remote data cache includes data in memory lines in the address space of remote clusters;

receiving information indicating whether the memory line was held in a modified or owned state.

14. The method of claim 13, wherein information indicating whether the memory line was held in the modified or owned state is received from a home cluster cache coherence controller having a coherence directory.

15. The method of claim 13, wherein information indicating whether the memory line was held in the modified or owned state is received from the request cluster processor.

16. The method of claim 13, wherein information indicating whether the memory line was held in the modified or owned state is received from the request cluster processor in a source done message.

17. The method of claim 13, further comprising receiving information indicating whether the memory line was invalidated by an intervening request.

18. The method of claim 17, wherein if the memory line was invalidated by an intervening request, the state of the memory line in the remote data cache is set to invalid.

19. The method of claim 18, wherein if the memory line was not invalidated, the state of the memory line in the remote data cache is set to shared or exclusive.

20. The method of claim 19, wherein the state of the memory line in the remote data cache is set to shared if the memory line was held in the owned state prior to receipt of the write back.

21. The method of claim 19, wherein the state of the memory line in the remote data cache is set to exclusive if the memory line was held in the modified state prior to receipt of the write back.

22. A computer system, comprising:

a request cluster including a first plurality of nodes and a request cache coherence controller, the first plurality of nodes having a first plurality of processors and a first plurality of caches associated with the first plurality of processors, the request cache coherence controller associated with a remote data cache, wherein the remote data cache includes data in memory lines of remote clusters;

a home cluster including a second plurality of processors and a request cache coherence controller, the second plurality of processors interconnected in a point-to-point architecture;

wherein the first plurality of processors are operable to send information to the request cache coherence controller indicating whether a cache line is owned or modified in order to modify an entry in the remote data cache.

23. The computer system of claim 22, wherein the first plurality of processors are further operable to send information to the request cache coherence controller indicating whether the cache line is invalid.

24. The computer system of claim 22, wherein nonrequest clusters comprise the home cluster and one or more remote clusters.

25. The computer system of claim 22, wherein the remote data cache is used to cache memory lines associated with nonrequest clusters when memory lines holding data are evicted from the first plurality of caches.

26. The computer system of claim 22, wherein information indicating whether a cache line is owned or modified is sent when a cache line is evicted.

27. The computer system of claim 26, wherein evicting a cache line comprises writing data back to memory.

28. The computer system of claim 22, wherein a plurality of remote data caches are associated with a plurality of cache coherence controllers in the computer system.

29. The computer system of claim 22, wherein data can be held in the remote data cache in states of modified, exclusive, owned, shared, and invalid.

30. The computer system of claim 29, wherein data can further be held in a state of pending.

31. The computer system of claim 30, wherein data is written to the remote data cache in the pending state after the cache coherence controller receives a write back from one of the first plurality of processors.

32. A computer system, comprising:

means for receiving a write back at a request cache coherence controller from a request cluster processor, the write back associated with a memory line evicted from a cache corresponding to the request cluster processor;

means for writing data associated with the memory line into a remote data cache, wherein the remote data cache includes data in memory lines in the address space of remote clusters;

means for receiving information indicating whether the memory line was held in a modified or owned state.

33. The computer system of claim 32, wherein information indicating whether the memory line was held in the modified or owned state is received from a home cluster cache coherence controller having a coherence directory.

34. The computer system of claim 32, wherein information indicating whether the memory line was held in the modified or owned state is received from the request cluster processor.

35. The computer system of claim 32, wherein information indicating whether the memory line was held in the modified or owned state is received from the request cluster processor in a source done message.

36. The computer system of claim 32, further comprising receiving information indicating whether the memory line was invalidated by an intervening request.

37. The computer system of claim 36, wherein if the memory line was invalidated by an intervening request, the state of the memory line in the remote data cache is set to invalid.