System with multicast invalidations and split ownership and access right coherence mechanism

• US 20040003183A1
• Filed: 06/28/2002
• Published: 01/01/2004
• Est. Priority Date: 06/28/2002
• Status: Active Grant

• Current Assignee: Oracle America, Inc. (Oracle Corporation)
• Original Assignee: Sun Microsystems Incorporated (Oracle Corporation)
• Inventors: Cypher, Robert E., Phelps, Andrew
• Granted Patent: US 6,970,980 B2
• Time in Patent Office: Days
• US Class Current: 711/144
• CPC Class Codes: G06F 12/0813 with a network or matrix configuration
• CPC Class Codes: G06F 12/0826 Limited pointers directories; State-only directories without pointers
• CPC Class Codes: G06F 12/0831 using a bus scheme, e.g. with bus monitoring or watching means

Abstract

Various systems and methods for using a directory based coherency protocol in a system that employs a split ownership and access right cache coherence mechanism are disclosed. A computer system may include a directory, several active devices configured to access data stored, an address network configured to convey coherence requests point-to-point between the active devices and the directory, and a data network configured to convey data between the active devices. If at least one of a subset of the active devices has a shared access right to a requested coherency unit, the directory is configured to send an invalidating address packet to each of the active devices in the subset. The subset contains fewer than all of the active devices.

Claims

1. A computer system comprising:

a plurality of active devices including a first active device that includes a first cache;

a directory configured to indicate which of the plurality of active devices has an ownership responsibility for a given coherency unit;

an address network configured to convey address packets between the plurality of active devices and the directory;

a data network configured to convey data packets between the plurality of active devices;

wherein depending upon whether the directory indicates that at least one active device included in a first subset of the plurality of active devices has a shared access right to a first coherency unit, the directory is configured to send an invalidating address packet on the address network to each active device included in the first subset;

wherein the first active device is configured to transition an ownership responsibility for a first coherency unit cached in the first cache upon receipt of a first address packet and to transition an access right to the first coherency unit cached in the first cache upon receipt of a corresponding data packet, wherein the ownership responsibility transitions at a different time than the access right transitions.

2. The computer system of claim 1, wherein the directory is configured to send the first invalidating packet to the first active device and the first active device is configured to transition an access right to the first coherency unit in the first cache upon receiving a data packet corresponding to the first coherency unit on the data network and the invalidating address packet on the address network.

3. The computer system of claim 1, wherein the plurality of active devices is divided into subsets, wherein the directory is configured to track which subsets of the plurality of active devices contain an active device that has a shared access right to a given coherency unit.

4. The computer system of claim 1, wherein the first subset contains a single active device.

5. The computer system as recited in claim 1, wherein the first address packet is sent from the directory to the first active device.

6. The computer system as recited in claim 1, wherein the plurality of active devices includes a second active device, wherein the data packet corresponding to the first coherency unit received by the first active device is conveyed through the data network from the second active device.

7. The computer system as recited in claim 6, wherein an access right associated with the first coherency unit cached in a second cache included in the second active device transitions in response to the second active device sending the data corresponding to the first coherency unit to the first active device.

8. The computer system as recited in claim 7, wherein an ownership responsibility corresponding to the first coherency unit in the second cache transitions upon the second active device receiving a third address packet on the address network.

9. The computer system as recited in claim 6, wherein the first address packet is a read-to-own packet.

10. The computer system as recited in claim 6, wherein the plurality of active devices includes a third active device that includes a third cache, wherein an access right associated with the first coherency unit cached in the third cache transitions to an invalid access right upon the third active device receiving the invalidating address packet.

11. The computer system as recited in claim 10, wherein the directory is configured to send the invalidating address packet to each of the active devices that has a shared access right to and does not own the first coherency unit.

12. The computer system as recited in claim 1, wherein the first subset contains fewer than all of the active devices.

13. A computer system comprising:

a plurality of active devices, wherein each active device includes a cache configured to store data accessed by that active device;

a directory configured to indicate which of the active devices has an ownership responsibility for a given coherency unit;

an address network configured to convey address packets between the plurality of active devices and the directory;

a data network configured to convey data packets between the plurality of active devices;

wherein depending upon whether the directory indicates that at least one active device included in a first subset of the active devices has a shared access right to a first coherency unit, the directory is configured to send an invalidating address packet on the address network to the first subset of the active devices;

wherein a first active device of the plurality of active devices is configured to transition its access right to the first coherency unit in response to sending a data packet corresponding to the first coherency unit on the data network.

14. A method for maintaining coherency in a computer system comprising a plurality of active devices that each include a cache, the method comprising:

a first active device of the plurality of active devices sending a first address packet on an address network in order to gain an access right to a first coherency unit, wherein the first active device includes a first cache;

conveying the first address packet point-to-point through the address network to a directory;

depending upon whether the directory indicates that at least one of a first subset of the plurality of active devices has a shared access right to the first coherency unit, the directory sending an invalidating packet to the first subset of the plurality of the active devices; and

the first active device transitioning an ownership responsibility for the first coherency unit cached in the first cache upon receiving a second address packet and transitioning an access right to the first coherency unit cached in the first cache upon receiving a corresponding data packet;

wherein said transitioning the ownership responsibility occurs at a different time than said transitioning the access right.

15. The method as recited in claim 14, further comprising the directory indicating that a device has an ownership responsibility for the first coherency unit.

16. The method as recited in claim 15, wherein the device is a second active device.

17. The method as recited in claim 16, further comprising changing an access right to the first coherency unit cached in the second active device in response to transmitting the data packet.

18. The method as recited in claim 16, further comprising changing an ownership responsibility for the first coherency unit cached in the second active device upon the second active device receiving a third address packet through the address network.

19. The method as recited in claim 14, further comprising changing an access right corresponding to the first coherency unit cached in a third active device upon the third active device receiving the invalidating address packet through the address network.

20. A computer system comprising:

a plurality of means for accessing data including a first means for accessing data, wherein the first means for accessing data includes a first cache;

means for storing ownership information associated with one or more coherency units and for storing access information indicating that at least one of the plurality of means for accessing data included in a subset of the means for accessing data has a shared access right to a first coherency unit;

means for conveying coherence requests point-to-point between the plurality of means for accessing data and the means for storing ownership information;

means for conveying data between the plurality of means for accessing data;

wherein the means for storing ownership information conveys an invalidating coherence request to each of the means for accessing data included in the first subset of the means for accessing data dependent upon the access information for the first coherency unit;

wherein the first means transitions an ownership responsibility for the first coherency unit cached in the first cache upon receiving a first coherence request on the means for conveying coherence requests;

wherein the first means transitions an access right to the first coherency unit cached in the first cache upon receiving corresponding data on the means for conveying data;

wherein the access right transitions at a different time than the ownership responsibility transitions.