Efficient distributed cache consistency

• US 9,183,148 B2
• Filed: 12/12/2013
• Issued: 11/10/2015
• Est. Priority Date: 12/12/2013
• Status: Active Grant

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Fried, Eric P., Russell, Lance W.
• Primary Examiner(s): YU, JAE UN
• Application Number:
  US14/104,008
• Publication Number:
  US 20150169455A1
• Time in Patent Office: 698 Days
• Field of Search: 711/141
• US Class Current: 1/1
• CPC Class Codes: G06F 12/0822 Copy directories local copy tags for implementing a bus snooping protocol G06F12/0831
• CPC Class Codes: G06F 12/0831 using a bus scheme, e.g. with bus monitoring or watching means
• CPC Class Codes: G06F 12/084 with a shared cache
• CPC Class Codes: G06F 15/17331 Distributed shared memory [DSM], e.g. remote direct memory access [RDMA]
• CPC Class Codes: G06F 2212/154 Networked environment
• CPC Class Codes: G06F 2212/60 Details of cache memory

Abstract

Mechanisms are provided for performing a write operation on a shared resource in a cluster of data processing systems. The mechanisms determine whether a locally cached copy of the shared resource is present in a local cache memory. The mechanisms, in response to a determination that a locally cached copy is present, determine whether the locally cached copy is a latest version of the shared resource. The mechanisms, in response to determining that that locally cached copy is a latest version: perform the write operation on the locally cached copy to generate an updated locally cached copy, and transmit a cluster event notification to other data processing systems of the cluster indicating the shared resource was written to and which data processing system performed the write operation. The cluster event notification is logged in at least one change log data structure associated with the other data processing systems.

Claims

1. A computer program product comprising a computer readable storage medium having a computer readable program stored therein, wherein the computer readable program, when executed on a data processing system, causes the data processing system to:

determine whether a locally cached copy of a shared resource is present in a local cache memory of the data processing system;

determine, in response to a determination that a locally cached copy of the shared resource is present in the local cache memory, whether the locally cached copy of the shared resource is a latest version of the shared resource; and

in response to determining that that locally cached copy of the shared resource is a latest version of the shared resource;

perform a write operation on the locally cached copy of the shared resource to generate an updated locally cached copy of the shared resource; and

transmit a cluster event notification to other data processing systems of a cluster indicating the shared resource was written to and identifying which data processing system in the cluster performed the write operation, wherein the cluster event notification is logged in at least one change log data structure associated with the other data processing systems.

2. The computer program product of claim 1, wherein the computer readable program further causes the data processing system to determine whether a locally cached copy of the shared resource is a latest version of the shared resource at least by:

searching a change log data structure associated with the data processing system for an entry corresponding to the shared resource, wherein the change log data structure stores entries corresponding to cluster event notifications received from other data processing systems in the cluster in response to the other data processing systems accessing shared resources of the cluster; and

determining, based on results of the searching of the change log data structure, whether entries in the change log data structure indicate that the locally cached copy of the shared resource is a latest version of the shared resource.

3. The computer program product of claim 2, wherein the computer readable program further causes the data processing system to determine whether entries in the change log data structure indicate that the locally cached copy of the shared resource is a latest version of the shared resource at least by:

identifying a latest entry in the change log data structure corresponding to the shared resource based on a staleness indicator of the entries in the change log data structure; and

determining if a source identifier in the latest entry matches an identifier of the data processing system, wherein the source identifier identifies a data processing system that performed a write operation to the shared resource.

4. The computer program product of claim 2, wherein the computer readable program further causes the data processing system to determine whether entries in the change log data structure indicate that the locally cached copy of the shared resource is a latest version of the shared resource at least by:

determining whether there are no entries corresponding to the shared resource in the change log data structure; and

in response to determining that there are no entries corresponding to the shared resource in the change log data structure, determining that the locally cached copy of the shared resource is not the latest version of the shared resource.

5. The computer program product of claim 2, wherein the computer readable program further causes the data processing system to:

identify, in response to determining, based on the entries in the change log data structure, that the locally cached copy of the shared resource is not the latest version of the shared resource, a storage location of the latest version of the shared resource based on the entries in the change log data structure;

read a the latest version of the shared resource from the storage location of the latest version of the shared resource; and

store a new locally cached copy of the shared resource in the local cache memory of the data processing system.

6. The computer program product of claim 1, wherein the cluster event notification comprises at least one of a version number of the updated locally cached copy of the shared resource or a timestamp corresponding to a time when the write operation was performed on the locally cached copy of the shared resource, a unique identifier of the data processing system, and a unique identifier of the shared resource.

7. The computer program product of claim 1, wherein the computer readable program further causes the data processing system to perform a flush of the local cache memory of the data processing system in response to an event, wherein performing the flush of the local cache memory comprises:

determining if a locally cached version of the shared resource is the latest version of the shared resource; and

based on results of determining if the locally cached version of the shared resource is the latest version of the shared resource, either writing the locally cached version back to a source storage location of the shared resource or deleting the locally cached copy of the shared resource from the local cache memory.

8. The computer program product of claim 7, wherein if the results of determining if the locally cached version of the shared resource is the latest version of the shared resource indicate that the locally cached version of the shared resource is the latest version of the shared resource, the computer readable program further causes the data processing system to write the locally cached version back to the source storage location of the shared resource and sending an event notification to the other data processing systems of the cluster indicating that the latest version of the shared resource is located at the source storage location.

9. The computer program product of claim 1, wherein the at least one change log data structure comprises at least one of a plurality of change log data structures, each change log data structure being resident on a corresponding one of the data processing systems in the cluster, or a single change log data structure associated with a source storage location of the shared resource.

10. An apparatus comprising:

a processor; and

a memory coupled to the processor, wherein the memory comprises instructions which, when executed by the processor, cause the processor to;

determine whether a locally cached copy of a shared resource is present in a local cache memory of the data processing system;

determine, in response to a determination that a locally cached copy of the shared resource is present in the local cache memory, whether the locally cached copy of the shared resource is a latest version of the shared resource; and

in response to determining that that locally cached copy of the shared resource is a latest version of the shared resource;

perform a write operation on the locally cached copy of the shared resource to generate an updated locally cached copy of the shared resource; and

transmit a cluster event notification to other data processing systems of a cluster indicating the shared resource was written to and identifying which data processing system in the cluster performed the write operation, wherein the cluster event notification is logged in at least one change log data structure associated with the other data processing systems.