Concurrent processing of transactions and read operations achieving serialization and isolation in clustered file systems

• US 8,495,110 B2
• Filed: 08/06/2012
• Issued: 07/23/2013
• Est. Priority Date: 08/25/2008
• Status: Expired due to Fees

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Aronovich, Lior, Toaff, Yair, Paz, Gil, Asher, Ron
• Primary Examiner(s): Casanova, Jorge A
• Application Number:
  US13/567,225
• Publication Number:
  US 20120303682A1
• Time in Patent Office: 351 Days
• Field of Search: 707/812, 707/826
• US Class Current: 707/826
• CPC Class Codes: G06F 12/0802 Addressing of a memory level in which the access to the desired data or data block requires associative addressing means, e.g. caches
• CPC Class Codes: G06F 12/0815 Cache consistency protocols
• CPC Class Codes: G06F 12/0828 with concurrent directory accessing, i.e. handling multiple concurrent coherency transactions
• CPC Class Codes: G06F 12/084 with a shared cache
• CPC Class Codes: G06F 16/11 File system administration, e.g. details of archiving or snapshots file system backup G06F11/14
• CPC Class Codes: G06F 16/13 File access structures, e.g. distributed indices arrangements of input from, or output to, record carriers G06F3/06
• CPC Class Codes: G06F 16/16 File or folder operations, e.g. details of user interfaces specifically adapted to file systems
• CPC Class Codes: G06F 16/172 Caching, prefetching or hoarding of files
• CPC Class Codes: G06F 16/182 Distributed file systems
• CPC Class Codes: G06F 16/183 Provision of network file services by network file servers, e.g. by using NFS, CIFS network file access protocols H04L67/1097
• CPC Class Codes: G06F 16/1865 Transactional file systems
• CPC Class Codes: G06F 16/24552 Database cache management
• CPC Class Codes: G06F 21/6218 to a system of files or objects, e.g. local or distributed file system or database
• CPC Class Codes: G06F 2212/604 Details relating to cache allocation

Abstract

Systems. Methods, and Computer Program Products are provided for concurrent processing of transactions and read operations for achieving serialization and isolation in a clustered file system (CFS). Users, performing read only operations, are allowed to currently access the CFS while mutually excluding and serializing transactions of users affecting a same portion of the CFS. Transactions are ordered across a cluster of nodes of the CFS according to the transactions termination time.

Claims

1. A method for concurrent processing of transactions and read operations for achieving serialization and isolation in a clustered file system (CFS) using a processor device, the method comprising:

allowing users performing read only operations to currently access the CFS while mutually excluding and serializing the transactions of users affecting a same portion of the CFS;

ordering the transactions across a cluster of nodes of the CFS according to a termination time of the transactions;

including a transaction journal in each node for storing committed transactions generated by users on that node;

scanning a list to identify the location of the latest contents of a data segment prior to the transaction using a rollback procedure;

for each modified data segment, identifying the location of the latest contents prior to the transaction using the rollback procedure by;

if the data segment was marked as modified in the cache at the time it was inserted into the list, then the latest contents of this data segment appears only in the journal,

otherwise, if the data segment was not marked as modified in the cache at the time the data segment was inserted into the list, then the latest contents of this data segment appears in its final location in the shared storage; and

recording a type of each data segment in the list during insertion of the data segment into the list, wherein;

all data segments in the list whose latest contents appear in a final location are discarded from the cache,

for all the other data segments in the list, latest contents for the all the other data segments are restored from the journal into the cache by scanning the local transaction journal from ending to beginning, and first occurrences of these data segments in the local transaction journal are considered, and a modification indication of the data segments is set as true, and

exclusive permissions on all the data segments involved in a cancellation transaction are released.

2. The method of claim 1, further including allowing the transactions that update disjointed portions of the CFS to be concurrently processed while serializing the transactions that share updated portions of the CFS.

3. The method of claim 1, further including taking exclusive permissions by each of the transactions on all data segments that are modified by the transactions.

4. The method of claim 3, further including releasing the exclusive permissions only during a termination of the transactions.

5. The method of claim 1, further including allocating a unique serial number value for each of the transactions at the time of a commit operation of the transactions, wherein the unique serial number value is larger than all previous unique serial number values existing in the CFS, and the allocation of the unique serial number value is atomic with a release of exclusive permissions on the data segments involved in the transactions.

6. The method of claim 5, further including implementing the unique serial number value using a DSM component to ensure coherent viewing of the unique serial number value across a cluster of nodes within the CFS.

7. The method of claim 5, further including recording the unique serial number value associated with a transaction within metadata of modified data segments within the transaction both in a final storage location and a transaction journal.

8. A system for concurrent processing of transactions and read operations for achieving serialization and isolation in a clustered file system (CFS), the system comprising:

a cluster of nodes,

the CFS including the cluster of nodes forming a computer cluster,

a distributed shared memory (DSM) agent within a node of the cluster of nodes,

a plurality of storage devices in communication with the CFS,

a cache associated with the node,

a transaction journal associated with the CFS, and

a processor device having a memory coupled to the processor device for controlling the CFS, wherein the processor device is assigned to the node and the node is in communication with the plurality of storage devices, wherein the processor device;

allows users performing read only operations to currently access the CFS while mutually excluding and serializing the transactions of users affecting a same portion of the CFS;

orders the transactions across a cluster of nodes of the CFS according to a termination time of the transactions;

includes a transaction journal in each node for storing committed transactions generated by users on that node;

includes a list to identify the location of the latest contents of a data segment prior to the transaction using a rollback procedure;

for each modified data segment, identifies the location of the latest contents prior to the transaction using the rollback procedure by;

if the data segment was marked as modified in the cache at the time it was inserted into the list, then the latest contents of this data segment appears only in the journal,

otherwise, if the data segment was not marked as modified in the cache at the time the data segment was inserted into the list, then the latest contents of this data segment appears in its final location in the shared storage; and

records a type of each data segment in the list during insertion of the data segment into the list, wherein;

all data segments in the list whose latest contents appear in a final location are discarded from the cache,

for all the other data segments in the list, latest contents for the all the other data segments are restored from the journal into the cache by scanning the local transaction journal from ending to beginning, and first occurrences of these data segments in the local transaction journal are considered, and a modification indication of the data segments is set as true, and

exclusive permissions on all the data segments involved in a cancellation transaction are released.

9. The system of claim 8, wherein the processor device allows the transactions that update disjointed portions of the CFS to be concurrently processed while serializing the transactions that share updated portions of the CFS.

10. The system of claim 8, wherein the processor device takes exclusive permissions by each of the transactions on all data segments that are modified by the transactions.

11. The system of claim 10, wherein the processor device releases the exclusive permissions only during a termination of the transactions.

12. The system of claim 8, wherein the processor device allocates a unique serial number value for each of the transactions at the time of a commit operation of the transactions, wherein the unique serial number value is larger than all previous unique serial number values existing in the CFS, and the allocation of the unique serial number value is atomic with a release of exclusive permissions on the data segments involved in the transactions.

13. The system of claim 12, wherein the processor device implements the unique serial number value using the DSM component to ensure coherent viewing of the unique serial number value across a cluster of nodes within the CFS.

14. The system of claim 12, wherein the processor device records the unique serial number value associated with a transaction within metadata of modified data segments within the transaction both in a final storage location and the transaction journal.

15. A computer program product for concurrent processing of transactions and read operations for achieving serialization and isolation in a clustered file system (CFS) using a processor device, the computer program product comprising a non-transitory computer-readable storage medium having computer-readable program code portions stored therein, the computer-readable program code portions comprising:

a first executable portion that allows users performing read only operations to currently access the CFS while mutually excluding and serializing the transactions of users affecting a same portion of the CFS;

a second executable portion that orders the transactions across a cluster of nodes of the CFS according to a termination time of the transactions;

a third executable portion that includes a transaction journal in each node for storing committed transactions generated by users on that node;

a fourth executable portion that includes a list to identify the location of the latest contents of a data segment prior to the transaction using a rollback procedure;

for each modified data segment, a fifth executable portion that identifies the location of the latest contents prior to the transaction using the rollback procedure by;

if the data segment was marked as modified in the cache at the time it was inserted into the list, then the latest contents of this data segment appears only in the journal,

otherwise, if the data segment was not marked as modified in the cache at the time the data segment was inserted into the list, then the latest contents of this data segment appears in its final location in the shared storage; and

a sixth executable portion that records a type of each data segment in the list during insertion of the data segment into the list, wherein;

all data segments in the list whose latest contents appear in a final location are discarded from the cache,

for all the other data segments in the list, latest contents for the all the other data segments are restored from the journal into the cache by scanning the local transaction journal from ending to beginning, and first occurrences of these data segments in the local transaction journal are considered, and a modification indication of the data segments is set as true, and

exclusive permissions on all the data segments involved in a cancellation transaction are released.

16. The computer program product of claim 15, further including a seventh executable portion that takes exclusive permissions by each of the transactions on all data segments that are modified by the transactions.

17. The computer program product of claim 16, further including a an eighth-executable portion that releases the exclusive permissions only during a termination of the transactions.

18. The computer program product of claim 17, further including a ninth executable portion that releases the exclusive permissions only during a termination of the transactions.

19. The computer program product of claim 15, further including a seventh executable portion that allocates a unique serial number value for each of the transactions at the time of a commit operation of the transactions, wherein the unique serial number value is larger than all previous unique serial number values existing in the CFS, and the allocation of the unique serial number value is atomic with a release of exclusive permissions on the data segments involved in the transactions.

20. The computer program product of claim 19, further including a an eighth-executable portion that implements the unique serial number value using the DSM component to ensure coherent viewing of the unique serial number value across a cluster of nodes within the CFS.

21. The computer program product of claim 19, further including an eighth executable portion that records the unique serial number value associated with a transaction within metadata of modified data segments within the transaction both in a final storage location and the transaction journal.