Transactional processing for clustered file systems

• US 8,447,795 B2
• Filed: 06/22/2012
• Issued: 05/21/2013
• Est. Priority Date: 08/25/2008
• Status: Expired due to Fees

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Aronovich, Lior, Toaff, Yair, Paz, Gil, Asher, Ron
• Primary Examiner(s): Casanova, Jorge A
• Application Number:
  US13/530,335
• Publication Number:
  US 20120265940A1
• Time in Patent Office: 333 Days
• Field of Search: 707/826
• US Class Current: 707/826
• CPC Class Codes: G06F 12/0802 Addressing of a memory level in which the access to the desired data or data block requires associative addressing means, e.g. caches
• CPC Class Codes: G06F 12/0815 Cache consistency protocols
• CPC Class Codes: G06F 12/0828 with concurrent directory accessing, i.e. handling multiple concurrent coherency transactions
• CPC Class Codes: G06F 12/084 with a shared cache
• CPC Class Codes: G06F 16/11 File system administration, e.g. details of archiving or snapshots file system backup G06F11/14
• CPC Class Codes: G06F 16/13 File access structures, e.g. distributed indices arrangements of input from, or output to, record carriers G06F3/06
• CPC Class Codes: G06F 16/16 File or folder operations, e.g. details of user interfaces specifically adapted to file systems
• CPC Class Codes: G06F 16/172 Caching, prefetching or hoarding of files
• CPC Class Codes: G06F 16/182 Distributed file systems
• CPC Class Codes: G06F 16/183 Provision of network file services by network file servers, e.g. by using NFS, CIFS network file access protocols H04L67/1097
• CPC Class Codes: G06F 16/1865 Transactional file systems
• CPC Class Codes: G06F 16/24552 Database cache management
• CPC Class Codes: G06F 21/6218 to a system of files or objects, e.g. local or distributed file system or database
• CPC Class Codes: G06F 2212/604 Details relating to cache allocation

Abstract

Systems and methods for transactional processing within a clustered file system wherein user defined transactions operate on data segments of the file system data. The users are provided within an interface for using a transactional mechanism, namely services for opening, writing and rolling-back transactions. A distributed shared memory technology is utilized to facilitate efficient and coherent cache management within the clustered file system based on the granularity of data segments (rather than files).

Claims

1. A method comprising:

providing a clustered file system (CFS) residing on a cluster of nodes for accessing a shared storage of file system data; and

providing a local cache memory on each node to reduce file system access to the shared storage and for processing modifications to the file system data;

providing a distributed shared memory (DSM) agent on each node;

collectively managing, by the DSM agent, access permissions to the entire space of file system data on a data segment basis;

utilizing, by each DSM agent, the distributed cache memories of the CFS as a virtual shared cache to provide transaction based modifications for user defined transactions on a data segment basis and to provide transaction based modifications of CFS defined transactions on the data segment basis;

providing a list of data segments modified within an ongoing transaction;

scanning, via a rollback procedure, the list to identify the location of the latest contents of a data segment prior to the transaction; and

identifying, by the rollback procedure, the location of the latest contents prior to the transaction for each modified data segment, wherein;

if the data segment was marked as modified in the cache at the time it was inserted into the list, then the latest contents of this data segment appears only in the journal, and

if the data segment was not marked as modified in the cache at the time it was inserted into the list, then the latest contents of this data segment appears in its final location in the shared storage.

2. The method of claim 1, further comprising recording the type of each data segment in the list during insertion of the data segment into the list, wherein:

each data segment in the list whose latest contents appear in their final location are discarded from the cache;

for each other data segment in the list whose latest contents do not appear in their final location, their latest contents are restored into the cache and then setting their modification indication to true; and

the procedure releases the exclusive permissions on all the data segments involved in a cancelled transaction.

3. The method of claim 1, further comprising determining, by each DSM agent, the latest contents of file system data to maintain coherency between the distributed cache memories of the CFS.

4. The method of claim 3, further comprising:

applying user operations to data segments in an associated local cache memory and reading requested data segments to the local cache memory in response to a user request to a local node; and

modifying data segments within the local cache memory in accordance with permissions granted by the DSM agents.

5. The method of claim 1, further comprising:

maintaining a local set of data segments in the local cache memory; and

maintaining associated local parameters that comprise an access permission and ownership by the local DSM agent.

6. The method of claim 5, further comprising:

performing checkpoint operations on modified and committed data segments that the local DSM agent owns; and

performing concurrent checkpoints by CFS agents residing on different nodes.

7. A non-transitory computer program product for managing access in a clustered file system (CFS) to a shared storage of file system data, each node of the CFS having a local cache memory, the computer program product comprising:

computer code for providing a clustered file system (CFS) residing on a cluster of nodes for accessing a shared storage of file system data; and

computer code for providing a local cache memory on each node to reduce file system access to the shared storage and for processing modifications to the file system data;

computer code for providing a distributed shared memory (DSM) agent on each node;

computer code for collectively managing, by the DSM agent, access permissions to the entire space of file system data on a data segment basis;

computer code for utilizing, by each DSM agent, the distributed cache memories of the CFS as a virtual shared cache to provide transaction based modifications for user defined transactions on a data segment basis and to provide transaction based modifications of CFS defined transactions on the data segment basis;

computer code for providing a list of data segments modified within an ongoing transaction;

computer code for scanning, via a rollback procedure, the list to identify the location of the latest contents of a data segment prior to the transaction; and

computer code for identifying, by the rollback procedure, the location of the latest contents prior to the transaction for each modified data segment, wherein;

if the data segment was marked as modified in the cache at the time it was inserted into the list, then the latest contents of this data segment appears only in the journal, and

if the data segment was not marked as modified in the cache at the time it was inserted into the list, then the latest contents of this data segment appears in its final location in the shared storage.

8. The computer program product of claim 7, further comprising computer code for recording the type of each data segment in the list during insertion of the data segment into the list, wherein:

each data segment in the list whose latest contents appear in their final location are discarded from the cache;

for each other data segment in the list whose latest contents do not appear in their final location, their latest contents are restored into the cache and then setting their modification indication to true; and

the procedure releases the exclusive permissions on all the data segments involved in a cancelled transaction.

9. The computer program product of claim 7, further comprising computer code for determining, by each DSM agent, the latest contents of file system data to maintain coherency between the distributed cache memories of the CFS.

10. The computer program product of claim 9, further comprising:

computer code for applying user operations to data segments in an associated local cache memory and reading requested data segments to the local cache memory in response to a user request to a local node; and

computer code for modifying data segments within the local cache memory in accordance with permissions granted by the DSM agents.

11. The computer program product of claim 7, further comprising:

computer code for maintaining a local set of data segments in the local cache memory;

computer code for maintaining associated local parameters that comprise an access permission and ownership by the local DSM agent;

computer code for performing checkpoint operations on modified and committed data segments that the local DSM agent owns; and

computer code for performing concurrent checkpoints by CFS agents resding on different nodes.

12. A system comprising:

a clustered file system (CFS) including a cluster of nodes forming a computer cluster, each node including a processor and a memory coupled to the processor, and each node being in communication with a shared storage of file system data;

wherein the memory stores computer code that, when executed by the processor, causes the processor to;

provide a distributed shared memory (DSM) agent on each node,

collectively manage access permissions to the entire space of file system data on a data segment basis,

utilize the distributed cache memories of the CFS as a virtual shared cache to provide transaction based modifications for user defined transactions on a data segment basis and to provide transaction based modifications of CFS defined transactions on the data segment basis,

provide a list of data se ments modified within an on oin transaction

scan, via a rollback procedure, the list to identify the location of the latest contents of a data segment prior to the transaction, and

identify, by the rollback procedure, the location of the latest contents prior to the transaction for each modified data segment, wherein;

if the data segment was marked as modified in the cache at the time it was inserted into the list, then the latest contents of this data segment appears only in the journal, and

if the data segment was not marked as modified in the cache at the time it was inserted into the list, then the latest contents of this data segment appears in its final location in the shared storage.

13. The system of claim 12, wherein the computer code further causes the processor to record the type of each data segment in the list during insertion of the data segment into the list, wherein:

each data segment in the list whose latest contents appear in their final location are discarded from the cache;

for each other data segment in the list whose latest contents do not appear in their final location, their latest contents are restored into the cache and then setting their modification indication to true; and

the procedure releases the exclusive permissions on all the data segments involved in a cancelled transaction.

14. The system of claim 12, wherein the computer code further causes the processor to determine the latest contents of file system data to maintain coherency between the distributed cache memories of the CFS.

15. The system of claim 14, wherein the computer code further causes the processor to:

apply user operations to data segments in an associated local cache memory and reading requested data segments to the local cache memory in response to a user request to a local node; and

modify data segments within the local cache memory in accordance with permissions granted by the DSM agents.

16. The system of claim 12, wherein the computer code further causes the processor to:

maintain a local set of data segments in the local cache memory; and

maintain associated local parameters that comprise an access permission and ownership by the local DSM agent.

17. The system of claim 16, wherein the computer code further causes the processor to:

perform checkpoint operations on modified and committed data segments that the local DSM agent owns; and

perform concurrent checkpoints by CFS agents residing on different nodes.