Managing the level of consistency for a file in a distributed filesystem

• US 9,990,372 B2
• Filed: 09/10/2014
• Issued: 06/05/2018
• Est. Priority Date: 09/10/2014
• Status: Active Grant

• Current Assignee: Panzura, Inc.
• Original Assignee: Panzura, Inc.
• Inventors: Lin, Yun, Jung, Steve Hyuntae, Anneboina, Vinay Kumar, Taylor, John Richard
• Primary Examiner(s): Brooks, David T
• Application Number:
  US14/482,923
• Publication Number:
  US 20160070741A1
• Time in Patent Office: 1,364 Days
• Field of Search: None
• CPC Class Codes: G06F 16/172 Caching, prefetching or hoarding of files
• CPC Class Codes: G06F 16/1774 Locking methods, e.g. locking methods for file systems allowing shared and concurrent access to files
• CPC Class Codes: G06F 16/178 Techniques for file synchronisation in file systems
• CPC Class Codes: G06F 16/183 Provision of network file services by network file servers, e.g. by using NFS, CIFS network file access protocols H04L67/1097

Abstract

The disclosed embodiments disclose techniques for managing consistency for a file in a distributed filesystem. Two or more cloud controllers collectively manage distributed filesystem data that is stored in the cloud storage systems; the cloud controllers ensure data consistency for the stored data, and each cloud controller caches portions of the distributed filesystem. During operation, a cloud controller receives from a client a request to access the file. The cloud controller determines a level of consistency that is associated with the file, and then uses this level of consistency to determine whether to communicate with a peer cloud controller when handling the request.

Claims

1. A computer-implemented method for managing a level of consistency for a file in a distributed filesystem, the method comprising:

collectively managing the data of the distributed filesystem using a set of two or more cloud controllers, wherein collectively managing the data comprises storing the data for the distributed filesystem in one or more cloud storage systems, wherein the cloud controllers cache and ensure data consistency for data stored in the cloud storage systems;

receiving at a cloud controller in the set a request from a client to access the file, wherein the set of cloud controllers detect and monitor accesses to the file to track in a specified timeframe the number and set of clients accessing the file, the number of simultaneous accesses for the file, and the number and locations of the cloud controllers that are involved in accessing the file, wherein the cloud controllers exchange tracked file access information to collectively create, maintain, and propagate a multi-dimensional consistency matrix that associates application behavior, file types, access type, and access frequencies for the files in the distributed filesystem;

monitoring accesses for the file and dynamically adjust a level of consistency that is associated with the file using the tracked information for the file and the consistency information collectively gathered in the multi-dimensional consistency matrix; and

determining from the level of consistency for the file whether to communicate with other cloud controllers in the set when handling the request and communicating changes to the level of consistency for the file and to the multi-dimensional consistency matrix to the cloud controllers in the set.

2. The computer-implemented method of claim 1, wherein the cloud controller determines that the file is associated with local file consistency and does not need to be kept consistent across the other cloud controllers for the distributed filesystem.

3. The computer-implemented method of claim 2,

wherein the file already exists in the distributed filesystem and the cloud controller is configured to use only metadata and data that is already cached locally on the cloud controller when handling the request;

wherein changes made to the contents of the file by clients of the cloud controller are not propagated to the cloud storage system nor to the other cloud controllers; and

wherein not contacting any other cloud controllers or a cloud storage system to retrieve data or updates for the file facilitates reducing file access delays for the request.

4. The computer-implemented method of claim 2,

wherein upon determining that the file does not yet exist in the context of the distributed filesystem, the cloud controller is configured to create a local-only version of the file on the cloud controller and notify the other cloud controllers for the distributed filesystem of the creation and existence of the file in the context of the distributed filesystem but not propagate any changes to the contents of the file to the cloud storage system nor to the other cloud controllers;

and

wherein using the local-only version of the file facilitates handling the request without needing to retrieve or send data or updates associated with the file from other cloud controllers or the cloud storage system, thereby reducing file access delays for the request.

5. The computer-implemented method of claim 2,

wherein the file already exists in the distributed filesystem and that metadata updates for the file are distributed by the set of cloud controllers but that the contents of the file are not synchronized to the distributed filesystem or the other cloud controllers;

wherein the cloud controller determines that the locally cached version of the file has not been updated in a specified time interval and determines using the multi-dimensional consistency matrix that the type of the file is such that the file contents of the file are generated using multiple other related files that are not currently cached on the cloud controller and would need substantial additional network bandwidth to be downloaded to the cloud controller and would then need to be processed on the client to update the file contents of the file;

wherein the cloud controller determines from a recent incremental metadata snapshot that a second cloud controller in the set recently modified the file;

wherein, upon comparing the network bandwidth and overhead needed to download the multiple other related files with the overhead of requesting and updating the version of the file stored by the second cloud controller, the cloud controller retrieves the version of the file from the second cloud controller.

6. The computer-implemented method of claim 1, wherein the cloud controller determines that the file needs write-after-write consistency.

7. The computer-implemented method of claim 6,

wherein the cloud controller determines that the request is a non-write request;

and

wherein the cloud controller uses the most up-to-date version of the file that is known to the cloud controller and does not check with any other cloud controllers for more recent updates to the file.

8. The computer-implemented method of claim 6,

wherein the cloud controller determines that the request is a write request;

and

wherein the cloud controller is configured to ensure write-after-write consistency for the file by;

contacting the owning cloud controller for the file to determine whether the file has been updated; and

if a more recent version of the file exists on the owning cloud controller, synchronizing the local version of the file with the more recent version of the file and claiming ownership for the file to ensure that the file can be updated exclusively on the cloud controller for the duration of the file access.

9. The computer-implemented method of claim 6,

wherein new files in the distributed filesystem are associated with write-after-write consistency by default unless an alternative level of consistency is explicitly specified or determined by the cloud controller;

wherein each cloud controller is configured to periodically send incremental metadata snapshots to all of the other cloud controllers of the distributed filesystem to lazily propagate metadata changes for recently modified files throughout the distributed filesystem;

wherein read requests for files in the distributed filesystem are typically more frequent than write requests for files in the distributed filesystem; and

wherein a default of write-after-write consistency facilitates reducing network load and cloud controller overhead for the distributed filesystem by primarily incurring the overhead of communicating with other cloud controllers during write accesses.

10. The computer-implemented method of claim 1, wherein the cloud controller determines that the file needs read-after-close consistency.

11. The computer-implemented method of claim 10, wherein the cloud controller is configured to ensure read-after-close consistency for the file by:

registering with all of the other cloud controllers for the distributed filesystem to request change notifications for the file;

sending change notifications to any other cloud controllers that have registered to receive notifications for the file whenever the cloud controller receives a write to the file from the client;

contacting the owning cloud controller for the file to determine whether the requested file has been updated; and

if a more recent version of the file exists on the owning cloud controller, synchronizing the local version of the file with the more recent version of the file.

12. The computer-implemented method of claim 1, wherein the cloud controller determines that the file is associated with real-time file consistency and that the request involves granting multiple distinct clients simultaneous byte-range locks for the file, wherein these clients simultaneously write to the different byte-ranges in the file at the same time.

13. The computer-implemented method of claim 1, wherein a level of consistency for the file is determined based on the file'"'"'s name, the file'"'"'s type, the file'"'"'s geographic location, the file'"'"'s location in the distributed filesystem hierarchy, the application accessing the file, and file access patterns.

14. The computer-implemented method of claim 13,

wherein the file is initially created and accessed by a single client and assigned a low level of consistency by the cloud controller;

wherein the cloud controller subsequently monitors accesses for the file and, upon detecting multiple simultaneous accesses for the file, determines that the file needs a higher level of consistency and then, upon confirming that the cloud controllers for the distributed filesystem can support a higher level of consistency for the file, dynamically increases the level of consistency for the file; and

wherein the cloud controller further considers collaborative access patterns, available compute resources, and available network bandwidth to determine the initial and subsequent levels of consistency for the file.

15. The computer-implemented method of claim 14,

wherein the cloud controller subsequently decreases the level of consistency for the file upon determining at least one of:

a change in the number of distributed clients that are accessing the file;

a change in the types of client accesses for the file; and

a change in the set of resources that are available for the distributed filesystem.

16. A non-transitory computer-readable storage medium storing instructions that when executed by a computer cause the computer to perform a method for managing a level of consistency for a file in a distributed filesystem, the method comprising:

collectively managing the data of the distributed filesystem using a set of two or more cloud controllers, wherein collectively managing the data comprises storing the data for the distributed filesystem in one or more cloud storage systems, wherein the cloud controllers cache and ensure data consistency for data stored in the cloud storage systems;

receiving at a cloud controller in the set a request from a client to access the file, wherein the set of cloud controllers detect and monitor accesses to the file to track in a specified timeframe the number and set of clients accessing the file, the number of simultaneous accesses for the file, and the number and locations of the cloud controllers that are involved in accessing the file, wherein the cloud controllers exchange tracked file access information to collectively create, maintain, and propagate a multi-dimensional consistency matrix that associates application behavior, file types, access type, and access frequencies for the files in the distributed filesystem;

monitoring accesses for the file and dynamically adjust a level of consistency that is associated with the file using the tracked information for the file and the consistency information collectively gathered in the multi-dimensional consistency matrix; and

determining from the level of consistency for the file whether to communicate with other cloud controllers in the set when handling the request and communicating changes to the level of consistency for the file and to the multi-dimensional consistency matrix to the cloud controllers in the set.

17. A cloud controller that manages a level of consistency for a file in a distributed filesystem, comprising:

a processor; and

a local storage device that stores a copy of the metadata for the distributed filesystem

wherein the cloud controller is part of a set of two or more cloud controllers that collectively manage the data of the distributed filesystem, wherein collectively managing the data comprises storing the data for the distributed filesystem in one or more cloud storage systems, wherein the cloud controllers cache and ensure data consistency for data stored in the cloud storage systems;

wherein the cloud controller;

receives a request from a client to access the file, wherein the cloud controller detects and monitors accesses to the file to track in a specified timeframe the number and set of clients accessing the file, the number of simultaneous accesses for the file, and the number and locations of the cloud controllers that are involved in accessing the file, wherein the cloud controllers exchange tracked file access information to collectively create, maintain, and propagate a multi-dimensional consistency matrix that associates application behavior, file types, access type, and access frequencies for the files in the distributed filesystem;

monitors accesses for the file and dynamically adjusts a level of consistency that is associated with the file using the tracked information for the file and the consistency information collectively gathered in the multi-dimensional consistency matrix; and

determines from the level of consistency for the file whether to communicate with other cloud controllers in the set when handling the request and communicating changes to the level of consistency for the file and to the multi-dimensional consistency matrix to the cloud controllers in the set.