Efficient file management through granular opportunistic locking

• US 8,121,061 B2
• Filed: 06/26/2008
• Issued: 02/21/2012
• Est. Priority Date: 06/26/2008
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Rajaram, Senthil, Christiansen, Neal R., Allred, Christian G, Kruse, David M., George, Mathew, Kirubanandan, Nandagopal, Havewala, Sarosh C.
• Primary Examiner(s): Pezzlo, John
• Application Number:
  US12/146,524
• Publication Number:
  US 20090327360A1
• Time in Patent Office: 1,335 Days
• Field of Search: 370/282, 370/252, 370/412, 370/419
• US Class Current: 370/282
• CPC Class Codes: G06F 12/0891 using clearing, invalidating or resetting means
• CPC Class Codes: G06F 16/10 File systems; File servers
• CPC Class Codes: G06F 16/1774 Locking methods, e.g. locking methods for file systems allowing shared and concurrent access to files
• CPC Class Codes: G06F 16/182 Distributed file systems
• CPC Class Codes: G06F 16/2308 Concurrency control transaction processing G06F9/466
• CPC Class Codes: G06F 16/2343 Locking methods, e.g. distributed locking or locking implementation details
• CPC Class Codes: G06F 16/27 Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
• CPC Class Codes: G06F 16/951 Indexing; Web crawling techniques
• CPC Class Codes: G06F 2212/6042 Allocation of cache space to multiple users or processors
• CPC Class Codes: H04L 67/5682 Policies or rules for updating, deleting or replacing the stored data

Abstract

Improved methods and systems for granular opportunistic locking mechanisms (oplocks) are provided for increasing file caching efficiency. Oplocks can be specified with a combination of three possible granular caching intentions: read, write, and/or handle. An oplock can be specified with an identifier that indicates a client/specific caller to avoid breaking the original oplock due to an incompatibility from other requests of the same client. An atomic oplock flag is added to create operations that allow callers to request an atomic open with an oplock with a given file.

Claims

1. A method for maintaining distributed cache coherency across multiple clients accessing a file or a shared resource, comprising:

opening a file handle with an oplock key associated to a first client;

receiving a request from the first client for a first oplock state, the request indicating an intent to locally cache one or more of;

write data, read data, and the file handle;

granting the first oplock state to the first client; and

in response to receiving an acknowledgement that the first oplock state is broken, transitioning from the first oplock state by granting the first client a second oplock state that is different from the first oplock state.

2. The method of claim 1, wherein opening the file handle with an oplock key associated to the first client comprises:

checking for oplocks on the file handle;

creating the file handle with an atomic oplock flag;

placing a temporary oplock on the file handle; and

upon an unsuccessful request by a second client, returning with an await status signifying that the temporary oplock is not able to be broken and allowing for the unsuccessful request by the second client to be retried, or blocking the second client'"'"'s request thereafter.

3. The method of claim 2, where the atomic oplock flag prevents breaking of the first oplock state between a time when the first client opens the file and when the first oplock state is specified by placing a temporary oplock on the file.

4. The method of claim 1, wherein the oplock key identifies the first client and prevents two or more file handles from the first client from breaking each other'"'"'s oplock state.

5. The method of claim 1, further comprising:

notifying the first client of the first client request that the first oplock state is broken upon receiving a second client request without the oplock key associated to the file handle originally opened;

providing an opportunity for the client to flush any unwritten data to the server, re-open any handles which were collapsed on the client, close any cached handles and purge its read cache; and

transmitting the oplock key to a file system control and storing the oplock key.

6. The method of claim 1, where the second oplock state specifies a higher caching level than the first oplock.

7. The method of claim 1, further comprising:

performing a share check to determine a sharing violation, and upon discovering a sharing violation breaking existing handle oplocks; and

performing the share check for a second time; and

upon discovery of a sharing violation, failing any file open requests.

8. The method of claim 1, further comprising:

breaking the first oplock state when a second client makes an incompatible request on the file handle associated with a different oplock key.

9. A file server comprising:

a storage having a file directed for shared usage;

an interface to a network; and

a processor, the storage operating from control signals of the processor to enforce opportunistic locking semantics for accessing the storage across the network, the opportunistic locking semantics enforced among the plurality of clients, the processor configured to;

open a file handle of the file directed for shared usage with an oplock key associating a first client to the file handle;

receive a request from the first client for a first oplock state, the request indicating an intent to locally cache one or more of;

write data, read data, and the file handle;

grant a first oplock state to the first client; and

transition from the first oplock state to a second oplock state different from the first oplock state in response to receiving an acknowledgement that the first oplock state is broken.

10. The file server of claim 9, wherein the opening the file handle with an oplock key associating the first client to the file handle comprises:

checking for oplocks on the file handle;

creating the file handle with an atomic oplock flag;

placing a temporary oplock on the file handle; and

upon an unsuccessful request by a second client, returning with an await status signifying that the temporary oplock is not able to be broken and allowing for the unsuccessful request by the second client to be retried, or blocking the second client'"'"'s request thereafter.

11. The file server of claim 10, where the atomic oplock flag prevents breaking of the first oplock state between a time when the first client opens the file and when the first oplock state is specified by placing a temporary oplock on the file.

12. The file server of claim 9, wherein the oplock key identifies a client and prevents two or more file handles from the client from breaking each other'"'"'s oplock state.

13. The file server of claim 9, the processor further configured to:

notify the first client of the first client request that the first oplock state is broken upon receiving a second client request, wherein the second client request does not include the oplock key associated to the file handle originally opened; and

transmit the oplock key to a file system control for storing the oplock key.

14. The file server of claim 9, where the second oplock state specifies a higher caching level than the first oplock state.

15. The file server of claim 9, performing a share check before breaking the first oplock state.

16. The file server of claim 9, comprising:

breaking the first oplock state when a second client makes an incompatible request on the file handle with a different oplock key.

17. A method for allocating and managing files in a multi-user network environment having at least one server with a file directed for shared usage, comprising:

opening a file handle with an oplock key associated to a first client, wherein the oplock key prevents two or more file handles from the first client from breaking each other'"'"'s oplock state;

granting a first oplock state as specified by a first client request, the first client request indicating an intent to perform locally one or more of;

read caching, write caching, or handle caching; and

transitioning from the first oplock state as specified to a second oplock state upon receiving an acknowledgement that the first oplock state is broken, the transitioning comprising;

notifying the first client that the first oplock state is broken in response to receiving a second client request without the oplock key;

providing an opportunity for the client to flush any unwritten data to the server, re-open any handles which were collapsed on the client, close any cached handles and purge its read cache;

transmitting the oplock key to a file system control to store the oplock key;

performing a share check to determine a sharing violation, and upon discovering a sharing violation breaking existing handle oplocks, if any;

performing the share check for a second time; and

upon discovery of a sharing violation, failing any file open requests.

18. The method of claim 17, wherein the opening the file handle with an oplock key associated to the first client comprises:

checking for oplocks on the file handle;

creating the file handle with an atomic oplock flag that prevents breaking of the first oplock state between a time when the first client opens the file and when the first oplock state is specified by placing a temporary oplock on the file;

placing a temporary oplock on the file handle; and

upon an unsuccessful request by a second client, returning with an await status signifying that the temporary oplock is not able to be broken and allowing for the unsuccessful request by the second client to be retried, or blocking the second client'"'"'s request thereafter;

where the second oplock state specifies a higher caching level than the first oplock state.