Apparatus and method for data consistency in a proxy cache

• US 7,552,223 B1
• Filed: 04/25/2003
• Issued: 06/23/2009
• Est. Priority Date: 09/16/2002
• Status: Active Grant

• Current Assignee: NetApp, Inc.
• Original Assignee: NetApp, Inc.
• Inventors: Ayyar, Kartik, Ackaouy, Emmanuel, Quirion, Brian, Voll, James, Kuo, Szu-wen, Grunwald, David, Prakash, Ashish, Eastham, Paul
• Primary Examiner(s): Hu; Jinsong
• Application Number:
  US10/423,477
• Time in Patent Office: 2,251 Days
• Field of Search: 709/213, 709/217, 709/229, 711/141, 707/10
• US Class Current: 709/229
• CPC Class Codes: G06F 12/0815 Cache consistency protocols
• CPC Class Codes: G06F 16/10 File systems; File servers
• CPC Class Codes: G06F 2212/6026 Prefetching based on access pattern detection, e.g. stride based prefetch
• CPC Class Codes: H04L 67/56 Provisioning of proxy services store-and-forward switching systems in data switching networks H04L12/54
• CPC Class Codes: H04L 67/5682 Policies or rules for updating, deleting or replacing the stored data
• CPC Class Codes: H04L 69/329 in the application layer [OSI layer 7]

Abstract

In an embodiment, a method to provide data consistency in a storage system, includes: providing, by a server to a proxy cache, a lock associated with a delegated file in the server; in response to a write request from a client, modifying data in a cached copy of the delegated file in the proxy cache; revoking, by the server, the lock associated with the delegated file, in response to a request from another device to access the delegated file so that the delegated file is now a formerly delegated file; and writing the modified data to the formerly delegated file in the server to update the formerly delegated file; and permitting access to the formerly delegated file by the another device.

Claims

1. A method to provide data consistency in a storage system, the method comprising:

storing active data from a plurality of servers in a proxy cache based on a demand indicated by a plurality of clients to access data from the plurality of servers, wherein the active data includes a plurality of files and is a subset of data stored in the plurality of servers;

retaining the active data in the proxy cache based on a specific value assigned to each of the plurality of files, wherein the specific value of each particular file is dynamically determined based on a number of access requests made by the plurality of clients for the particular file;

providing, by a server of the plurality of servers to the proxy cache, a lock associated with a delegated file in the server, wherein the server prevents a write operation on the delegated file in the server when the proxy cache has the lock;

in response to a write request from a client of the plurality of clients, modifying, by the proxy cache, data in a cached copy of the delegated file, wherein the cached copy is stored in the proxy cache and wherein the write request modifies the data in the cached copy of the delegated file into a modified data in the cached copy;

revoking, by the server, the lock associated with the delegated file so that the proxy cache provides the lock to the server, in response to a request from another device to access the delegated file in the server, wherein the delegated file is now a formerly delegated file after the proxy cache has provided the lock to the server; and

writing the modified data from the proxy cache to the formerly delegated file in the server in order to update the formerly delegated file based upon the write request that modifies the data in the cached copy, when the server has obtained the lock from the proxy cache; and

permitting access to the updated formerly delegated file in the server by the another device.

2. The method of claim 1, further comprising:

requesting, by the proxy cache to the server, for the lock associated with the delegated file.

3. The method of claim 1, wherein the modified data written to the formerly delegated file is tagged to indicate transmission of the modified data to the server.

4. The method of claim 1, wherein the modified data that is not yet written to the formerly delegated file is untagged to indicate that no transmission of the modified data to the server.

5. The method of claim 1, wherein the lock prevents another client to modify the delegated file.

6. The method of claim 1, wherein the proxy cache and the server can communicate with each other by use of the NFS version 4 protocol.

7. The method of claim 1, further comprising:

revoking the lock of the proxy cache for the delegated file in response to a request from another client to the server to access the delegated file.

8. The method of claim 1, further comprising:

revoking the lock of the proxy cache for the delegated file in response to a request from another proxy cache to the server to access the delegated file.

9. The method of claim 1, further comprising:

sending modified data of the delegated file to the server after the lock of the proxy cache for the delegated file is revoked.

10. A method to provide data consistency in a storage system, the method comprising:

storing active data from a plurality of servers in a proxy cache based on a demand indicated by a plurality of clients to access data from the plurality of servers, wherein the active data includes a plurality of files and is a subset of data stored in the plurality of servers;

retaining the active data in the proxy cache based on a specific value assigned to each of the plurality of files, wherein the specific value of a particular file is dynamically determined based on a number of access requests made by the plurality of clients for the particular file;

providing, by a server of the plurality of servers to the proxy cache, a lock associated with a delegated file in the server, wherein the server prevents a write operation on the delegated file in the server when the proxy cache has the lock;

in response to a write request from a client of the plurality of clients, modifying, by the proxy cache, data in a cached copy of the delegated file, wherein the cached copy is stored in the proxy cache and wherein the write request modifies the data in the cached copy of the delegated file into a modified data in the cached copy; and

writing the modified data from the proxy cache to the delegated file in the server in order to update the delegated file based upon the write request that modifies the data in the cached copy, when the server has obtained the lock from the proxy cache.

11. The method of claim 10, wherein the modified data is written by a deferred write operation.

12. The method of claim 10, wherein the modified data is written by a delayed write operation.

13. The method of claim 10, wherein the proxy cache receives a write request from the client to modify the cached copy of the delegated file while a disconnect operation occurs between the server and the proxy cache.

14. The method of claim 10, further comprising:

requesting, by the proxy cache to the server, for a lock associated with the delegated file.

15. The method of claim 10, wherein the modified data written to the server is tagged to indicate transmission of the modified data to the server.

16. The method of claim 10, wherein the modified data that is not yet written to the server is untagged to indicate that no transmission of the modified data to the server.

17. An apparatus for providing data consistency in a storage system, the apparatus comprising:

a server configured to provide a lock associated with a delegated file in the server;

a proxy cache configured to store active data from the server based on a demand indicated by a client to access data on the server,

wherein the proxy cache retains the active data based on a specific value assigned to each of a plurality of files of the active data;

wherein the specific value of each of the plurality of files is determined based on a number of access requests made by the client;

wherein in response to the proxy cache receiving the lock the server prevents a write operation on the delegated file in the server when the proxy cache has the lock;

wherein the client sends a write request to the proxy cache;

wherein the proxy cache modifies data in a cached copy of the delegated file, wherein the cached copy is stored in the proxy cache, in response to a write request from a client and write the modified data to the delegated file in the server to update the delegated file based upon the write request that modifies the data in the cached copy, wherein the modified data is written to the delegated file when the server has obtained the lock from the proxy cache; and

wherein the server revokes the lock associated with the delegated file, in response to a request from another device to access the delegated file so that the delegated file is now a formerly delegated file.

18. The apparatus of claim 17, wherein the modified data written to the formerly delegated file is tagged to indicate transmission of the modified data to the server.

19. The apparatus of claim 17, wherein the modified data that is not yet written to the formerly delegated file is untagged to indicate that no transmission of the modified data to the server.

20. The apparatus of claim 17, wherein the lock prevents another client to modify the delegated file.

21. The apparatus of claim 17, wherein the proxy cache and the server can communicate with each other by use of the NFS version 4 protocol.

22. The apparatus of claim 17, wherein the server is configured to revoke the lock of the proxy cache for the delegated file in response to a request from another client to the server to access the delegated file.

23. The apparatus of claim 17, wherein the server is configured to revoke the lock of the proxy cache for the delegated file in response to a request from another proxy cache to the server to access the delegated file.

24. The apparatus of claim 17, wherein the proxy cache is configured to send the modified data of the delegated file to the server after the lock of the proxy cache for the delegated file is revoked.

32. The apparatus of claim 17, wherein the proxy cache is configured to request to the server for a lock associated with the delegated file.

25. An apparatus for providing data consistency in a storage system, the apparatus comprising:

a server configured to provide a lock associated with a delegated file in the server, wherein server prevents a write operation on the delegated file in the server when the proxy cache has the lock;

a proxy cache configured to store active data from the server based on a demand indicated by a client to access data on the server,

wherein the proxy cache retains the active data based on a specific value assigned to each of a plurality of files of the active data, and wherein the specific value of each of the plurality of files is determined based on a number of access requests made by the client, and wherein the proxy cache receives the lock and modifies data in a cached copy of the delegated file in response to a write request from the client, and wherein the cached copy is stored in the proxy cache, and wherein the proxy cache is further configured to write the modified data to the delegated file in the server to update the delegated file based upon the write request that modifies the data in the cached copy, wherein the modified data is written to the delegated file when the server has obtained the lock from the proxy cache.

26. The apparatus of claim 25, wherein the modified data is written by a deferred write operation.

27. The apparatus of claim 25, wherein the modified data is written by a delayed write operation.

28. The apparatus of claim 25, wherein the proxy cache receives a write request from the client to modify the cached copy of the delegated file while a disconnect operation occurs between the server and the proxy cache.

29. The apparatus of claim 25, wherein the proxy cache is configured to request for a lock associated with the delegated file.

30. The apparatus of claim 25, wherein the modified data written to the server is tagged to indicate transmission of the modified data to the server.

31. The apparatus of claim 25, wherein the modified data that is not yet written to the server is untagged to indicate that no transmission of the modified data to the server.

33. A method to provide a distributed storage system, the method comprising:

storing active data from a plurality of storage servers in a proxy cache, wherein the active data is a subset of data stored in the plurality of storage servers, and wherein the active data includes a plurality of data blocks;

caching the active data in the proxy cache based on a demand indicated by a plurality of clients to access the data from the plurality of storage servers, wherein the plurality of clients communicate with the proxy cache to access the data stored in the plurality of storage servers; and

retaining the active data in the proxy cache based on a priority value associated with each of the plurality of data blocks, wherein the priority value of a particular data block is assigned by;

determining whether the particular data block is assigned a predetermined value;

in response to a determination that the particular data block has a predetermined value, using the predetermined value to assign the priority value for the particular data block; and

otherwise, using a dynamic value to assign the importance value for the particular data block, wherein the dynamic value is determined based on a number of requests made by the plurality of clients to access the particular data block.

34. The method of claim 33, further comprising:

requesting a delegation lock for a specific data block in response to a request to the proxy cache from a particular client of the plurality of clients to write to the specific data block;

enabling the proxy cache to receive the delegation lock for the specific data block from a server of the plurality of storage servers;

locking the specific data block in the proxy cache after receiving the delegation lock; and

disallowing write requests to the specific data block until the server revokes the delegation lock to unlock the specific data block.

35. The method of claim 34, further comprising:

enabling the particular client to modify the specific data block after the proxy cache receives the delegation lock for the specific data block;

caching modifications to the specific data block by creating a modified data block in the proxy cache; and

replacing the specific data block in the server with the modified data block from the proxy cache after the server revokes the delegation lock on the specific data block.