System and method for operating a system to cache a networked file system utilizing tiered storage and customizable eviction policies based on priority and tiers

• US 9,355,036 B2
• Filed: 09/18/2013
• Issued: 05/31/2016
• Est. Priority Date: 09/18/2012
• Status: Active Grant

• Current Assignee: NetApp, Inc.
• Original Assignee: NetApp, Inc.
• Inventors: Beard, Derek, Yammine, Ghassan, Dahl, Gregory
• Primary Examiner(s): Chace, Christian P
• Assistant Examiner(s): Yew, Chie
• Application Number:
  US14/031,026
• Publication Number:
  US 20140082288A1
• Time in Patent Office: 986 Days
• Field of Search: None
• US Class Current: 1/1
• CPC Class Codes: G06F 12/0875 with dedicated cache, e.g. instruction or stack
• CPC Class Codes: G06F 16/172 Caching, prefetching or hoarding of files
• CPC Class Codes: G06F 3/0611 in relation to response time
• CPC Class Codes: G06F 3/0646 Horizontal data movement in storage systems, i.e. moving data in between storage devices or systems
• CPC Class Codes: G06F 3/0671 In-line storage system

Abstract

A network attached storage (NAS) caching appliance, system, and associated method of operation for caching a networked file system. Still further, some embodiments provide for a cache system that implements a mufti-tiered, policy-influenced block replacement algorithm.

Claims

1. A non-transitory computer-readable medium that stores instructions for caching a networked file system, the instructions being executable by one or more processors to cause the one or more processors to perform operations comprising:

connecting a cache system in-line as between a networked file system and one or more clients of the networked file system, the cache system including one or more appliances that store data corresponding to at least a portion of the networked file system;

assigning each of multiple cache resources to one of a plurality of ranks, wherein the cache resources of each rank include a greedy capacity;

processing requests from the one or more clients to access file system objects stored on the networked file system;

wherein processing the requests includes determining whether individual requests specify data from the networked file system that are also stored in the cache system;

wherein for each processed request that specifies data stored in the cache system, providing a response to the individual requests using data that is stored in the cache system; and

wherein for each processed request that specifies data that is not stored with the cache system;

forwarding the request to the networked file system;

receiving a response from the networked file system, the response including data corresponding to a file system object stored on the networked file system;

storing cache data corresponding to the file system object;

determining a natural rank for the cache data based at least in part on an access count of the file system object;

determining a highest rank of the cache resources with available greedy capacity;

upon determining that the highest rank of the cache resources with available greedy capacity is higher than the natural rank, (i) increasing, to a level consistent with the highest rank determined, an artificial access count of the file system object, and (ii) assigning the cache data to the cache resources of the highest rank determined;

assigning the cache data to the cache resources of the natural rank when there are no cache resources with available greedy capacity higher than the natural rank; and

forwarding the response from the networked file system to a client from which the individual requests originated.

2. The non-transitory computer-readable medium of claim 1, wherein the instructions for storing cache data further include instructions for:

determining a priority designation for the file system object corresponding to the data corresponding to the file system object stored on the network file system returned with the response; and

storing the cache data in the cache resource based on the priority designation of the file system object.

3. The non-transitory computer-readable medium of claim 2, wherein the priority designation for the file system object data is based on one or more user-defined policies.

4. The non-transitory computer-readable medium of claim 3, further comprising instructions for determining when to evict the cache data from the cache resource based on the priority designation.

5. The non-transitory computer-readable medium of claim 4, further comprising instructions for evicting the cache data from the assigned cache resources by performing one of (i) removing the cache data from the cache resources of the assigned rank and storing the cache data with cache resources of a lower rank if the assigned cache resources do not belong to the lowest rank, else (ii) removing the cache data from the cache resources of the assigned rank so that the cache data is no longer cached.

6. The non-transitory computer-readable medium of claim 1, wherein each of the multiple cache resources is assigned to one of the plurality of ranks based on a type of memory employed with that cache resource.

7. A cache system comprising:

multiple cache resources;

one or more processors to;

connect the cache system to a networked file system, the cache system being connected in-line as between the networked file system and one or more clients of the networked file system;

assign each of multiple cache resources to one of a plurality of ranks, wherein the cache resources of each rank include a greedy capacity;

process requests from the one or more clients to access file system objects stored on the networked file system by;

(i) determining whether individual requests specify data from the networked file system that are stored in the cache system, and for each processed request that specifies data stored in the cache system, provide a response to the individual requests using data that is stored in the cache system; and

(ii) for each processed request that specifies data that is not stored locally in the cache system;

forward the request to the networked file system;

receive a response from the networked file system, the response including data corresponding to a file system object stored on the networked file system;

store cache data corresponding to the file system object;

determine a natural rank for the cache data based at least in part on an access count of the file system object;

determine a highest rank of the cache resources with available greedy capacity;

upon determining that the highest rank of the cache resources with available greedy capacity is higher than the natural rank, (i) increase, to a level consistent with the highest rank determined, an artificial access count of the file system object, and (ii) assign the cache data to the cache resources of the highest rank determined;

assign the cache data to the cache resources of the natural rank when there are no cache resources with available greedy capacity higher than the natural rank;

forward the response from the networked file system to a client from which the individual requests originated.

8. The cache system of claim 7, wherein the one or more processors are to further assign each of the multiple cache resources to one of the plurality of ranks based at least in part on a type of memory used with that cache resource.

9. The cache system of claim 7, wherein the one or more processors are to further provide a policy engine that receives input for determining multiple policies, and to determine a priority designation for the cache data based on one or more of the multiple policies.

10. The cache system of claim 7, wherein the one or more processors are to further:

determine a priority designation for the file system object corresponding to the data corresponding to the file system object stored on the network file system returned with the response; and

store the cache data in the cache resource based on the priority designation of the file system object.

11. The cache system of claim 10, wherein the one or more processors are to determine when to evict the cache data from the cache resource based on the priority designation.