Clustered cache appliance system and methodology

• US 20090182945A1
• Filed: 01/16/2008
• Published: 07/16/2009
• Est. Priority Date: 01/16/2008
• Status: Active Grant

• Current Assignee: NetApp, Inc.
• Original Assignee: NetApp, Inc.
• Inventors: Aviles, Joaquin J., Cree, Mark U., Dahl, Gregory A.
• Granted Patent: US 9,130,968 B2
• Time in Patent Office: Days
• US Class Current: 711/122
• CPC Class Codes: G06F 3/0611 in relation to response time
• CPC Class Codes: G06F 3/0656 Data buffering arrangements
• CPC Class Codes: G06F 3/067 Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
• CPC Class Codes: H04L 67/1097 for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
• CPC Class Codes: H04L 67/56 Provisioning of proxy services store-and-forward switching systems in data switching networks H04L12/54
• CPC Class Codes: H04L 67/5682 Policies or rules for updating, deleting or replacing the stored data
• CPC Class Codes: H04L 69/16 Implementation or adaptation of Internet protocol [IP], of transmission control protocol [TCP] or of user datagram protocol [UDP]

Abstract

A method, system and program are disclosed for accelerating data storage by providing non-disruptive storage caching using clustered cache appliances with packet inspection intelligence. A cache appliance cluster that transparently monitors NFS and CIFS traffic between clients and NAS subsystems and caches files using dynamically adjustable cache policies provides low-latency access and redundancy in responding to both read and write requests for cached files, thereby improving access time to the data stored on the disk-based NAS filer (group).

Claims

1. An enterprise cache cluster of two or more cache appliances for caching data operations requested from one or more networked data storage devices by one or more remote clients, the enterprise cache cluster comprising:

a cache memory at each cache appliance for caching data that is requested by a remote client;

a packet processor at each cache appliance coupled to the cache memory in said cache appliance and to one or more I/O ports for splicing connections between the data storage devices and remote clients, where the packet processor inspects network protocol traffic state parameters received on the I/O ports to determine if a request from a remote client can be serviced by the enterprise cache cluster; and

a connection interface for connecting the two or more cache appliances over a cluster bus in a private network to form a cohesive memory pool from the cache memories in the two or more cache appliances.

2. The enterprise cache cluster of claim 1, where the connection interface comprises a first pair of 10G Ethernet ports at a first cache appliance that are directly connected to a second pair of 10G Ethernet ports in a second cache appliance to form point-to-point connections for up to three cache appliances.

3. The enterprise cache cluster of claim 1, where the connection interface comprises a first cluster switch coupled to the one or more I/O ports of each cache appliance for forming a fully meshed network between the two or more cache appliances of the enterprise cache cluster, where the first cluster switch provides port pairs between the networked data storage devices and the remote clients.

4. The enterprise cache cluster of claim 3, where the connection interface comprises a first pair of 10G Ethernet ports at each cache appliance for directly connecting each cache appliance to the first cluster switch.

5. The enterprise cache cluster of claim 3, where the connection interface comprises a second cluster switch coupled to the one or more I/O ports of each cache appliance for forming a fully meshed network between the two or more cache appliances of the enterprise cache cluster, where the second cluster switch provides port pairs between the networked data storage devices and the remote clients.

6. The enterprise cache cluster of claim 5, where the connection interface comprises a second pair of 10G Ethernet ports at each cache appliance for directly connecting each cache appliance to the second cluster switch.

7. The enterprise cache cluster of claim 1, further comprising a network switch interconnect at each cache appliance that is coupled between the one or more I/O ports, the packet processor and the cache memory for routing network protocol traffic from the data storage devices and remote clients.

8. The enterprise cache cluster of claim 1, further comprising a network switch interconnect at each cache appliance that is coupled to the connection interface for routing network protocol traffic from the data storage devices and remote clients.

9. The enterprise cache cluster of claim 1, where the packet processor at each cache appliance executes software that transparently monitors NFS and CIFS traffic between remote clients and NAS subsystems and caches files using a predetermined cache policy.

10. The enterprise cache cluster of claim 1, further comprising a distributed cache software module for distributing caching operations amongst the two or more cache appliances to thereby service I/O requests presented to the enterprise cache cluster from the one or more remote clients.

11. The enterprise cache cluster of claim 1, where the enterprise cache cluster is connected in-line between the remote clients and the one or more networked data storage devices so as to intercept all data operation requests submitted to the one or more networked data storage devices.

12. A method for caching data operations at an enterprise cache cluster of two or more cache appliances, comprising:

receiving at the enterprise cache cluster a request from a remote client to perform a specified data operation at one or more networked data storage devices;

inspecting packet parameters in each TCP/IP stack layer associated with the request to determine if the request can be serviced by a cache memory located in one of the cache appliances in the enterprise cache cluster;

forwarding the request to the one or more networked data storage devices if the request can not be serviced by the enterprise cache cluster; and

performing the specified data operation at a selected cache memory located at the enterprise cache cluster if the request can be serviced by the enterprise cache cluster by forwarding the request to the selected cache memory over a connection interface which connects the two or more cache appliances over a cluster bus in a private network to form a cohesive memory pool from the cache memories in the two or more cache appliances.

13. The method of claim 12 where forwarding the request to the selected cache memory over a connection interface comprises sending the request to a first pair of 10G Ethernet ports at a first cache appliance that are directly connected to a second pair of 10G Ethernet ports in a second cache appliance to form point-to-point connections for up to three cache appliances.

14. The method of claim 12 where forwarding the request to the selected cache memory over a connection interface comprises sending the request over a first cluster switch coupled to the one or more I/O ports of each cache appliance for forming a fully meshed network between the two or more cache appliances of the enterprise cache cluster.

15. The method of claim 12, further comprising transparently splicing connections between the remote client and the one or more networked data storage devices.

16. The method of claim 12, where performing the specified data operation at the cache memory comprises caching files in the selected cache memory using a predetermined cache policy.

17. The method of claim 12, further comprising caching files in the enterprise cache cluster using dynamically adjustable cache policies that reflect application workloads that change over time.

18. A network cache appliance cluster for accelerating read and write requests from one or more storage clients for one or more files residing at one or more networked storage devices, comprising:

a plurality of cache appliances, each comprising;

a tiered memory cache system for providing low-latency access in responding to read and write requests comprising a first cache storage for storing business critical data under control of a policy engine that is managed independently from the one or more networked storage devices, and

a packet inspection module for inspecting a read or write request sent using an IP-based network protocol to determine if the request should be passed to the tiered memory cache system or forwarded to a networked storage device for further processing; and

a cluster switch for connecting the plurality of cache appliances in a private network to form a cohesive memory pool from the cache memories in the plurality of cache appliances.

19. The network cache appliance cluster of claim 18, where each tiered memory cache system comprises:

a dynamic and non-volatile cache memory for providing low-latency access in responding to read and write requests; and

a cache controller for caching files in the cache memory using a predetermined cache policy.

20. The network cache appliance cluster of claim 18, where the cluster switch comprises:

a switch management processor; and

a network switch interconnect coupled to one or more I/O ports on each of the plurality of cache appliances for routing network protocol traffic between the plurality of cache appliances and one or more storage clients and the one or more networked storage devices.