Network-attached storage enhancement appliance

• US 9,875,029 B2
• Filed: 12/27/2016
• Issued: 01/23/2018
• Est. Priority Date: 04/11/2014
• Status: Expired due to Fees

• Current Assignee: Parsec Labs, LLC
• Original Assignee: Parsec Labs, LLC
• Inventors: Bromley, Graham, Angerer, Walter, Bromley, Richard, Clowser, Kirk, Genda, Jon
• Primary Examiner(s): Rossiter, Sean D
• Assistant Examiner(s): CHOI, CHARLES J
• Application Number:
  US15/391,286
• Publication Number:
  US 20170109053A1
• Time in Patent Office: 392 Days
• Field of Search: None
• CPC Class Codes: G06F 16/122 using management policies backup systems G06F11/1446; file migration policies for HSM systems G06F16/185
• CPC Class Codes: G06F 16/1827 Management specifically adapted to NAS management of storage area networks [SAN] G06F3/067
• CPC Class Codes: G06F 3/0605 by facilitating the interaction with a user or administrator
• CPC Class Codes: G06F 3/0607 by facilitating the process of upgrading existing storage systems, e.g. for improving compatibility between host and storage device
• CPC Class Codes: G06F 3/0608 Saving storage space on storage systems
• CPC Class Codes: G06F 3/061 Improving I/O performance
• CPC Class Codes: G06F 3/0629 Configuration or reconfiguration of storage systems
• CPC Class Codes: G06F 3/0641 De-duplication techniques
• CPC Class Codes: G06F 3/0649 Lifecycle management
• CPC Class Codes: G06F 3/0658 Controller construction arrangements
• CPC Class Codes: G06F 3/067 Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
• CPC Class Codes: H04L 41/0893 Assignment of logical groups to network elements
• CPC Class Codes: H04L 41/0894 Policy-based network configuration management
• CPC Class Codes: H04L 61/457 containing identifiers of data entities on a computer, e.g. file names
• CPC Class Codes: H04L 67/1097 for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
• CPC Class Codes: H04L 67/5682 Policies or rules for updating, deleting or replacing the stored data

Abstract

A network attached storage management appliance that can be inserted into a pre-existing network. The appliance sits between an end user and the available storage and optimizes performance and storage through acceleration of data, migration of data, compression of data, deduplication of data, and expansion of storage. The device moves data between lower- and higher-performance storage, with frequently accessed data sitting in higher-performance storage and infrequently accessed data sitting in lower-performance storage.

Claims

1. A method comprising:

connecting a network-attached storage (NAS) enhancement appliance to a network to which a NAS device currently storing data for a plurality of clients is connected, the NAS device having an original Internet Protocol (IP) address by which the clients access the data;

assigning the NAS device a new IP address on the network;

configuring the NAS enhancement appliance to intercept network packets originating by the clients and addressed to the original IP address of the NAS device;

exporting a file system (fs) of the NAS device to the appliance;

configuring a managed file system (mfs) on the appliance, the mfs corresponding to the exported fs, the exported fs becoming the mfs;

configuring the appliance to forward non-fs-related intercepted network packets addressed to the original IP address of NAS device;

configuring a proxy fs (pxfs) to process access to the exported fs and therefore to the mfs;

configuring within the appliance a migration policy for the mfs, the migration policy specifying a target size of the mfs above which data is migrated away from the mfs;

setting within the appliance a cache acceleration flag for the mfs indicating whether files of the mfs are to be cached by the appliance;

configuring within the appliance a compression flag for the mfs indicating whether files of the mfs are to be compressed by the appliance; and

causing the appliance to operate on the network in accordance with the mfs, the proxy fs, the migration policy, the cache acceleration flag, and the compression flag that have been configured,

wherein the appliance interacts with the clients on behalf of the NAS device, the clients accessing the fs at the original IP address of the NAS device without reconfiguration of the clients, the appliance intercepting client access of the fs at the original IP address and instead processing the client access via the pxfs.

2. The method of claim 1, wherein the pxfs exports a mount point identical to a mount point of the mfs, the appliance taking the original IP address of the NAS device as a virtual IP address.

3. The method of claim 2, wherein the clients access files of the fs of the NAS device, and therefore of the mfs, via the appliance interacting with the pxfs.

4. The method of claim 1, further comprising:

adding an entry in an mfs table of the appliance for the mfs, the entry for the mfs comprising;

the original IP address of the NAS device;

a mount point of the NAS device;

the new IP address of the NAS device;

an identifier referencing the migration policy;

the cache acceleration flag; and

the compression flag.

5. The method of claim 4, further comprising:

defining a storage bin corresponding to an expansion storage drive connected to the network to which files of the mfs are expandable,

wherein the entry for the mfs further comprises;

identification of a storage bin corresponding to the expansion storage device,

and wherein original data of each file expanded to the expansion storage device is stored on the NAS device, and additional data of each file expanded to the expansion storage device is stored on the expansion storage device.

6. The method of claim 4, further comprising:

defining a storage bin corresponding to a migration storage device connected to the network to which files of the mfs are migratable,

wherein the entry for the mfs further comprises;

identification of the storage bin corresponding to the migration storage device connected,

and wherein the files migrated to the migration storage device are completely stored on the migration storage device, and no part thereof is stored on the NAS device.

7. The method of claim 1, wherein causing the appliance to operate comprises, by the appliance:

intercepting the network packets originating by the clients and addressed to the original IP address; and

forwarding the non-fs-related intercepted network to the new IP address of the NAS device without modification.

8. The method of claim 7, wherein causing the appliance to operate further comprises, by the appliance:

determining that an intercepted network packet pertains to a file on the fs of the NAS device and therefore to the mfs configured on the appliance; and

controlling access to the file in accordance with the mfs, the proxy fs, the migration policy, the cache acceleration flag, and the compression flag that have been configured.

9. The method of claim 1, wherein causing the appliance to operate comprises, by the appliance:

in response to determining that a current size of the mfs is greater than the target size of the mfs, selecting a plurality of files of the mfs in accordance with the migration policy;

for each selected filed;

chunking the selected file into a plurality of chunks, each chunk being a discrete file;

moving the chunks of the selected file to a lower-performance NAS device communicatively connected to the network, the lower-performance NAS device having lower performance than the NAS device; and

replacing the selected file on the mfs with a stub file indicating a location of the chunks of the selected file on the lower-performance NAS.

10. The method of claim 9, wherein causing the appliance to operate comprises, by the appliance:

determining that an intercepted network packet pertains to a given selected file that has been migrated to the lower-performance NAS device;

determining that the given selected file is to be de-migrated to a higher-performance NAS device, the higher-performance NAS device having higher performance than the lower-performance NAS device;

moving the chunks of the given selected file from the lower-performance NAS device to the higher-performance NAS device; and

updating the stub file on the mfs indicating the location of the chunks of the selected file on the higher-performance NAS device.

11. The method of claim 1, wherein causing the appliance to operate comprises, by the appliance:

in response to determining that an intercepted network packet pertains to a file on the fs of the NAS device and therefore to the mfs configured on the appliance, in response to determining that the intercepted network packet is adding data to the file, and in response to determining that the mfs has reached capacity;

chunking the file into a plurality of chunks, each chunk being a discrete file;

storing the chunks of the selected file except for a last chunk of the file on the NAS device;

storing the last chunk of the file, including the data added to the file, on an expansion storage device; and

replacing the file on the mfs with a stub file indicating a location of the chunks of the file except the last chunk on the NAS device and a location of the last chunk of the file on the expansion storage device.

12. The method of claim 1, wherein causing the appliance to operate comprises, by the appliance:

in response to determining that an intercepted network packet pertains to a file on the fs of the NAS device and therefore to the mfs configured on the appliance, and in response to determining that the cache acceleration flag has been set;

chunking the file into a plurality of chunks, each chunk being a block; and

storing the chunks of the file within a persistent storage of the appliance having a higher performance than the NAS device.

13. The method of claim 12, wherein causing the appliance to operate further comprises, by the appliance:

in response to determining that the intercepted network packet pertains to reading a portion of the file,

determining a selected chunk of the file to which the portion corresponds;

retrieving the selected chunk from the persistent storage of the appliance; and

returning the selected chunk in response to the intercepted network packet.

14. The method of claim 12, wherein causing the appliance to operate further comprises, by the appliance:

in response to determining that the intercepted network packet pertains to altering a portion of the file,

determining a selected chunk of the file to which the portion corresponds;

altering the selected chunk of the file within the persistent storage of the appliance;

setting a dirty bit corresponding to the selected chunk;

at a later time, writing back the selected chunk to the file as stored on the NAS device.

15. The method of claim 1, wherein causing the appliance to operate comprises, by the appliance:

in response to determining that an intercepted network packet pertains to a file on the fs of the NAS device and therefore to the mfs configured on the appliance, and in response to determining that the compression flag has been set;

chunking the file into a plurality of chunks, each chunk being a block;

compressing each chunk of the file individually;

storing the chunks of the file on the NAS device;

storing a mapping file on the NAS device referencing the chunks of the file;

replacing the file on the mfs with a stub file indicating a location of the mapping file for the file.

16. A non-transitory computer-readable data storage medium storing computer-executable code that is executable by a processor to perform a method comprising:

assigning a new Internet Protocol (IP) address to a network-attached storage(NAS) device connected to a network and currently storing data for a plurality of clients, the NAS device having an original IP address by which the clients access the data;

configuring a NAS enhancement appliance to intercept network packets originating by the clients and addressed to the original IP address of the NAS device;

exporting a file system (fs) of the NAS device to the appliance;

configuring a managed file system (mfs) on the appliance, the mfs corresponding to the exported fs, the exported fs becoming the mfs;

configuring the appliance to forward non-fs-related intercepted network packets addressed to the original IP address of NAS device;

configuring a proxy fs (pxfs) to process access to the exported fs and therefore to the mfs;

causing the appliance to operate on the network in accordance with the mfs and the proxy fs,

wherein the appliance interacts with the clients on behalf of the NAS device, the clients accessing the fs at the original IP address of the NAS device without reconfiguration of the clients, the appliance intercepting client access of the fs at the original IP address and instead processing the client access via the pxfs.

17. The non-transitory computer-readable data storage medium of claim 16, wherein the method further comprises:

configuring within the appliance a migration policy for the mfs, the migration policy specifying a target size of the mfs above which data is migrated away from the mfs; and

defining a storage bin corresponding to a migration storage device connected to the network to which files of the mfs are migratable; and

adding an entry in an mfs table of the appliance for the mfs, the entry for the mfs comprising;

the original IP address of the NAS device;

a mount point of the NAS device;

the new IP address of the NAS device;

an identifier referencing the migration policy; and

identification of the storage bin corresponding to the migration storage device connected,

wherein the files migrated to the migration storage device are completely stored on the migration storage device, and no part thereof is stored on the NAS device.

18. The non-transitory computer-readable data storage medium of claim 16, wherein the method further comprises:

defining a storage bin corresponding to an expansion storage drive connected to the network to which files of the mfs are expandable; and

adding an entry in an mfs table of the appliance for the mfs, the entry for the mfs comprising;

the original IP address of the NAS device;

a mount point of the NAS device;

the new IP address of the NAS device;

identification of a storage bin corresponding to the expansion storage device,

wherein original data of each file expanded to the expansion storage device is stored on the NAS device, and additional data of each file expanded to the expansion storage device is stored on the expansion storage device.

19. The non-transitory computer-readable data storage medium of claim 16, wherein the method further comprises:

setting within the appliance a cache acceleration flag for the mfs indicating whether files of the mfs are to be cached by the appliance; and

adding an entry in an mfs table of the appliance for the mfs, the entry for the mfs comprising;

the original IP address of the NAS device;

a mount point of the NAS device;

the new IP address of the NAS device;

the cache acceleration flag,

wherein causing the appliance to operate comprises, by the appliance;

in response to determining that an intercepted network packet pertains to a file on the fs of the NAS device and therefore to the mfs configured on the appliance, and in response to determining that the cache acceleration flag has been set;

chunking the file into a plurality of chunks, each chunk being a block; and

storing the chunks of the file within a persistent storage of the appliance having a higher performance than the NAS device.

20. The non-transitory computer-readable data storage medium of claim 16, wherein the method further comprises:

configuring within the appliance a compression flag for the mfs indicating whether files of the mfs are to be compressed by the appliance; and

adding an entry in an mfs table of the appliance for the mfs, the entry for the mfs comprising;

the original IP address of the NAS device;

a mount point of the NAS device;

the new IP address of the NAS device;

the compression flag,

wherein causing the appliance to operate comprises, by the appliance;

in response to determining that an intercepted network packet pertains to a file on the fs of the NAS device and therefore to the mfs configured on the appliance, and in response to determining that the compression flag has been set;

chunking the file into a plurality of chunks, each chunk being a block;

compressing each chunk of the file individually;

storing the chunks of the file on the NAS device;

storing a mapping file on the NAS device referencing the chunks of the file;

replacing the file on the mfs with a stub file indicating a location of the mapping file for the file.