Systems and methods for writing data and storage system specific metadata to network attached storage device

• US 9,124,611 B2
• Filed: 03/14/2014
• Issued: 09/01/2015
• Est. Priority Date: 12/18/2006
• Status: Active Grant

• Current Assignee: CommVault Systems Incorporated
• Original Assignee: CommVault Systems Incorporated
• Inventors: Chen, Ho-chi, Kottomtharayil, Rajiv, Littlefield, Duncan
• Primary Examiner(s): Rutz, Jared
• Assistant Examiner(s): Ayash, Marwan
• Application Number:
  US14/212,080
• Publication Number:
  US 20140201250A1
• Time in Patent Office: 536 Days
• Field of Search: None
• US Class Current: 1/1
• CPC Class Codes: G06F 11/1464 for networked environments
• CPC Class Codes: G06F 11/20 using active fault-masking, e.g. by switching out faulty elements or by switching in spare elements
• CPC Class Codes: G06F 16/168 Details of user interfaces specifically adapted to file systems, e.g. browsing and visualisation, 2d or 3d GUIs query results presentation G06F16/156
• CPC Class Codes: G06F 16/1827 Management specifically adapted to NAS management of storage area networks [SAN] G06F3/067
• CPC Class Codes: G06F 16/2308 Concurrency control transaction processing G06F9/466
• CPC Class Codes: G06F 2201/80 Database-specific techniques
• CPC Class Codes: H04L 67/1097 for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]

Abstract

A system and method for communicating, browsing, verifying and routing data in storage operation systems using network attached storage devices is provided. In some embodiments, the system may include a management module and a media management component connected to the management server, which interoperate with network attached storage devices to provide the communicating, browsing, verifying and routing functions.

Claims

1. A method for managing data in a storage system, the method comprising:

receiving a request to store data on a Network-Attached Storage (NAS) Device, wherein the data comprises data files stored on a first storage device with a first file management system, and the Network-Attached Storage (NAS) Device comprises a second file management system that is different than the first file management system;

combining a plurality of the multiple data files in the source data into at least one chunk of data;

creating a first data structure that comprises a first header and the chunk of data;

receiving the first data structure at a file server comprising computer hardware, the file server remotely located from the Network-Attached Storage (NAS) Device;

creating a second data structure with the file server, wherein the file server adds at least a second header and a trailer to the first data structure, the second header comprising at least a set of file markers that identify the plurality of data files in the chunk of data, the trailer comprising at least metadata about the plurality of data files in the chunk of data; and

transferring the second data structure to the Network-Attached Storage (NAS) Device, wherein the second data structure is stored with the second file management system.

2. The method of claim 1 wherein transferring the second data structure to the Network-Attached Storage (NAS) Device is performed by the file server.

3. The method of claim 1 wherein the file server receives the first data structure via a first network protocol.

4. The method of claim 1 wherein the file server writes the second data structure to the Network-Attached Storage (NAS) Device via a second network protocol.

5. The method of claim 4 wherein the second network protocol is a Network Data Management Protocol.

6. The method of claim 1 wherein the trailer further comprises a second set of file markers that identify the plurality of data files in the chunk of data.

7. The method of claim 1 further comprising storing information about the plurality of files in the chunk of data.

8. The method of claim 1 further comprising browsing the plurality of files in the chunk of data by accessing information stored by the media agent.

9. The method of claim 1 wherein, in response to a request, the file server retrieves the second data structure from the Network-Attached Storage (NAS) Device.

10. The method of claim 9 wherein the media agent unpacks the plurality of files in a chunk of data retrieved from the Network-Attached Storage (NAS) Device.

11. A system for managing data in a storage system, the system comprising:

a storage device that stores multiple data files with a first file management system;

a media agent component comprising computer hardware that is in communication with the data source, the media agent receives a request to store source data on a Network-Attached Storage (NAS) Device;

wherein the media agent component combines a plurality of the multiple data files in the source data into at least one chunk of data;

wherein the media agent component creates a first data structure that comprises a first header and the chunk of data; and

a file server comprising computer hardware that is remotely located from a Network-Attached Storage (NAS) Device,

wherein the file server receives the first data structure, and creates a second data structure comprising at least a second header, the first data structure, and a trailer, the second header comprising at least a set of file markers that identify the plurality of data files in the chunk of data, the trailer comprising at least metadata about the plurality of data files in the chunk of data; and

wherein the file server transfers the second data structure to the Network-Attached Storage (NAS) Device, and the Network-Attached Storage (NAS) Device stores the second data structure with the second file management system.

12. The system of claim 11 wherein the file server receives the first data structure via a first network protocol.

13. The system of claim 11 wherein the file server writes the second data structure to the Network-Attached Storage (NAS) Device via a second network protocol.

14. The system of claim 13 wherein the second network protocol is a Network Data Management Protocol.

15. The system of claim 11 wherein the trailer further comprises a second set of file markers that identify the plurality of data files in the chunk of data.

16. The system of claim 11 wherein the media agent stores information about the plurality of files in the chunk of data.

17. The system of claim 11 wherein a user browses the plurality of files in the chunk of data by accessing information stored by the media agent.

18. The system of claim 11 wherein the file server retrieves the second data structure from the Network-Attached Storage (NAS) Device in response to a request.

19. The system of claim 18 wherein the media agent unpacks the plurality of files in a chunk of data retrieved from the Network-Attached Storage (NAS) Device.