SYSTEM AND METHOD FOR ARCHIVE IN A DISTRIBUTED FILE SYSTEM

• US 20130325814A1
• Filed: 05/30/2012
• Published: 12/05/2013
• Est. Priority Date: 05/30/2012
• Status: Abandoned Application

• Current Assignee: Spectra Logic Corporation
• Original Assignee: Spectra Logic Corporation
• Inventors: Carter, Joshua Daniel
• Application Number:
  US13/483,256
• Publication Number:
  US 20130325814A1
• Time in Patent Office: Days
• US Class Current: 707/661
• CPC Class Codes: G06F 16/113 Details of archiving lifecycle management in storage systems G06F3/0649; backup systems G06F11/1446
• CPC Class Codes: G06F 16/27 Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor

Abstract

Provided is a system and method for archive in a distributed file system. The system includes at least one Name Node structured and arranged to map distributed data allocated to at least one Active Data Node, the Name Node further structured and arranged to direct manipulation of the distributed data by the Active Data Node. The system further includes at least one Archive Data Node coupled to at least one data read/write device and a plurality of portable data storage elements compatible with the data read/write device, the Archive Data Node structured and arranged to receive distributed data from at least one Active Data Node, archive the received distributed data to at least one portable data storage element and respond to the Name Node directions to manipulate the archived data. An associated method of use is also provided.

Claims

1. An archive system for a distributed file system, comprising:

at least one Name Node structured and arranged to map distributed data allocated to at least one Active Data Node, the Name Node further structured and arranged to direct manipulation of the data by the Active Data Node;

at least one Archive Data Node coupled to a data read/write device and a plurality of non-powered portable data storage elements compatible with the data read/write device, the Archive Data Node structured and arranged to receive data from at least one Active Data Node, archive the received data to at least one non-powered portable data storage element and respond to the Name Node directions to manipulate the archived data, the archived received data maintained in a non-powered state.

2. The system of claim 1, wherein the received data archived to the portable data storage elements is not maintained in active memory by the Archive Data Node following the creation of the archive copy.

3. The system of claim 1, wherein the archive of the received data upon the non-powered data storage element is duplicated upon a second non-powered data storage element, the second non-powered data storage element structured and arranged for off-site storage distinctly separate from the Archive Data Node.

4. The system of claim 1, wherein the archive data is passively maintained by the portable data storage elements.

5. The system of claim 1, wherein upon the Active Data Nodes the distributed data is subdivided as data blocks, the archived data aggregated as files.

6. The system of claim 1, wherein to a user or requesting application, the at least one Archive Data Node is transparent in nature from the at least one active data node.

7. The system of claim 1, wherein the non-powered portable data storage elements are physically separated and stored apart from the read/write device.

8. An archive system for a distributed file system, comprising:

a distributed file system having at least one Name Node and a plurality of Active Data Nodes, a first data element disposed in the distributed file system as a plurality of data blocks distributed among a plurality of Active Data Nodes and mapped by the Name Node; and

at least one Archive Data Node having a data read/write device and a plurality of portable data storage elements compatible with the data read/write device, the Archive Data Node structured and arranged to receive the first data element data blocks from the Active Data Nodes and archive the received data blocks upon at least one non-powered portable data storage element as at least one file, the archived file maintained in a non-powered state.

9. The system of claim 8, wherein the received data archived to the portable data storage elements is not maintained in active memory by the Archive Data node following the creation of the archive copy.

10. The system of claim 8, wherein the archive of the received data upon the non-powered data storage element is duplicated upon a second non-powered data storage element, the second non-powered data storage element structured and arranged for off-site storage distinctly separate from the Archive Data Node.

11. The system of claim 8, wherein the Name Node is further structured and arranged to direct manipulation of the distributed data by the Active Data Nodes and the Archive Data Node, the Archive Data Node further structured and arranged to direct the coupling of a selected non-powered portable data storage element to the read/write device to retrieve a selected archived file and respond to the Name Node directions to manipulate the archived file.

12. The system of claim 8, wherein to a user or requesting application, the at least one Archive Data Node is transparent in nature from the at least one active data node.

13. The system of claim 8, wherein the non-powered portable data storage elements are physically separated and stored apart from the read/write device.

14. A method for archiving data in a Hadoop style distributed file system comprising:

providing at least one Archive Data Node having a data read/write device and a plurality of non-powered portable data storage elements compatible with the data read/write device;

permitting a user of the Hadoop style distributed file system to identify a given file for archiving, the given file subdivided as a set of data blocks distributed to a plurality of Active Data Nodes maintaining the data blocks in a powered state;

moving the set of data blocks of the given file from the powered state of the Active Data Nodes to the Archive Data Node;

archiving the set of data blocks of the given file to at least one non-powered portable data storage element with the read/write device, the archive maintained in a non-powered state; and

updating a map record of at least one Name Node to identify the Archive Data Node as the repository of the set of data blocks of the given file.

15. The method of claim 14, wherein the non-powered archived of the given file is maintained at a greater cost savings then the powered state of the set of data blocks of the given file maintained by the Active Name Nodes.

16. The method of claim 14, wherein the archive of the received data upon the non-powered data storage element is duplicated upon a second non-powered data storage element, the second non-powered data storage element structured and arranged for off-site storage distinctly separate from the Archive Data Node.

17. The method of claim 14, wherein in a first instance the user is a human user and in a second instance the user is an application.

18. The method of claim 14, wherein the archived file is directly accessible as a data file.

19. The method of claim 14, wherein the non-powered portable data storage elements are physically separated and stored apart from the read/write device.

20. The method of claim 14, further including providing an Archive Name Node disposed between the Name Node and the Archive Data Node, the Archive Name Node structured and arranged to map the archived data blocks of the given file.