Data backup/recovery

• US 7,650,341 B1
• Filed: 12/22/2006
• Issued: 01/19/2010
• Est. Priority Date: 12/23/2005
• Status: Expired due to Fees

• Current Assignee: Hewlett Packard Enterprise Development LP (Hewlett-Packard Enterprise Company)
• Original Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Inventors: Oratovsky, Vitaly M., Levin, Benjamin, Zuckerman, Boris, Srinivasan, Sudhir, John, Shaji O., Orszag, Steven A., Shea, Kevin J.
• Primary Examiner(s): Rones; Charles
• Assistant Examiner(s): ORTIZ DITREN, BELIX M
• Application Number:
  US11/615,534
• Time in Patent Office: 1,124 Days
• Field of Search: None
• US Class Current: 1/1
• CPC Class Codes: G06F 11/1435 using file system or storage system metadata
• CPC Class Codes: G06F 11/1451 by selection of backup contents
• CPC Class Codes: G06F 11/1456 Hardware arrangements for backup
• CPC Class Codes: G06F 11/1464 for networked environments
• CPC Class Codes: G06F 11/1469 Backup restoration techniques
• CPC Class Codes: G06F 2201/82 Solving problems relating to consistency

Abstract

An apparatus in a first device of an association of devices includes a processor configured to: communicate with a storage device storing segments of a distributed, segmented single first file system including file system entities residing in segments and including at least portions of one of files and directories, the association of devices including file servers that control metadata of separate segments of the single first file system, including metadata of file system entities residing in the segments; communicate with a backup module configured to backup file system data of a second file system different from a distributed, segmented file system; analyze data in the single first file system to determine data associated with different segments of the single first file system; and present data from the single first file system to the backup module in accordance with what data belong to which segment of the single first file system.

Claims

1. A distributed, segmented single file system comprising:

a first server that controls metadata of a first segment of the distributed, segmented single file system, the first segment including file system entities comprising at least portions of at least one of files or directories; and

a second server, communicatively coupled to the first server, that controls metadata of a second segment of the distributed, segmented single file system, the second segment including file system entities comprising at least portions of at least one of files or directories, the second server being distinct from the first server and the second segment being distinct from the first segment;

the first segment including a first file and the second segment including a first directory pointing to the first file, the first segment including a file identifier of the first file and a second consistency-check identifier associated with the file identifier;

the second segment further including a D_entry including a first consistency-check identifier associated with the file identifier of the first file; and

restore and recover modules communicatively coupled to the first and second servers and configured to restore and recover the first directory and to analyze the first consistency-check identifier and the second consistency-check identifier to determine consistency of the restored first directory and the first file.

2. The file system of claim 1 wherein the first consistency-check identifier comprises a generation number.

3. The file system of claim 1 wherein the second server is configured to use the first consistency-check identifier to verify content of the first file while the single file system is active.

4. The file system of claim 3 wherein the restore and recover modules are configured to initiate restoration or recovery, respectively, if a discrepancy is detected between the first consistency-check identifier and the second consistency-check identifier stored in association with the first file.

5. The file system of claim 4 wherein the recover module is configured to replace a file system entity using a backup and the restore module is configured to replace a file system entity with a clone or replace an outdated clone of a file system entity with a current version of the file system entity.

6. A distributed, segmented single file system comprising:

a first server that controls metadata of a first segment of the distributed, segmented single file system, the first segment including file system entities comprising at least portions of at least one of files or directories; and

a second server, communicatively coupled to the first server, that controls metadata of a second segment of the distributed, segmented single file system, the second segment including file system entities comprising at least portions of at least one of files or directories, the second server being distinct from the first server and the second segment being distinct from the first segment;

the first server controlling metadata of a first filtered namespace comprising a first portion of a complete namespace of the single file system;

the second server controlling metadata of a second filtered namespace comprising a second portion of the complete namespace of the single file system, the second filtered namespace being distinct from the first filtered namespace;

the file system including a module configured to traverse the first filtered namespace and the second filtered namespace in parallel; and

the first and second segments being confined to independent hardware units;

wherein the first filtered namespace is a subset of a complete namespace of the single file system and the file system entities of the first filtered namespace share a common characteristic other than physical locality.

7. The file system of claim 6 further comprising backup, recover, and restore modules configured to backup, recover, and restore file system entities of the single file system from the first and second filtered namespaces in parallel.

8. The file system of claim 6 wherein the first server is configured to use the first filtered namespace to perform at least one of a virus scan, a compression operation, or a de-duplication.

9. A distributed, segmented single file system comprising:

a first server that controls metadata of a first segment of the distributed, segmented single file system, the first segment including file system entities comprising at least portions of at least one of files or directories; and

a second server, communicatively coupled to the first server, that controls metadata of a second segment of the distributed, segmented single file system, the second segment including file system entities comprising at least portions of at least one of files or directories, the second server being distinct from the first server and the second segment being distinct from the first segment;

the first server controlling metadata of a first filtered namespace comprising a first portion of a complete namespace of the single file system;

the second server controlling metadata of a second filtered namespace comprising a second portion of the complete namespace of the single file system, the second filtered namespace being distinct from the first filtered namespace;

the first and second servers associating a respective consistency-check identifier with each file system entity;

the first segment including a shadow tree indicative of non-local file system entities residing on at least one segment other than the first segment, each of the non-local file system entities either being pointed to by, or pointing to, a respective file system entity of the first segment;

the file system further comprising restore and recover modules configured to restore and recover portions of the complete namespace, including a file system entity pointing to one of the non-local file system entities, using the shadow tree and the consistency-check identifiers and to analyze the consistency-check identifiers to determine consistency of restored file system entities.

10. The file system of claim 9 wherein the restore module is configured to compare consistency-check identifiers of the shadow tree with consistency-check identifiers stored in associated with the non-local file system entities indicated by the shadow tree.

11. A computer program product residing on a computer-readable medium and comprising computer-readable instructions configured to cause a computer to:

control metadata of a first segment of a distributed, segmented single file system, the first segment including file system entities comprising at least portions of at least one of files or directories;

control metadata of a second segment of the distributed, segmented single file system, the second segment including file system entities comprising at least portions of at least one of files or directories, the second server being distinct from the first server and the second segment being distinct from the first segment;

store a first file in the first segment and a first directory in the second segment, the first directory pointing to the first file;

store a D_entry in the second segment, the D_entry including a first consistency-check identifier associated with the file identifier of the first file;

store the file identifier in the first segment;

store a second consistency-check identifier in the first segment, the second consistency-check identifier being associated with the file identifier;

recover the first directory and to analyze the first consistency-check identifier and the second consistency-check identifier to determine consistency of the recovered first directory and the first file; and

restore the first directory and to analyze the first consistency-check identifier and the second consistency-check identifier to determine consistency of the restored first directory and the first file.

12. The computer program product of claim 11 wherein the first consistency-check identifier comprises a generation number.

13. The computer program product of claim 11 further comprising, instructions configured to cause the computer to use the first consistency-check identifier to verify content of the first file while the single file system is active.

14. The computer program product of claim 13 further comprising instructions configured to cause the computer to initiate recovery or restoration if a discrepancy is detected between the first consistency-check identifier and a second consistency-check identifier stored in association with the first file.

15. The computer program product of claim 14 wherein the instructions configured to cause the computer to initiate recovery include instructions configured to cause the computer to replace a file system entity using a backup and the instructions configured to cause the computer to initiate restoration are configured to at least one of replace a file system entity from a clone or replace an outdated clone of a file system entity with a current version of the file system entity.

16. A computer program product residing on a computer-readable medium and comprising computer-readable instructions configured to cause a computer to:

control metadata of a first segment of a distributed, segmented single file system, the first segment including file system entities comprising at least portions of at least one of files or directories;

control metadata of a second segment of the distributed, segmented single file system, the second segment including file system entities comprising at least portions of at least one of files or directories, the second server being distinct from the first server and the second segment being distinct from the first segment, the first and second segments being confined to independent hardware units;

control metadata of a first filtered namespace residing on the first segment and comprising a first portion of a complete namespace of the single file system;

control metadata of a second filtered namespace residing on the second segment and comprising a second portion of the complete namespace of the single file system, the second filtered namespace being distinct from the first filtered namespace; and

traverse the first filtered namespace and the second filtered namespace in parallel;

wherein the first filtered namespace is a subset of a complete namespace of the single file system with the file system entities of the first filtered namespace sharing a common characteristic other than physical locality.

17. The computer program product of claim 16 further comprising instructions configured to cause the computer to backup and restore file system entities of the single file system from the first and second filtered namespaces in parallel.

18. The computer program product of claim 16 wherein the instructions configured to cause the computer to control metadata of the filtered namespaces are configured to cause the computer to control the metadata of the filtered namespaces such that the filtered namespaces are continually present and up to date.

19. The computer program product of claim 18 further comprising instructions configured to cause the computer to use the first filtered namespace to perform at least one of a virus scan, a compression operation, or a de-duplication.

20. A computer program product residing on a computer-readable medium and comprising computer-readable instructions configured to cause a computer to:

control metadata of a first segment of a distributed, segmented single file system, the first segment including file system entities comprising at least portions of at least one of files or directories;

control metadata of a second segment of the distributed, segmented single file system, the second segment including file system entities comprising at least portions of at least one of files or directories, the second server being distinct from the first server and the second segment being distinct from the first segment;

control metadata of a first filtered namespace residing on the first segment and comprising a first portion of a complete namespace of the single file system;

control metadata of a second filtered namespace residing on the second segment and comprising a second portion of the complete namespace of the single file system, the second filtered namespace being distinct from the first filtered namespace;

associate a respective consistency-check identifier with each file system entity;

produce a shadow tree indicative of non-local file system entities residing on at least one segment other than the first segment, each of the non-local file system entities either being pointed to by, or pointing to, a respective file system entity of the first segment;

restore and recover portions of the complete namespace, including a file system entity pointing to one of the non-local file system entities using the shadow tree and the consistency-check identifiers; and

analyze the consistency-check identifiers to determine consistency of restored file system entities.

21. The computer program product of claim 20 wherein the instructions configured to cause the computer to restore and recover are configured to cause the computer to compare consistency-check identifiers of the shadow tree with consistency-check identifiers stored in associated with the non-local file system entities indicated by the shadow tree.