Detecting inconsistencies in hierarchical organization directories

• US 10,387,405 B2
• Filed: 04/24/2015
• Issued: 08/20/2019
• Est. Priority Date: 11/03/2014
• Status: Active Grant

• Current Assignee: Hewlett Packard Enterprise Development LP (Hewlett-Packard Enterprise Company)
• Original Assignee: Hewlett Packard Enterprise Development LP (Hewlett-Packard Enterprise Company)
• Inventors: Doval, Shruti, Kamalaksha, Venkataraman, Balakrishna, Rohit, Verma, Rajat
• Primary Examiner(s): Nguyen, Merilyn P
• Application Number:
  US15/522,609
• Publication Number:
  US 20180276268A1
• Time in Patent Office: 1,579 Days
• CPC Class Codes: G06F 11/0727 in a storage system, e.g. in a DASD or network based storage system drivers for digital recording or reproducing units G06F3/06; circuits for error detection or correction within digital recording or reproducing units G11B20/18; for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS], H04L67/1097
• CPC Class Codes: G06F 11/0751 Error or fault detection not based on redundancy power supply failures G06F1/30; network fault management H04L41/06
• CPC Class Codes: G06F 11/1458 Management of the backup or restore process
• CPC Class Codes: G06F 16/10 File systems; File servers
• CPC Class Codes: G06F 16/185 Hierarchical storage management [HSM] systems, e.g. file migration or policies thereof details of archiving G06F16/11
• CPC Class Codes: G06F 16/2365 Ensuring data consistency and integrity
• CPC Class Codes: G06F 16/9017 using directory or table look-up use of a directory or look-up table in file systems G06F16/13

Abstract

In one example, a system is described in which a storage device, communicatively coupled to a processor, includes an inconsistency detection and reconstruction tool. The inconsistency detection and reconstruction tool may create a database including metadata associated with hierarchical organization directories and policy and configuration data files in a file system. Further, the inconsistency detection and reconstruction tool may perform consistency check of one or more of the hierarchical organization directories, the policy and configuration data files and the metadata to detect inconsistencies. Furthermore, the inconsistency detection and reconstruction tool may reconstruct one or more of the hierarchical organization directories, the policy and configuration data files and the metadata based on the outcome of the consistency check.

Claims

1. A system, comprising:

a processor; and

a storage device communicatively coupled to the processor, wherein the storage device comprises an inconsistency detection and reconstruction tool to;

create a database including a first plurality of records including metadata associated with respective hierarchical organization directories located between a root directory and user directories in a file system, and including a second plurality of records including metadata associated with respective policy and configuration data files in the file system;

in response to successful validation of the integrity of the metadata in the database, perform a consistency check using the metadata in the database to determine whether a respective hierarchical organization directory is present in the file system outside of an orphaned objects directory for each of the first plurality of records and to determine whether a respective policy and configuration data file is present in the file system outside of the orphaned objects directory for each of the second plurality of records;

in response to a determination that no hierarchical organization directory corresponding to one of the records of the first plurality of records is present in the file system outside of the orphaned object directory, create or restore a corresponding hierarchical organization directory, for the one of the records, in the file system outside of the orphaned object directory; and

in response to a determination that no policy and configuration data file is present for a given record of the second plurality of records, create or restore a corresponding policy and configuration data file for the given record of the second plurality of records using the metadata.

2. The system of claim 1, wherein the inconsistency detection and reconstruction tool is to validate the integrity of the metadata in the database and perform the consistency check of the hierarchical organization directories using the metadata in the database when the validation is successful.

3. The system of claim 2, wherein the inconsistency detection and reconstruction tool is to reconstruct the metadata in the database using the hierarchical organization directories and the policy and configuration data files when the validation is not successful.

4. The system of claim 3, wherein the inconsistency detection and reconstruction tool is to reconstruct the metadata in the database by creating a record for each of the hierarchical organization directories and the policy and configuration data files in the file system, wherein each record includes metadata associated with the hierarchical organization directories and the policy and configuration data files, wherein the metadata includes attributes selected from the group consisting of a name, a unique identifier (ID) and an inode ID associated with the hierarchical organization directories and the policy and configuration files.

5. The system of claim 1, wherein

the metadata of the records includes attributes selected from the group consisting of a name, a unique ID and an inode ID associated with the hierarchical organization directory or the policy and configuration file.

6. The system of claim 1, wherein the inconsistency detection and reconstruction tool is to perform the consistency check in response to receiving a request from an operating system during one of a system crash, a periodic consistency check of file system and a user initiated consistency check.

7. The system of claim 1, wherein the metadata associated with the hierarchical organization directories and the policy and configuration data files are stored in extended attributes and/or inodes of the hierarchical organization directories and the policy and configuration data files, respectively, wherein the metadata comprises attributes selected from the group consisting of a name, a unique ID and an inode ID associated with the hierarchical organization directories and the policy and configuration files and a unique ID of the hierarchical organization directories associated with the policy and configuration data files.

8. A method, comprising:

creating a database including a first plurality of records including metadata associated with respective hierarchical organization directories located between a root directory and user directories in a file system and including a second plurality of records including metadata associated with respective policy and configuration data files in the file system;

validating integrity of the metadata in the database;

in response to the validating being successful, performing a consistency check using the metadata in the database to determine, for each of the first plurality of records, whether a respective hierarchical organization directory is present in the file system outside of an orphaned objects directory;

in response to a determination that no hierarchical organization directory corresponding to one of the records of the first plurality of records is present in the file system outside of the orphaned object directory, creating or restoring a hierarchical organization directory for the one of the records in the file system outside of the orphaned object directory, and

in response to a determination that no policy and configuration data file corresponding to a given one of the records of the second plurality of records is present in the file system outside of the orphaned object directory, creating or restoring a policy and configuration data file for the given one of the records in the file system, outside of the orphaned object directory, using the metadata in the database.

9. The method of claim 8, further comprising:

reconstructing the metadata in the database using the hierarchical organization directories and policy and configuration data files when the validating is not successful.

10. The method of claim 9, wherein the reconstructing the metadata includes creating a record for each of the hierarchical organization directories and the policy and configuration data files in the file system, the record including an attribute of a name, a unique identifier (ID) or an inode ID associated with the hierarchical organization directories and the policy and configuration files.

11. The method of claim 8, further comprising performing the consistency check in response to a request from an operating system during one of a system crash, a periodic consistency check of file system and a user initiated consistency check.

12. A non-transitory machine-readable storage medium comprising instructions executable by a processor to:

create a database including a first plurality of records including metadata associated with respective hierarchical organization directories located between a root directory and user directories in a file system, and including a second plurality of records including metadata associated with respective policy and configuration data files in the file system;

in response to successful validation of the integrity of the metadata in the database, perform, using the metadata in the database, a consistency check to determine whether a respective hierarchical organization directory is present in the file system outside of an orphaned objects directory for each of the first plurality of records and to determine whether a respective policy and configuration data file is present in the file system outside of the orphaned objects directory for each of the second plurality of records; and

create or restore, in the file system outside of the orphaned object directory, at least one hierarchical organization directory or at least one policy and configuration data file based on at least one of the records of the database and the outcome of the consistency check.

13. The non-transitory machine-readable storage medium of claim 12, comprising instructions executable by the processor to validate the integrity of the metadata in the database.

14. The non-transitory machine-readable storage medium of claim 12, comprising instructions executable by the processor to reconstruct the metadata in the database using the hierarchical organization directories and the policy and configuration data files in response to unsuccessful validation of the integrity of the metadata in the database.

15. The non-transitory machine-readable storage medium of claim 14, wherein the instructions executable by the processor to reconstruct the metadata in the database includes instructions to create a record for each of the hierarchical organization directories and the policy and configuration data files in the file system, the record including an attribute of a name, a unique identifier (ID) or an inode ID associated with the hierarchical organization directories and the policy and configuration files.

16. The non-transitory machine-readable storage medium of claim 12, comprising instructions executable by the processor to perform the consistency check in response to a request from an operating system during one of a system crash, a periodic consistency check of file system and a user initiated consistency check.

17. The non-transitory machine-readable storage medium of claim 12, wherein the metadata associated with the hierarchical organization directories and the policy and configuration data files are stored in extended attributes or inodes of the hierarchical organization directories and the policy and configuration data files, respectively, wherein the metadata comprises attributes selected from the group consisting of a name, a unique ID and an inode ID associated with the hierarchical organization directories and the policy and configuration files and a unique ID of the hierarchical organization directories associated with the policy and configuration data files.