Providing a shadow directory and virtual files to store metadata

• US 8,849,880 B2
• Filed: 05/18/2011
• Issued: 09/30/2014
• Est. Priority Date: 05/18/2011
• Status: Expired due to Fees

• Current Assignee: Hewlett Packard Enterprise Development LP (Hewlett-Packard Enterprise Company)
• Original Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Inventors: Thelen, Greg
• Primary Examiner(s): SYED, FARHAN M
• Application Number:
  US13/110,424
• Publication Number:
  US 20120296944A1
• Time in Patent Office: 1,231 Days
• US Class Current: 707/831
• CPC Class Codes: G06F 16/00 Information retrieval; Database structures therefor; File system structures therefor
• CPC Class Codes: G06F 16/13 File access structures, e.g. distributed indices arrangements of input from, or output to, record carriers G06F3/06

Abstract

Metadata is stored in non-volatile storage. The metadata is associated with files in a directory. A shadow directory and virtual files that correspond to the files of the directory are formed. The virtual files contain the metadata.

Claims

1. A system comprising:

a non-volatile storage to store a particular directory having files that contain data, wherein the non-volatile storage is to further store metadata associated with the files;

at least one processor to form a shadow directory and virtual files that correspond to the files of the particular directory, wherein the virtual files contain a copy of the metadata; and

a volatile memory to store the shadow directory and the virtual files,

wherein the at least one processor is to form an inode data structure for storing on the volatile memory, wherein the inode data structure comprises;

an inode type field that indicates that the inode data structure represents one of a file and a directory, and

a sub-type field that indicates a type of an object represented by the inode data structure, wherein the sub-type field is settable to a first value to indicate that the object is a shadow directory, and to another value to indicate that the object is another type,

wherein the at least one processor is to;

determine, by accessing the sub-type field in the inode data structure, that a given object represented by the inode data structure is the shadow directory, based on detecting the sub-type field set to the first value, and

determine, by accessing the inode type field in the inode data structure, that the given object is a directory, based on detecting the inode type field set to a value indicating a directory.

2. The system of claim 1:

wherein the shadow directory corresponds to the particular directory, and wherein the virtual files contain a copy of the metadata without storing the data of the files of the particular directory.

3. The system of claim 2, wherein the metadata describes a file allocation of the data on the non-volatile memory.

4. The system of claim 1, wherein the inode data structure further comprises:

an inode number field that indicates an identity of the inode data structure and is useable to locate a record data structure.

5. The system of claim 4, wherein the record data structure comprises information describing locations of each piece of the object.

6. The system of claim 2, further comprising an application to access the shadow directory to retrieve the metadata.

7. The system of claim 6, wherein the application is associated with a different file system than a file system that contains the particular directory.

8. The system of claim 2, wherein the shadow directory is part of the particular directory.

9. A method comprising:

storing metadata in non-volatile storage, wherein the metadata describes a hierarchical arrangement of directories and files containing data;

creating, by a system including a processor, shadow directories corresponding to the directories of the hierarchical arrangement, wherein each of the shadow directories includes virtual files corresponding to respective files containing data, wherein each of the virtual files contains metadata corresponding to the respective file containing data;

forming, by the system, an inode data structure for storing on volatile memory, wherein the inode data structure comprises an inode type field settable to a first value to indicate that the inode data structure represents a directory, and to a second value to indicate that the inode data structure represents a file, and the inode data structure further comprising a sub-type field that indicates a type of an object represented by the inode data structure, wherein the sub-type field is settable to one value to indicate that the object is a shadow directory, and to another value to indicate that the object is another type;

determining, by accessing the sub-type field in the inode data structure, that a given object represented by the inode data structure is one of the shadow directories, based on detecting the sub-type field set to the one value; and

determining, by accessing the inode type field in the inode data structure, that the given object is a directory, based on detecting the inode type field set to the first value.

10. The method of claim 9, wherein each of the shadow directories is part of a respective directory of the hierarchical arrangement.

11. The method of claim 9, further comprising storing the shadow directories and the virtual files in volatile memory.

12. The method of claim 9, wherein the metadata describes a file allocation hierarchy, and wherein creating the shadow directories and virtual files are part of forming a virtual layout that corresponds to the file allocation hierarchy, wherein the shadow directories are not part of the file allocation hierarchy.

13. The method of claim 12, further comprising:

providing a plurality of inodes for the virtual layout with one inode being associated with each object of the layout, wherein the plurality of inodes are stored in the volatile memory;

locating a particular inode of the plurality of inodes, wherein the particular inode stores a portion of the metadata; and

reading the portion of the metadata associated of the particular inode.

14. The method of claim 13, wherein the locating comprises:

moving through a path name string by moving through inodes until a file type inode is located; and

returning the file type inode as the particular inode.

15. The method of claim 12, wherein the forming the virtual layout comprises:

publishing an entry in the virtual layout for a directory object of the file allocations hierarchy having a name that identifies the published entry as a file allocations directory.

17. The method of claim 9, wherein each of the virtual files contains the metadata corresponding to the respective file containing data, without storing the data of the respective file containing data.

19. The method of claim 9, wherein the Mode type field in the Mode data structure is distinct from the sub-type field in the Mode data structure.

16. An article comprising at least one non-transitory machine-readable storage medium storing instructions that upon execution cause a system to:

store metadata in non-volatile storage, wherein the metadata describes a hierarchical arrangement of directories and files containing data;

create shadow directories corresponding to the directories of the hierarchical arrangement, wherein each of the shadow directories includes virtual files corresponding to respective files containing data, wherein each of the virtual files contains metadata corresponding to the respective file containing data;

form an inode data structure for storing on volatile memory, wherein the inode data structure comprises;

an inode type field that indicates that the inode data structure represents one of a file and a directory, and

a sub-type field that indicates a type of an object represented by the inode data structure, wherein the sub-type field is settable to a first value to indicate that the object is a shadow directory, and to another value to indicate that the object is another type;

determine, by accessing the sub-type field in the inode data structure, that a given object represented by the inode data structure is one of the shadow directories, based on detecting the sub-type field set to the first value; and

determine, by accessing the inode type field in the inode data structure, that the given object is a directory, based on detecting the inode type field set to a value indicating a directory.

18. The article of claim 16, wherein each of the virtual files contains the metadata corresponding to the respective file containing data, without storing the data of the respective file containing data.