System and method for generating extensible file system metadata

• US 8,484,257 B2
• Filed: 06/07/2004
• Issued: 07/09/2013
• Est. Priority Date: 11/26/2003
• Status: Active Grant

• Current Assignee: Veritas Technologies, LLC (Whitehouse Group Ltd.)
• Original Assignee: Symantec Operating Corporation (Gen Digital Inc.)
• Inventors: Borthakur, Dhrubajyoti, Premo, Nur
• Primary Examiner(s): Mofiz, Apu
• Assistant Examiner(s): BIBBEE, JARED M
• Application Number:
  US10/862,505
• Publication Number:
  US 20050114381A1
• Time in Patent Office: 3,319 Days
• Field of Search: 707/102, 707/1, 707/201, 707/705, 707/822
• US Class Current: 707/822
• CPC Class Codes: G06F 16/10 File systems; File servers
• CPC Class Codes: Y10S 707/99933 Query processing, i.e. searching
• CPC Class Codes: Y10S 707/99942 Manipulating data structure, e.g. compression, compaction, compilation

Abstract

A system and method for generating extensible file system metadata. In one embodiment, the system may include a storage device configured to store data and a file system configured to manage access to the storage device and to store file system content. The file system may be further configured to detect a file system content access event, and in response to detecting the file system content access event, to generate a metadata record, where the metadata record is stored in an extensible, self-describing data format.

Claims

1. A system, comprising:

a storage device configured to store file system content including a plurality of files; and

a host device configured to implement a file system, wherein said file system is configured to manage application accesses to said storage device and to store said file system content to said storage device, wherein said file system is further configured to;

detect a file system content access event generated by a first application distinct from said file system; and

in response to detecting said file system content access event;

generate a metadata record indicative of said file system content access event, wherein said metadata record includes information identifying said first application; and

store said metadata record within said file system content on said storage device;

wherein said file system is further configured to generate said metadata record according to an extensible, self-describing data format in which individual data elements included within said metadata record are delimited by one or more corresponding tag fields, wherein for a given individual data element included within said metadata record, said one or more corresponding tag fields indicate a type of information of said given individual data element.

2. The system as recited in claim 1, wherein said file system is further configured to detect said file system content access event in-band, such that detection of said file system content access event occurs synchronously with respect to occurrence of said file system content access event.

3. The system as recited in claim 1, wherein said extensible, self-describing data format is compliant with a version of the Extensible Markup Language (XML) format.

4. The system as recited in claim 1, wherein said metadata record is stored in a named stream corresponding to a given one of said plurality of files.

5. The system as recited in claim 1, wherein said metadata record is stored in an event log corresponding to said file system.

6. The system as recited in claim 1, further comprising a content processor and a second application distinct from said content processor and said file system, wherein said content processor is configured to invoke said second application in response to detecting said file system content access event out-of-band.

7. The system as recited in claim 1, further comprising a query engine through which said first application is configured to query said file system content.

22. The system as recited in claim 1, wherein while generating said metadata record, said file system is further configured to extend said extensible, self-describing data format such that at least one of said tag fields corresponding to said given individual data element was not previously defined within said extensible, self-describing data format.

8. A method, comprising:

a file system storing file system content on a storage device, wherein said file system content includes a plurality of files, and wherein said file system is configured to manage application accesses to said storage device;

said file system detecting a file system content access event generated by a first application distinct from said file system;

in response to detecting said file system content access event, said file system generating a metadata record indicative of said file system content access event, wherein said metadata record includes information identifying said first application, and wherein said metadata record is generated according to an extensible, self-describing data format in which individual data elements included within said metadata record are delimited by one or more corresponding tag fields, wherein for a given individual data element included within said metadata record, said one or more corresponding tag fields indicate a type of information of said given individual data element; and

said file system storing said metadata record within said file system content on said storage device.

9. The method as recited in claim 8, wherein said file system detecting said file system content access event is performed in-band, such that detection of said file system content access event occurs synchronously with respect to said file system content access event occurring.

10. The method as recited in claim 8, wherein said extensible, self-describing data format is compliant with a version of the Extensible Markup Language (XML) format.

11. The method as recited in claim 8, wherein said metadata record is stored in a named stream corresponding to a given one of said plurality of files.

12. The method as recited in claim 8, wherein said metadata record is stored in an event log.

13. The method as recited in claim 8, further comprising a content processor invoking a second application in response to detecting said file system content access event out-of-band, wherein said second application is distinct from said content processor and said file system.

14. The method as recited in claim 8, further comprising said first application querying said file system content through a query engine.

23. The method as recited in claim 8, wherein said file system generating said metadata record comprises said file system extending said extensible, self-describing data format such that at least one of said tag fields corresponding to said given individual data element was not previously defined within said extensible, self-describing data format.

15. A tangible, computer-accessible storage medium comprising program instructions, wherein the program instructions are executable to implement:

a file system storing file system content on a storage device, wherein said file system content includes a plurality of files, and wherein said file system is configured to manage application accesses to said storage device;

said file system detecting a file system content access event generated by a first application distinct from said file system;

in response to detecting said file system content access event, said file system generating a metadata record indicative of said file system content access event, wherein said metadata record includes information identifying said first application, and wherein said metadata record is generated according to an extensible, self-describing data format in which individual data elements included within said metadata record are delimited by one or more corresponding tag fields, wherein for a given individual data element included within said metadata record, said one or more corresponding tag fields indicate a type of information of said given individual data element; and

said file system storing said metadata record within said file system content on said storage device.

16. The computer-accessible storage medium as recited in claim 15, wherein said file system detecting said file system content access event is performed in-band, such that detection of said file system content access event occurs synchronously with respect to said file system content access event occurring.

17. The computer-accessible storage medium as recited in claim 15, wherein said extensible, self-describing data format is compliant with a version of the Extensible Markup Language (XML) format.

18. The computer-accessible storage medium as recited in claim 15, wherein said metadata record is stored in a named stream corresponding to a given one of said plurality of files.

19. The computer-accessible storage medium as recited in claim 15, wherein said metadata record is stored in an event log.

20. The computer-accessible storage medium as recited in claim 15, wherein the program instructions are further executable to implement a content processor invoking a second application in response to detecting said file system content access event out-of-band, wherein said second application is distinct from said content processor and said file system.

21. The computer-accessible storage medium as recited in claim 15, wherein the program instructions are further executable to implement a query engine through which said first application is configured to query said file system content.

24. The computer-accessible storage medium as recited in claim 15, wherein to implement said file system generating said metadata record, the program instructions are further executable to implement said file system extending said extensible, self-describing data format such that at least one of said tag fields corresponding to said given individual data element was not previously defined within said extensible, self-describing data format.