Method and apparatus for managing file systems and file-based data

• US 8,032,501 B2
• Filed: 10/10/2007
• Issued: 10/04/2011
• Est. Priority Date: 07/30/2002
• Status: Expired due to Fees

• Current Assignee: International Business Machines Corporation
• Original Assignee: Storediq Incorporated (International Business Machines Corporation)
• Inventors: Jimenez, A. Paul, Funderburg, Brett A., Bone, Jeff G., Arbilla, Laura
• Primary Examiner(s): Dwivedi; Mahesh
• Application Number:
  US11/973,846
• Publication Number:
  US 20080046404A1
• Time in Patent Office: 1,455 Days
• Field of Search: 707/694, 707/737, 707/754
• US Class Current: 707/694
• CPC Class Codes: G06F 16/10 File systems; File servers
• CPC Class Codes: Y10S 707/99932 Access augmentation or optimizing
• CPC Class Codes: Y10S 707/99953 Recoverability

Abstract

Embodiments of the present invention can comprise systems and methods for managing filesystems and can provide a programmable filesystem with active rules and policies, an n-tier network filesystem, stack mounting, a union filesystem with write-through semantics, a filesystem middleware with selective delegation, a filesystem with a statistical warehouse and/or other management functionality.

Claims

1. An non-transitory computer readable medium comprising a set of computer instructions executable by a computer processor for:

receiving a filesystem request identifying a requested operation on a filesystem object, where the filesystem request was generated by a filesystem client and is intended for a filesystem server;

determining one or more of a set of rules to be applied based on the filesystem request by matching each of the set of rules to the filesystem request, wherein each rule comprises a pattern and an associated action and matching a rule to the filesystem request comprises;

obtaining metadata associated with the filesystem object identified by the filesystem request, wherein the metadata is specified in the pattern of the rule and the pattern is an expression for the evaluation of the metadata, and

evaluating the metadata using the pattern;

applying each of the one or more rules, wherein applying a rule comprises applying the action associated with the rule and applying the action comprises;

determining if the action should be applied in-band or out-of-band; and

applying the action, wherein if the action is to be applied is an in-band action the action is performed either before providing the filesystem request to the filesystem server or before returning a filesystem response to the filesystem client and if the action is to be applied is an out-of-band action the action is performed after returning the filesystem response to the filesystem client.

2. The computer readable medium of claim 1, wherein the metadata is collected in one or more harvests.

3. The computer readable medium of claim 2, wherein the metadata has been gathered synchronously.

4. The computer readable medium of claim 2, wherein the metadata has been gathered asynchronously.

5. The computer readable medium of claim 2, wherein each harvest has a corresponding harvest ID.

6. The computer readable medium of claim 5, wherein the instructions are further executable for grouping one or more pieces of metadata by harvest ID.

7. The computer readable medium of claim 6, wherein the instructions are further executable for applying a heuristic to a group of metadata to generate a statistic of interest.

8. A method of managing a statistical warehouse comprising:

receiving a filesystem request identifying a requested operation on a filesystem object, where the filesystem request was generated by a filesystem client and is intended for a filesystem server;

determining one or more of a set of rules to be applied based on the filesystem request by matching each of the set of rules to the filesystem request, wherein each rule comprises a pattern and an associated action and matching a rule to the filesystem request comprises;

obtaining metadata associated with the filesystem object identified by the filesystem request, wherein the metadata is specified in the pattern of the rule and the pattern is an expression for the evaluation of the metadata, and

evaluating the metadata using the pattern;

applying each of the one or more rules, wherein applying a rule comprises applying the action associated with the rule and applying the action comprises;

determining if the action should be applied in-band or out-of-band; and

applying the action, wherein if the action is to be applied is an in-band action the action is performed either before providing the filesystem request to the filesystem server or before returning a filesystem response to the filesystem client and if the action is to be applied is an out-of-band action the action is performed after returning the filesystem response to the filesystem client.

9. The method of claim 8, wherein the metadata is collected in one or more harvests.

10. The method of claim 9, wherein the metadata has been gathered synchronously.

11. The method of claim 9, wherein the metadata has been gathered asynchronously.

12. The method of claim 9, wherein each harvest has a corresponding harvest ID.

13. The method of claim 12, further comprising grouping one or more pieces of metadata by harvest ID.

14. The method of claim 13, applying a heuristic to a group of metadata to generate a statistic of interest.

15. A system, comprising an intermediate filesystem server, the intermediate filesystem server comprising a processor and a non-transitory computer readable medium comprising instructions for:

receiving a filesystem request identifying a requested operation on a filesystem object, where the filesystem request was generated by a filesystem client and is intended for a filesystem server;

determining one or more of a set of rules to be applied based on the filesystem request by matching each of the set of rules to the filesystem request, wherein each rule comprises a pattern and an associated action and matching a rule to the filesystem request comprises;

obtaining metadata associated with the filesystem object identified by the filesystem request, wherein the metadata is specified in the pattern of the rule and the pattern is an expression for the evaluation of the metadata, and

evaluating the metadata using the pattern;

applying each of the one or more rules, wherein applying a rule comprises applying the action associated with the rule and applying the action comprises;

determining if the action should be applied in-band or out-of-band; and

applying the action, wherein if the action is to be applied is an in-band action the action is performed either before providing the filesystem request to the filesystem server or before returning a filesystem response to the filesystem client and if the action is to be applied is an out-of-band action the action is performed after returning the filesystem response to the filesystem client.

16. The system of claim 15, wherein the metadata is collected in one or more harvests.

17. The system of claim 16, wherein the metadata has been gathered synchronously.

18. The system of claim 16, wherein the metadata has been gathered asynchronously.

19. The system of claim 16, wherein each harvest has a corresponding harvest ID.

20. The system of claim 19, further comprising grouping one or more pieces of metadata by harvest ID.

21. The system of claim 20, applying a heuristic to a group of metadata to generate a statistic of interest.