System and method for performing distributed consistency verification of a clustered file system

• US 8,301,673 B2
• Filed: 12/28/2007
• Issued: 10/30/2012
• Est. Priority Date: 12/29/2006
• Status: Active Grant

• Current Assignee: NetApp, Inc.
• Original Assignee: NetApp, Inc.
• Inventors: Hyer, Robert Wyckoff Jr., Derr, Todd, Edwards, John K.
• Primary Examiner(s): Nguyen, Loan T
• Application Number:
  US11/966,591
• Publication Number:
  US 20080189343A1
• Time in Patent Office: 1,768 Days
• Field of Search: None
• US Class Current: 707/822
• CPC Class Codes: G06F 3/0614 Improving the reliability of storage systems
• CPC Class Codes: G06F 3/0643 Management of files
• CPC Class Codes: G06F 3/0653 Monitoring storage devices or systems
• CPC Class Codes: G06F 3/067 Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]

Abstract

A system and method for performing a distributed consistency check of a clustered file system. File system functions for loading an inode and/or buffer tree are modified so that in response to either of these functions being invoked, a consistency check is performed. The consistency check verifies both local consistency on a node of the clustered file and a distributed check across the nodes of the storage system.

Claims

1. A method for performing verification of a striped volume set, comprising:

executing an operating system by a computer servicing a plurality of data containers, the plurality of data containers organized as the striped volume set that includes a plurality of constituent volumes;

receiving a request at the operating system directed to a data container of the striped volume set;

in response to receiving the request directed to the data container, determining whether the data container has been checked locally;

in response to determining that the data container has not been checked locally, performing a local check of the data container;

performing a striped volume set check to ensure that the data container is consistent among all the plurality of the constituent volumes by verifying that locally stored metadata associated with the data container is consistent with metadata stored within a container attribute volume of the striped volume set, wherein the container attribute volume is designated to the data container; and

returning a message to the operating system in response to verifying the striped volume set.

2. The method of claim 1, wherein the data container comprises an inode.

3. The method of claim 1, wherein the data container comprises a buffer tree.

4. The method of claim 1, wherein performing a striped volume set check comprises:

verifying that the locally stored metadata associated with the data container is consistent with metadata stored within a metadata volume of the striped volume set.

5. The method of claim 1, wherein performing the local check comprises:

performing a file inode check of the data container.

6. The method of claim 1, wherein performing the local check comprises:

performing a check of a buffer tree associated with an inode of the data container.

7. The method of claim 1, further comprising:

modifying a function to load the data container to perform a check of the data container in response to the request directed to the data container.

8. A system configured to perform verification of a striped volume set, comprising:

a computer configured to execute an operating system, the computer further configured to service a plurality of data containers organized as the striped volume set that include a plurality of constituent volumes serviced by the computer;

the operating system configured to receive a request directed to a data container of the striped volume set;

the operating system further configured to determine, in response to receiving the request directed to the data container, whether the data container has been checked locally;

the operating system further configured to perform, in response to determining that the data container has not been checked locally, a local check of the data container;

the operating system further configured to perform a striped volume set check to ensure that the data container is consistent among all the plurality of the constituent volumes by verifying that locally stored metadata associated with the data container is consistent with metadata stored within a container attribute volume of the striped volume set, wherein the container attribute volume is designated to the data container; and

the operating system further configured to receive a message in response to verifying the striped volume set.

9. The system of claim 8, wherein the data container comprises an inode.

10. The system of claim 8, wherein the data container comprises a buffer tree.

11. The system of claim 8, wherein performing a striped volume set check comprises:

the operating system further configured to verify that the locally stored metadata associated with the data container is consistent with metadata stored within a metadata volume of the striped volume set.

12. The system of claim 8, wherein the local check of the data container comprises:

the operating system further configured to perform a file inode check of the data container.

13. The system of claim 8, wherein the local check of the data container comprises:

the operating system further configured to perform a check of a buffer tree associated with an inode of the data container.

14. The system of claim 8, wherein a set of verification processes of the operating system is configured to perform the verification of the striped volume set.

15. The system of claim 8, wherein the computer comprises a network element and a disk element.

16. The system of claim 8, further comprising:

the operating system further configured to organize the plurality of constituent volumes into a single addressable storage space.

17. A non-transitory computer-readable media containing executable program instructions executed by a processor, comprising:

program instructions that execute an operating system by a computer servicing a plurality of data containers, the plurality of data containers organized as a striped volume set that includes a plurality of constituent volumes;

program instructions that receive a request directed to a data container of the striped volume set;

program instructions that determine, in response to receiving the request directed to the data container, whether the data container has been checked locally;

program instructions that perform, in response to determining that the data container has not been checked locally, a local check of the data container;

program instructions that perform a striped volume set check to ensure that the data container is consistent among all the plurality of constituent volumes by verifying that locally stored metadata associated with the data container is consistent with metadata stored within a container attribute volume of the striped volume set, wherein the container attribute volume is designated to the data container; and

program instructions that return a message to the operating system in response to verifying the striped volume set.

18. A system configured to verify a striped volume set, comprising:

means for executing an operating system by a computer servicing a plurality of data containers, the plurality of data containers organized as the striped volume set on one or more storage devices operatively connected to the computer, wherein the striped volume set includes a plurality of constituent volumes;

means for receiving a request directed to a data container of the striped volume set;

means for determining, in response to receiving the request directed to the data container, whether the data container has been checked locally;

means for performing, in response to determining that the data container has not been checked locally, a local check of the data container;

means for performing a striped volume set check to ensure that the data container is consistent among all the plurality of the constituent volumes by verifying that locally stored metadata associated with the data container is consistent with metadata stored within a container attribute volume of the striped volume set, wherein the container attribute volume is designated to the data container; and

means for returning a message to the operating system in response to verifying the striped volume set.

19. The system as in claim 18, further comprising:

means for storing the data container as the striped volume set across one or more of the plurality of constituent volumes.

20. The system as in claim 18, further comprising:

means for using a buffer tree as the data container.

21. The system as in claim 18, further comprising:

means for verifying an inode of the data container.

22. The system as in claim 18, further comprising:

means for using an attached array of writable storage device media as the one or more storage devices.

23. The system as in claim 18, further comprising:

means for using an optical media as the one or more storage devices.

24. The system as in claim 18, further comprising:

means for using a DVD media as the one or more storage devices.

25. The system as in claim 18, further comprising:

means for using a magnetic tape as the one or more storage devices.

26. The system as in claim 18, further comprising:

means for using an electronic random access memory as the one or more storage devices.

27. The system as in claim 18, further comprising:

means for using a micro-electro mechanical media as the one or more storage devices.

28. The system as in claim 18, further comprising:

means for using a magnetic disk as the one or more storage devices.

29. The system as in claim 18, further comprising:

means for using a RAID array of magnetic disks as the one or more storage devices.

30. A data storage system, comprising:

a computer configured to execute an operating system, the computer configured to service a plurality of data containers organized as a striped volume set that includes a plurality of constituent volumes;

a process of the operating system configured to call a loading function of the operating system, the process further configured to issue a request directed to a data container of the striped volume set on one or more persistent storage devices operatively connected to the computer;

the operating system further configured to determine, in response to the request directed to the data container, whether the data container has been checked locally;

the operating system further configured to perform, in response to determining that the data container has not been checked locally, a local check of the data container;

the operating system further configured to perform a striped volume set check to ensure that the data container is consistent among all the plurality of the constituent volumes by verifying that locally stored metadata associated with the data container is consistent with metadata stored within a container attribute volume of the striped volume set, wherein the container attribute volume is designated to the data container, and wherein the striped volume set check is performed before the data container is returned to the process calling the loading function; and

the operating system further configured to return a message to the process in response to verifying the striped volume set.

31. The data storage system as in claim 30, where the striped volume set check further comprises:

the operating system further configured to verify that the locally stored metadata associated with the data container is consistent with metadata stored within a metadata volume of the striped volume set.

32. The data storage system as in claim 30, wherein the data container comprises a buffer tree.

33. The data storage system as in claim 30, wherein the data container comprises an inode.

34. The data storage system as in claim 30, wherein the one or more persistent storage devices comprises an attached array of writable storage device media.

35. The data storage system as in claim 30, wherein the one or more persistent storage devices comprises an optical media.

36. The data storage system as in claim 30, wherein the one or more persistent storage devices comprises a DVD media.

37. The data storage system as in claim 30, wherein the one or more persistent storage devices comprises a magnetic tape.

38. The data storage system as in claim 30, wherein the one or more persistent storage devices comprises an electronic random access memory.

39. The data storage system as in claim 30, wherein the one or more persistent storage devices comprises a micro-electro mechanical media.

40. The data storage system as in claim 30, wherein the one or more persistent storage devices comprises a magnetic disk.

41. The data storage system as in claim 30, wherein the one or more persistent storage devices comprises a RAID array of magnetic disks.

42. A storage system, comprising:

means for executing an operating system of a computer, the computer configured to service a plurality of data containers organized as a striped volume set that includes a plurality of constituent volumes;

means for calling a loading function of the operating system to load a data container of the striped volume set on one or more persistent storage devices operatively connected to the computer;

means for determining, in response to loading the data container, whether the data container has been checked locally;

means for performing, in response to determining that the data container has not been checked locally, a local check of the data container;

means for performing a striped volume set check to verify that the data container is consistent among all the plurality of constituent volumes by verifying that locally stored metadata associated with the data container is consistent with metadata stored within a container attribute volume of the striped volume set, wherein the container attribute volume is designated to the data container, and wherein the striped volume set check is performed before the data container is returned to the means for calling; and

means for sending a return message in response to verifying the striped volume set.