Performing operations without requiring split mirrors in a multi-class file system

• US 7,293,133 B1
• Filed: 12/31/2003
• Issued: 11/06/2007
• Est. Priority Date: 12/31/2003
• Status: Active Grant

• Current Assignee: Veritas Technologies, LLC (Whitehouse Group Ltd.)
• Original Assignee: Veritas Operating Corporation (Gen Digital Inc.)
• Inventors: Vajgel, Peter, Botes, Par, Colgrove, John, Silvers, Charles H., Timpanaro, Michael
• Primary Examiner(s): Sough; Hyung
• Assistant Examiner(s): Lo; Kenneth M
• Application Number:
  US10/749,299
• Time in Patent Office: 1,406 Days
• Field of Search: 711/111, 711/117, 711/202
• US Class Current: 711/111
• CPC Class Codes: G06F 11/1461 Backup scheduling policy
• CPC Class Codes: G06F 3/0608 Saving storage space on storage systems
• CPC Class Codes: G06F 3/0647 Migration mechanisms
• CPC Class Codes: G06F 3/0685 Hybrid storage combining heterogeneous device types, e.g. hierarchical storage, hybrid arrays

Abstract

System and method for performing operations in a multi-class file system without requiring split mirrors. For one or more storage classes in the multi-class file system, operations that require stable copies of the storage classes may be performed without using split mirrors. In one embodiment, read-only data may be assigned and/or migrated to lower storage classes, and operations may be performed on the read-only storage classes without using split mirrors. In one embodiment, to perform an operation without using a split mirror, a write lock of a storage class may be examined to determine if the write-locked storage class has been written to during the operation on the storage class and, if so, the operation may be retried for the storage class. In one embodiment, the file system software may be blocked from enabling a storage class for writing for the duration of the operation on the storage class.

Claims

1. A system, comprising:

a processor; and

a memory comprising program instructions, wherein the program instructions are executable by the processor to implement;

file system software configured to assign and migrate data in a multi-class file system comprising a hierarchy of storage classes, wherein the migrated data remains online within the multi-class file system, wherein one or more of the storage classes store data that is not modifiable but is readable by applications while the data is on the one or more storage classes, and wherein one or more others of the storage classes store data that is modifiable by applications while the data is on the one or more storage classes; and

an application configured to perform an operation on data stored in the multi-class file system, wherein the operation requires stable data, wherein, to perform the operation, the application is configured to;

perform the operation on at least one of the one or more storage classes that store data that is not modifiable without using a split mirror of the at least one of the one or more storage classes; and

perform the operation on at least one of the one or more other storage classes that store data that is modifiable using a split mirror of the at least one of the one or more other storage classes.

2. The system as recited in claim 1, wherein the operation is a backup of the storage classes.

3. The system as recited in claim 1, wherein the one or more storage classes that store data that is not modifiable by applications while the data is on those storage classes are configured to be write locked, and wherein, to perform the operation on at least one of the one or more storage classes that store data that is not modifiable without using a split mirror of the at least one of the one or more storage classes, the application is further configured to, for each write-locked storage class on which the operation is performed:

examine a write lock of the write-locked storage class to determine if the write-locked storage class could have been written to during the operation on that storage class; and

if said examine a write lock of the write-locked storage class determines the storage class could have been written to during the operation on that storage class, retry the operation for the write-locked storage class.

4. The system as recited in claim 1, wherein the one or more storage classes that store data that is not modifiable by applications while the data is on those storage classes are configured to be write locked, and wherein the application is further configured to block the file system software from enabling a write-locked storage class for writing for the duration of the operation.

5. The system as recited in claim 1, wherein the data includes files or portions of files.

6. The system as recited in claim 1, wherein the data comprises one or more of application data and file system metadata.

7. The system as recited in claim 1, wherein the storage classes are ordered in the hierarchy according to one or more characteristics from a highest storage class to a lowest storage class.

8. The system as recited in claim 7, wherein the one or more characteristics include one or more of performance and cost.

9. The system as recited in claim 1, wherein the storage classes are ordered in the hierarchy of storage classes according to performance characteristics from a highest storage class comprising one or more high-performance storage devices to a lowest storage class comprising one or more low-performance storage devices.

10. A system, comprising:

a plurality of storage devices;

a host system configured to couple to the plurality of storage devices via a network, wherein the host system comprises;

file system software configured to assign and migrate data in a multi-class file system comprising a hierarchy of storage classes, wherein migrated data remains online within the multi-class file system, wherein one or more of the storage classes store data that is not modifiable but is readable by applications while the data is on the one or more storage classes, and wherein one or more others of the storage classes store data that is modifiable by applications while the data is on the one or more storage classes; and

an application configured to perform an operation on data stored in the multi-class file system, wherein the operation requires stable data, wherein, to perform the operation, the application is configured to;

perform the operation on at least one of the one or more storage classes that store data that is not modifiable without using a split mirror of the at least one of the one or more storage classes; and

perform the operation on at least one of the one or more other storage classes that store data that is modifiable using a split mirror of the at least one of the one or more other storage classes.

11. The system as recited in claim 10, wherein the operation is a backup of the storage classes.

12. The system as recited in claim 10, wherein the one or more storage classes that store data that is not modifiable by applications while the data is on those storage classes are configured to be write locked, and wherein, to perform the operation on at least one of the one or more storage classes that store data that is not modifiable without using a split mirror of the at least one of the one or more storage classes, the application is further configured to, for each write-locked storage class on which the operation is performed:

examine a write lock of the write-locked storage class to determine if the write-locked storage class could have been written to during the operation on that storage class; and

if said examine a write lock of the write-locked storage class determines the storage class could have been written to during the operation on that storage class, retry the operation for the write-locked storage class.

13. The system as recited in claim 10, wherein the one or more storage classes that store data that is not modifiable by applications while the data is on those storage classes are configured to be write locked, and wherein the application is further configured to block the file system software from enabling a write-locked storage class for writing for the duration of the operation.

14. A system, comprising:

software means for assigning and migrating data in a multi-class file system comprising a plurality of storage classes and for providing access to the data in the multi-class file system to one or more applications, wherein migrated data remains online within the multi-class file system, wherein one or more of the storage classes store data that is not modifiable but is readable by the applications while the data is on the one or more storage classes, and wherein one or more others of the storage classes store data that is modifiable by applications while the data is on the one or more storage classes; and

means for performing operations that require stable data on data stored in the multi-class file system, wherein said means for performing operations that require stable data comprise;

means for performing the operations on the one or more storage classes that store data that is not modifiable without using a split mirror of the one or more storage classes; and

means for performing the operations on the one or more other storage classes that store data that is modifiable using a split mirror of the one or more other storage classes.

15. The system as recited in claim 14, further comprising means for blocking write access to the one or more storage classes that store data that is not modifiable for the duration of the operations.

16. A method, comprising:

file system software assigning and migrating data in a multi-class file system comprising a hierarchy of storage classes, wherein migrated data remains online within the multi-class file system, wherein one or more of the storage classes store data that is not modifiable but is readable by applications while the data is on the one or more storage classes, and wherein one or more others of the storage classes store data that is modifiable by applications while the data is on the one or more storage classes; and

performing an operation on data stored in the multi-class file system, wherein the operation requires stable data, wherein said performing the operation comprises;

performing the operation on at least one of the one or more storage classes that store data that is not modifiable without using a split mirror of the at least one of the one or more storage classes; and

performing the operation on at least one of the one or more other storage classes that store data that is modifiable using a split mirror of the at least one of the one or more other storage classes.

17. The method as recited in claim 16, wherein the operation is a backup of the storage classes.

18. The method as recited in claim 16, wherein the one or more storage classes that store data that is not modifiable by applications while the data is on those storage classes are write locked, and wherein said performing the operation on at least one of the one or more storage classes that store data that is not modifiable without using a split mirror of the at least one of the one or more storage classes comprises, for each write-locked storage class on which the operation is performed:

examining a write lock of the write-locked storage class to determine if the write-locked storage class could have been written to during the operation on that storage class; and

if said examining a write lock of the write-locked storage class determines the storage class could have been written to during the operation on that storage class, retrying the operation for the write-locked storage class.

19. The method as recited in claim 16, wherein the one or more storage classes that store data that is not modifiable by applications while the data is on those storage classes are configured to be write locked, and wherein the method further comprises blocking the file system software from enabling a write-locked storage class for writing for the duration of the operation.

20. The method as recited in claim 16, wherein the data includes files or portions of files.

21. The method as recited in claim 16, wherein the data comprises one or more of application data and file system metadata.

22. The method as recited in claim 16, wherein the storage classes are ordered in the hierarchy according to one or more characteristics from a highest storage class to a lowest storage class.

23. The method as recited in claim 16, wherein the storage classes are ordered in the hierarchy of storage classes according to performance characteristics from a highest storage class comprising one or more high-performance storage devices to a lowest storage class comprising one or more low-performance storage devices.

24. A computer-accessible storage medium, comprising program instructions, wherein the program instructions are computer-executable to implement:

assigning and migrating data in a multi-class file system comprising a hierarchy of storage classes, wherein migrated data remains online within the multi-class file system, wherein one or more of the storage classes store data that is not modifiable but is readable by applications while the data is on the one or more storage classes, and wherein one or more others of the storage classes store data that is modifiable by applications while the data is on the one or more storage classes; and

performing an operation on data stored in the multi-class file system, wherein the operation requires stable data, wherein said performing the operation comprises;

performing the operation on at least one of the one or more storage classes that store data that is not modifiable without using a split mirror of the at least one of the one or more storage classes; and

performing the operation on at least one of the one or more other storage classes that store data that is modifiable using a split mirror of the at least one of the one or more other storage classes.

25. The computer-accessible storage medium as recited in claim 24, wherein the operation is a backup of the storage classes.

26. The computer-accessible storage medium as recited in claim 24, wherein the one or more storage classes that store data that is not modifiable by applications while the data is on those storage classes are write locked, and wherein, in said performing the operation on at least one of the one or more storage classes that store data that is not modifiable without using a split mirror of the at least one of the one or more storage classes, the program instructions are further computer-executable to implement, for each write-locked storage class on which the operation is performed:

examining a write lock of the write-locked storage class to determine if the write-locked storage class could have been written to during the operation on that storage class; and

if said examining a write lock of the write-locked storage class determines the storage class could have been written to during the operation on that storage class, retrying the operation for the write-locked storage class.

27. The computer-accessible storage medium as recited in claim 24, wherein the one or more storage classes that store data that is not modifiable by applications while the data is on those storage classes are configured to be write locked, and wherein the program instructions are further computer-executable to implement blocking file system software from enabling write access to a write-locked storage class for the duration of the operation.

28. The computer-accessible storage medium as recited in claim 24, wherein the data includes files or portions of files.

29. The computer-accessible storage medium as recited in claim 24, wherein the data comprises one or more of application data and file system metadata.

30. The computer-accessible storage medium as recited in claim 24, wherein the storage classes are ordered in the hierarchy according to one or more characteristics from a highest storage class to a lowest storage class.

31. The computer-accessible storage medium as recited in claim 24, wherein the storage classes are ordered in the hierarchy of storage classes according to performance characteristics from a highest storage class comprising one or more high-performance storage devices to a lowest storage class comprising one or more low-performance storage devices.