System and method for managing redundant storage consistency at a file system level
First Claim
1. A method for a file system to perform a redundancy consistency recovery operation for a file on a storage system without using any redundancy consistency mechanism of the storage system, comprising:
- a file system receiving data modification requests each indicating data modifications to a file on a storage system, wherein the storage system comprises a plurality of storage devices configured to store data and redundancy data for the file;
for each data modification request;
the file system saving dirty file information at a file system level, wherein the dirty file information is separate from the data and redundancy data for the file, wherein the dirty file information indicates one or more portions of the file to be modified, wherein the one or more portions correspond to the indicated data modifications; and
the file system performing the indicated data modifications on the storage system, wherein said performing comprises storing redundancy data for the indicated data modifications, wherein the data modifications and redundancy data are stored on the storage system and are stored separately from the dirty file information; and
performing a redundancy consistency recovery operation for the file on the storage system without using any redundancy consistency mechanism of the storage system, wherein the redundancy consistency recovery operation uses the dirty file information.
9 Assignments
0 Petitions
Accused Products
Abstract
A file system may save dirty file information indicating portions of files, residing on a storage system, to be modified corresponding data modification requests received by the file system. The file system may update the saved dirty file information to indicate successful modification of the files across redundant storage of the storage system and may track redundancy consistency recovery information on a file-by-file basis or on a file portion basis. A file system may also retrieve saved dirty file information and recover redundancy consistency for portions of files determined, based on the saved dirty file information, not to have redundancy consistency on the storage system. Recovering redundancy consistency may include copying, either directly to via a storage system mechanism, portions of files between redundant storage of the storage system. The redundancy consistency for the saved dirty file information may be recovered prior to recovering redundancy consistency for individual files.
68 Citations
19 Claims
-
1. A method for a file system to perform a redundancy consistency recovery operation for a file on a storage system without using any redundancy consistency mechanism of the storage system, comprising:
-
a file system receiving data modification requests each indicating data modifications to a file on a storage system, wherein the storage system comprises a plurality of storage devices configured to store data and redundancy data for the file; for each data modification request; the file system saving dirty file information at a file system level, wherein the dirty file information is separate from the data and redundancy data for the file, wherein the dirty file information indicates one or more portions of the file to be modified, wherein the one or more portions correspond to the indicated data modifications; and the file system performing the indicated data modifications on the storage system, wherein said performing comprises storing redundancy data for the indicated data modifications, wherein the data modifications and redundancy data are stored on the storage system and are stored separately from the dirty file information; and performing a redundancy consistency recovery operation for the file on the storage system without using any redundancy consistency mechanism of the storage system, wherein the redundancy consistency recovery operation uses the dirty file information. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11)
-
-
12. A device, comprising:
-
a processor; and a memory coupled to the processor, wherein the memory comprises program instructions executable by the processor to implement a file system configured to; receive data modification requests each indicating data modifications to a file on a storage system, wherein the storage system comprises a plurality of storage devices configured to store data and redundancy data for the file;
for each data modification request;save dirty file information and metadata information for the data modification request to a log or journal of the file system, wherein the dirty file information and metadata information are separate from the data and redundancy data for the file, wherein the dirty file information indicates one or more portions of the file to be modified, wherein the one or more portions correspond to the indicated data modifications; and
wherein the metadata information is saved to the log or journal of the file system using an I/O operation and the dirty file information is saved to the log or journal of the file system without incurring an additional I/O operation;perform the indicated data modifications on the storage system; and perform a redundancy consistency recovery operation for the file on the storage system without using any redundancy consistency mechanism of the storage system, wherein the redundancy consistency recovery operation uses the dirty file information. - View Dependent Claims (13, 14)
-
-
15. A method for recovering redundancy consistency for a storage system comprising a plurality of storage devices configured to store data and redundancy data, comprising:
-
recovering redundancy consistency for saved dirty file information on a storage system, wherein the dirty file information indicates one or more portions of one or more files that are known to have redundancy consistency on the storage system, wherein said recovering redundancy consistency comprises verifying redundancy data for the dirty file information to ensure a consistent state of the saved dirty file information; retrieving said saved dirty file information from a file system; and subsequent to said recovering redundancy consistency for saved dirty file information and subsequent to said retrieving said saved dirty file information, recovering redundancy consistency for one or more remaining portions of one or more files, wherein said recovering redundancy consistency comprises updating redundancy data for the one or more remaining portions of each file as indicated by the dirty file information. - View Dependent Claims (16, 17, 18, 19)
-
Specification