Scrubbing procedure for a data storage system
First Claim
1. A method of scrubbing information stored in a data storage system, comprising:
- maintaining on a first storage device a list of metadata entries corresponding to values that are stored in the data storage system at an At Maximum Redundancy (AMR) state, where each of the values is divided into encoded fragments;
verifying that the encoded fragments corresponding to each of the metadata entries are stored on a second storage device;
verifying that a corresponding metadata entry is stored on the first storage device for each of the encoded fragments that are stored on the second storage device; and
scheduling for recovery any missing encoded fragments and/or any missing metadata entry.
2 Assignments
0 Petitions
Accused Products
Abstract
A method is provided for scrubbing information stored in a data storage system where the information is stored as a plurality of encoded fragments across multiple storage devices. The method includes maintaining on a first storage device a list of metadata entries corresponding to values that are stored in the data storage system at an At Maximum Redundancy (AMR) state, verifying that encoded fragments associated with each of the metadata entries are stored on a second storage, verifying that a corresponding metadata entry is stored on the first storage device for each encoded fragment that is stored on the second storage device, and scheduling for recovery any missing encoded fragments and/or any missing metadata entry.
15 Citations
21 Claims
-
1. A method of scrubbing information stored in a data storage system, comprising:
-
maintaining on a first storage device a list of metadata entries corresponding to values that are stored in the data storage system at an At Maximum Redundancy (AMR) state, where each of the values is divided into encoded fragments; verifying that the encoded fragments corresponding to each of the metadata entries are stored on a second storage device; verifying that a corresponding metadata entry is stored on the first storage device for each of the encoded fragments that are stored on the second storage device; and scheduling for recovery any missing encoded fragments and/or any missing metadata entry. - View Dependent Claims (2, 3, 4, 5, 6, 7)
-
-
8. A method of scrubbing information stored as a plurality of encoded fragments across a plurality of storage nodes, comprising:
-
verifying, at a first storage node, that a plurality of encoded fragments associated with a plurality of values is stored at the first storage node; scheduling any missing fragments for recovery by the first storage node; transmitting a communication from the first storage node to a second storage node if the second storage node should have an encoded fragment that is a sibling of an encoded fragment stored at the first storage node; in response to the communication, verifying, at the second storage node, that the sibling fragment is stored at the second storage node; and if not, scheduling the sibling fragment for recovery by the second storage node. - View Dependent Claims (9, 10, 11, 12, 13, 14, 15)
-
-
16. A data storage system, comprising:
-
a local storage node; and a remote storage node in communication with the local storage node via a network, each of the local and remote storage nodes comprising; a fragment server having a plurality of storage devices, each of the storage devices to store a plurality of encoded fragments divided from values, and metadata associated with the encoded fragments, each of the fragment servers configured to repeatedly; cross-check the encoded fragments stored on the fragment server'"'"'s storage devices against the metadata stored on the fragment server'"'"'s storage devices; and schedule for recovery any fragments and/or metadata missing from the storage devices; and wherein each fragment server at the local storage node is further configured to transmit messages to sibling fragment servers at the remote storage node to request that the sibling fragment servers verify storage of sibling fragments. - View Dependent Claims (17, 18, 19, 20, 21)
-
Specification