Method for erasure coding data across a plurality of data stores in a network
First Claim
1. A method operative within a set of data stores in which data blocks and their associated recovery blocks are stored using an erasure encoding and decoding scheme comprising:
- (a) providing a processor;
(b) providing a memory interoperably coupled to the processor and having computer software code stored thereon;
(c) using the processor and the memory in combination to perform at least one of steps (d)-(g);
(d) initializing a counter;
(e) storing a sequence number in a data structure having positions corresponding to the data blocks and their associated recovery blocks;
(f) as a given data block is changed, (i) incrementing the counter, (ii) assigning a value of the counter to a then current sequence number at a position associated with the given data block, and (iii) assigning the value of the counter to a then current sequence number at each position in the data structure associated with a recovery value;
(g) upon a given failure event, using the sequence numbers in the data structure to recover a data set associated with the sequence numbers in the data structure.
25 Assignments
0 Petitions
Accused Products
Abstract
An efficient method to apply an erasure encoding and decoding scheme across dispersed data stores that receive constant updates. A data store is a persistent memory for storing a data block. Such data stores include, without limitation, a group of disks, a group of disk arrays, or the like. An encoding process applies a sequencing method to assign a sequence number to each data and checksum block as they are modified and updated onto their data stores. The method preferably uses the sequence number to identify data set consistency. The sequencing method allows for self-healing of each individual data store, and it maintains data consistency and correctness within a data block and among a group of data blocks. The inventive technique can be applied on many forms of distributed persistent data stores to provide failure resiliency and to maintain data consistency and correctness.
277 Citations
6 Claims
-
1. A method operative within a set of data stores in which data blocks and their associated recovery blocks are stored using an erasure encoding and decoding scheme comprising:
-
(a) providing a processor; (b) providing a memory interoperably coupled to the processor and having computer software code stored thereon; (c) using the processor and the memory in combination to perform at least one of steps (d)-(g); (d) initializing a counter; (e) storing a sequence number in a data structure having positions corresponding to the data blocks and their associated recovery blocks; (f) as a given data block is changed, (i) incrementing the counter, (ii) assigning a value of the counter to a then current sequence number at a position associated with the given data block, and (iii) assigning the value of the counter to a then current sequence number at each position in the data structure associated with a recovery value; (g) upon a given failure event, using the sequence numbers in the data structure to recover a data set associated with the sequence numbers in the data structure. - View Dependent Claims (2, 3, 4, 5, 6)
-
Specification