Eventually durable redundancy encoded data storage
First Claim
Patent Images
1. A computer-implemented method, comprising:
- receiving, at a data storage service, a set of data objects over an interval of time;
storing, on at least one device of the data storage service, each data object of the set of data objects with a first durability;
selecting a subset of the set of the data objects that have been stored for at least a predetermined length of time with the first durability; and
changing durability of the subset of the set of data objects by at least;
applying a first redundancy encoding technique to generate, based at least in part on the selected subset of the set of data objects, a set of data shards; and
storing the set of data shards among a plurality of data storage devices such that the selected subset of the set of data objects is stored with at least a second durability that is different from the first durability.
1 Assignment
0 Petitions
Accused Products
Abstract
Techniques for making storage of data objects eventually durable using redundancy encoding are described herein. Data objects are stored in a first set of data storage devices with a first durability. After a predetermined length of time, the data objects are converted to data shards and distributed to a second set of data storage devices with a second durability that is distinct from the first durability.
46 Citations
25 Claims
-
1. A computer-implemented method, comprising:
-
receiving, at a data storage service, a set of data objects over an interval of time; storing, on at least one device of the data storage service, each data object of the set of data objects with a first durability; selecting a subset of the set of the data objects that have been stored for at least a predetermined length of time with the first durability; and changing durability of the subset of the set of data objects by at least; applying a first redundancy encoding technique to generate, based at least in part on the selected subset of the set of data objects, a set of data shards; and storing the set of data shards among a plurality of data storage devices such that the selected subset of the set of data objects is stored with at least a second durability that is different from the first durability. - View Dependent Claims (2, 3, 4, 5)
-
-
6. A system, comprising at least one computing device that implements one or more services, wherein the one or more services:
-
store a set of data objects using a first set of data storage devices, each data storage device of the first set of data storage devices having a first durability; and after the set of data objects are stored with the first durability at least a determined length of time, at least; apply a redundancy encoding technique to generate a set of data shards based at least in part on a subset of the set of data objects; and store the set of data shards on a second set of data storage devices such that the subset of the set of data objects is stored with a second durability that is distinct from the first durability. - View Dependent Claims (7, 8, 9, 10, 11, 12, 13, 14)
-
-
15. A non-transitory computer-readable storage medium having stored thereon executable instructions that, as a result of execution by one or more processors of a computer system, cause the computer system to at least:
-
select, from a set of data objects stored with a first durability using a first set of data storage devices provided by a data storage service, a subset of the set of data objects that have been stored with the first durability for at least a predetermined length of time; and perform one or more operations that cause a set of data shards to be stored among a second set of data storage devices provided by the data storage service, each data shard of the set of data shards generated by applying a corresponding redundancy encoding technique to the subset of the set of data objects, the set of data shards stored among the set of data storage devices such that the subset of the set of data objects is stored with at least a second durability that is distinct from the first durability. - View Dependent Claims (16, 17, 18, 19, 20, 21, 22, 23, 24, 25)
-
Specification