Dynamically controlling erasure code distribution in an object store
First Claim
1. A non-transitory computer-readable storage medium storing computer-executable instructions that when executed by a computer cause the computer to perform a method, the method comprising:
- accessing a first data concerning an operating condition associated with an erasure code based object storage system, the object storage system comprising two or more devices on which an erasure code can be stored, where the operating condition concerns a load balance measure associated with the object storage system, and at least one of a capacity balance measure associated with the object storage system, or a fault tolerance measure associated with the object storage system;
recognizing an association between a plurality of objects associated with an erasure code to be stored in the object storage system;
identifying a usage pattern associated with the plurality of objects, where the usage pattern is based, at least in part, on the association, where the usage pattern concerns a relationship between an ingest site and an accessing site, and a relationship between the plurality of objects or erasure codes to be stored in the object storage system;
generating a prediction of where, in the object storage system, a read operation will be performed on the plurality of objects, based, at least in part, on the usage pattern; and
creating a distribution plan to control distribution of erasure codes to members of the two or more devices when the erasure codes are stored in the object storage system, where the distribution plan is based, at least in part, on the first data and the prediction.
8 Assignments
0 Petitions
Accused Products
Abstract
Example apparatus and methods monitor conditions in an object storage system. The conditions monitored may include a load balance measure in the system, a capacity balance measure in the system, a fault tolerance measure in the system, or a usage pattern measure in the system. A distribution plan or redistribution plan for storing or moving erasure codes in the object storage system may be determined based on the conditions. The distribution plan or the redistribution plan for the erasure codes may be updated dynamically in response to changing conditions in the object storage system. The distribution or redistribution may depend on a weighted combination of the load balance measure, the capacity balance measure, the fault tolerance measure, or the usage pattern measure so that responding to one sub-optimal condition (e.g., load imbalance) does not create a different sub-optimal condition (e.g., unacceptable fault tolerance).
8 Citations
12 Claims
-
1. A non-transitory computer-readable storage medium storing computer-executable instructions that when executed by a computer cause the computer to perform a method, the method comprising:
-
accessing a first data concerning an operating condition associated with an erasure code based object storage system, the object storage system comprising two or more devices on which an erasure code can be stored, where the operating condition concerns a load balance measure associated with the object storage system, and at least one of a capacity balance measure associated with the object storage system, or a fault tolerance measure associated with the object storage system; recognizing an association between a plurality of objects associated with an erasure code to be stored in the object storage system; identifying a usage pattern associated with the plurality of objects, where the usage pattern is based, at least in part, on the association, where the usage pattern concerns a relationship between an ingest site and an accessing site, and a relationship between the plurality of objects or erasure codes to be stored in the object storage system; generating a prediction of where, in the object storage system, a read operation will be performed on the plurality of objects, based, at least in part, on the usage pattern; and creating a distribution plan to control distribution of erasure codes to members of the two or more devices when the erasure codes are stored in the object storage system, where the distribution plan is based, at least in part, on the first data and the prediction. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12)
-
Specification