Reconciler for a distributed storage system
First Claim
1. A computer implemented method for discovering and logging misplaced objects in a distributed object storage system, comprising:
- providing a processor running at least one container replicator in said distributed object storage system, said container replicator discovering storage policy inconsistencies;
said container replicator recording each transaction in a container database;
said container replicator adding said inconsistencies to a misplaced objects container;
said container replicator using a log format to record a history of state transitions which result from a series of requests, wherein said history is recorded in a plurality of container replicas;
each container replica maintaining a set of three vectors that indicate when the container replica last recorded a PUT or DELETE and when these actions resulted in a change of the container replica'"'"'s status (created or deleted); and
said container replicator comparing log items in said history between two or more containers to determine a representation of said state transaction history which resulted in a current state.
3 Assignments
0 Petitions
Accused Products
Abstract
A technique is applied to eventually converge on a single data storage strategy for any set of object data which had an inconsistent data storage strategy applied during storage while there was a network partition. This state could occur in instances of a highly available distributed object storage system which can store objects according to multiple data storage strategies. Upon the healing of a network partition, the technique discovers if multiple data storage strategies were applied to the object data stored during a network partition, deterministically identifies which data storage strategy represents the correct strategy, for example based on the log of state transitions requested by the client according to the API contract, and ensures that this strategy is consistently applied to all object data in the collection.
7 Citations
7 Claims
-
1. A computer implemented method for discovering and logging misplaced objects in a distributed object storage system, comprising:
-
providing a processor running at least one container replicator in said distributed object storage system, said container replicator discovering storage policy inconsistencies; said container replicator recording each transaction in a container database; said container replicator adding said inconsistencies to a misplaced objects container; said container replicator using a log format to record a history of state transitions which result from a series of requests, wherein said history is recorded in a plurality of container replicas; each container replica maintaining a set of three vectors that indicate when the container replica last recorded a PUT or DELETE and when these actions resulted in a change of the container replica'"'"'s status (created or deleted); and said container replicator comparing log items in said history between two or more containers to determine a representation of said state transaction history which resulted in a current state. - View Dependent Claims (2, 3, 4, 5, 6, 7)
-
Specification