System and method for a distributed object store
First Claim
1. A method in a distributed computer system capable of redundantly storing a plurality of data objects, the method for detecting an index failure and repairing the index, the method comprising:
- storing a replicated data object on a computer storage medium;
building an index of a replicated data object in memory of a first system node;
a data node that has at least one object which is indexed by the first system node detecting that the first system node has failed;
a membership and routing layer detecting a failed node;
receiving notification of a changed configuration;
the membership and routing layer sending notification of the changed configuration to at least one live data node;
detecting a change in an availability of an index node for data objects stored by the live data node;
determining that a time period for propagation delay has expired and, upon determining the time period has expired, initiating data repair procedures;
upon determining the time period has expired, determining a new index node for each data object without a live index node;
a data node having at least one object indexed by the first system node determining, by using membership information of operable nodes in the new configuration, a second system node for rebuilding of the index for the replicated data object;
computing a responsible index node for maintaining index information for the replicated data object using the membership information;
sending an indexing request to the second system node for at least one object without a live index node;
rebuilding the index for the replicated data object; and
storing the rebuilt index in computer storage media corresponding to memory of a second system node.
3 Assignments
0 Petitions
Accused Products
Abstract
An improved system and method for flexible object placement and soft-state indexing of objects in a distributed object store is provided. A distributed object store may be provided by a large number of system nodes operably coupled to a network. A system node provided may include an access module for communicating with a client, an index module for building an index of a replicated data object, a data module for storing a data object on a computer readable medium, and a membership and routing module for detecting the configuration of operable nodes in the distributed system. Upon failure of an index node, the failure may be detected at other nodes, including those nodes that store the replicas of the object. These nodes may then send new index rebuilding requests to a different node that may rebuild the index for servicing any access request to the object.
226 Citations
10 Claims
-
1. A method in a distributed computer system capable of redundantly storing a plurality of data objects, the method for detecting an index failure and repairing the index, the method comprising:
-
storing a replicated data object on a computer storage medium; building an index of a replicated data object in memory of a first system node; a data node that has at least one object which is indexed by the first system node detecting that the first system node has failed; a membership and routing layer detecting a failed node; receiving notification of a changed configuration; the membership and routing layer sending notification of the changed configuration to at least one live data node; detecting a change in an availability of an index node for data objects stored by the live data node; determining that a time period for propagation delay has expired and, upon determining the time period has expired, initiating data repair procedures; upon determining the time period has expired, determining a new index node for each data object without a live index node; a data node having at least one object indexed by the first system node determining, by using membership information of operable nodes in the new configuration, a second system node for rebuilding of the index for the replicated data object; computing a responsible index node for maintaining index information for the replicated data object using the membership information; sending an indexing request to the second system node for at least one object without a live index node; rebuilding the index for the replicated data object; and storing the rebuilt index in computer storage media corresponding to memory of a second system node. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10)
-
Specification