System and method for storing metadata for a file in a distributed storage system
First Claim
1. A computer-implemented method for storing metadata for a file in a distributed storage system, performed on a server having at least one processor and memory storing at least one program for execution by the at least one processor to perform the method, comprising:
- after the file has been uploaded to at least one storage cluster in the distributed storage system;
generating metadata for the uploaded file, the metadata for the uploaded file including information identifying at least one location of the uploaded file in the at least one storage cluster in the distributed storage system;
identifying a subset of metadata clusters in the distributed storage system to form a quorum of metadata clusters, wherein the subset of metadata clusters forming the quorum includes one or more metadata clusters selected from one or more geographical regions associated with the metadata clusters in the distributed storage system; and
issuing requests to store the metadata for the uploaded file on the metadata clusters in the distributed storage system, the requests including high priority requests and normal priority requests, wherein the high priority requests are requests to store the metadata for the uploaded file on at least one of the metadata clusters in the quorum of metadata clusters, and the normal priority requests are requests to store the metadata in the remaining metadata clusters,the metadata being stored on the at least one of the metadata clusters in the quorum of metadata clusters before being stored on the remaining metadata clusters in accordance with the high priority requests, such that in response to a request to obtain the uploaded file, the location of the uploaded file in the at least one storage cluster in the distributed storage system can be identified from the metadata stored on the at least one of the metadata clusters in the quorum of metadata clusters.
2 Assignments
0 Petitions
Accused Products
Abstract
A system, computer-readable storage medium storing at least one program, and a computer-implemented method for storing metadata for a file in a distributed storage system is presented. Metadata for a file is generated. A subset of metadata clusters in a distributed storage system is identified to form a quorum of metadata clusters. Requests to store the metadata for the file on the metadata clusters in the distributed storage system are issued, where the requests include high priority requests to store the metadata for the file on at least one of the metadata clusters in the quorum of metadata clusters and normal priority requests to store the metadata in the remaining metadata clusters, the metadata being stored on the at least one of the metadata clusters in the quorum of metadata clusters before being stored on the remaining metadata clusters.
-
Citations
23 Claims
-
1. A computer-implemented method for storing metadata for a file in a distributed storage system, performed on a server having at least one processor and memory storing at least one program for execution by the at least one processor to perform the method, comprising:
after the file has been uploaded to at least one storage cluster in the distributed storage system; generating metadata for the uploaded file, the metadata for the uploaded file including information identifying at least one location of the uploaded file in the at least one storage cluster in the distributed storage system; identifying a subset of metadata clusters in the distributed storage system to form a quorum of metadata clusters, wherein the subset of metadata clusters forming the quorum includes one or more metadata clusters selected from one or more geographical regions associated with the metadata clusters in the distributed storage system; and issuing requests to store the metadata for the uploaded file on the metadata clusters in the distributed storage system, the requests including high priority requests and normal priority requests, wherein the high priority requests are requests to store the metadata for the uploaded file on at least one of the metadata clusters in the quorum of metadata clusters, and the normal priority requests are requests to store the metadata in the remaining metadata clusters, the metadata being stored on the at least one of the metadata clusters in the quorum of metadata clusters before being stored on the remaining metadata clusters in accordance with the high priority requests, such that in response to a request to obtain the uploaded file, the location of the uploaded file in the at least one storage cluster in the distributed storage system can be identified from the metadata stored on the at least one of the metadata clusters in the quorum of metadata clusters. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11)
-
12. A system to store metadata for a file in a distributed storage system, comprising:
-
at least one processor; memory; and at least one program stored in the memory and executable by the at least one processor, the at least one program comprising instructions to; after the file has been uploaded to at least one storage cluster in the distributed storage system; generate metadata for the uploaded file, the metadata for the uploaded file including information identifying at least one location of the uploaded file in the at least one storage cluster in the distributed storage system; identify a subset of metadata clusters in the distributed storage system to form a quorum of metadata clusters, wherein the subset of metadata clusters forming the quorum includes one or more metadata clusters selected from one or more geographical regions associated with the metadata clusters in the distributed storage system; and issue requests to store the metadata for the uploaded file on the metadata clusters in the distributed storage system, the requests including high priority requests and normal priority requests, wherein the high priority requests are requests to store the metadata for the uploaded file on at least one of the metadata clusters in the quorum of metadata clusters, and the normal priority requests are requests to store the metadata in the remaining metadata clusters, the metadata being stored on the at least one of the metadata clusters in the quorum of metadata clusters before being stored on the remaining metadata clusters in accordance with the high priority requests, such that in response to a request to obtain the uploaded file, the location of the uploaded file in the at least one storage cluster in the distributed storage system can be identified from the metadata stored on the at least one of the metadata clusters in the quorum of metadata clusters. - View Dependent Claims (13, 14, 15, 16, 17, 18, 19, 20, 21, 22)
-
-
23. A non-transitory computer readable storage medium storing at least one program configured for execution by at least one processor of a computer system, the at least one program comprising instructions to:
after the file has been uploaded to at least one storage cluster in the distributed storage system; generate metadata for the uploaded file, the metadata for the uploaded file including information identifying at least one location of the uploaded file in the at least one storage cluster in the distributed storage system; identify a subset of metadata clusters in the distributed storage system to form a quorum of metadata clusters, wherein the subset of metadata clusters forming the quorum includes one or more metadata clusters selected from one or more geographical regions associated with the metadata clusters in the distributed storage system; and issue requests to store the metadata for the uploaded file on the metadata clusters in the distributed storage system, the requests including high priority requests and normal priority requests, wherein the high priority requests are requests to store the metadata for the uploaded file on at least one of the metadata clusters in the quorum of metadata clusters, and the normal priority requests are requests to store the metadata in the remaining metadata clusters, the metadata being stored on the at least one of the metadata clusters in the quorum of metadata clusters before being stored on the remaining metadata clusters in accordance with the high priority requests, such that in response to a request to obtain the uploaded file, the location of the uploaded file in the at least one storage cluster in the distributed storage system can be identified from the metadata stored on the at least one of the metadata clusters in the quorum of metadata clusters.
Specification