Data storage inventory indexing
First Claim
1. A computer-implemented method for index management, comprising:
- under the control of one or more computer systems configured with executable instructions,storing data in archival storage;
obtaining a data inventory index by at least;
if the data inventory index does not exist, generating the data inventory index associated with the stored data, the data inventory index including at least a manifest of parts of the stored data, the manifest including a data object identifier for at least a subset of the parts;
if the data inventory index does exist, merging into the data inventory index at least the manifest of parts of the stored data;
receiving information corresponding to a completed job associated with the stored data, the information including at least a logical data container identifier associated with the completed job;
partitioning the information based at least in part on the logical data container identifier to generate one or more logical data container queues corresponding to at least a subset of a plurality of logical data containers;
selecting at least one of the parts of the manifest that references a portion of the data inventory index to be updated based at least in part on the data object identifier for the at least one of the parts and the partitioned information; and
updating a portion of the data inventory index with at least a portion of the partitioned information based at least in part on the selected part of the manifest.
1 Assignment
0 Petitions
Accused Products
Abstract
Embodiments of the present disclosure are directed to, among other things, managing inventory indexing of one or more data storage devices. In some examples, a storage service may store an index associated with archived data. Additionally, the storage service may receive information associated with an operation performed on the archived data. The storage service may also partition the received information into subsets corresponding to an identifier. In some cases, the identifier may be received with or otherwise be part of the received information. The storage service may also retrieve at least a portion of the index that corresponds to the subset. Further, the storage service may update the retrieved portion of the index with at least part of the received information. The updating may be based at least in part on the subsets.
-
Citations
26 Claims
-
1. A computer-implemented method for index management, comprising:
under the control of one or more computer systems configured with executable instructions, storing data in archival storage; obtaining a data inventory index by at least; if the data inventory index does not exist, generating the data inventory index associated with the stored data, the data inventory index including at least a manifest of parts of the stored data, the manifest including a data object identifier for at least a subset of the parts; if the data inventory index does exist, merging into the data inventory index at least the manifest of parts of the stored data; receiving information corresponding to a completed job associated with the stored data, the information including at least a logical data container identifier associated with the completed job; partitioning the information based at least in part on the logical data container identifier to generate one or more logical data container queues corresponding to at least a subset of a plurality of logical data containers; selecting at least one of the parts of the manifest that references a portion of the data inventory index to be updated based at least in part on the data object identifier for the at least one of the parts and the partitioned information; and updating a portion of the data inventory index with at least a portion of the partitioned information based at least in part on the selected part of the manifest. - View Dependent Claims (2, 3, 4, 5, 6)
-
7. A computer-implemented method for index management, comprising:
under the control of one or more computer systems configured with executable instructions, generating an archival storage directory associated with stored data located in a memory by at least; receiving information corresponding to a data operation associated with the stored data, the information including a data object identifier associated with the data operation and one or more logical data container identifiers associated with the data operation; for at least a subset of the one or more logical data container identifiers, generating a table of parts; and for at least a subset of the table of parts, storing the data object identifier; obtaining an index by at least; if the data inventory index does not exist, generating an index for the archival storage directory; if the index does exist merging into the index at least the table of parts; storing the archival storage directory, based at least in part on the index; and validating that stored data identified by the data object identifier is stored in a data storage node of the memory. - View Dependent Claims (8, 9, 10, 11, 12)
-
13. A system for index management, comprising:
-
at least one memory that stores computer-executable instructions; and at least one processor configured to access the at least one memory, wherein the at least one processor is configured to execute the computer-executable instructions to collectively at least; obtain an index by at least; if the index does not exist, generating the index; if the index does exist merging into the index at least a list of parts associated with archived data; store the index associated with the archived data; receive information associated with a completed operation performed on the archived data; partition the received information into one or more subsets based at least in part on a logical data container identifier of the received information; retrieve at least a portion of the index corresponding to the one or more subsets; and update the retrieved portion of the index with at least part of the received information based at least in part on the one or more subsets. - View Dependent Claims (14, 15, 16, 17, 18)
-
-
19. One or more computer-readable media storing computer-executable instructions for index management that, when executed by one or more processors of a computer system, configure the computer system to perform operations comprising:
-
obtaining an index of operations associated with stored data by at least; if the index of operations associated with stored data does not exist generating the index; if the index does exist, merging into the index operations associated with the stored data; storing the index, the index including at least one or more data object identifiers; retrieving the data object identifiers of the index; transmitting at least one entry of the index, corresponding to at least one of the data object identifiers, to a remote computing device; in response to the transmitting the at least one entry of the index, receiving information associated with the stored data corresponding to the entry of the index; and validating information associated with the index. - View Dependent Claims (20, 21, 22, 23, 24, 25, 26)
-
Specification