Method and system for managing metadata in a storage environment
First Claim
Patent Images
1. A machine implemented method for a storage system, comprising:
- configuring a data storage volume for collecting metadata for a plurality of data containers stored at the data storage volume when a first snapshot of the data storage volume is generated;
wherein the metadata includes an attribute that is associated with the plurality of data containers and the metadata comprises a baseline image for a searchable data structure;
configuring a storage volume as a catalog volume for storing metadata associated with the plurality of data containers;
collecting metadata for the plurality of data containers by a processor executable metadata collection module executed by the plurality of computing nodes;
wherein after the first snapshot is generated for the data storage volume, metadata is collected only for data containers that were changed after the first snapshot was generated;
pre-processing the collected metadata by extracting one or more fields from the collected metadata by a processor executable catalog module executed by the plurality of computing nodes; and
storing the pre-processed metadata in the searchable data structure for responding to a user query requesting information regarding the plurality of data containers;
wherein the searchable data structure is stored at the catalog volume by the catalog module and includes a first searchable segment for storing metadata for a plurality of directory entries of the data storage volume and a second searchable segment for storing metadata for non-directory based data containers stored at the storage volume; and
wherein each entry in the second searchable segment stores a reference to a parent entry in the first searchable segment such that a storage path of each entry in the second searchable segment can be obtained from the reference to the parent entry in the first searchable segment without having to store individual storage paths for the non-directory based data containers at the second searchable segment.
1 Assignment
0 Petitions
Accused Products
Abstract
Method and system is provided for managing metadata for a plurality of data containers that are stored at one or more storage volumes in a storage system. The metadata is collected from one or more storage volumes and then provided to a catalog module. The catalog module pre-processes the metadata and then generates a searchable data structure. The searchable data structure may then be used to respond to a user request for information regarding the storage system.
-
Citations
30 Claims
-
1. A machine implemented method for a storage system, comprising:
-
configuring a data storage volume for collecting metadata for a plurality of data containers stored at the data storage volume when a first snapshot of the data storage volume is generated;
wherein the metadata includes an attribute that is associated with the plurality of data containers and the metadata comprises a baseline image for a searchable data structure;configuring a storage volume as a catalog volume for storing metadata associated with the plurality of data containers; collecting metadata for the plurality of data containers by a processor executable metadata collection module executed by the plurality of computing nodes;
wherein after the first snapshot is generated for the data storage volume, metadata is collected only for data containers that were changed after the first snapshot was generated;pre-processing the collected metadata by extracting one or more fields from the collected metadata by a processor executable catalog module executed by the plurality of computing nodes; and storing the pre-processed metadata in the searchable data structure for responding to a user query requesting information regarding the plurality of data containers;
wherein the searchable data structure is stored at the catalog volume by the catalog module and includes a first searchable segment for storing metadata for a plurality of directory entries of the data storage volume and a second searchable segment for storing metadata for non-directory based data containers stored at the storage volume; and
wherein each entry in the second searchable segment stores a reference to a parent entry in the first searchable segment such that a storage path of each entry in the second searchable segment can be obtained from the reference to the parent entry in the first searchable segment without having to store individual storage paths for the non-directory based data containers at the second searchable segment. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13)
-
-
14. A machine implemented method for a storage system for storing a plurality of data containers at one or more storage volumes, comprising:
-
pre-processing metadata associated with the plurality of data containers, the metadata including an attribute that is associated with the plurality of data containers; and generating a searchable data structure by indexing the pre-processed metadata such that information related to the plurality of data containers is obtained regardless of a storage volume location;
wherein the search data structure includes a first searchable segment for storing metadata for a plurality of directory entries and a second searchable segment for storing metadata for non-directory based data containers; and
wherein each entry in the second searchable segment stores a reference to a parent entry in the first searchable segment such that a storage path of each entry in the second searchable segment can be obtained from the reference to the parent entry in the first searchable segment without having to store individual storage paths for the non-directory based data containers at the second searchable segment. - View Dependent Claims (15, 16, 17, 18)
-
-
19. A machine implemented method for a storage system for storing a plurality of data containers at one or more storage volumes, comprising:
-
indexing metadata associated with the plurality of data containers, the metadata including an attribute that is associated with the plurality of data containers and the metadata is collected from at least one storage volume; and storing the indexed metadata associated with the plurality of data containers in a searchable data structure used for obtaining information regarding the plurality of data containers;
wherein the searchable data structure is stored at a catalog volume by a catalog module executed by a plurality of nodes and includes a first searchable segment for storing metadata for a plurality of directory entries of the data storage volume and a second searchable segment for storing metadata for non-directory based data containers stored at the storage volume; and
wherein each entry in the second searchable segment stores a reference to a parent entry in the first searchable segment such that a storage path of each entry in the second searchable segment can be obtained from the reference to the parent entry in the first searchable segment without having to store individual storage paths for the non-directory based data containers at the second searchable segment; and
wherein the searchable data structure stores a snapshot table identifier for identifying a snapshot when the plurality of data containers were replicated and a time stamp when the snapshot was taken. - View Dependent Claims (20, 21, 22, 23, 24)
-
-
25. A machine implemented method for a storage system for storing a plurality of data containers, comprising:
-
preprocessing metadata associated with the plurality of data containers stored at one or more storage volumes, the metadata including an attribute that is associated with the plurality of data containers; generating a searchable data structure for storing the pre-processed metadata for gathering information regarding any data container stored at any storage volume;
wherein the search data structure includes a first searchable segment for storing metadata for a plurality of directory entries and a second searchable segment for storing metadata for non-directory based data containers; and
wherein each entry in the second searchable segment stores a reference to a parent entry in the first searchable segment such that a storage path of each entry in the second searchable segment can be obtained from the reference to the parent entry in the first searchable segment without having to store individual storage paths for the non-directory based data containers at the second searchable segment;searching the searchable data structure in response to a request for information related to the plurality of data containers; retrieving the requested information from the searchable data structure; and presenting the information in response to the request. - View Dependent Claims (26, 27, 28, 29, 30)
-
Specification