Distributed metadata management

• US 10,162,843 B1
• Filed: 06/30/2014
• Issued: 12/25/2018
• Est. Priority Date: 05/05/2014
• Status: Active Grant

• Current Assignee: Emc IP Holding Company LLC (Dell Technologies Inc.)
• Original Assignee: Emc IP Holding Company LLC (Dell Technologies Inc.)
• Inventors: Srivastav, Shashwat, Sankaran, Sriram, Zhang, Qi, Luo, Jun, Mei, Liang, Musial, Peter M., Robertson, Andrew D., Yuan, Huapeng, Medvedev, Igor A., Song, Jie
• Primary Examiner(s): Chappell, Daniel C
• Application Number:
  US14/319,360
• Time in Patent Office: 1,639 Days
• CPC Class Codes: G06F 12/0831 using a bus scheme, e.g. with bus monitoring or watching means
• CPC Class Codes: G06F 16/13 File access structures, e.g. distributed indices arrangements of input from, or output to, record carriers G06F3/06
• CPC Class Codes: G06F 16/2246 Trees, e.g. B+trees
• CPC Class Codes: G06F 16/273 Asynchronous replication or reconciliation
• CPC Class Codes: G06F 16/275 Synchronous replication
• CPC Class Codes: G06F 3/0604 Improving or facilitating administration, e.g. storage management
• CPC Class Codes: G06F 3/0611 in relation to response time
• CPC Class Codes: G06F 3/0614 Improving the reliability of storage systems
• CPC Class Codes: G06F 3/0619 in relation to data integrity, e.g. data losses, bit errors
• CPC Class Codes: G06F 3/0626 Reducing size or complexity of storage systems
• CPC Class Codes: G06F 3/0638 Organizing or formatting or addressing of data
• CPC Class Codes: G06F 3/065 Replication mechanisms
• CPC Class Codes: G06F 3/0653 Monitoring storage devices or systems
• CPC Class Codes: G06F 3/0655 Vertical data movement, i.e. input-output transfer; data movement between one or more hosts and one or more storage devices
• CPC Class Codes: G06F 3/067 Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
• CPC Class Codes: G06F 3/0689 Disk arrays, e.g. RAID, JBOD
• CPC Class Codes: G06F 9/5061 Partitioning or combining of resources
• CPC Class Codes: H04L 67/1095 Replication or mirroring of data, e.g. scheduling or transport for data synchronisation between network nodes

Abstract

A computer-executable method, computer program product and system for managing metadata in a distributed data storage system, wherein the distributed data storage system includes a first node and one or more data storage arrays, the computer-executable method, computer program product and system comprising partitioning management of metadata created in the distributed data storage system into one or more portions of metadata, wherein the first node manages a first portion of the one or more portions of metadata, and storing the metadata using the first node.

Claims

1. A computer-executable method of managing metadata in a distributed data storage system, wherein the distributed data storage system includes a first node of a plurality of nodes and one or more data storage arrays, the computer-executable method comprising:

partitioning management of metadata created in the distributed data storage system into one or more portions of metadata, wherein the first node manages a first portion of the one or more portions of metadata, using one or more processors and memory;

wherein each of the plurality of nodes manages one or more portions of the metadata;

wherein each of the plurality of nodes includes a table storing which node of the plurality of nodes manages each of the one or more portions of metadata;

storing the metadata using the first node;

periodically analyzing a load balance of metadata management, using one or more processors and memory available to the distributed data storage system, by each of the one or more nodes; and

dynamically rebalancing the partitioning of metadata throughout the distributed data storage system based on the analysis matching changes to the distributed data storage system;

upon receipt, at a second node of the plurality of nodes, of notice that the first node has failed, acquiring management of the first portion of one or more portions of the metadata;

wherein the storing comprises;

providing a metadata storage structure including a first portion and a second portion, where in received metadata is combined with the second portion;

periodically updating the first portion from the second portion; and

removing portions of the second portions used to update the first portion, wherein the first portion of the metadata storage is a b-tree.

2. The computer-executable method of claim 1, wherein the metadata storage structure is stored using the second node in the distributed data storage system.

3. The computer-executable method of claim 1, wherein the partitioning the management of metadata is hashing the metadata into the one or more portions of metadata.

4. The computer-executable method of claim 1, further comprising:

analyzing a distribution of the one or more portions of metadata; and

modifying the distribution of the one or more portions of metadata based on a load of each node in the distributed data storage system.

5. A system, comprising:

a distributed data storage system including a first node and one or more data storage arrays; and

computer-executable program logic encoded in memory of one or more computers in communication with the distributed data storage system to enable management of metadata within the distributed data storage system, wherein the computer-executable program logic is configured for the execution of;

partitioning management of metadata created in the distributed data storage system into one or more portions of metadata, wherein the first node manages a first portion of the one or more portions of metadata;

wherein each of the plurality of nodes manages one or more portions of the metadata;

wherein each of the plurality of nodes includes a table storing which node of the plurality of nodes manages each of the one or more portions of metadata;

storing the metadata using the first node;

periodically analyzing a load balance of metadata management, using one or more processors and memory available to the distributed data storage system, by each of the one or more nodes; and

dynamically rebalancing the partitioning of metadata throughout the distributed data storage system based on the analysis matching changes to the distributed data storage system;

upon receipt, at a second node of the plurality of nodes, of notice that the first node has failed, acquiring management of the first portion of one or more portions of the metadata;

wherein the storing comprises;

providing a metadata storage structure including a first portion and a second portion, wherein received metadata is combined with the second portion;

periodically updating the first portion from the second portion; and

removing portions of the second portions used to update the first portion, wherein the first portion of the metadata storage is a b-tree.

6. The system of claim 5, wherein the metadata storage structure is stored using the second node in the distributed data storage system.

7. The system of claim 5, wherein the partitioning the management of metadata is hashing the metadata into the one or more portions of metadata.

8. The system of claim 5, wherein the computer-executable program logic is further configured for the execution of:

analyzing a distribution of the one or more portions of metadata; and

modifying the distribution of the one or more portions of metadata based on a load of each node in the distributed data storage system.

9. A computer program product for managing metadata in a distributed data storage system, wherein the distributed data storage system includes a first node and one or more data storage arrays, the computer program product comprising:

a non-transitory computer readable medium encoded with computer-executable program code for using read signatures in replication, the code configured to enable the execution of;

partitioning management of metadata created in the distributed data storage system into one or more portions of metadata, wherein the first node manages a first portion of the one or more portions of metadata;

wherein each of the plurality of nodes manages one or more portions of the metadata;

wherein each of the plurality of nodes includes a table storing which node of the plurality of nodes manages each of the one or more portions of metadata;

storing the metadata using the first node;

periodically analyzing a load balance of metadata management, using one or more processors and memory available to the distributed data storage system, by each of the one or more nodes; and

dynamically rebalancing the partitioning of metadata throughout the distributed data storage system based on the analysis matching changes to the distributed data storage system;

upon receipt, at a second node of the plurality of nodes, of notice that the first node has failed, acquiring management of the first portion of one or more portions of the metadata;

wherein the storing comprises;

providing a metadata storage structure including a first portion and a second portion, wherein received metadata is combined with the second portion;

periodically updating the first portion from the second portion; and

removing portions of the second portions used to update the first portion, wherein the first portion of the metadata storage is a b-tree.

10. The computer program product of claim 9, wherein the metadata storage structure is stored using the second node in the distributed data storage system.

11. The computer program product of claim 9, wherein the partitioning the management of metadata is hashing the metadata into the one or more portions of metadata.

12. The computer program product of claim 9, wherein the code is further configured to enable the execution of:

analyzing a distribution of the one or more portions of metadata; and

modifying the distribution of the one or more portions of metadata based on a load of each node in the distributed data storage system.