Techniques for storing and distributing metadata among nodes in a storage cluster system

• US 10,554,754 B2
• Filed: 11/22/2017
• Issued: 02/04/2020
• Est. Priority Date: 10/30/2014
• Status: Active Grant

• Current Assignee: NetApp, Inc.
• Original Assignee: NetApp, Inc.
• Inventors: Mu, Paul Yuedong, Sundararajan, Manoj, Ngan, Paul
• Primary Examiner(s): Tokuta, Shean
• Application Number:
  US15/820,678
• Publication Number:
  US 20180097882A1
• Time in Patent Office: 804 Days
• CPC Class Codes: H04L 67/1097 for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]

Abstract

Various embodiments are generally directed to techniques for reducing the time required for a node to take over for a failed node or to boot. An apparatus includes an access component to retrieve a metadata from a storage device coupled to a first D-module of a first node during boot, the metadata generated from a first mutable metadata portion and an immutable metadata portion, and the first metadata specifying a first address of a second D-module of a second node; a replication component to contact the second data storage module at the first address; and a generation component to, in response to failure of the contact, request a second mutable metadata portion from a N-module of the first node and generate a second metadata from the second mutable metadata portion and the immutable metadata portion, the second mutable metadata portion specifying a second address of the second D-module.

Claims

1. A device comprising:

a memory comprising machine executable code; and

a processor coupled to the memory, the processor configured to execute the machine executable code to cause the processor to;

obtain, by a first node, a second mutable metadata portion specifying a second address of a second node based upon a failure to contact the second node using a first address within a first mutable metadata portion of first metadata, wherein the first metadata is generated from a first immutable metadata portion and the first mutable metadata portion wherein configuration data regarded as immutable metadata is overridden by acquired data and regarded as mutable metadata based upon the acquired data contradicting the configuration data; and

generate a second metadata from the second address of the second node specified by the second mutable metadata portion and the first immutable metadata portion.

2. The device of claim 1, wherein the first immutable metadata portion corresponds to a file system selection and a redundancy level and the first mutable metadata portion corresponds to a network address.

3. The device of claim 2, wherein the acquired data corresponds to results of a test.

4. The device of claim 1, wherein the machine executable code causes the processor to:

transmit the second metadata to a partner node of the first node via a second interconnect based upon successfully contacting the second node via an interconnect at the second address.

5. The device of claim 1, wherein the machine executable code causes the processor to:

store the second metadata within storage in place of the first metadata based upon successfully contacting the second node via an interconnect at the second address.

6. The device of claim 1, wherein the machine executable code causes the processor to:

form an active communications session through an interconnect between the first node and the second node an inactive communications session through the interconnect between the first node and a third node, wherein third metadata is generated to specify a third address of the third node to which to transmit a replica data access command in lieu of transmitting the replica data access command to the second node based upon the inactive communications session becoming active and the active communications session being inactive.

7. The device of claim 1, wherein the machine executable code causes the processor to:

transmit a replica data access command to the second node to store client device data within a second storage device coupled to the second node at least partially in parallel with storage of the client device data within storage of the first node.

8. A method comprising:

obtaining, by a first node, a second mutable metadata portion specifying a second address of a second node based upon a failure to contact the second node using a first address within a first mutable metadata portion of first metadata, wherein the first metadata is generated from a first immutable metadata portion and the first mutable metadata portion wherein configuration data regarded as immutable metadata is overridden by acquired data and regarded as mutable metadata based upon the acquired data contradicting the configuration data; and

generating a second metadata from the second address of the second node specified by the second mutable metadata portion and the first immutable metadata portion.

9. The method of claim 8, wherein the first immutable metadata portion corresponds to a file system selection and a redundancy level and the first mutable metadata portion corresponds to a network address.

10. The method of claim 8, comprising:

transmitting the second metadata to a partner node of the first node via an interconnect based upon the second node successfully receiving a message at the second address.

11. The method of claim 8, comprising:

storing the second metadata within storage in place of the first metadata in response to the second node successfully receiving a message at the second address.

12. The method of claim 10, comprising:

generating a third metadata from at least the second mutable metadata portion and a second immutable metadata portion based upon a second failure to contact the second node, the third metadata specifying a third address of the second node.

13. The method of claim 8, comprising:

forming an active communications session through an interconnect between the first node and the second node and the second node an inactive communications session through the interconnect between the first node and a third node, wherein third metadata is generated to specify a third address of the third node to which to transmit a replica data access command in lieu of transmitting the replica data access command to the second node based upon the inactive communications session becoming active and the active communications session being inactive.

14. The method of claim 8, the first mutable metadata portion comprising a RAID level selection of the second node.

15. A non-transitory machine-readable storage medium comprising instructions that when executed by a machine, causes the machine to:

obtain, by a first node, a second mutable metadata portion specifying a second address of a second node based upon a failure to contact the second node using a first address within a first mutable metadata portion of first metadata, wherein the first metadata is generated from a first immutable metadata portion and the first mutable metadata portion wherein configuration data regarded as immutable metadata is overridden by acquired data and regarded as mutable metadata based upon the acquired data contradicting the configuration data; and

generate a second metadata from the second address of the second node specified by the second mutable metadata portion and the first immutable metadata portion.

16. The non-transitory machine-readable storage medium of claim 15, wherein the first immutable metadata portion corresponds to a file system selection and a redundancy level and the first mutable metadata portion corresponds to a network address.

17. The non-transitory machine-readable storage medium of claim 15, wherein the instructions cause the machine to:

transmit the second metadata to a partner node of the first node via a second interconnect based upon successfully contacting the second node via an interconnect at the second address.

18. The non-transitory machine-readable storage medium of claim 15, wherein the instructions cause the machine to:

store the second metadata within storage in place of the first metadata based upon successfully contacting the second node via an interconnect at the second address.

19. The non-transitory machine-readable storage medium of claim 15, wherein the first immutable metadata portion comprises a RAID level selection.

20. The non-transitory machine-readable storage medium of claim 15, wherein the instructions cause the machine to:

transmit a replica data access command to the second node to store client device data within a second storage device coupled to the second node at least partially in parallel with storage of the client device data within storage of the first node.