Network bootstrapping for a distributed storage system

• US 9,276,900 B1
• Filed: 03/19/2015
• Issued: 03/01/2016
• Est. Priority Date: 03/19/2015
• Status: Active Grant

• Current Assignee: Rubrik, Inc.
• Original Assignee: Igneous Systems, Inc. (Rubrik, Inc.)
• Inventors: Daud, Asif Arif, Pilloud, Andrew Martin, Wallace, Kevin Thomas
• Primary Examiner(s): Park, Jeong S
• Application Number:
  US14/663,359
• Time in Patent Office: 348 Days
• US Class Current: 1/1
• CPC Class Codes: H04L 41/0803 Configuration setting
• CPC Class Codes: H04L 41/0886 Fully automatic configuration
• CPC Class Codes: H04L 41/12 Discovery or management of network topologies
• CPC Class Codes: H04L 41/5058 Service discovery by the service manager
• CPC Class Codes: H04L 61/4511 using domain name system [DNS]
• CPC Class Codes: H04L 61/5007 Internet protocol [IP] addresses
• CPC Class Codes: H04L 61/5014 using dynamic host configuration protocol [DHCP] or bootstrap protocol [BOOTP]
• CPC Class Codes: H04L 61/5069 for group communication, multicast communication or broadcast communication
• CPC Class Codes: H04L 67/1097 for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
• CPC Class Codes: H04W 8/005 Discovery of network devices, e.g. terminals

Abstract

Embodiments are directed towards configuring a distributed storage system over a network. Master computers and Subordinate computers may separate components of the distributed storage system. Each subordinate computer may perform actions when connected to the network. When the network provides for site-level multicasting, the subordinate computer broadcasts site-level multicast request(s) for a network address of master computer(s) assigned to that subordinate computer. When the network supports a local domain name system (DNS) server, the subordinate computer provides a DNS query to the local DNS server to obtain from an external server the network address for the master computer(s) assigned to that subordinate computer. When then network supports a master computer as a DNS server, the subordinate computer provides the DNS query to the master computer DNS server to obtain from the external server the network address of the master computer(s) assigned to that subordinate computer.

Claims

1. A method for configuring a distributed storage system over a network, comprising:

connecting a plurality of master computers and a plurality of subordinate computers to the network, wherein the master computers and the subordinate computers are separate components of the distributed storage system;

when the network provides for site-level multicasting, for each subordinate computer, broadcasting site-level multicast requests for a network address of one or more master computers assigned to that subordinate computer;

when the network supports a local domain name system (DNS) server, for each subordinate computer, providing a DNS query to the local DNS server to obtain from an external server the network address for the one or more master computers assigned to that subordinate computer;

when the network supports a master computer as a DNS server, for each subordinate computer, providing the DNS query to the master computer DNS server to obtain from the external server the network address of the one or more master computers assigned to that subordinate computer; and

wherein when the master computer is operating as the DNS server and is a master of that subordinate computer, either the master computer notifies each other master computer in its cluster of that subordinate computer, else that subordinate computer registers itself with each master computer assigned to that subordinate computer based on a response from the DNS query.

2. The method of claim 1, further comprising, employing a subordinate computer to provide a request to at least one of the one or more master computers to determine other subordinate computers associated with the subordinate computer.

3. The method of claim 1, wherein the DNS query requests a list of network addresses for the one or more master computers of a subordinate computer without providing an identity of the one or more master computers.

4. The method of claim 1, further comprising, configuring a master computer as a DNS server to communicate DNS requests to the external server.

5. The method of claim 1, further comprising:

when the network provides for site-level multicasting, employing a master computer, broadcasting site-level multicast requests for a network address of one or more other master computers assigned to a same cluster as that master computer;

when the network supports a local domain name system (DNS) server, employing a master computer, providing a DNS query to the local DNS server to obtain from an external server the network address for the one or more other master computers assigned to the same cluster as that master computer; and

when the network supports a master computer as a DNS server, employing a master computer, providing the DNS query to the master computer DNS server to obtain from the external server the network address of the one or more other master computers assigned to the same cluster as that master computer.

6. The method of claim 1, wherein each of the master computers provides its network address to the external server to enable the external server to provide master computer network addresses to the subordinate computers based on the query.

7. The method of claim 1, further comprising, employing each subordinate computer to provide a request to at least one of the one or more master computers to register with the one or more master computers.

8. The method of claim 1, further comprising, employing a subordinate computer to provide a request to at least one of the one or more master computers to determine other master computers in a same cluster as the subordinate computer.

9. The method of claim 1, further comprising, employing the one or more master computers to respond to the site-level multicast request with a unicast or multicast message to the broadcasting subordinate computer with its network address.

10. A system for configuring a distributed storage system over a network, comprising:

a plurality of master computers that are connected to the network, and have processors that execute instructions to perform actions; and

a plurality of subordinate computers that are connected to the network, and have processors that execute instructions to perform actions, the actions including;

when the network provides for site-level multicasting, for each subordinate computer, broadcasting site-level multicast requests for a network address of one or more master computers assigned to that subordinate computer;

when the network supports a local domain name system (DNS) server, for each subordinate computer, providing a DNS query to the local DNS server to obtain from an external server the network address for the one or more master computers assigned to that subordinate computer;

when the network supports a master computer as a DNS server, for each subordinate computer, providing the DNS query to the master computer DNS server to obtain from the external server the network address of the one or more master computers assigned to that subordinate computer; and

wherein when the master computer is operating as the DNS server and is a master of that subordinate computer, either the master computer notifies each other master computer in its cluster of that subordinate computer, else that subordinate computer registers itself with each master computer assigned to that subordinate computer based on a response from the DNS query.

11. The system of claim 10, wherein the plurality of subordinate computers execute instructions to perform further actions, comprising, providing a request to at least one of the one or more master computers to determine other subordinate computers associated with the subordinate computer.

12. The system of claim 10, wherein the DNS query requests a list of network addresses for the one or more master computers of a subordinate computer without providing an identity of the one or more master computers.

13. The system of claim 10, wherein one of the plurality of master computers is configured as a DNS server to communicate DNS requests to the external server.

14. The system of claim 10, wherein the plurality of master computers execute instructions to perform further actions, comprising:

when the network provides for site-level multicasting, employing a master computer, broadcasting site-level multicast requests for a network address of one or more other master computers assigned to a same cluster as that master computer;

when the network supports a local domain name system (DNS) server, employing a master computer, providing a DNS query to the local DNS server to obtain from an external server the network address for the one or more other master computers assigned to the same cluster as that master computer; and

when the network supports a master computer as a DNS server, employing a master computer, providing the DNS query to the master computer DNS server to obtain from the external server the network address of the one or more other master computers assigned to the same cluster as that master computer.

15. The system of claim 10, wherein each of the master computers provides its network address to the external server to enable the external server to provide master computer network addresses to the subordinate computers based on the query.

16. The system of claim 10, wherein the plurality of subordinate computers execute instructions to perform further actions, comprising, employing each subordinate computer to provide a request to at least one of the one or more master computers to register with the one or more master computers.

17. The system of claim 10, wherein the plurality of subordinate computers execute instructions to perform further actions, comprising, employing a subordinate computer to provide a request to at least one of the one or more master computers to determine other master computers in a same cluster as the subordinate computer.

18. A processor readable non-transitory storage media that includes instructions for configuring a distributed storage system over a network, comprising:

employing a plurality of master computers and a plurality of subordinate computers to establish a connection with the network, wherein the master computers and the subordinate computers are separate components of the distributed storage system;

when the network provides for site-level multicasting, for each subordinate computer, broadcasting site-level multicast requests for a network address of one or more master computers assigned to that subordinate computer;

when the network supports a local domain name system (DNS) server, for each subordinate computer, providing a DNS query to the local DNS server to obtain from an external server the network address for the one or more master computers assigned to that subordinate computer;

when the network supports a master computer as a DNS server, for each subordinate computer, providing the DNS query to the master computer DNS server to obtain from the external server the network address of the one or more master computers assigned to that subordinate computer; and

wherein when the master computer is operating as the DNS server and is a master of that subordinate computer, either the master computer notifies each other master computer in its cluster of that subordinate computer, else that subordinate computer registers itself with each master computer assigned to that subordinate computer based on a response from the DNS query.

19. The media of claim 18, further comprising, employing a subordinate computer to provide a request to at least one of the one or more master computers to determine other subordinate computers associated with the subordinate computer.

20. The media of claim 18, wherein the DNS query requests a list of network addresses for the one or more master computers of a subordinate computer without providing an identity of the one or more master computers.

21. The media of claim 18, further comprising, configuring a master computer as a DNS server to communicate DNS requests to the external server.

22. The media of claim 18, further comprising:

when the network provides for site-level multicasting, employing a master computer, broadcasting site-level multicast requests for a network address of one or more other master computers assigned to a same cluster as that master computer;

when the network supports a local domain name system (DNS) server, employing a master computer, providing a DNS query to the local DNS server to obtain from an external server the network address for the one or more other master computers assigned to the same cluster as that master computer;

when the network supports a master computer as a DNS server, employing a master computer, providing the DNS query to the master computer DNS server to obtain from the external server the network address of the one or more other master computers assigned to the same cluster as that master computer.

23. The media of claim 18, wherein each of the master computers provides its network address to the external server to enable the external server to provide master computer network addresses to the subordinate computers based on the query.

24. The media of claim 18, further comprising, employing each subordinate computer to provide a request to at least one of the one or more master computers to register with the one or more master computers.

25. The media of claim 18, further comprising, employing a subordinate computer to provide a request to at least one of the one or more master computers to determine other master computers in a same cluster as the subordinate computer.

26. A subordinate computer for configuring a distributed storage system over a network, comprising:

a memory that stores instructions; and

a processor that executes the instructions to perform actions, including;

establishing a connection to the network, wherein a plurality of master computers and a plurality of subordinate computers are separate components of the distributed storage system;

when the network provides for site-level multicasting, broadcasting site-level multicast requests for a network address of one or more master computers assigned to the subordinate computer;

when the network supports a local domain name system (DNS) server, providing a DNS query to the local DNS server to obtain from an external server the network address for the one or more master computers assigned to the subordinate computer;

when the network supports a master computer as a DNS server, providing the DNS query to the master computer DNS server to obtain from the external server the network address of the one or more master computers assigned to the subordinate computer; and

wherein when the master computer is operating as the DNS server and is a master of that subordinate computer, either the master computer notifies each other master computer in its cluster of that subordinate computer, else that subordinate computer registers itself with each master computer assigned to that subordinate computer based on a response from the DNS query.

27. The subordinate computer of claim 26, wherein the processor that executes the instructions performs further actions, comprising, providing a request to at least one of the one or more master computers to determine other subordinate computers associated with the subordinate computer.

28. The subordinate computer of claim 26, wherein the DNS query requests a list of network addresses for the one or more master computers of a subordinate computer without providing an identity of the one or more master computers.

29. The subordinate computer of claim 26, wherein the processor that executes the instructions performs further actions, comprising, providing a request to at least one of the one or more master computers to register with the one or more master computers.

30. The subordinate computer of claim 26, wherein the processor that executes the instructions performs further actions, comprising, providing a request to at least one of the one or more master computers to determine other master computers in a same cluster as the subordinate computer.