Broadcast data operations in distributed file systems

• US 10,523,753 B2
• Filed: 05/06/2014
• Issued: 12/31/2019
• Est. Priority Date: 05/06/2014
• Status: Active Grant

• Current Assignee: JP Morgan Chase Bank, N.A. (JP Morgan Chase & Co)
• Original Assignee: Western Digital Technologies Incorporated (Western Digital Corporation)
• Inventors: Squires, Christopher J.
• Primary Examiner(s): Pham, Michael
• Application Number:
  US14/271,435
• Publication Number:
  US 20150324387A1
• Time in Patent Office: 2,065 Days
• Field of Search: 707770
• CPC Class Codes: G06F 16/1824 implemented using Network-attached Storage [NAS] architecture distributed or networked storage systems G06F3/067; protocols for distributed storage of data in a network H04L67/1097
• CPC Class Codes: G06F 16/188 Virtual file systems
• CPC Class Codes: H04L 67/1097 for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]

Abstract

Systems, methods, and software for distributed file systems (DFS) are provided herein. In one example, the DFS is operable to respond to a write operation for the DFS by transferring a write command to a selected storage system for broadcast of the write command to a plurality of storage devices associated with a network switch fabric of the selected storage system. Further operations of the DFS can include, responsive to a read operation for the DFS, transferring a read command to a selected storage system for broadcast of the read command to a plurality of storage devices associated with a network switch fabric of the selected storage system.

Claims

1. A system comprising:

a plurality of data storage systems, each of the plurality of data storage systems comprising;

a plurality of non-transitory data storage devices; and

a network switch connected to each of the plurality of non-transitory data storage devices;

a distributed file system node connected to each of the plurality of data storage systems and comprising a processor and a memory storing instructions which when executed by the processor cause the processor to;

receive a request from a client device to perform an operation;

convert the request into a command that identifies one of the plurality of data storage systems to fulfil the request; and

transfer the command to the network switch of the identified one of the plurality of data storage systems,

wherein, upon receiving the command, the network switch broadcasts the command to each of the plurality of non-transitory data storage devices associated with the identified one of the plurality of data storage systems without uniquely identifying a specific one of the plurality of non-transitory data storage devices for fulfilling the request; and

wherein the processor of the distributed file system node receives an acknowledgement from one or more of the plurality of non-transitory data storage devices that fulfil the request.

2. The system of claim 1, wherein the distributed file system node identifies the one of the plurality of data storage systems to fulfil the request by identifying a broadcast network address for the one of the plurality of data storage systems.

3. The system of claim 1, wherein:

the request comprises a read operation to read data from one of the plurality of non-transitory data storage devices; and

upon receiving a read command via the network switch associated with the one of the plurality of non-transitory data storage devices, the one of the plurality of non-transitory data storage devices transfers

the data from the one of the plurality of non-transitory data storage devices to the distributed file system node.

4. The system of claim 3, wherein the distributed file system node transfers the data to the client device.

5. The system of claim 1, wherein the request is a write operation for writing data to one of the plurality of non-transitory data storage devices, and wherein the command comprises the data that is to be written to the one of the plurality of non-transitory data storage devices.

6. The system of claim 1, wherein upon receiving the command from the network switch, the one or more of the plurality of non-transitory data storage devices that fulfil the request accept the command based upon satisfaction of one or more criteria before fulfilling the request.

7. The system of claim 1, wherein:

the distributed file system node maintains a data structure for correlating information from the request to a broadcast network address of the one of the plurality of data storage systems to fulfil the request.

8. The system of claim 1, wherein the command does not identify the one or more of the plurality of non-transitory data storage devices that fulfil the request.

9. A system comprising:

a plurality of data storage systems, each of the plurality of data storage systems comprising;

a plurality of non-transitory data storage devices organized into one or more virtual local area networks; and

a network switch connected to each of the plurality of non-transitory data storage devices;

a distributed file system node connected to each of the plurality of data storage systems and comprising a processor and a memory storing instructions which when executed by the processor cause the processor to;

receive a request from a client device to perform an operation;

convert the request into a command that identifies one of the plurality of data storage systems to fulfil the request; and

transfer the command to the network switch of the identified one of the plurality of data storage systems,

wherein, upon receiving the command, the network switch broadcasts the command to all of the plurality of non-transitory data storage devices having a first virtual local area network for fulfilling the request without identifying a specific one of the plurality of non-transitory data storage devices.

10. The system of claim 9, wherein the request is a read operation or a write operation, wherein the read operation is for reading data from one of the plurality of non-transitory data storage devices having the first virtual local area network, and wherein the write operation is to write the data to the one of the plurality of non-transitory data storage devices having the first virtual local area network.

11. The system of claim 9, wherein the distributed file system node maintains a data structure for identifying a broadcast network address of the one of the plurality of data storage systems based upon the request.

12. The system of claim 9, wherein the processor of the distributed file system node receives an acknowledgement from one or more of the plurality of non-transitory data storage devices that fulfil the request.

13. The system of claim 9, wherein:

the network switch that receives the command does not broadcast the command to the plurality of non-transitory data storage devices that have a second virtual local area network.

14. The system of claim 13, wherein each of the plurality of non-transitory data storage devices having the first virtual local area network that receives the command:

determines, based on one or more criteria, whether the command is to be accepted; and

in response to determining that the command is to be accepted, sends an acknowledgement message to the network switch.