IP multicast message transmission for event notifications

• US 10,409,514 B2
• Filed: 10/24/2016
• Issued: 09/10/2019
• Est. Priority Date: 11/30/2015
• Status: Active Grant

• Current Assignee: Pure Storage, Inc.
• Original Assignee: International Business Machines Corporation
• Inventors: Hegde, Harsha
• Primary Examiner(s): Sloms, Nicholas
• Application Number:
  US15/332,557
• Publication Number:
  US 20170155520A1
• Time in Patent Office: 1,051 Days
• Field of Search: None
• CPC Class Codes: G06F 11/0727 in a storage system, e.g. in a DASD or network based storage system drivers for digital recording or reproducing units G06F3/06; circuits for error detection or correction within digital recording or reproducing units G11B20/18; for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS], H04L67/1097
• CPC Class Codes: G06F 11/1076 Parity data used in redundant arrays of independent storages, e.g. in RAID systems
• CPC Class Codes: G06F 11/1092 Rebuilding, e.g. when physically replacing a failing disk
• CPC Class Codes: G06F 16/258 Data format conversion from or to a database
• CPC Class Codes: G06F 3/0611 in relation to response time
• CPC Class Codes: G06F 3/0617 in relation to availability
• CPC Class Codes: G06F 3/0619 in relation to data integrity, e.g. data losses, bit errors
• CPC Class Codes: G06F 3/0631 by allocating resources to storage systems
• CPC Class Codes: G06F 3/0635 by changing the path, e.g. traffic rerouting, path reconfiguration
• CPC Class Codes: G06F 3/064 Management of blocks
• CPC Class Codes: G06F 3/0659 Command handling arrangements, e.g. command buffers, queues, command scheduling
• CPC Class Codes: G06F 3/067 Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
• CPC Class Codes: H03M 13/1515 Reed-Solomon codes
• CPC Class Codes: H03M 13/3761 using code combining, i.e. using combining of codeword portions which may have been transmitted separately, e.g. Digital Fountain codes, Raptor codes or Luby Transform [LT] codes
• CPC Class Codes: H03M 13/616 Matrix operations, especially for generator matrices or check matrices, e.g. column or row permutations
• CPC Class Codes: H04L 12/18 for broadcast or conference , e.g. multicast
• CPC Class Codes: H04L 67/1008 based on parameters of servers, e.g. available memory or workload monitoring of computer activity G06F11/30
• CPC Class Codes: H04L 67/1097 for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
• CPC Class Codes: H04L 67/565 Conversion or adaptation of application format or content adding application control or application functional data H04L67/561

Abstract

A method for a dispersed storage network (DSN) begins when storing data associated with a vault, by identifying a multicast IP address associated with the vault. The method continues by generating and sending a multicast IP message to a plurality of storage units of the DSN and extracting, by each storage unit receiving the multicast IP message, the multicast IP address. The method continues when the extracted IP address compares favorably to a subscribed IP address, by storing, by the storage unit, the one or more encoded data slices for storage and the corresponding slice name for each encoded data slice. The method continues by each storage unit issuing a status multicast IP message. The method continues when an extracted IP address of a plurality of received status multicast IP messages compares favorably to a subscribed IP address, by executing an associated task.

Claims

1. A method for execution by one or more processing modules of one or more computing devices of a dispersed storage network (DSN), the method comprises:

storing data associated with a vault and identifying a multicast IP address associated with the vault, where the vault includes a set of encoded data slices for each data segment and where a write threshold number is a minimum number, less than a complete set of the encoded data slices, that is required to successfully write to dispersed storage the data segment to a vault of storage units;

generating and sending, by a first DS processing unit, a multicast IP message via a network, to a plurality of storage units of the DSN, wherein the multicast IP message includes the multicast IP address, a plurality of encoded data slices for storage and, for each encoded data slice, a corresponding slice name;

extracting, by each of the plurality of storage units receiving the multicast IP message, the multicast IP address;

for the extracted multicast IP address comparing favorably to a subscribed IP address, storing in each storage unit of the vault of storage units one or more of the plurality of encoded data slices and a corresponding slice name for each encoded data slice, where each storage unit of the vault of storage units stores, based on the corresponding slice name, a respective encoded data slice associated with that storage unit;

after the storing is completed, each of the plurality of storage units issuing a status multicast IP message;

extracting the multicast IP address of a plurality of received status multicast IP messages comparing favorably to a subscribed IP address and determining, by a second DS processing unit, separate from the first DS processing unit, whether the plurality of received status multicast IP messages indicates successful storage of data in a corresponding vault, wherein the determining includes indicating that the data has been successfully stored in the vault of storage units when a confirmation of the write threshold number of favorable received status multicast IP messages indicate successful storage of encoded data slices; and

based on the data being successfully stored, facilitating, by the second DS processing unit execution of an associated task.

2. The method of claim 1, wherein each storage unit can see a plurality of multicast IP messages, but filter out all but subscribed IP addresses by one or more of:

a vault ID, an object ID, or a slice name range.

3. The method of claim 1, wherein the identifying includes one or more of:

assigning, interpreting system registry information, interpreting a query response, or interpreting a multicast IP address subscription.

4. The method of claim 1, wherein the extracting includes one or more of:

identifying a multicast IP address field of the multicast IP message or retrieving the multicast IP address from the identified multicast IP address field.

5. The method of claim 1, wherein the extracted IP address compares favorably to a subscribed IP address when the extracted IP address is within a range of a subscribed IP address.

6. The method of claim 1, wherein the status multicast IP message includes one or more of:

the multicast IP address associated with the vault, a storage unit identifier, one or more of the corresponding slice name(s), or a status indicator that indicates successful storage of the one or more encoded data slices.

7. The method of claim 1, wherein the issuing includes generating the status multicast IP message and transmit the status multicast IP message to the network.

8. The method of claim 1, wherein the associated task includes one or more of:

reading the data back, updating a directory, or notifying a user device.

9. The method of claim 1, wherein the facilitating includes one or more of:

issuing read slice requests, for each set of encoded data slices, or receiving additional multicast IP messages that includes a decode threshold number of encoded data slices for decoding to produce recovered data.

10. A computing device of a group of computing devices of a dispersed storage network (DSN), the computing device comprises:

an interface;

a local memory; and

a processing module operably coupled to the interface and the local memory, wherein the processing module functions to;

store data associated with a vault and identify a multicast IP address associated with the vault, where the vault includes a set of encoded data slices for each data segment and where a write threshold number is a minimum number, less than a complete set of the encoded data slices, that is required to successfully write to dispersed storage the data segment to a vault of storage units;

generate and send, by a first DS processing unit, a multicast IP message via a network, to a plurality of storage units of the DSN, wherein the multicast IP message includes the multicast IP address, a plurality of encoded data slices for storage and, for each encoded data slice, a corresponding slice name;

extract, by each of the plurality of storage units receiving the multicast IP message, the multicast IP address;

for the extracted multicast IP address comparing favorably to a subscribed IP address, store in each storage unit of the vault of storage units one or more of the plurality of encoded data slices and a corresponding slice name for each encoded data slice, where each storage unit of the vault of storage units stores, based on the corresponding slice name, a respective encoded data slice associated with that storage unit;

after the storing is completed, each of the plurality of storage units issuing a status multicast IP message;

extracting the multicast IP address of a plurality of received status multicast IP messages comparing favorably to a subscribed IP address and determine, by a second DS processing unit, separate from the first DS processing unit, whether the plurality of received status multicast IP messages indicates successful storage of data in a corresponding vault, wherein the determine step includes indicating that the data has been successfully stored in the vault of storage units when a confirmation of the write threshold number of favorable received status multicast IP messages indicate successful storage of encoded data slices; and

based on the data being successfully stored, facilitate, by the second DS processing unit execution of an associated task.

11. The computing device of claim 10, wherein the extracting includes one or more of:

identifying a multicast IP address field of the multicast IP message or retrieving the multicast IP address from the identified multicast IP address field.

12. The computing device of claim 10, wherein the extracted IP address compares favorably to a subscribed IP address when the extracted IP address is within a range of a subscribed IP address.

13. The computing device of claim 10, wherein the status multicast IP message includes one or more of:

the multicast IP address associated with the vault, a storage unit identifier, one or more of the corresponding slice names, or a status indicator that indicates successful storage of the one or more encoded data slices.

14. The computing device of claim 10, wherein the associated task includes one or more of:

reading the data back, updating a directory, or notifying a user device.

15. A method for execution by one or more processing modules of one or more computing devices of a dispersed storage network (DSN), the method comprises:

storing data associated with a vault, identifying, by a first distributed storage and task (DST) processing unit, a multicast IP address associated with the vault, where the vault includes a set of encoded data slices for each data segment and where a write threshold number is a minimum number, less than a complete set of the encoded data slices, that is required to successfully write to dispersed storage the data segment to a vault of storage units;

generating and sending, by the first DST processing unit, a multicast IP message via a network, to a plurality of storage units of the DSN, wherein the multicast IP message includes the multicast IP address, a plurality of encoded data slices for storage and, for each encoded data slice, a corresponding slice name;

extracting, by each storage unit receiving the multicast IP message, the multicast IP address;

for the extracted multicast IP address comparing favorably to a subscribed IP address, storing, by the storage unit, one or more encoded data slices for storage and a corresponding slice name for each encoded data slice, where each storage unit of the vault of storage units stores, based on the corresponding slice name, a respective encoded data slice associated with that storage unit;

after the storing is completed, each storage unit issuing a status multicast IP message;

extracting the multicast IP address of a plurality of received status multicast IP messages comparing favorably to a subscribed IP address and determining, by a second DST processing unit, separate from the first DST processing unit, whether the plurality of received status multicast IP messages indicates successful storage of data in a corresponding vault, wherein the determining includes indicating that the data has been successfully stored in the vault of storage units when a confirmation of the write threshold number of favorable received status multicast IP messages indicate successful storage of encoded data slices; and

based on the data being successfully stored, facilitating, by the second DST processing unit execution of an associated task.

16. The method of claim 15, wherein the associated task includes one or more of:

reading the data back, updating a directory, or notifying a user device.