Multiple writes using inter-site storage unit relationship

• US 10,394,650 B2
• Filed: 06/03/2016
• Issued: 08/27/2019
• Est. Priority Date: 06/03/2016
• Status: Active Grant

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Dubucq, Thomas, Scholl, Daniel J.
• Primary Examiner(s): Decady, Albert
• Assistant Examiner(s): Ahmed, Enam
• Application Number:
  US15/173,201
• Publication Number:
  US 20170351574A1
• Time in Patent Office: 1,180 Days
• Field of Search: 714764
• CPC Class Codes: G06F 11/1076 Parity data used in redundant arrays of independent storages, e.g. in RAID systems
• CPC Class Codes: G06F 3/061 Improving I/O performance
• CPC Class Codes: G06F 3/0619 in relation to data integrity, e.g. data losses, bit errors
• CPC Class Codes: G06F 3/064 Management of blocks
• CPC Class Codes: G06F 3/067 Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]

Abstract

A method includes utilizing, by a first computing device, a first writing pattern to write a set of encoded data slices to a sharing group of sites. The first writing pattern includes writing a write threshold number of encoded data slices to storage units of a first site and writing a remaining number of encoded data slices to another storage unit(s) in another site(s). The method further includes sending, by storage units of the first site, encoded data slices of up to the write threshold number to other storage units in accordance with an inter-site storage unit relationship. The method further includes, when indicating in the inter-site storage unit relationship, sending, by storage unit(s) of the other site(s), encoded data slices of the remaining number of encoded data slices to other storage units in accordance with the inter-site storage unit relationship.

Claims

1. A method comprises:

determining, by a first computing device of a plurality of computing devices of a dispersed storage network (DSN), whether the first computing device is to write a set of encoded data slices to a sharing group of sites;

in response to a determination by the first computing device to write a set of encoded data slices to a sharing group of sites, utilizing, by the first computing device, a first writing pattern of a plurality of writing patterns to write a set of encoded data slices to a sharing group of sites, wherein each site of the sharing group of sites includes a set of storage units interconnected via a local area network, wherein the first writing pattern includes writing a write threshold number of encoded data slices to storage units of a first site of the sharing group of sites and writing a remaining number of encoded data slices to one or more storage units of one or more other sites of the sharing group of sites, and wherein the first computing device is affiliated with the first site;

sending, by at least some of the storage units of the set of storage units of the first site, one or more copies of encoded data slices of up to the write threshold number of encoded data slices to other storage units in the sharing group of sites in accordance with an inter-site storage unit relationship; and

based on the inter-site storage unit relationship, sending, by the one or more storage units of one or more other sites of the sharing group of sites, one or more copies of encoded data slices of the remaining number of encoded data slices to still other storage units in the sharing group of sites in accordance with the inter-site storage unit relationship, wherein each site of the sharing group of sites stores encoded data slices numbering the write threshold number.

2. The method of claim 1 further comprises:

when a second computing device of the plurality of computing devices of DSN is to write the set of encoded data slices to a sharing group of sites;

utilizing, by the second computing device, a second writing pattern of the plurality of writing patterns to write the set of encoded data slices to the sharing group of sites, wherein the second writing pattern includes writing the write threshold number of encoded data slices to storage units of a second site of the sharing group of sites and writing the remaining number of encoded data slices to one or more storage units of the first site, and wherein the second computing device is affiliated with the second site;

sending, by at least some of the storage units of the set of storage units of the second site, a copy of encoded data slices of up to the write threshold number of encoded data slices to at least some storage units in the first site in accordance with the inter-site storage unit relationship; and

based on the inter-site storage unit relationship, sending, by the one or more storage units of the first site, a copy of encoded data slices of the remaining number of encoded data slices to still other storage units in the sharing group of sites in accordance with the inter-site storage unit relationship, wherein each site of the sharing group of sites stores encoded data slices numbering the write threshold number.

3. The method of claim 2 further comprises:

when a third computing device of the plurality of computing devices of DSN is to write the set of encoded data slices to a sharing group of sites;

utilizing, by the third computing device, a third writing pattern of the plurality of writing patterns to write the set of encoded data slices to the sharing group of sites, wherein the third writing pattern includes writing the write threshold number of encoded data slices to storage units of a third site of the sharing group of sites and writing the remaining number of encoded data slices to one or more storage units of the second site, and wherein the third computing device is affiliated with the third site;

sending, by at least some of the storage units of the set of storage units of the third site, a first copy of encoded data slices of up to the write threshold number of encoded data slices to at least some storage units in the second site in accordance with the inter-site storage unit relationship;

sending, by the storage units of the set of storage units of the third site, a second copy of encoded data slices of the write threshold number of encoded data slices to the storage units in the first site in accordance with the inter-site storage unit relationship; and

based on the inter-site storage unit relationship, sending, by the one or more storage units of the second site, one or more copies of encoded data slices of the remaining number of encoded data slices to still other storage units in the sharing group of sites in accordance with the inter-site storage unit relationship, wherein each site of the sharing group of sites stores encoded data slices numbering the write threshold number.

4. The method of claim 1 further comprises:

selecting, by the first computing device, the first writing pattern of the plurality of writing patterns when the first computing device is operably coupled to a local area network of the first site.

5. The method of claim 1 further comprises:

dispersed storage error encoding a data segment of a data object in accordance with dispersed storage error encoding parameters to produce the set of encoded data slices, wherein the dispersed storage error encoded parameters include a decode threshold number, the write threshold number, and a total number, wherein the decode threshold number corresponds to a minimum number of encoded data slices of the set of encoded data slices needed to recover the data segment, the total number corresponds to a number of encoded data slices in the set of encoded data slices, and wherein the write threshold number is equal or greater than the decode threshold number and less than the total number.

6. The method of claim 5 further comprises:

when the total number is less than two times the decode threshold number;

the first writing pattern including;

writing the write threshold number of encoded data slices to the storage units of the first site, wherein each storage unit of the first site stores at least one encoded data slice of the write threshold number of encoded data slices; and

writing the remaining number of encoded data slices to storage units of the second site, wherein the remaining number equals N−

WT, wherein N corresponds to the total number and WT corresponds to the write threshold number; and

the inter-site storage unit relationship maps storage of 2*WT−

N encoded data slices stored in the storage units of the first site to a corresponding 2*WT−

N number of encoded data slices stored in the storage units of the second site, wherein the corresponding 2*WT−

N number of encoded data slices excludes the remaining number of encoded data slices.

7. The method of claim 5, wherein the inter-site storage unit relationship further maps:

storage of the write threshold number of encoded data slices stored in the storage units of the first site to a corresponding write threshold number of encoded data slices stored in storage units of a third site.

8. The method of claim 5 further comprises:

when the total number is greater than two times the decode threshold number;

the first writing pattern including;

writing a first write threshold number of encoded data slices to the storage units of the first site, wherein each storage unit of the first site stores at least one encoded data slice of the first write threshold number of encoded data slices;

writing a second write threshold number of encoded data slices to the storage units of the second site, wherein each storage unit of the second site stores at least one encoded data slice of the second write threshold number of encoded data slices;

writing the remaining number of encoded data slices to storage units of a third site, wherein the remaining number equals N−

2*WT, and wherein N corresponds to the total number and WT corresponds to the write threshold number; and

the inter-site storage unit relationship maps storage of 3*WT−

N encoded data slices stored the storage units of the first site to a corresponding 3*WT−

N encoded data slices stored in storage units of the third site, wherein the corresponding 3*WT−

N encoded data slices excludes the remaining number of encoded data slices.

9. The method of claim 1 further comprises:

determining the sharing group of sites based on one or more of a look up table, a determination, and a query-response protocol.

10. The method of claim 1 further comprises:

selecting the sharing group of sites from a plurality of sharing groups of sites.

11. A non-transitory computer readable memory device comprises:

a first memory device that stores operational instructions that, when executed by a first computing device of a dispersed storage network (DSN), causes the first computing device to;

determine whether to write a set of encoded data slices to a sharing group of sites;

in response to a determination to write a set of encoded data slices to a sharing group of sites;

utilize, by the first computing device, a first writing pattern of a plurality of writing patterns to write a set of encoded data slices to a sharing group of sites, wherein each site of the sharing group of sites includes a set of storage units interconnected via a local area network, wherein the first writing pattern includes writing a write threshold number of encoded data slices to storage units of a first site of the sharing group of sites and writing a remaining number of encoded data slices to one or more storage units of one or more other sites of the sharing group of sites, and wherein the first computing device is affiliated with the first site;

a second memory device that stores operational instructions that, when executed by at least some of the storage units of the set of storage units of the first site, causes the at least some of the storage units of the set of storage units of the first site to;

send one or more copies of encoded data slices of up to the write threshold number of encoded data slices to other storage units in the sharing group of sites in accordance with an inter-site storage unit relationship; and

a third memory device that stores operational instructions that, when executed by the one or more storage units of one or more other sites of the sharing group of sites, causes the one or more storage units of one or more other sites of the sharing group of sites to;

based on the inter-site storage unit relationship, send one or more copies of encoded data slices of the remaining number of encoded data slices to still other storage units in the sharing group of sites in accordance with the inter-site storage unit relationship, wherein each site of the sharing group of sites stores encoded data slices numbering the write threshold number.

12. The computer readable memory device of claim 11 further comprises:

a fourth memory device that stores operational instructions that, when executed by a second computing device of the DSN, causes the second computing device to;

when a second computing device of the plurality of computing devices of DSN is to write the set of encoded data slices to a sharing group of sites;

utilize a second writing pattern of the plurality of writing patterns to write the set of encoded data slices to the sharing group of sites, wherein the second writing pattern includes writing the write threshold number of encoded data slices to storage units of a second site of the sharing group of sites and writing the remaining number of encoded data slices to one or more storage units of the first site, and wherein the second computing device is affiliated with the second site;

a fifth memory device that stores operational instructions that, when executed by at least some of the storage units of the set of storage units of the second site, causes the at least some of the storage units of the set of storage units of the second site to;

send a copy of encoded data slices of up to the write threshold number of encoded data slices to at least some storage units in the first site in accordance with the inter-site storage unit relationship; and

a sixth memory device that stores operational instructions that, when executed by the one or more storage units of the first site, causes the one or more storage units of the first site to;

based on the inter-site storage unit relationship, send a copy of encoded data slices of the remaining number of encoded data slices to still other storage units in the sharing group of sites in accordance with the inter-site storage unit relationship, wherein each site of the sharing group of sites stores encoded data slices numbering the write threshold number.

13. The computer readable memory device of claim 11 further comprises:

a seventh memory device that stores operational instructions that, when executed by a third computing device of the DSN, causes the third computing device to;

when a third computing device of the plurality of computing devices of DSN is to write the set of encoded data slices to a sharing group of sites;

utilize a third writing pattern of the plurality of writing patterns to write the set of encoded data slices to the sharing group of sites, wherein the third writing pattern includes writing the write threshold number of encoded data slices to storage units of a third site of the sharing group of sites and writing the remaining number of encoded data slices to one or more storage units of the second site, and wherein the third computing device is affiliated with the third site;

an eighth memory device that stores operational instructions that, when executed by at least some of the storage units of the set of storage units of the third site, causes the at least some of the storage units of the set of storage units of the third site to;

send a first copy of encoded data slices of up to the write threshold number of encoded data slices to at least some storage units in the second site in accordance with the inter-site storage unit relationship;

a ninth memory device that stores operational instructions that, when executed by the storage units of the set of storage units of the third site, causes the storage units of the set of storage units of the third site to;

send a second copy of encoded data slices of the write threshold number of encoded data slices to the storage units in the first site in accordance with the inter-site storage unit relationship; and

a tenth memory device that stores operational instructions that, when executed by the one or more storage units of the second site, causes the one or more storage units of the second site to;

based on the inter-site storage unit relationship, send one or more copies of encoded data slices of the remaining number of encoded data slices to still other storage units in the sharing group of sites in accordance with the inter-site storage unit relationship, wherein each site of the sharing group of sites stores encoded data slices numbering the write threshold number.

14. The computer readable memory device of claim 11, wherein the first memory device further stores operational instructions that, when executed by the first computing device, causes the first computing device to:

select the first writing pattern of the plurality of writing patterns when the first computing device is operably coupled to a local area network of the first site.

15. The computer readable memory device of claim 11, wherein the first memory device further stores operational instructions that, when executed by the first computing device, causes the first computing device to:

dispersed storage error encode a data segment of a data object in accordance with dispersed storage error encoding parameters to produce the set of encoded data slices, wherein the dispersed storage error encoded parameters include a decode threshold number, the write threshold number, and a total number, wherein the decode threshold number corresponds to a minimum number of encoded data slices of the set of encoded data slices needed to recover the data segment, the total number corresponds to a number of encoded data slices in the set of encoded data slices, and wherein the write threshold number is equal or greater than the decode threshold number and less than the total number.

16. The computer readable memory device of claim 15 further comprises:

when the total number is less than two times the decode threshold number;

the first writing pattern including;

writing the write threshold number of encoded data slices to the storage units of the first site, wherein each storage unit of the first site stores at least one encoded data slice of the write threshold number of encoded data slices; and

writing the remaining number of encoded data slices to storage units of the second site, wherein the remaining number equals N−

WT, wherein N corresponds to the total number and WT corresponds to the write threshold number; and

the inter-site storage unit relationship maps storage of 2*WT−

N encoded data slices stored in the storage units of the first site to a corresponding 2*WT−

N number of encoded data slices stored in the storage units of the second site, wherein the corresponding 2*WT−

N number of encoded data slices excludes the remaining number of encoded data slices.

17. The computer readable memory device of claim 15 further comprises:

the inter-site storage units relationship further mapping storage of the write threshold number of encoded data slices stored in the storage units of the first site to a corresponding write threshold number of encoded data slices stored in storage units of a third site.

18. The computer readable memory device of claim 15 further comprises:

when the total number is greater than two times the decode threshold number;

the first writing pattern including;

writing a first write threshold number of encoded data slices to the storage units of the first site, wherein each storage unit of the first site stores at least one encoded data slice of the first write threshold number of encoded data slices;

writing a second write threshold number of encoded data slices to the storage units of the second site, wherein each storage unit of the second site stores at least one encoded data slice of the second write threshold number of encoded data slices;

writing the remaining number of encoded data slices to storage units of a third site, wherein the remaining number equals N−

2*WT, and wherein N corresponds to the total number and WT corresponds to the write threshold number; and

the inter-site storage unit relationship maps storage of 3*WT−

N encoded data slices stored the storage units of the first site to a corresponding 3*WT−

N encoded data slices stored in storage units of the third site, wherein the corresponding 3*WT−

N encoded data slices excludes the remaining number of encoded data slices.

19. The computer readable memory device of claim 11, wherein the first memory device further stores operational instructions that, when executed by the first computing device, causes the first computing device to:

determine the sharing group of sites based on one or more of a look up table, a determination, and a query-response protocol.

20. The computer readable memory device of claim 11, wherein the first memory device further stores operational instructions that, when executed by the first computing device, causes the first computing device to:

select the sharing group of sites from a plurality of sharing groups of sites.