Entity registration in multiple dispersed storage networks

• US 10,412,165 B2
• Filed: 05/27/2016
• Issued: 09/10/2019
• Est. Priority Date: 05/19/2010
• Status: Active Grant

• Current Assignee: Pure Storage, Inc.
• Original Assignee: Pure Storage, Inc.
• Inventors: Resch, Jason K., Grube, Gary W., Markison, Timothy W.
• Primary Examiner(s): Tolentino, Roderick
• Application Number:
  US15/167,482
• Publication Number:
  US 20160277502A1
• Time in Patent Office: 1,201 Days
• Field of Search: 726 2- 4, 726 26- 30
• CPC Class Codes: G06F 11/1092 Rebuilding, e.g. when physically replacing a failing disk
• CPC Class Codes: G06F 11/2094 Redundant storage or storage space G06F11/2056 takes precedence
• CPC Class Codes: G06F 2211/1028 Distributed, i.e. distributed RAID systems with parity
• CPC Class Codes: H04L 67/1097 for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
• CPC Class Codes: H04L 67/52 specially adapted for the location of the user terminal

Abstract

A method includes obtaining a set of encoded data slices for storage. The method further includes selecting, based factor(s) from a set of factors, one or more of a local vault, a regional vault, and a global vault for storing the set of encoded data slices. The method further includes determining, based on at least one factor from the set of factors, a number of copies of the set of encoded data slices for storing in each vault of the vault selection. The method further includes identifying “Z” number of sets of storage units for storing the number of copies of the set of encoded data slices, wherein “Z” is equal to a number of vaults times the number of copies. The method further includes sending the number of copies of the set of encoded data slices to the Z number of sets of storage units.

Claims

1. A method for execution by a computing device associated a with a storage system that includes a plurality of dispersed storage networks (DSN), the method comprises:

obtaining a set of encoded data slices for storage in the storage system, wherein a data segment of data is dispersed storage error encoded by utilizing a dispersed storage error encoding function to produce the set of encoded data slices, wherein the dispersed storage error encoding function utilizes a first set of dispersal parameters that includes a decode threshold parameter indicating a decode threshold number;

producing a vault selection by selecting, based on one or more factors from a set of factors, one or more of a local vault, a regional vault, and a global vault for storing the set of encoded data slices, wherein the vault selection includes a plurality of selected vaults;

determining, based on at least one factor from the set of factors, a number “

N”

, wherein the number “

N”

corresponds to an equal number of copies of the set of encoded data slices to be stored in each of the plurality of selected vaults of the vault selection, and wherein the number “

N”

is greater than one;

identifying “

Z”

number of sets of storage units for storing copies of the set of encoded data slices, wherein the “

Z”

number is equal to a number of vaults corresponding to the plurality of selected vaults of the vault selection times the number “

N”

, wherein each of a plurality of subsets of sets of storage units of the “

Z”

number of sets correspond to each of the plurality of selected vaults, wherein each of the plurality of subsets are mutually exclusive and collectively exhaustive with respect to the “

Z”

number of sets, and wherein each of the plurality of subsets includes “

N”

sets of storage units;

generating “

Z”

number of copies of the set of encoded data slices;

sending the “

Z”

number of copies of the set of encoded data slices to the “

Z”

number of sets of storage units;

obtaining a read operation for the data segment;

determining a set of retrieval storage units of the “

Z”

number of sets of storage units for retrieval of the set of encoded data slices, wherein a first subset of the set of retrieval storage units is a proper subset of the first one of the plurality of subsets of sets of storage units of the “

Z”

number of sets corresponding to a first one of the plurality of selected vaults, wherein a second subset of the set of retrieval storage units is a proper subset of the second one of the plurality of subsets of sets of storage units of the “

Z”

number of sets corresponding to a second one of the plurality of selected vaults, wherein a size of the first subset of the set of retrieval storage units is less than the decode threshold number, wherein a size of the second subset of the set of retrieval storage units is less than the decode threshold number, and wherein a size of the set of retrieval storage units is at least the decode threshold number;

sending a set of read requests to the set of retrieval storage units regarding the read operation;

retrieving a proper subset of the set of encoded data slices from the set of storage units, wherein the proper subset includes at least the decode threshold number of encoded data slices; and

recovering the data segment by dispersed storage error decoding the proper subset of the set of encoded slices.

2. The method of claim 1, wherein the set of factors comprises:

reliability of storage of the set of encoded data slices;

estimated data access rate of the set of encoded data slices;

actual data access rate of the set of encoded data slices;

latency of one or more storage units in the Z number of sets of storage units;

geographic location of data accessing computing devices;

metadata associated with the set of encoded data slices; and

metadata associated with one or more storage units of the Z number of sets of storage units.

3. The method of claim 1, wherein the sending the “

Z”

number of copies of the set of encoded data slices to the Z number of sets of storage units comprises;

sending a first copy of the set of encoded data slices to a first set of storage units of the Z number of sets of storage units, wherein the first set of storage units is associated with the first one of the plurality of selected vaults of the vault selection; and

sending a second copy of the set of encoded data slices to a second set of storage units of the Z number of sets of storage units, wherein the second set of storage units is associated with the second one of the plurality of selected vaults of the vault selection.

4. The method of claim 1 further comprises:

selecting a factor from the set of factors for the read operation to produce a selected factor;

selecting, based on the selected factor, the first one of the plurality of selected vaults and the second one of the plurality of selected vaults from the plurality of selected vaults for retrieval of the data segment;

selecting the proper subset of the first one of the plurality of subsets of sets of storage units of the “

Z”

number of sets corresponding to a first one of the plurality of selected vaults by selecting storage units of the first one of the plurality of subsets that are determined to have favorable estimated performance; and

selecting the proper subset of the second one of the plurality of subsets of sets of storage units of the “

Z”

number of sets corresponding to the second one of the plurality of selected vaults for retrieval of the data segment by selecting storage units of the second one of the plurality of subsets that are determined to have favorable estimated performance.

5. The method of claim 1, wherein the first set of dispersal parameters for the dispersed storage error encoding function further includes a pillar width parameter indicating a first pillar width number, a write threshold parameter indicating a first write threshold number, and a read threshold parameter indicating a first read threshold number, further comprising:

determining a second set of dispersal parameters, wherein the second set of dispersal parameters includes the decode threshold parameter indicating the decode threshold number, the pillar width parameter indicating a second pillar width number, a write threshold parameter indicating a second write threshold number, and a read threshold parameter indicating a second read threshold number, wherein at least one of;

the second pillar width number is different from the first pillar width number, the second write threshold number is different from the first write threshold number;

or the second read threshold number is different from the first read threshold number;

designating the set of encoded data slices generated by utilizing the first set of dispersal parameters for storage in the first one of the plurality of selected vaults;

generating a set of copies of the set of encoded data slices by utilizing the second set of dispersal parameters to perform the dispersed storage error encoding function on the data segment; and

designating the set of copies of the set of encoded data slices for storage in the second one of the plurality of selected vaults.

6. A computing device comprises:

an interface;

memory; and

a processing module operably coupled to the interface and to the memory, wherein the processing module is operable to;

obtain a set of encoded data slices for storage in a storage system, wherein a data segment of data is dispersed storage error encoded by utilizing a dispersed storage error encoding function to produce the set of encoded data slices, wherein the dispersed storage error encoding function utilizes a first set of dispersal parameters that includes a decode threshold parameter indicating a decode threshold number;

produce a vault selection by selecting, based on one or more factors from a set of factors, one or more of a local vault, a regional vault, and a global vault for storing the set of encoded data slices, wherein the vault selection includes a plurality of selected vaults;

determine, based on at least one factor from the set of factors, a number “

N”

, wherein the number “

N”

corresponds to an equal number of copies of the set of encoded data slices to be stored in each of the plurality of selected vaults of the vault selection, and wherein the number “

N”

is greater than one;

identify “

Z”

number of sets of storage units for storing copies of the set of encoded data slices, wherein the “

Z”

number is equal to a number of vaults corresponding to the plurality selected of vaults of the vault selection times the number “

N”

, wherein each of a plurality of subsets of sets of storage units of the “

Z”

number of sets correspond to each of the plurality of selected vaults, wherein each of the plurality of subsets are mutually exclusive and collectively exhaustive with respect to the “

Z”

number of sets, and wherein each of the plurality of subsets includes “

N”

sets of storage units;

generate “

Z”

number of copies of the set of encoded data slices;

send the “

Z”

number of copies of the set of encoded data slices to the “

Z”

number of sets of storage units;

obtain a read operation for the data segment;

determine a set of retrieval storage units of the “

Z”

number of sets of storage units for retrieval of the set of encoded data slices, wherein a first subset of the set of retrieval storage units is a proper subset of the first one of the plurality of subsets of sets of storage units of the “

Z”

number of sets corresponding to a first one of the plurality of selected vaults, wherein a second subset of the set of retrieval storage units is a proper subset of the second one of the plurality of subsets of sets of storage units of the “

Z”

number of sets corresponding to a second one of the plurality of selected vaults, wherein a size of the first subset of the set of retrieval storage units is less than the decode threshold number, wherein a size of the second subset of the set of retrieval storage units is less than the decode threshold number, and wherein a size of the set of retrieval storage units is at least the decode threshold number;

send a set of read requests to the set of retrieval storage units regarding the read operation;

retrieve a proper subset of the set of encoded data slices from the set of storage units, wherein the proper subset includes at least the decode threshold number of encoded data slices; and

recover the data segment by dispersed storage error decoding the proper subset of the set of encoded slices.

7. The computing device of claim 6, wherein the set of factors comprises:

reliability of storage of the set of encoded data slices;

estimated data access rate of the set of encoded data slices;

actual data access rate of the set of encoded data slices;

latency of one or more storage units in the Z number sets of storage units;

geographic location of data accessing computing devices;

metadata associated with the set of encoded data slices; and

metadata associated with one or more storage units of the Z number of sets of storage units.

8. The computing device of claim 6, wherein the sending the “

Z”

number of copies of the set of encoded data slices to the Z number of sets of storage units comprises;

sending a first copy of the set of encoded data slices to a first set of storage units of the Z number of sets of storage units, wherein the first set of storage units is associated with the first one of the plurality of selected vaults of the vault selection; and

sending a second copy of the set of encoded data slices to a second set of storage units of the Z number of sets of storage units, wherein the second set of storage units is associated with the second one of the plurality of selected vaults of the vault selection.

9. The computing device of claim 6, wherein the processing module is further operable to:

selecting a factor from the set of factors for the read operation to produce a selected factor;

select, based on the selected factor, the first one of the plurality of selected vaults and the second one of the plurality of selected vaults from the plurality of selected vaults for retrieval of the data segment;

select the proper subset of the first one of the plurality of subsets of sets of storage units of the “

Z”

number of sets corresponding to a first one of the plurality of selected vaults by selecting storage units of the first one of the plurality of subsets that are determined to have favorable estimated performance; and

select the proper subset of the second one of the plurality of subsets of sets of storage units of the “

Z”

number of sets corresponding to the second one of the plurality of selected vaults for retrieval of the data segment by selecting storage units of the second one of the plurality of subsets that are determined to have favorable estimated performance.

10. The computing device of claim 6, wherein the first set of dispersal parameters for the dispersed storage error encoding function further includes a pillar width parameter indicating a first pillar width number, a write threshold parameter indicating a first write threshold number, and a read threshold parameter indicating a first read threshold number, and wherein the processing module is further operable to:

determine a second set of dispersal parameters, wherein the second set of dispersal parameters includes the decode threshold parameter indicating the decode threshold number, the pillar width parameter indicating a second pillar width number, a write threshold parameter indicating a second write threshold number, and a read threshold parameter indicating a second read threshold number, wherein at least one of;

the second pillar width number is different from the first pillar width number, the second write threshold number is different from the first write threshold number;

or the second read threshold number is different from the first read threshold number;

designate the set of encoded data slices generated by utilizing the first set of dispersal parameters for storage in the first one of the plurality of selected vaults;

generate a set of copies of the set of encoded data slices by utilizing the second set of dispersal parameters to perform the dispersed storage error encoding function on the data segment; and

designate the set of copies of the set of encoded data slices for storage in the second one of the plurality of selected vaults.

11. A computer readable memory comprises:

a first memory element that stores operational instructions that, when executed by a computing device, causes the computing device to;

obtain a set of encoded data slices for storage in a storage system, wherein a data segment of data is dispersed storage error encoded by utilizing a dispersed storage error encoding function to produce the set of encoded data slices, wherein the dispersed storage error encoding function utilizes a first set of dispersal parameters that includes a decode threshold parameter indicating a decode threshold number; and

a second memory element that stores operational instructions that, when executed by the computing device, causes the computing device to;

produce a vault selection by selecting, based on one or more factors from a set of factors, one or more of a local vault, a regional vault, and a global vault for storing the set of encoded data slices, wherein the vault selection includes a plurality of selected vaults;

determine, based on at least one factor from the set of factors, a number “

N”

, wherein the number “

N”

corresponds to an equal number of copies of the set of encoded data slices to be stored in each of the plurality of selected vaults of the vault selection, and wherein the number “

N”

is greater than one;

identify “

Z”

number of sets of storage units for storing copies of the set of encoded data slices, wherein the “

Z”

number is equal to a number of vaults corresponding to the plurality of selected vaults of the vault selection times the number “

N”

, wherein each of a plurality of subsets of sets of storage units of the “

Z”

number of sets correspond to each of the plurality of selected vaults, wherein each of the plurality of subsets are mutually exclusive and collectively exhaustive with respect to the “

Z”

number of sets, and wherein each of the plurality of subsets includes “

N”

sets of storage units;

generate “

Z”

number of copies of the set of encoded data slices; and

a third memory element that stores operational instructions that, when executed by the computing device, causes the computing device to;

send the “

Z”

number of copies of the set of encoded data slices to the “

Z”

number of sets of storage units; and

a fourth memory element that stores operational instructions that, when executed by the computing device, causes the computing device to;

obtain a read operation for the data segment;

determine a set of retrieval storage units of the “

Z”

number of sets of storage units for retrieval of the set of encoded data slices, wherein a first subset of the set of retrieval storage units is a proper subset of the first one of the plurality of subsets of sets of storage units of the “

Z”

number of sets corresponding to a first one of the plurality of selected vaults, wherein a second subset of the set of retrieval storage units is a proper subset of the second one of the plurality of subsets of sets of storage units of the “

Z”

number of sets corresponding to a second one of the plurality of selected vaults, wherein a size of the first subset of the set of retrieval storage units is less than the decode threshold number, wherein a size of the second subset of the set of retrieval storage units is less than the decode threshold number, and wherein a size of the set of retrieval storage units is at least the decode threshold number;

send a set of read requests to the set of retrieval storage units regarding the read operation;

retrieve a proper subset of the set of encoded data slices from the set of storage units, wherein the proper subset includes at least the decode threshold number of encoded data slices; and

recover the data segment by dispersed storage error decoding the proper subset of the set of encoded slices.

12. The computer readable memory of claim 11, wherein the set of factors comprises:

reliability of storage of the set of encoded data slices;

estimated data access rate of the set of encoded data slices;

actual data access rate of the set of encoded data slices;

latency of one or more storage units in the Z number of sets of storage units;

geographic location of data accessing computing devices;

metadata associated with the set of encoded data slices; and

metadata associated with one or more storage units of the Z number of sets of storage units.

13. The computer readable memory of claim 11, wherein the sending the “

Z”

number of copies of the set of encoded data slices to the Z number of sets of storage units comprises;

sending a first copy of the set of encoded data slices to a first set of storage units of the Z number of sets of storage units, wherein the first set of storage units is associated with the second one of the plurality of selected vaults of the vault selection; and

sending a second copy of the set of encoded data slices to a second set of storage units of the Z number of sets of storage units, wherein the second set of storage units is associated the second one of the plurality of selected vaults of the vault selection.

14. The computer readable memory of claim 11, wherein the operational instructions, when executed by the computing device, further cause the computing device to:

selecting a factor from the set of factors for the read operation to produce a selected factor;

select, based on the selected factor, the first one of the plurality of selected vaults and the second one of the plurality of selected vaults from the plurality of selected vaults for retrieval of the data segment;

select the proper subset of the first one of the plurality of subsets of sets of storage units of the “

Z”

number of sets corresponding to a first one of the plurality of selected vaults by selecting storage units of the first one of the plurality of subsets that are determined to have favorable estimated performance; and

select the proper subset of the second one of the plurality of subsets of sets of storage units of the “

Z”

number of sets corresponding to the second one of the plurality of selected vaults for retrieval of the data segment by selecting storage units of the second one of the plurality of subsets that are determined to have favorable estimated performance.

15. The computer readable memory of claim 11, wherein the first set of dispersal parameters for the dispersed storage error encoding function further includes a pillar width parameter indicating a first pillar width number, a write threshold parameter indicating a first write threshold number, and a read threshold parameter indicating a first read threshold number, and wherein the operational instructions, when executed by the computing device, further cause the computing device to:

determine a second set of dispersal parameters, wherein the second set of dispersal parameters includes the decode threshold parameter indicating the decode threshold number, the pillar width parameter indicating a second pillar width number, a write threshold parameter indicating a second write threshold number, and a read threshold parameter indicating a second read threshold number, wherein at least one of;

the second pillar width number is different from the first pillar width number, the second write threshold number is different from the first write threshold number;

or the second read threshold number is different from the first read threshold number;

designate the set of encoded data slices generated by utilizing the first set of dispersal parameters for storage in the first one of the plurality of selected vaults;

generate a set of copies of the set of encoded data slices by utilizing the second set of dispersal parameters to perform the dispersed storage error encoding function on the data segment; and

designate the set of copies of the set of encoded data slices for storage in the second one of the plurality of selected vaults.