REDISTRIBUTING ENCODED DATA SLICES IN A DISPERSED STORAGE NETWORK

• US 20180373459A1
• Filed: 08/24/2018
• Published: 12/27/2018
• Est. Priority Date: 12/31/2014
• Status: Abandoned Application

• Current Assignee: Pure Storage, Inc.
• Original Assignee: International Business Machines Corporation
• Inventors: Resch, Jason K., Leggette, Wesley B., Motwani, Manish
• Application Number:
  US16/112,377
• Publication Number:
  US 20180373459A1
• Time in Patent Office: Days
• CPC Class Codes: G06F 3/0604 Improving or facilitating administration, e.g. storage management
• CPC Class Codes: G06F 3/0644 Management of space entities, e.g. partitions, extents, pools
• CPC Class Codes: G06F 3/0647 Migration mechanisms
• CPC Class Codes: G06F 3/067 Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]

Abstract

A method begins by storage units of a first pool of storage units of a plurality of pools detecting a change to a weighting factor of a pool of storage units and calculating an updated plurality of storage pool scores for a respective encoded data slice of a set of encoded data slices that is stored by a respective storage unit of the first pool of storage units. The method continues with each of the storage units of the first pool of storage units identifying one pool of storage units having a desired storage pool score based on the updated plurality of storage pool scores. When the one pool of storage units is not the first pool of storage units, each of the storage units of the first pool of storage units transfers the respective encoded data slice to a corresponding storage unit of the one pool of storage units.

Claims

1. A storage unit (SU) of a first pool of storage units (SUs) of a plurality of pools of SUs, the SU comprising:

an interface configured to interface and communicate with a dispersed or distributed storage network (DSN);

memory that stores operational instructions; and

processing circuitry operably coupled to the interface and to the memory, wherein the processing circuitry is configured to execute the operational instructions to;

detect a change of a weighting factor of a second pool of SUs;

calculate an updated plurality of storage pool scores of the plurality of pools of SUs for a respective encoded data slice (EDS) of a set of encoded data slices (EDSs) that is currently stored by the SU of the first pool of SUs of the first pool of SUs and that is based on a decentralized agreement protocol function;

identify, from a plurality pools of SUs implemented within a dispersed storage network (DSN) that includes the first pool of SUs and the second pool of SUs, another pool of SUs having a desired storage pool score based on the updated plurality of storage pool scores that is based on the decentralized agreement protocol function;

determine whether the another pool of SUs is the first pool of SUs; and

based on a determination that the another pool of SUs is not the first pool of SUs, transfer, via the interface, the respective EDS of the set of EDSs that is currently stored by the SU of the first pool of SUs to another SU of the another pool of SUs.

2. The SU of claim 1, wherein another pool of SUs is the second pool of SUs.

3. The SU of claim 1, wherein the processing circuitry is further configured to execute the operational instructions to:

based on another determination that the another pool of SUs is the first pool of SUs, maintain storage of the respective EDS of the set of EDSs that is currently stored by the SU of the first pool of SUs.

4. The SU of claim 1, wherein the processing circuitry is further configured to execute the operational instructions to:

delete the respective EDS of the set of EDSs that is currently stored by the SU of the first pool of SUs after successful transfer thereof to the another SU of the another pool of SUs.

5. The SU of claim 1, wherein the change of the weighting factor of the second pool of SUs is based on a change of memory capabilities of at least one SU of the second pool of SUs.

6. The SU of claim 1, wherein the processing circuitry is further configured to execute the operational instructions to:

receive, via the interface and from one or more SUs of the second pool of SUs, an updated storage pool score of the second pool of SUs is based on a changed weighting factor of the second pool of SUs that is determined by the one or more SUs of the second pool of SUs.

7. The SU of claim 1, wherein at least one of:

the first pool of SUs includes a first one or more SUs;

the second pool of SUs includes a second one or more SUs;

or

the another pool of SUs includes another one or more SUs.

8. The SU of claim 1, wherein the DSN includes at least one of a wireless communication system, a wire lined communication system, a private intranet system, a public internet system, a local area network (LAN), or a wide area network (WAN).

9. A storage unit (SU) of a first pool of storage units (SUs) of a plurality of pools of SUs, the SU comprising:

an interface configured to interface and communicate with a dispersed or distributed storage network (DSN);

memory that stores operational instructions; and

processing circuitry operably coupled to the interface and to the memory, wherein the processing circuitry is configured to execute the operational instructions to;

detect a change of a weighting factor of a second pool of SUs based on a change of memory capabilities of at least one SU of the second pool of SUs;

calculate an updated plurality of storage pool scores of the plurality of pools of SUs for a respective encoded data slice (EDS) of a set of encoded data slices (EDSs) that is currently stored by the SU of the first pool of SUs of the first pool of SUs and that is based on a decentralized agreement protocol function;

identify, from a plurality pools of SUs implemented within a dispersed storage network (DSN) that includes the first pool of SUs and the second pool of SUs, another pool of SUs having a desired storage pool score based on the updated plurality of storage pool scores that is based on the decentralized agreement protocol function;

determine whether the another pool of SUs is the first pool of SUs; and

based on a determination that the another pool of SUs is not the first pool of SUs;

transfer, via the interface, the respective EDS of the set of EDSs that is currently stored by the SU of the first pool of SUs to another SU of the another pool of SUs; and

delete the respective EDS of the set of EDSs that is currently stored by the SU of the first pool of SUs after successful transfer thereof to the another SU of the another pool of SUs.

10. The SU of claim 9, wherein the processing circuitry is further configured to execute the operational instructions to:

based on another determination that the another pool of SUs is the first pool of SUs, maintain storage of the respective EDS of the set of EDSs that is currently stored by the SU of the first pool of SUs.

11. The SU of claim 9, wherein the processing circuitry is further configured to execute the operational instructions to:

receive, via the interface and from one or more SUs of the second pool of SUs, an updated storage pool score of the second pool of SUs is based on a changed weighting factor of the second pool of SUs that is determined by the one or more SUs of the second pool of SUs.

12. The SU of claim 9, wherein at least one of:

the first pool of SUs includes a first one or more SUs;

the second pool of SUs includes a second one or more SUs;

or

the another pool of SUs includes another one or more SUs.

13. The SU of claim 9, wherein the DSN includes at least one of a wireless communication system, a wire lined communication system, a private intranet system, a public internet system, a local area network (LAN), or a wide area network (WAN).

14. A method for execution by a storage unit (SU) of a first pool of storage units (SUs) of a plurality of pools of SUs, the method comprising:

detecting a change of a weighting factor of a second pool of SUs;

calculating an updated plurality of storage pool scores of the plurality of pools of SUs for a respective encoded data slice (EDS) of a set of encoded data slices (EDSs) that is currently stored by the SU of the first pool of SUs of the first pool of SUs and that is based on a decentralized agreement protocol function;

identifying, from a plurality pools of SUs implemented within a dispersed storage network (DSN) that includes the first pool of SUs and the second pool of SUs, another pool of SUs having a desired storage pool score based on the updated plurality of storage pool scores that is based on the decentralized agreement protocol function;

determining whether the another pool of SUs is the first pool of SUs; and

based on a determination that the another pool of SUs is not the first pool of SUs, transferring, via an interface of the SU that is configured to interface and communicate with the DSN, the respective EDS of the set of EDSs that is currently stored by the SU of the first pool of SUs to another SU of the another pool of SUs.

15. The method of claim 14, wherein another pool of SUs is the second pool of SUs.

16. The method of claim 14 further comprising:

based on another determination that the another pool of SUs is the first pool of SUs, maintaining storage of the respective EDS of the set of EDSs that is currently stored by the SU of the first pool of SUs.

17. The method of claim 14 further comprising:

deleting the respective EDS of the set of EDSs that is currently stored by the SU of the first pool of SUs after successful transfer thereof to the another SU of the another pool of SUs.

18. The method of claim 14, wherein the change of the weighting factor of the second pool of SUs is based on a change of memory capabilities of at least one SU of the second pool of SUs.

19. The method of claim 14 further comprising:

receive, via the interface and from one or more SUs of the second pool of SUs, an updated storage pool score of the second pool of SUs is based on a changed weighting factor of the second pool of SUs that is determined by the one or more SUs of the second pool of SUs.

20. The method of claim 14, wherein at least one of:

the first pool of SUs includes a first one or more SUs;

the second pool of SUs includes a second one or more SUs;

the another pool of SUs includes another one or more SUs;

or

the DSN includes at least one of a wireless communication system, a wire lined communication system, a private intranet system, a public interne system, a local area network (LAN), or a wide area network (WAN).