Reallocation in a dispersed storage network (DSN)

• US 10,169,153 B2
• Filed: 01/26/2018
• Issued: 01/01/2019
• Est. Priority Date: 10/30/2015
• Status: Active Grant

• Current Assignee: Pure Storage, Inc.
• Original Assignee: International Business Machines Corporation
• Inventors: Abhijeet, Kumar, Motwani, Manish, Resch, Jason K., Wozniak, Ethan S.
• Primary Examiner(s): Knapp, Justin R
• Application Number:
  US15/881,366
• Publication Number:
  US 20180150355A1
• Time in Patent Office: 340 Days
• Field of Search: None
• CPC Class Codes: G06F 11/1092 Rebuilding, e.g. when physically replacing a failing disk
• CPC Class Codes: G06F 11/2094 Redundant storage or storage space G06F11/2056 takes precedence
• CPC Class Codes: G06F 2201/805 Real-time
• CPC Class Codes: G06F 3/0604 Improving or facilitating administration, e.g. storage management
• CPC Class Codes: G06F 3/061 Improving I/O performance
• CPC Class Codes: G06F 3/0611 in relation to response time
• CPC Class Codes: G06F 3/0619 in relation to data integrity, e.g. data losses, bit errors
• CPC Class Codes: G06F 3/0635 by changing the path, e.g. traffic rerouting, path reconfiguration
• CPC Class Codes: G06F 3/064 Management of blocks
• CPC Class Codes: G06F 3/0659 Command handling arrangements, e.g. command buffers, queues, command scheduling
• CPC Class Codes: G06F 3/0665 at area level, e.g. provisioning of virtual or logical volumes
• CPC Class Codes: G06F 3/067 Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
• CPC Class Codes: G06F 3/0689 Disk arrays, e.g. RAID, JBOD
• CPC Class Codes: H03M 13/1515 Reed-Solomon codes
• CPC Class Codes: H03M 13/3761 using code combining, i.e. using combining of codeword portions which may have been transmitted separately, e.g. Digital Fountain codes, Raptor codes or Luby Transform [LT] codes
• CPC Class Codes: H04L 43/0864 Round trip delays
• CPC Class Codes: H04L 43/0876 Network utilisation, e.g. volume of load or congestion level
• CPC Class Codes: H04L 43/16 Threshold monitoring
• CPC Class Codes: H04L 67/1008 based on parameters of servers, e.g. available memory or workload monitoring of computer activity G06F11/30
• CPC Class Codes: H04L 67/1097 for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]

Abstract

A computing device includes an interface configured to interface and communicate with a dispersed storage network (DSN), a memory that stores operational instructions, and a processing module operably coupled to the interface and memory such that the processing module, when operable within the computing device based on the operational instructions, is configured to perform various operations. When a is to DSN undergo a change from a first system configuration of a Decentralized, or Distributed, Agreement Protocol (DAP) to a second system configuration of the DAP (e.g., such as based on addition, and/or removal of storage unit(s) (SU(s)) within the DSN or reallocation of data within the DSN, etc.), a computing device identifies a DAP transition mapping between the first system configuration of the DAP to the second system configuration of the DAP. Then, the computing device directs SU(s) to operate based on the DAP transition mapping during the transition.

Claims

1. A computing device comprising:

an interface configured to interface and communicate with a dispersed storage network (DSN);

memory that stores operational instructions; and

a processing module operably coupled to the interface and to the memory, wherein the processing module, when operable within the computing device based on the operational instructions, is configured to;

within a dispersed or distributed storage network (DSN) that includes a plurality of storage units (SUs) that distributedly store a set of encoded data slices (EDSs) associated with a data object, during a transition from a first system configuration of a Decentralized, or Distributed, Agreement Protocol (DAP) to a second system configuration of the DAP, direct at least one SU of the plurality of SUs to service a data access request based on at least one EDS of the set of EDSs based on a DAP transition mapping between the first system configuration of the DAP to the second system configuration of the DAP, wherein the data object is segmented into a plurality of data segments, wherein a data segment of the plurality of data segments is dispersed error encoded in accordance with dispersed error encoding parameters to produce the set of EDSs.

2. The computing device of claim 1, wherein the processing module, when operable within the computing device based on the operational instructions, is further configured to:

direct the at least one SU to service another data access request based on the at least one EDS of the set of EDSs or another EDS of the set of EDSs based on the second system configuration of the DAP after completion of the transition from the first system configuration of the DAP to the second system configuration of the DAP.

3. The computing device of claim 2, wherein at least one of:

the data access request includes a first read request or a first write request;

or

the another data access request includes a second read request or a second write request.

4. The computing device of claim 1, wherein the processing module, when operable within the computing device based on the operational instructions, is further configured to:

detect a change within the DSN from the first system configuration of the DAP to the second system configuration of the DAP based on at least one of addition or removal of at least one SU within a plurality of SUs within the DSN or reallocation of data within the DSN.

5. The computing device of claim 1, wherein the processing module, when operable within the computing device based on the operational instructions, is further configured to:

direct the at least one SU of the plurality of SUs to service the data access request based on the at least one EDS of the set of EDSs based on the DAP transition mapping between the first system configuration of the DAP to the second system configuration of the DAP when performed on a data object-by-data object basis, an EDS set-by-EDS set basis, or a vault-by-vault basis.

6. The computing device of claim 1, wherein the computing device is located at a first premises that is remotely located from at least one SU of the plurality of SUs within the DSN.

7. The computing device of claim 1 further comprising:

a SU of the plurality of SUs within the DSN, a wireless smart phone, a laptop, a tablet, a personal computers (PC), a work station, or a video game device.

8. The computing device of claim 1, wherein the DSN includes at least one of a wireless communication system, a wire lined communication system, a non-public intranet system, a public internet system, a local area network (LAN), or a wide area network (WAN).

9. A computing device comprising:

an interface configured to interface and communicate with a dispersed storage network (DSN);

memory that stores operational instructions; and

a processing module operably coupled to the interface and to the memory, wherein the processing module, when operable within the computing device based on the operational instructions, is configured to;

within a dispersed or distributed storage network (DSN) that includes a plurality of storage units (SUs) that distributedly store a set of encoded data slices (EDSs) associated with a data object, during a transition from a first system configuration of a Decentralized, or Distributed, Agreement Protocol (DAP) to a second system configuration of the DAP, direct at least one SU of the plurality of SUs to service a first data access request that includes a first read request or a first write request based on at least one EDS of the set of EDSs based on a DAP transition mapping between the first system configuration of the DAP to the second system configuration of the DAP, wherein the data object is segmented into a plurality of data segments, wherein a data segment of the plurality of data segments is dispersed error encoded in accordance with dispersed error encoding parameters to produce the set of EDSs; and

direct the at least one SU to service a second data access request that includes a second read request or a second write request based on the at least one EDS of the set of EDSs or another EDS of the set of EDSs based on the second system configuration of the DAP after completion of the transition from the first system configuration of the DAP to the second system configuration of the DAP.

10. The computing device of claim 9, wherein the processing module, when operable within the computing device based on the operational instructions, is further configured to:

detect a change within the DSN from the first system configuration of the DAP to the second system configuration of the DAP based on at least one of addition or removal of at least one SU within a plurality of SUs within the DSN or reallocation of data within the DSN.

11. The computing device of claim 9, wherein the processing module, when operable within the computing device based on the operational instructions, is further configured to:

direct the at least one SU of the plurality of SUs to service the data access request based on the at least one EDS of the set of EDSs based on the DAP transition mapping between the first system configuration of the DAP to the second system configuration of the DAP when performed on a data object-by-data object basis, an EDS set-by-EDS set basis, or a vault-by-vault basis.

12. The computing device of claim 9 further comprising:

a SU of the plurality of SUs within the DSN, a wireless smart phone, a laptop, a tablet, a personal computers (PC), a work station, or a video game device.

13. The computing device of claim 9, wherein the DSN includes at least one of a wireless communication system, a wire lined communication system, a non-public intranet system, a public internet system, a local area network (LAN), or a wide area network (WAN).

14. A method for execution by a computing device, the method comprising:

within a dispersed or distributed storage network (DSN) that includes a plurality of storage units (SUs) that distributedly store a set of encoded data slices (EDSs) associated with a data object, during a transition from a first system configuration of a Decentralized, or Distributed, Agreement Protocol (DAP) to a second system configuration of the DAP, directing, via an interface of the computing device that is configured to interface and communicate with a dispersed storage network (DSN), at least one SU of the plurality of SUs to service a data access request based on at least one EDS of the set of EDSs based on a DAP transition mapping between the first system configuration of the DAP to the second system configuration of the DAP, wherein the data object is segmented into a plurality of data segments, wherein a data segment of the plurality of data segments is dispersed error encoded in accordance with dispersed error encoding parameters to produce the set of EDSs.

15. The method of claim 14 further comprising:

directing, via the interface, the at least one SU to service another data access request based on the at least one EDS of the set of EDSs or another EDS of the set of EDSs based on the second system configuration of the DAP after completion of the transition from the first system configuration of the DAP to the second system configuration of the DAP.

16. The method of claim 15, wherein at least one of:

the data access request includes a first read request or a first write request;

or

the another data access request includes a second read request or a second write request.

17. The method of claim 14 further comprising:

detecting a change within the DSN from the first system configuration of the DAP to the second system configuration of the DAP based on at least one of addition or removal of at least one SU within a plurality of SUs within the DSN or reallocation of data within the DSN.

18. The method of claim 14 further comprising:

directing the at least one SU of the plurality of SUs to service the data access request based on the at least one EDS of the set of EDSs based on the DAP transition mapping between the first system configuration of the DAP to the second system configuration of the DAP when performed on a data object-by-data object basis, an EDS set-by-EDS set basis, or a vault-by-vault basis.

19. The method of claim 14, wherein the computing device includes a SU of the plurality of SUs within the DSN, a wireless smart phone, a laptop, a tablet, a personal computers (PC), a work station, or a video game device.

20. The method of claim 14, wherein the DSN includes at least one of a wireless communication system, a wire lined communication system, a non-public intranet system, a public internet system, a local area network (LAN), or a wide area network (WAN).