Prioritizing ranges to rebuild based on namespace health

• US 10,356,177 B2
• Filed: 12/13/2017
• Issued: 07/16/2019
• Est. Priority Date: 09/30/2005
• Status: Active Grant

• Current Assignee: Pure Storage, Inc.
• Original Assignee: International Business Machines Corporation
• Inventors: Cocagne, Thomas D.
• Primary Examiner(s): Bradley, Matthew
• Application Number:
  US15/840,397
• Publication Number:
  US 20180103107A1
• Time in Patent Office: 580 Days
• CPC Class Codes: G06F 11/1076 Parity data used in redundant arrays of independent storages, e.g. in RAID systems
• CPC Class Codes: G06F 11/1092 Rebuilding, e.g. when physically replacing a failing disk
• CPC Class Codes: G06F 21/6227 where protection concerns the structure of data, e.g. records, types, queries
• CPC Class Codes: G06F 2211/1028 Distributed, i.e. distributed RAID systems with parity
• CPC Class Codes: H04L 63/08 for authentication of entities cryptographic mechanisms or cryptographic arrangements for entity authentication H04L9/32
• CPC Class Codes: H04L 67/1097 for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]

Abstract

A computing device includes an interface configured to interface and communicate with a dispersed storage network (DSN), a memory that stores operational instructions, and processing circuitry operably coupled to the interface and to the memory. The processing circuitry is configured to execute the operational instructions to perform various operations and functions. The computing device detects memory error(s) associated with memory device(s) of set(s) of storage units (SUs). The computing device processes the memory error(s) to generate a rebuilding priority level for at least some EDS(s) and establishes an EDS scanning rate. The computing device scans the EDS(s) based on the EDS scanning rate. When an EDS error is detected, the computing device updates the rebuilding priority level to generate an updated rebuilding priority level for the at least some of the set of EDSs and facilitates generation at least one rebuilt EDS for the EDS error based on the updated rebuilding priority level.

Claims

1. A computing device comprising:

an interface configured to interface and communicate with a dispersed or distributed storage network (DSN);

memory that stores operational instructions; and

processing circuitry operably coupled to the interface and to the memory, wherein the processing circuitry is configured to execute the operational instructions to;

detect one or more memory errors associated with one or more memory devices of one or more sets of storage units (SUs) within the DSN that distributedly store a set of encoded data slices (EDSs), wherein a data object is segmented into a plurality of data segments, wherein a data segment of the plurality of data segments is dispersed error encoded in accordance with dispersed error encoding parameters to produce the set of encoded data slices (EDSs);

process the one or more memory errors to generate a rebuilding priority level for at least some of the set of EDSs;

establish an EDS scanning rate for the set of EDSs;

scan the set of EDSs based on the EDS scanning rate;

when an EDS error is detected based on scanning of the set of EDSs based on the EDS scanning rate;

update the rebuilding priority level to generate an updated rebuilding priority level for the at least some of the set of EDSs; and

facilitate generation at least one rebuilt EDS for the EDS error based on the updated rebuilding priority level.

2. The computing device of claim 1, wherein the processing circuitry is further configured to execute the operational instructions to:

detect the one or more memory errors based on at least one of issuing a memory device information status to a SU corresponding to a memory device of the one or more memory devices of the one or more sets of SUs or receiving a memory device information status response from the SU corresponding to the memory device of the one or more memory devices of the one or more sets of SUs.

3. The computing device of claim 1, wherein the processing circuitry is further configured to execute the operational instructions to:

process the one or more memory errors to generate a first rebuilding priority level for a first at least one EDS of the set of EDSs associated with a first set of SUs of the one or more sets of SUs that is greater than a second rebuilding priority level for a second at least one EDS of the set of EDSs associated with the first set of SUs or a second set of SUs of the one or more sets of SUs.

4. The computing device of claim 1, wherein the processing circuitry is further configured to execute the operational instructions to:

prioritize rebuilding of a first at least one EDS of the set of EDSs associated with a first set of SUs of the one or more sets of SUs over rebuilding of a second at least one EDS of the set of EDSs associated with the first set of SUs or a second set of SUs of the one or more sets of SUs.

5. The computing device of claim 1, wherein:

a decode threshold number of EDSs are needed to recover the data segment;

a read threshold number of EDSs provides for reconstruction of the data segment;

a write threshold number of EDSs provides for a successful transfer of the set of EDSs from a first at least one location in the DSN to a second at least one location in the DSN;

the set of EDSs is of pillar width and includes a pillar number of EDSs;

each of the decode threshold number, the read threshold number, and the write threshold number is less than the pillar number; and

the write threshold number is greater than or equal to the read threshold number that is greater than or equal to the decode threshold number.

6. The computing device of claim 1, wherein the computing device is located at a first premises that is remotely located from a second premises of at least one SU of the one or more sets of SUs within the DSN.

7. The computing device of claim 1 further comprising:

a SU of the one or more sets of SUs within the DSN, a wireless smart phone, a laptop, a tablet, a personal computers (PC), a work station, or a video game device.

8. The computing device of claim 1, wherein the DSN includes at least one of a wireless communication system, a wire lined communication system, a non-public intranet system, a public internet system, a local area network (LAN), or a wide area network (WAN).

9. A computing device comprising:

an interface configured to interface and communicate with a dispersed or distributed storage network (DSN);

memory that stores operational instructions; and

processing circuitry operably coupled to the interface and to the memory, wherein the processing circuitry is configured to execute the operational instructions to;

detect one or more memory errors associated with one or more memory devices of one or more sets of storage units (SUs) within the DSN that distributedly store a set of encoded data slices (EDSs) based on at least one of issuing a memory device information status to a SU corresponding to a memory device of the one or more memory devices of the one or more sets of SUs or receiving a memory device information status response from the SU corresponding to the memory device of the one or more memory devices of the one or more sets of SUs, wherein a data object is segmented into a plurality of data segments, wherein a data segment of the plurality of data segments is dispersed error encoded in accordance with dispersed error encoding parameters to produce the set of encoded data slices (EDSs);

process the one or more memory errors to generate a rebuilding priority level for at least some of the set of EDSs;

establish an EDS scanning rate for the set of EDSs;

scan the set of EDSs based on the EDS scanning rate;

when an EDS error is detected based on scanning of the set of EDSs based on the EDS scanning rate;

update the rebuilding priority level to generate an updated rebuilding priority level for the at least some of the set of EDSs;

prioritize rebuilding of a first at least one EDS of the set of EDSs associated with a first set of SUs of the one or more sets of SUs over rebuilding of a second at least one EDS of the set of EDSs associated with the first set of SUs or a second set of SUs of the one or more sets of SUs; and

facilitate generation of at least one rebuilt EDS for the EDS error based on the updated rebuilding priority level.

10. The computing device of claim 9, wherein the processing circuitry is further configured to execute the operational instructions to:

process the one or more memory errors to generate a first rebuilding priority level for a first at least one EDS of the set of EDSs associated with a first set of SUs of the one or more sets of SUs that is greater than a second rebuilding priority level for a second at least one EDS of the set of EDSs associated with the first set of SUs or a second set of SUs of the one or more sets of SUs.

11. The computing device of claim 9, wherein the processing circuitry is further configured to execute the operational instructions to:

prioritize rebuilding of a first at least one EDS of the set of EDSs associated with a first set of SUs of the one or more sets of SUs over rebuilding of a second at least one EDS of the set of EDSs associated with the first set of SUs or a second set of SUs of the one or more sets of SUs.

12. The computing device of claim 9, wherein:

a decode threshold number of EDSs are needed to recover the data segment;

a read threshold number of EDSs provides for reconstruction of the data segment;

a write threshold number of EDSs provides for a successful transfer of the set of EDSs from a first at least one location in the DSN to a second at least one location in the DSN;

the set of EDSs is of pillar width and includes a pillar number of EDSs;

each of the decode threshold number, the read threshold number, and the write threshold number is less than the pillar number; and

the write threshold number is greater than or equal to the read threshold number that is greater than or equal to the decode threshold number.

13. The computing device of claim 9, wherein the DSN includes at least one of a wireless communication system, a wire lined communication system, a non-public intranet system, a public internet system, a local area network (LAN), or a wide area network (WAN).

14. A method for execution by a computing device, the method comprising:

detecting one or more memory errors associated with one or more memory devices of one or more sets of storage units (SUs) within a dispersed or distributed storage network (DSN) that distributedly store a set of encoded data slices (EDSs), wherein a data object is segmented into a plurality of data segments, wherein a data segment of the plurality of data segments is dispersed error encoded in accordance with dispersed error encoding parameters to produce the set of encoded data slices (EDSs);

processing the one or more memory errors to generate a rebuilding priority level for at least some of the set of EDSs;

establishing an EDS scanning rate for the set of EDSs;

scanning the set of EDSs based on the EDS scanning rate;

when an EDS error is detected based on scanning of the set of EDSs based on the EDS scanning rate;

updating the rebuilding priority level to generate an updated rebuilding priority level for the at least some of the set of EDSs; and

facilitating, via an interface of the computing device that is configured to interface and communicate with a dispersed or distributed storage network (DSN), generation of at least one rebuilt EDS for the EDS error based on the updated rebuilding priority level.

15. The method of claim 14 further comprising:

detect the one or more memory errors based on at least one of issuing a memory device information status to a SU corresponding to a memory device of the one or more memory devices of the one or more sets of SUs or receiving a memory device information status response from the SU corresponding to the memory device of the one or more memory devices of the one or more sets of SUs.

16. The method of claim 14 further comprising:

process the one or more memory errors to generate a first rebuilding priority level for a first at least one EDS of the set of EDSs associated with a first set of SUs of the one or more sets of SUs that is greater than a second rebuilding priority level for a second at least one EDS of the set of EDSs associated with the first set of SUs or a second set of SUs of the one or more sets of SUs.

17. The method of claim 14 further comprising:

prioritize rebuilding of a first at least one EDS of the set of EDSs associated with a first set of SUs of the one or more sets of SUs over rebuilding of a second at least one EDS of the set of EDSs associated with the first set of SUs or a second set of SUs of the one or more sets of SUs.

18. The method of claim 14, wherein:

a decode threshold number of EDSs are needed to recover the data segment;

a read threshold number of EDSs provides for reconstruction of the data segment;

a write threshold number of EDSs provides for a successful transfer of the set of EDSs from a first at least one location in the DSN to a second at least one location in the DSN;

the set of EDSs is of pillar width and includes a pillar number of EDSs;

each of the decode threshold number, the read threshold number, and the write threshold number is less than the pillar number; and

the write threshold number is greater than or equal to the read threshold number that is greater than or equal to the decode threshold number.

19. The method of claim 14, wherein the computing device includes a SU of the one or more sets of SUs within the DSN, a wireless smart phone, a laptop, a tablet, a personal computers (PC), a work station, or a video game device.

20. The method of claim 14, wherein the DSN includes at least one of a wireless communication system, a wire lined communication system, a non-public intranet system, a public internet system, a local area network (LAN), or a wide area network (WAN).