Selecting storage units to rebuild an encoded data slice

• US 9,270,298 B2
• Filed: 07/20/2014
• Issued: 02/23/2016
• Est. Priority Date: 11/24/2009
• Status: Active Grant

• Current Assignee: Pure Storage, Inc.
• Original Assignee: International Business Machines Corporation
• Inventors: Dhuse, Greg, Baptist, Andrew, Resch, Jason K.
• Primary Examiner(s): Gelagay, Shewaye
• Assistant Examiner(s): NGUYEN, TRONG H
• Application Number:
  US14/335,912
• Publication Number:
  US 20140331100A1
• Time in Patent Office: 583 Days
• Field of Search: 714/2, 714/6.2, 714/6.22, 714/6.24, 714/6.32, 714/48, 714/54, 714/710, 714/746, 714/747, 714/755, 714/758, 714/760, 714/764, 714/799, 726/4, 726/17, 726/21, 726 27- 30, 713/165, 713/167, 713193-194
• US Class Current: 1/1
• CPC Class Codes: G06F 11/1092 Rebuilding, e.g. when physically replacing a failing disk
• CPC Class Codes: G06F 11/1402 Saving, restoring, recovering or retrying
• CPC Class Codes: G06F 16/215 Improving data quality; Data cleansing, e.g. de-duplication, removing invalid entries or correcting typographical errors
• CPC Class Codes: G06F 21/64 Protecting data integrity, e.g. using checksums, certificates or signatures
• CPC Class Codes: G06F 21/80 in storage media based on magnetic or optical technology, e.g. disks with sectors preventing unauthorised reproduction or copying of disc-type recordable media G11B20/00
• CPC Class Codes: G06F 2211/1028 Distributed, i.e. distributed RAID systems with parity
• CPC Class Codes: H03M 13/1105 Decoding

Abstract

A method begins with a processing module of a dispersed storage network (DSN) identifying an encoded data slice of a set of encoded data slices that requires rebuilding and identifying storage units of the DSN that store the set of encoded data slices. The method continues with the processing module determining a rebuilding metric regarding the identified encoded data slice and selecting a sub-set of the storage units for retrieving a decode threshold number of encoded data slices of the set of encoded data slices based on the rebuilding metric. When the decode threshold number of encoded data slices have been retrieved, the method continues with the processing module decoding the decode threshold number of encoded data slices to produce a reconstructed data segment and generating a rebuilt encoded data slice from the reconstructed data segment.

Claims

1. A method for execution by a processor configured to operate with a dispersed storage network (DSN), the method comprises:

identifying an encoded data slice of a set of encoded data slices that requires rebuilding;

identifying storage units of the DSN that store the set of encoded data slices;

determining a rebuilding metric for the identified storage units that store the set of encoded data slices by determining a response attribute that pertains to encoded data slice retrieval from the identified storage units to rebuild the identified encoded data slice;

selecting a sub-set of the storage units for retrieving a decode threshold number of encoded data slices of the set of encoded data slices based on a performance metric associated with the response attribute for respective storage units that store the set of encoded data slices, wherein a data segment of data was error encoded to produce the set of encoded data slices, wherein the decode threshold number of encoded data slices is required to recover the data segment, and wherein the decode threshold number of encoded data slices does not include the identified encoded data slice;

when the decode threshold number of encoded data slices has not been retrieved within a given time period;

modifying the rebuilding metric; and

selecting a new sub-set of the storage units for retrieving the decode threshold number of encoded data slices based on the modified rebuilding metric;

when the decode threshold number of encoded data slices has been retrieved, decoding the decode threshold number of encoded data slices to produce a reconstructed data segment; and

generating a rebuilt encoded data slice from the reconstructed data segment.

2. The method of claim 1, wherein the response attribute comprises one or more of:

a ping time response;

historical read response times;

geographic proximity to the one or more computing devices;

data throughput;

reliability; and

up-time.

3. The method of claim 1, wherein the determining the rebuilding metric includes accessing a look up table based on the identified encoded data slice to determine the response attribute for respective storage units that store the set of encoded data slices.

4. The method of claim 1, wherein the generating the rebuilt encoded data slice comprises:

dispersed storage error encoding the reconstructed data segment to produce a new set of encoded data slices; and

selecting, as the rebuilt encoded data slice, an encoded data slice of the new set of encoded data slices.

5. The method of claim 1, wherein the generating the rebuilt encoded data slice comprises:

encoding the reconstructed data segment to produce the rebuilt encoded data slice.

6. The method of claim 1 further comprises:

outputting, for storage in one of the storage units, the rebuilt encoded data slice.

7. A computer readable storage medium comprises:

at least one memory section that stores operational instructions that, when executed by a processor configured to operate with a dispersed storage network (DSN), causes the processor to;

identify an encoded data slice of a set of encoded data slices that requires rebuilding;

identify storage units of the DSN that store the set of encoded data slices;

determine a rebuilding metric for the identified storage units that store the set of encoded data slices by determining a response attribute that pertains to encoded data slice retrieval from the identified storage units to rebuild the identified encoded data slice;

select a sub-set of the storage units for retrieving a decode threshold number of encoded data slices of the set of encoded data slices based on a performance metric associated with the response attribute for respective storage units that store the set of encoded data slices, wherein a data segment of data was error encoded to produce the set of encoded data slices, wherein the decode threshold number of encoded data slices is required to recover the data segment, and wherein the decode threshold number of encoded data slices does not include the identified encoded data slice;

when the decode threshold number of encoded data slices has not been retrieved within a given time period;

modify the rebuilding metric; and

select a new sub-set of the storage units for retrieving the decode threshold number of encoded data slices based on the modified rebuilding metric;

when the decode threshold number of encoded data slices has been retrieved, decode the decode threshold number of encoded data slices to produce a reconstructed data segment; and

generate a rebuilt encoded data slice from the reconstructed data segment.

8. The computer readable storage medium of claim 7, wherein the processor functions to execute the operational instructions stored by the at least one memory section to determine the response attribute that comprises one or more of:

a ping time response;

historical read response times;

geographic proximity to the one or more computing devices;

data throughput;

reliability; and

up-time.

9. The computer readable storage medium of claim 7, wherein the processor functions to execute the operational instructions stored by the at least one memory section to access a look up table based on the identified encoded data slice to determine the response attribute for respective storage units that store the set of encoded data slices.

10. The computer readable storage medium of claim 7, wherein the processor functions to execute the operational instructions stored by the at least one memory section to generate the rebuilt encoded data slice by:

dispersed storage error encoding the reconstructed data segment to produce a new set of encoded data slices; and

selecting, as the rebuilt encoded data slice, an encoded data slice of the new set of encoded data slices.

11. The computer readable storage medium of claim 7, wherein the processor functions to execute the operational instructions stored by the at least one memory section to generate the rebuilt encoded data slice by:

encoding the reconstructed data segment to produce the rebuilt encoded data slice.

12. The computer readable storage medium of claim 7, wherein the processor functions to execute the operational instructions stored by the at least one memory section to

output, for storage in one of the storage units, the rebuilt encoded data slice.

13. A computing device of a dispersed storage network (DSN), wherein the computing device comprises:

an interface; and

a hardware processor operably coupled to the interface, wherein the processor is operable to;

identify an encoded data slice of a set of encoded data slices that requires rebuilding;

identify storage units of the DSN that store the set of encoded data slices;

determine a rebuilding metric for the identified storage units that store the set of encoded data slices by determining a response attribute that pertains to encoded data slice retrieval from the identified storage units to rebuild the identified encoded data slice;

select a sub-set of the storage units for retrieving a decode threshold number of encoded data slices of the set of encoded data slices based on a performance metric associated with the response attribute for respective storage units that store the set of encoded data slices, wherein a data segment of data was error encoded to produce the set of encoded data slices, wherein the decode threshold number of encoded data slices is required to recover the data segment, and wherein the decode threshold number of encoded data slices does not include the identified encoded data slice;

when the decode threshold number of encoded data slices has not been retrieved within a given time period;

modify the rebuilding metric; and

select a new sub-set of the storage units for retrieving the decode threshold number of encoded data slices based on the modified rebuilding metric;

when the decode threshold number of encoded data slices has been retrieved, decode the decode threshold number of encoded data slices to produce a reconstructed data segment; and

generate a rebuilt encoded data slice from the reconstructed data segment.

14. The computing device of claim 13, wherein the response attribute comprises one or more of:

a ping time response;

historical read response times;

geographic proximity to one or more computing devices;

data throughput;

reliability; and

up-time.

15. The computing device of claim 13, wherein the processor functions to determine the rebuilding metric by:

accessing a look up table based on the identified encoded data slice to determine the response attribute for respective storage units that store the set of encoded data slices.

16. The computing device of claim 13, wherein the processor functions to generate the rebuilt encoded data slice by:

dispersed storage error encoding the reconstructed data segment to produce a new set of encoded data slices; and

selecting, as the rebuilt encoded data slice, an encoded data slice of the new set of encoded data slices.

17. The computing device of claim 13, wherein the processor functions to generate the rebuilt encoded data slice by:

encoding the reconstructed data segment to produce the rebuilt encoded data slice.

18. The computing device of claim 13 further comprises:

the processor is further operable to;

output, via the interface, for storage in one of the storage units, the rebuilt encoded data slice.