REBUILDING SLICES OF A SET OF ENCODED DATA SLICES

• US 20130238932A1
• Filed: 05/01/2013
• Published: 09/12/2013
• Est. Priority Date: 11/24/2009
• Status: Active Grant

• Current Assignee: Pure Storage, Inc.
• Original Assignee: Cleversafe Incorporated (International Business Machines Corporation)
• Inventors: Resch, Jason K.
• Granted Patent: US 9,703,812 B2
• Time in Patent Office: Days
• US Class Current: 714/20
• CPC Class Codes: G06F 11/1402 Saving, restoring, recovering or retrying
• CPC Class Codes: G06F 16/215 Improving data quality; Data cleansing, e.g. de-duplication, removing invalid entries or correcting typographical errors
• CPC Class Codes: G06F 21/64 Protecting data integrity, e.g. using checksums, certificates or signatures
• CPC Class Codes: G06F 21/80 in storage media based on magnetic or optical technology, e.g. disks with sectors preventing unauthorised reproduction or copying of disc-type recordable media G11B20/00
• CPC Class Codes: H04L 9/085 Secret sharing or secret splitting, e.g. threshold schemes

Abstract

A method begins with a processing module initiating a rebuilding process for an encoded data slice of a set of encoded data slices and generating rebuilding information from one or more other encoded data slices of the set of encoded data slices. The method continues with the processing module creating a rebuilt encoded data slice for the encoded data slice based on the rebuilding information. The method continues with the processing module determining whether another encoded data slice of the set of encoded data slices requires rebuilding and when the other encoded data slice requires rebuilding, the method continues with the processing module creating another rebuilt encoded data slice for the other encoded data slice based on the rebuilding information without initiating another rebuilding process for the other encoded data slice.

Claims

1. A method for execution by a computing device within a dispersed storage network (DSN), the method comprises:

initiating a rebuilding process for an encoded data slice of a set of encoded data slices, wherein a data segment is encoded using an error coding dispersal storage function to produce the set of encoded data slices;

generating rebuilding information from one or more encoded data slices of the set of encoded data slices, wherein the one or more encoded slices excludes the encoded data slice;

creating a rebuilt encoded data slice for the encoded data slice based on the rebuilding information;

determining whether another encoded data slice of the set of encoded data slices requires rebuilding; and

when the other encoded data slice requires rebuilding, creating another rebuilt encoded data slice for the other encoded data slice based on the rebuilding information without initiating another rebuilding process for the other encoded data slice.

2. The method of claim 1, wherein the initiating the rebuilding processing comprises:

identifying a storage error regarding the encoded data slice;

issuing read commands to storage units of the DSN, wherein one of the read commands includes a request to read one or more encoded data slices of the set of encoded data slices stored by one of the storage units; and

receiving the one or more encoded data slices from one or more of the storage units.

3. The method of claim 1, wherein the generating the rebuilding information comprises:

retrieving a decode threshold number of encoded data slices of the set of encoded data slices, which excludes the encoded data slice; and

storing the decode threshold number of encoded data slices as the rebuilding information.

4. The method of claim 3, wherein the creating the rebuilt encoded data slice comprises:

decoding the decode threshold number of encoded data slices in accordance with the error coding dispersal storage function to produce a recovered data segment;

encoding the recovered data segment using the error coding dispersal storage function to produce a new set of encoded data slices; and

selecting an encoded data slice of the new set of encoded data slices as the rebuilt encoded data slice.

5. The method of claim 1, wherein the generating the rebuilding information comprises:

retrieving a decode threshold number of encoded data slices of the set of encoded data slices, which excludes the encoded data slice;

decoding the decode threshold number of encoded data slices in accordance with the error coding dispersal storage function to produce a recovered data segment; and

storing the recovered data segment as the rebuilding information.

6. The method of claim 5, wherein the creating the rebuilt encoded data slice comprises:

encoding the recovered data segment using the error coding dispersal storage function to produce a new set of encoded data slices; and

selecting an encoded data slice of the new set of encoded data slices as the rebuilt encoded data slice.

7. The method of claim 1, wherein the generating the rebuilding information comprises:

receiving partially rebuilt slices from storage units of the DSN; and

storing the partially rebuilt slices as the rebuilding information.

8. The method of claim 7, wherein the creating the rebuilt encoded data slice comprises:

creating the rebuilt encoded data slice based on the partially rebuilt slices.

9. The method of claim 1, wherein the determining whether the other encoded data slice requires rebuilding comprises:

detecting a storage error regarding the other encoded data slice within a given time frame of rebuilding the encoded data slice.

10. The method of claim 1 further comprises:

outputting the rebuilt encoded data slice for storage in the DSN; and

outputting the other rebuilt encoded data slice for storage in the DSN.

11. A computing device within a dispersed storage network (DSN), the computing device comprises:

a memory;

an interface; and

a processing module operable to;

initiate, via the interface, a rebuilding process for an encoded data slice of a set of encoded data slices, wherein a data segment is encoded using an error coding dispersal storage function to produce the set of encoded data slices;

generate rebuilding information from one or more encoded data slices of the set of encoded data slices, wherein the one or more encoded slices excludes the encoded data slice;

create a rebuilt encoded data slice for the encoded data slice based on the rebuilding information;

determine whether another encoded data slice of the set of encoded data slices requires rebuilding; and

when the other encoded data slice requires rebuilding, create another rebuilt encoded data slice for the other encoded data slice based on the rebuilding information without initiating another rebuilding process for the other encoded data slice.

12. The computing device of claim 11, wherein the processing module functions to initiate the rebuilding processing by:

identifying a storage error regarding the encoded data slice;

issuing, via the interface, read commands to storage units of the DSN, wherein one of the read commands includes a request to read one or more encoded data slices of the set of encoded data slices stored by one of the storage units; and

receiving, via the interface, the one or more encoded data slices from one or more of the storage units.

13. The computing device of claim 11, wherein the processing module functions to generate the rebuilding information by:

retrieving, via the interface, a decode threshold number of encoded data slices of the set of encoded data slices, which excludes the encoded data slice; and

storing, in the memory, the decode threshold number of encoded data slices as the rebuilding information.

14. The computing device of claim 13, wherein the processing module functions to create the rebuilt encoded data slice by:

decoding the decode threshold number of encoded data slices in accordance with the error coding dispersal storage function to produce a recovered data segment;

encoding the recovered data segment using the error coding dispersal storage function to produce a new set of encoded data slices; and

selecting an encoded data slice of the new set of encoded data slices as the rebuilt encoded data slice.

15. The computing device of claim 11, wherein the processing module further functions to generate the rebuilding information by:

retrieving, from the memory, a decode threshold number of encoded data slices of the set of encoded data slices, which excludes the encoded data slice;

decoding the decode threshold number of encoded data slices in accordance with the error coding dispersal storage function to produce a recovered data segment; and

storing, in the memory, the recovered data segment as the rebuilding information.

16. The computing device of claim 15, wherein the processing module further functions to create the rebuilt encoded data slice by:

encoding the recovered data segment using the error coding dispersal storage function to produce a new set of encoded data slices; and

selecting an encoded data slice of the new set of encoded data slices as the rebuilt encoded data slice.

17. The computing device of claim 11, wherein the processing module further functions to generate the rebuilding information by:

receiving, via the interface, partially rebuilt slices from storage units of the DSN; and

storing, in the memory, the partially rebuilt slices as the rebuilding information.

18. The computing device of claim 17, wherein the processing module further functions to create the rebuilt encoded data slice by:

creating the rebuilt encoded data slice based on the partially rebuilt slices.

19. The computing device of claim 11, wherein the processing module functions to determine whether the other encoded data slice requires rebuilding by:

detecting a storage error regarding the other encoded data slice within a given time frame of rebuilding the encoded data slice.

20. The computing device of claim 11, wherein the processing module is further operable to:

output, via the interface, the rebuilt encoded data slice for storage in the DSN; and

output, via the interface, the other rebuilt encoded data slice for storage in the DSN.