Method and apparatus for distributed storage integrity processing
First Claim
1. A storage integrity processing unit in a distributed storage network, comprises:
- a rebuild queue including non-transitory memory that stores a plurality of identifications of data slices that require rebuilding; and
at least one rebuild module utilizing processing hardware operable to;
select one of the plurality of identifications of data slices from the rebuild queue based on a priority of a selected data slice associated with the select one of the plurality of identifications of data slices, wherein the selected data slice is one of a number of a plurality of encoded data slices of an encoded data segment;
reconstruct the encoded data segment from at least a threshold number of the number of the plurality of encoded data slices of the encoded data segment to generate a reconstructed data segment; and
generate a rebuilt encoded data slice corresponding to the selected data slice from the reconstructed data segment.
4 Assignments
0 Petitions
Accused Products
Abstract
A distributed storage integrity system in a dispersed storage network includes a scanning agent and a control unit. The scanning agent identifies an encoded data slice that requires rebuilding, wherein the encoded data slice is one of a plurality of encoded data slices generated from a data segment using an error encoding dispersal function. The control unit retrieves at least a number T of encoded data slices needed to reconstruct the data segment based on the error encoding dispersal function. The control unit is operable to reconstruct the data segment from at least the number T of the encoded data slices and generate a rebuilt encoded data slice from the reconstructed data segment. The scanning agent is located in a storage unit and the control unit is located in the storage unit or in a storage integrity processing unit, a dispersed storage processing unit or a dispersed storage managing unit.
-
Citations
20 Claims
-
1. A storage integrity processing unit in a distributed storage network, comprises:
-
a rebuild queue including non-transitory memory that stores a plurality of identifications of data slices that require rebuilding; and at least one rebuild module utilizing processing hardware operable to; select one of the plurality of identifications of data slices from the rebuild queue based on a priority of a selected data slice associated with the select one of the plurality of identifications of data slices, wherein the selected data slice is one of a number of a plurality of encoded data slices of an encoded data segment; reconstruct the encoded data segment from at least a threshold number of the number of the plurality of encoded data slices of the encoded data segment to generate a reconstructed data segment; and generate a rebuilt encoded data slice corresponding to the selected data slice from the reconstructed data segment. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11)
-
-
12. A device in a dispersed storage network comprising:
-
a network interface for interfacing with a plurality of storage units in the dispersed storage network; and at least one scanning agent utilizing processing hardware operable to; identify an encoded data slice having an address within an address range that requires rebuilding to generate an identified data slice, wherein the identified data slice is one of an X number of a plurality of encoded data slices of an encoded data segment; at least one rebuild module operable to; reconstruct the encoded data segment from at least a threshold number T of the X number of the plurality of encoded data slices of the encoded data segment to generate a reconstructed data segment; and generate a rebuilt encoded data slice corresponding to the identified data slice from the reconstructed data segment. - View Dependent Claims (13, 14, 15, 16)
-
-
17. A method in a device, comprising:
-
identifying an encoded data slice having an address within an address range stored in one of a plurality of storage units that requires rebuilding to generate an identified data slice, wherein the identified data slice is one of an X number of a plurality of encoded data slices of an encoded data segment; reconstructing the encoded data segment from at least a threshold number T of the X number of the plurality of encoded data slices of the encoded data segment to generate a reconstructed data segment; and generating a rebuilt encoded data slice corresponding to the identified data slice from the reconstructed data segment; and storing the rebuilt encoded data slice in the one of the plurality of storage units. - View Dependent Claims (18, 19, 20)
-
Specification