QUASI-ERROR NOTIFICATIONS IN A DISPERSED STORAGE NETWORK

• US 20170185303A1
• Filed: 03/13/2017
• Published: 06/29/2017
• Est. Priority Date: 04/30/2015
• Status: Active Grant

• Current Assignee: Pure Storage, Inc.
• Original Assignee: International Business Machines Corporation
• Inventors: McShane, Niall J., Resch, Jason K.
• Granted Patent: US 10,168,904 B2
• Time in Patent Office: Days
• CPC Class Codes: G06F 11/1076 Parity data used in redundant arrays of independent storages, e.g. in RAID systems
• CPC Class Codes: G06F 11/1092 Rebuilding, e.g. when physically replacing a failing disk
• CPC Class Codes: G06F 2211/1028 Distributed, i.e. distributed RAID systems with parity
• CPC Class Codes: G06F 3/0604 Improving or facilitating administration, e.g. storage management
• CPC Class Codes: G06F 3/0619 in relation to data integrity, e.g. data losses, bit errors
• CPC Class Codes: G06F 3/064 Management of blocks
• CPC Class Codes: G06F 3/0644 Management of space entities, e.g. partitions, extents, pools
• CPC Class Codes: G06F 3/0659 Command handling arrangements, e.g. command buffers, queues, command scheduling
• CPC Class Codes: G06F 3/067 Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
• CPC Class Codes: H03M 13/1515 Reed-Solomon codes
• CPC Class Codes: H03M 13/3761 using code combining, i.e. using combining of codeword portions which may have been transmitted separately, e.g. Digital Fountain codes, Raptor codes or Luby Transform [LT] codes
• CPC Class Codes: H03M 13/616 Matrix operations, especially for generator matrices or check matrices, e.g. column or row permutations

Abstract

Methods for use in a dispersed storage network (DSN) to retrieve encoded data from memory device of an impaired storage unit. In various examples, a computing device of the DSN issues requests to a plurality of storage units, including the impaired storage unit, to recover at least a decode threshold number of encoded data slices of a set of encoded data slices. When the impaired storage unit determines that it is not able to quickly retrieve the requested data slice for provision to the computing device, the impaired storage unit promptly issues a quasi-error response instead. When the computing device receives less than the decode threshold number of encoded data slices and a quasi-error response, it may elect to issue another slice request(s) to another storage unit(s) and/or issue a continue request instructing the impaired storage unit to continue processing the request to recover the data slice stored therein.

Claims

1. A method for execution by one or more processing modules of one or more computing devices of a dispersed storage network (DSN), the DSN including a set of storage units storing encoded data, the method comprises:

issuing slice requests to a plurality of storage units of the set of storage units for at least a decode threshold number of encoded data slices of a set of encoded data slices, wherein segments of a data object are dispersed storage error encoded to produce a plurality of sets of encoded data slices including the set of encoded data slices, and wherein a decode threshold number of encoded data slices of the set of encoded data slices is required to recover a corresponding data segment;

receiving a plurality of responses from the plurality of storage units, wherein the plurality of responses include less than the decode threshold number of encoded data slices and at least one quasi-error response from an impaired storage unit;

based on the at least one quasi-error response, determining whether to issue;

a continue request to the impaired storage unit, the continue request requesting continued processing of a slice request received by the impaired storage unit;

or

an additional slice request to an additional storage unit of the set of storage units; and

issuing the continue request to the impaired storage unit or the additional slice request to the additional storage unit.

2. The method of claim 1 further comprises:

receiving the decode threshold number of encoded data slices in response to the continue request or the additional slice request; and

dispersed storage error decoding the decode threshold number of encoded data slices to recover the corresponding data segment.

3. The method of claim 1, wherein determining whether to issue a continue request or an additional slice request is based on at least one of:

a number of quasi-error responses received from the plurality of storage units of the set of storage units;

or

a number of additional storage units of the set of storage units to which a slice request was not issued.

4. The method of claim 1, wherein determining whether to issue a continue request or an additional slice request is based on at least one of:

determining that a calculated probability of receiving an encoded data slice from the impaired storage unit is below a threshold level;

or

determining that a calculated probability of receiving an encoded data slice from the additional storage unit is greater than a calculated probability of receiving an encoded data slice from the impaired storage unit.

5. The method of claim 1, wherein determining whether to issue a continue request or an additional slice request is based on at least one of:

an estimated time to retrieve an encoded data slice from the additional storage unit;

or

a timing requirement.

6. The method of claim 1, wherein the continue request, when issued, includes a status code and a slice name of an encoded data slice.

7. The method of claim 1, wherein issuing slice requests to the plurality of storage units of the set of storage units includes:

receiving a retrieve data request associated with the data object; and

selecting the plurality of storage units based on the retrieve data request.

8. The method of claim 1, wherein determining whether to issue a continue request or an additional slice request includes determining to issue both.

9. A computing device of a group of computing devices of a dispersed storage network (DSN), the DSN including a set of storage units storing encoded data, the computing device comprises:

a network interface;

a local memory; and

a processing module operably coupled to the network interface and the local memory, wherein the processing module is configured to;

issue, via the network interface, slice requests to a plurality of storage units of the set of storage units for at least a decode threshold number of encoded data slices of a set of encoded data slices, wherein segments of a data object are dispersed storage error encoded to produce a plurality of sets of encoded data slices including the set of encoded data slices, and wherein a decode threshold number of encoded data slices of the set of encoded data slices is required to recover a corresponding data segment;

receive, via the network interface, a plurality of responses from the plurality of storage units, wherein the plurality of responses include less than the decode threshold number of encoded data slices and at least one quasi-error response from an impaired storage unit;

based on the at least one quasi-error response, determine to issue an additional slice request to an additional storage unit of the set of storage units; and

issue, via the network interface, the additional slice request to the additional storage unit.

10. The computing device of claim 9, wherein the processing module is further configured to:

receive, via the network interface, the decode threshold number of encoded data slices in response to the additional slice request; and

dispersed storage error decode the decode threshold number of encoded data slices to recover the corresponding data segment.

11. The computing device of claim 10, wherein the processing module is further configured to:

issue, via the network interface, a cancel request to the impaired storage unit, the cancel request requesting discontinued processing of a slice request received by the impaired storage unit.

12. The computing device of claim 9, wherein determining to issue a continue request or an additional slice request is based on at least one of:

a number of quasi-error responses received from the plurality of storage units of the set of storage units;

or

a number of additional storage units of the set of storage units to which a slice request was not issued.

13. The computing device of claim 9, wherein determining to issue an additional slice request is based on at least one of:

determining that a calculated probability of receiving an encoded data slice from the impaired storage unit is below a threshold level;

or

determining that a calculated probability of receiving an encoded data slice from the additional storage unit is greater than a calculated probability of receiving an encoded data slice from the impaired storage unit.

14. The computing device of claim 9, wherein determining to issue an additional slice request is based on at least one of:

an estimated time to retrieve an encoded data slice from the additional storage unit;

or

a timing requirement.

15. The computing device of claim 9, wherein issuing slice requests to the plurality of storage units of the set of storage units includes:

receiving, via the network interface, a retrieve data request associated with the data object; and

selecting the plurality of storage units based on the retrieve data request.

16. The computing device of claim 9, wherein determining to issue an additional slice request further includes:

determining to issue, via the network interface, a continue request to the impaired storage unit, the continue request requesting continued processing of a slice request received by the impaired storage unit.

17. A storage unit of a set of storage units of a dispersed storage network (DSN), the DSN including a computing device, storage unit comprises:

a network interface;

a memory device, the memory device storing an encoded data slice of a set of encoded data slices, wherein segments of a data object are dispersed storage error encoded to produce a plurality of sets of encoded data slices including the set of encoded data slices; and

a processing module operably coupled to the network interface and the memory device, wherein the processing module is configured to;

receive, via the network interface, a slice request from the computing device for the encoded data slice;

process the slice request to determine whether the encoded data slice is immediately available to send to the computing device; and

when the encoded data slice is immediately available, retrieve the encoded data slice from the memory device and send, via the network interface, the encoded data slice to the computing device, and

when the encoded data slice is not immediately available, send, via the network interface, a quasi-error response to the computing device.

18. The storage unit of claim 17, the processing module further configured to:

receive, via the network interface, a continue request in reply to the quasi-error response; and

in response to the continue request, continue processing of the slice request.

19. The storage unit of claim 18, the processing module further configured to:

receive, via the network interface, a cancel request in reply to the quasi-error response; and

in response to the cancel request, discontinue processing of the slice request.

20. The storage unit of claim 18, wherein continued processing of the slice request includes:

determining that the encoded data slice is unavailable from the memory device; and

sending, via the network interface, an error response to the computing device.