Adjusting optimistic writes in a dispersed storage network

• US 10,289,318 B2
• Filed: 08/16/2016
• Issued: 05/14/2019
• Est. Priority Date: 11/01/2010
• Status: Expired due to Fees

• Current Assignee: Pure Storage, Inc.
• Original Assignee: International Business Machines Corporation
• Inventors: Dhuse, Greg R.
• Primary Examiner(s): Shanmugasundaram, Kannan
• Application Number:
  US15/238,165
• Publication Number:
  US 20160357467A1
• Time in Patent Office: 1,001 Days
• CPC Class Codes: G06F 2212/7205 Cleaning, compaction, garbage collection, erase control
• CPC Class Codes: G06F 3/061 Improving I/O performance
• CPC Class Codes: G06F 3/0619 in relation to data integrity, e.g. data losses, bit errors
• CPC Class Codes: G06F 3/0635 by changing the path, e.g. traffic rerouting, path reconfiguration
• CPC Class Codes: G06F 3/064 Management of blocks
• CPC Class Codes: G06F 3/0659 Command handling arrangements, e.g. command buffers, queues, command scheduling
• CPC Class Codes: G06F 3/067 Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
• CPC Class Codes: H04L 67/1097 for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]

Abstract

A method includes encoding a data object into a plurality of sets of encoded data slices. The method further includes commencing execution of a plurality of three-phase write operations for writing the plurality of sets of encoded data slices to a set of storage units. The method further includes, during execution of the three-phase write operations, determining write speed differences between storage units of the set of storage units. The method further includes determining whether the write speed differences are having an adverse effect of the execution of the three-phase write operations. The method further includes, when the write speed differences are having the adverse effect, adjusting subsequent three-phase write operations by one or more of: throttling back write operations to a faster storage unit of the set of storage units and dropping write operations to a slower storage unit of the set of storage units.

Claims

1. A method comprises:

dispersed storage error encoding, by a computing device of a dispersed storage network (DSN), a data object to produce a plurality of sets of encoded data slices;

executing, by the computing device, a plurality of three-phase write operations for writing the plurality of sets of encoded data slices to a set of storage units of the DSN, wherein, a phase of a three-phase write operation of the plurality of three-phase write operations includes a set of write requests regarding a set of encoded data slices of the plurality of sets of encoded data slices, wherein a write threshold number of favorable responses is required from the set of storage units to complete the a phase of the three-phase write operation and to begin a subsequent phase of the three-phase write operation or a first phase of another three-phase write operation of the plurality of three-phase write operations;

during execution of the three-phase write operation of the plurality of three-phase write operations;

determining, by the computing device, a write speed of a storage unit of the set of storage units, in processing a write request of the set of write requests, is outside a write speed range, wherein the write speed range includes one or more of a user defined write speed range, one storage unit'"'"'s write speed being a standard deviation difference than another storage unit'"'"'s write speed, and a specified level of a quality of service;

determining, by the computing device, whether the write speed of the storage unit being outside the write speed range is decreasing performance of the execution of the plurality of three-phase write operations; and

when the write speed is decreasing the performance;

adjusting, by the computing device, for one or more subsequent phases of the plurality of three-phase write operations, the execution of one or more subsequent write requests for the storage unit, wherein the adjustment causes write speeds, for the set of storage units, in executing the one or more subsequent phases, to be within the write speed range, and wherein the adjustment includes one or more of;

throttling back the one or more subsequent write requests to the storage unit; and

dropping the one or more subsequent write requests to the storage unit.

2. The method of claim 1 further comprises:

executing, by the computing device, a first phase of the three-phase write operation by;

sending a first set of write requests to the set of storage units regarding a first set of encoded data slices of the plurality of sets of encoded data slices, wherein a first write request of the first set of write requests is regarding a first encoded data slice of the first set of encoded data slices and is sent to a first storage unit of the set of storage units;

receiving at least the write threshold number of favorable write responses from at least some storage units of the set of storage units; and

determining response times for the at least some storage units regarding the first phase.

3. The method of claim 2 further comprises:

interpreting, by the computing device, the response times for the at least some storage units of the set of storage units for execution of the first phase of one or more of the plurality of three-phase write operations to determine the write speeds for the at least some storage units.

4. The method of claim 2 further comprises:

executing, by the computing device, a second phase of the three-phase write operation by;

sending a set of write commit requests to the set of storage units regarding the first set of encoded data slices, wherein a first write commit request of the set of write commit requests is regarding the first encoded data slice and is sent to the first storage unit;

receiving at least the write threshold number of favorable write commit responses from at least some storage units of the set of storage units; and

determining second response times for the at least some storage units regarding the second phase.

5. The method of claim 4 further comprises:

interpreting, by the computing device, the second response times for the at least some storage units for execution of the second phase of one or more of the plurality of three-phase write operations to determine second write speeds for the at least some storage units.

6. The method of claim 2 further comprises:

executing, by the computing device, a third phase of the three-phase write operation by;

sending a set of write finalize requests to the set of storage units regarding the first set of encoded data slices, wherein a first write finalize request of the set of write finalize requests is regarding the first encoded data slice and is sent to the first storage unit;

receiving at least the write threshold number of favorable write finalize responses from at least some storage units of the set of storage units; and

determining third response times for the at least some storage units regarding the third phase.

7. The method of claim 6 further comprises:

interpreting, by the computing device, the third response times for the at least some of the sets of storage units for execution of the third phase of one or more of the plurality of three-phase write operations to determine third write speeds for the at least some storage units.

8. The method of claim 1, where the determining whether the write speed of the storage unit being outside the write speed range is decreasing performance comprises one or more of:

determining, that due to the write speed, one or more write requests of the plurality of three-phase write operations are being dropped;

determining a difference in the write speed between storage units of the set of storage units is causing a phase write speed for executing the phase of the three-phase operation to be less than a phase write speed threshold; and

determining that a current level of throughput for the plurality of three-phase write operations is below a minimum level of throughput.

9. A computing device of a dispersed storage network (DSN), wherein the computing device comprises:

an interface;

memory; and

a processing module operably coupled to the interface and the memory, wherein the processing module is operable to;

dispersed storage error encode, a data object to produce a plurality of sets of encoded data slices;

executing a plurality of three-phase write operations for writing the plurality of sets of encoded data slices to a set of storage units of the DSN, wherein, a phase of a three-phase write operation of the plurality of three-phase write operations includes a set of write requests regarding a set of encoded data slices of the plurality of sets of encoded data slices, wherein a write threshold number of favorable responses is required from the set of storage units to complete a phase of the three-phase write operation and to begin a subsequent phase of the three-phase write operation or a first phase of another three-phase write operation of the plurality of three-phase write operations;

during execution of the three-phase write operation of the plurality of three-phase write operations;

determine a write speed of a storage unit of the set of storage units, in processing a write request of the set of write requests, is outside a write speed range, wherein the write speed range includes one or more of a user defined write speed range, one storage unit'"'"'s write speed being a standard deviation difference than another storage unit'"'"'s write speed, and a specified level of a quality of service;

determine whether the write speed of the storage unit being outside the write speed range is decreasing performance of the execution of the plurality of three-phase write operations; and

when the write speed is decreasing the performance;

adjust for one or more subsequent phases of the plurality of three-phase write operations, the execution of one or more subsequent write requests for the storage unit, wherein the adjustment causes write speeds, for the set of storage units, in executing the one or more subsequent phases, to be within the write speed range, and wherein the adjustment includes one or more of throttling back the one or more subsequent write requests to the storage unit; and

dropping the one or more subsequent write requests to the storage unit.

10. The computing device of claim 9, wherein the processing module is further operable to:

execute a first phase of the three-phase write operation by;

sending, via the interface, a first set of write requests to the set of storage units regarding a first set of encoded data slices of the plurality of sets of encoded data slices, wherein a first write request of the first set of write requests is regarding a first encoded data slice of the first set of encoded data slices and is sent to a first storage unit of the set of storage units;

receiving, via the interface, at least the write threshold number of favorable write responses from at least some storage units of the set of storage units; and

determining response times for the at least some storage units regarding the first phase.

11. The computing device of claim 10, wherein the processing module is further operable to:

interpret the response times for the at least some storage units of the set of storage units for execution of the first phase of one or more of the plurality of three-phase write operations to determine write speeds for the at least some storage units.

12. The computing device of claim 10, wherein the processing module is further operable to:

execute a second phase of the three-phase write operation by;

sending, via the interface, a set of write commit requests to the set of storage units regarding the first set of encoded data slices, wherein a first write commit request of the set of write commit requests is regarding the first encoded data slice and is sent to the first storage unit;

receiving, via the interface, at least the write threshold number of favorable write commit responses from at least some storage units of the set of storage units; and

determining second response times for the at least some storage units regarding the second phase.

13. The computing device of claim 12, wherein the processing module is further operable to:

interpret the second response times for the at least some storage units for execution of the second phase of one or more of the plurality of three-phase write operations to determine second write speeds for the at least some storage units.

14. The computing device of claim 10, wherein the processing module is further operable to:

execute a third phase of the three-phase write operation by;

sending, via the interface, a set of write finalize requests to the set of storage units regarding the first set of encoded data slices, wherein a first write finalize request of the set of write finalize requests is regarding the first encoded data slice and is sent to the first storage unit;

receiving, via the interface, at least the write threshold number of favorable write finalize responses from at least some storage units of the set of storage units; and

determining third response times for the at least some storage units regarding the third phase.

15. The computing device of claim 14, wherein the processing module is further operable to:

interpret the third response times for the at least some of the sets of storage units for execution of the third phase of one or more of the plurality of three-phase write operations to determine third write speeds for the at least some storage units.

16. The computing device of claim 9, wherein the processing module is further operable to determine whether the write speed of the storage unit being outside the write speed range is decreasing performance by one or more of:

determining, that due to the write speed, one or more write requests of the plurality of three-phase write operations are being dropped;

determining a difference in the write speed between storage units of the set of storage units is causing a phase write speed for executing the phase of the three-phase operation to be less than a phase write speed threshold; and

determining that a current level of throughput for the plurality of three-phase write operations is below a minimum level of throughput.