Storing data in accordance with a performance threshold

• US 10,162,705 B2
• Filed: 08/01/2016
• Issued: 12/25/2018
• Est. Priority Date: 05/22/2013
• Status: Active Grant

• Current Assignee: Pure Storage, Inc.
• Original Assignee: International Business Machines Corporation
• Inventors: Dhuse, Greg, Resch, Jason K., Shirley, Jr., Thomas Franklin
• Primary Examiner(s): Chu, Gabriel
• Application Number:
  US15/224,863
• Publication Number:
  US 20160342475A1
• Time in Patent Office: 876 Days
• CPC Class Codes: G06F 11/1076 Parity data used in redundant arrays of independent storages, e.g. in RAID systems
• CPC Class Codes: G06F 11/1092 Rebuilding, e.g. when physically replacing a failing disk
• CPC Class Codes: G06F 16/2379 Updates performed during online database operations; commit processing
• CPC Class Codes: G06F 2211/1028 Distributed, i.e. distributed RAID systems with parity
• CPC Class Codes: G06F 3/0619 in relation to data integrity, e.g. data losses, bit errors
• CPC Class Codes: G06F 3/064 Management of blocks
• CPC Class Codes: G06F 3/067 Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
• CPC Class Codes: H04L 67/1097 for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]

Abstract

A method includes, for a first phase of a multiple phase write operation, determining whether to send a write performance threshold number of write requests to a subset of the set of storage units regarding a write performance threshold number of encoded data slices. The method further includes, when the write performance threshold number of write requests is to be sent, sending them to the subset of the set of storage units. The method further includes, when the write threshold number of favorable responses have been received, determining whether to change the write performance threshold number for a second phase of the multiple write operation. The method further includes, when the write performance threshold number is to be changed, changing the write performance threshold number. The method further includes sending the changed write performance threshold number of write commit requests to a second subset of the set of storage units.

Claims

1. A method for execution by a computing device of a dispersed storage network (DSN), the method comprises:

for a first phase of a multiple phase write operation to write a set of encoded data slices to a set of storage units of the DSN, determining whether to send a write performance threshold number of write requests to a subset of the set of storage units regarding a write performance threshold number of encoded data slices of the set of encoded data slices, wherein a data segment of data is dispersed storage error encoded into the set of encoded data slices, wherein a decode threshold number of encoded data slices of the set of encoded data slices is required to recover the data segment, wherein a write threshold number of favorable write responses is required to move to a next phase of the multiple phase write operation, wherein the set of encoded data slices includes a total number of encoded data slices, and wherein the write performance threshold number is less than the total number and greater than or equal to the write threshold number;

when the write performance threshold number of write requests is to be sent to the subset of the set of storage units, sending the write performance threshold number of write requests to the subset of the set of storage units; and

when the write threshold number of favorable responses to the write performance threshold number of write requests have been received;

determining whether to change the write performance threshold number for a second phase of the multiple phase write operation; and

when the write performance threshold number is to be changed, changing the write performance threshold number to produce a changed write performance threshold number; and

sending the changed write performance threshold number of write commit requests to a second subset of the set of storage units.

2. The method of claim 1, wherein the determining whether to send the write performance threshold number of write requests comprises:

obtaining a set of storage performance information regarding the set of storage units;

interpreting the set of storage performance information to identify one or more storage units having a less than a desired performance level, which adversely affects the multiple phase write operation; and

excluding the one or more storage units to produce the subset of the set of storage units.

3. The method of claim 1, wherein the determining whether to send the write performance threshold number of write requests comprises:

obtaining a set of storage performance information regarding the set of storage units;

interpreting the set of storage performance information to rank storage units of the set of storage units in accordance with a desired performance level; and

selecting the subset of the set of storage units based on the ranking of the storage units.

4. The method of claim 1 further comprises:

when the write threshold number of favorable commit responses to the changed write performance threshold number of write commit requests have been received;

determining whether to change the write performance threshold number for a third phase of the multiple phase write operation; and

when the write performance threshold number is to be changed, changing the write performance threshold number to produce a second changed write performance threshold number; and

sending the second changed write performance threshold number of write finalize requests to a third subset of the set of storage units.

5. The method of claim 1, wherein determining whether to change the write performance threshold number comprises:

obtaining a set of current storage performance data regarding storage performance by the subset of storage units for the first phase of a multiple phase write operation;

interpreting the set of current storage performance data to identify an additional one or more storage units having a less than a desired performance level; and

excluding the additional one or more storage units to produce the second subset of the set of storage units.

6. The method of claim 1 further comprises:

when the write performance threshold number of write requests is not to be sent to the subset of the set of storage units, sending the total number of write requests to the set of storage units.

7. The method of claim 1 further comprises:

when the write performance threshold number is not to be changed, sending the write performance threshold number of write commit requests to the subset of the set of storage units.

8. A dispersed storage (DS) module for use in a dispersed storage network (DSN), the DS module comprises:

a first module, when operable within a computing device, causes the computing device to;

for a first phase of a multiple phase write operation to write a set of encoded data slices to a set of storage units of the DSN, determine whether to send a write performance threshold number of write requests to a subset of the set of storage units regarding a write performance threshold number of encoded data slices of the set of encoded data slices, wherein a data segment of data is dispersed storage error encoded into the set of encoded data slices, wherein a decode threshold number of encoded data slices of the set of encoded data slices is required to recover the data segment, wherein a write threshold number of favorable write responses is required to move to a next phase of the multiple phase write operation, wherein the set of encoded data slices includes a total number of encoded data slices, and wherein the write performance threshold number is less than the total number and greater than or equal to the write threshold number; and

when the write performance threshold number of write requests is to be sent to the subset of the set of storage units, send the write performance threshold number of write requests to the subset of the set of storage units; and

a second module, when operable within the computing device, causes the computing device to;

when the write threshold number of favorable responses to the write performance threshold number of write requests have been received;

determine whether to change the write performance threshold number for a second phase of the multiple phase write operation; and

when the write performance threshold number is to be changed, change the write performance threshold number to produce a changed write performance threshold number; and

send the changed write performance threshold number of write commit requests to a second subset of the set of storage units.

9. The DS module of claim 8, wherein the first module, when operable within the computing device, further causes the computing device to determine whether to send the write performance threshold number of write requests by:

obtaining a set of storage performance information regarding the set of storage units;

interpreting the set of storage performance information to identify one or more storage units having a less than a desired performance level, which adversely affects the multiple phase write operation; and

excluding the one or more storage units to produce the subset of the set of storage units.

10. The DS module of claim 8, wherein the first module, when operable within the computing device, further causes the computing device to determine whether to send the write performance threshold number of write requests by:

obtaining a set of storage performance information regarding the set of storage units;

interpreting the set of storage performance information to rank storage units of the set of storage units in accordance with a desired performance level; and

selecting the subset of the set of storage units based on the ranking of the storage units.

11. The DS module of claim 8 further comprises:

a third module, when operable within the computing device, causes the computing device to;

when the write threshold number of favorable commit responses to the changed write performance threshold number of write commit requests have been received;

determine whether to change the write performance threshold number for a third phase of the multiple phase write operation; and

when the write performance threshold number is to be changed, change the write performance threshold number to produce a second changed write performance threshold number; and

send the second changed write performance threshold number of write finalize requests to a third subset of the set of storage units.

12. The DS module of claim 8, wherein the second module, when operable within the computing device, further causes the computing device to determine whether to change the write performance threshold number by:

obtaining a set of current storage performance data regarding storage performance by the subset of storage units for the first phase of a multiple phase write operation;

interpreting the set of current storage performance data to identify an additional one or more storage units having a less than a desired performance level; and

excluding the additional one or more storage units to produce the second subset of the set of storage units.

13. The DS module of claim 8, wherein the first module, when operable within the computing device, further causes the computing device to:

when the write performance threshold number of write requests is not to be sent to the subset of the set of storage units, send the total number of write requests to the set of storage units.

14. The DS module of claim 8, wherein the second module, when operable within the computing device, further causes the computing device to:

when the write performance threshold number is not to be changed, send the write performance threshold number of write commit requests to the subset of the set of storage units.