OVERDRIVE MODE FOR DISTRIBUTED STORAGE NETWORKS

• US 20180113747A1
• Filed: 12/20/2017
• Published: 04/26/2018
• Est. Priority Date: 10/29/2014
• Status: Abandoned Application

• Current Assignee: Pure Storage, Inc.
• Original Assignee: International Business Machines Corporation
• Inventors: Resch, Jason K., Leggette, Wesley B., Khadiwala, Ravi V., Pfeifer, Randy Dean, Cabral, Bruno Hennig, Volvovski, Ilya, Kaczmarek, Joseph M.
• Application Number:
  US15/848,137
• Publication Number:
  US 20180113747A1
• Time in Patent Office: Days
• CPC Class Codes: G06F 11/1004 to protect a block of data words, e.g. CRC or checksum G06F11/1076 takes precedence; security arrangements for protecting computers or computer systems against unauthorized activity G06F21/00
• CPC Class Codes: G06F 11/1076 Parity data used in redundant arrays of independent storages, e.g. in RAID systems
• CPC Class Codes: G06F 9/5072 Grid computing
• CPC Class Codes: H03M 13/1515 Reed-Solomon codes
• CPC Class Codes: H03M 13/3761 using code combining, i.e. using combining of codeword portions which may have been transmitted separately, e.g. Digital Fountain codes, Raptor codes or Luby Transform [LT] codes
• CPC Class Codes: H04L 63/00 Network architectures or network communication protocols for network security cryptographic mechanisms or cryptographic arrangements for secret or secure communication H04L9/00; network architectures or network communication protocols for wireless network security H04W12/00; security arrangements for protecting computers or computer systems against unauthorised activity G06F21/00
• CPC Class Codes: H04L 63/0428 wherein the data content is protected, e.g. by encrypting or encapsulating the payload
• CPC Class Codes: H04L 67/06 specially adapted for file transfer, e.g. file transfer protocol [FTP]
• CPC Class Codes: H04L 67/1097 for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
• CPC Class Codes: H04W 84/02 Hierarchically pre-organised networks, e.g. paging networks, cellular networks, WLAN [Wireless Local Area Network] or WLL [Wireless Local Loop]

Abstract

A method for implementing an overdrive in a dispersed storage network begins by a processing module receiving an access request for a set of encoded data slices and continues with the processing module determining whether a level of access requests for the DSN meets a predetermined threshold. When the level of access requests for the DSN meets the predetermined threshold, the method continues with the processing module transitioning from a first operational mode to a second operational mode. The method continues with the processing module determining whether the level of access requests for the DSN is below the predetermined threshold, and when it is, transitioning back to the first operational mode.

Claims

1. A method for execution by one or more processing modules of one or more computing devices of a dispersed storage network (DSN), the method comprises:

receiving, by the one or more processing modules, an access request for a set of encoded data slices (EDSs), wherein a data segment is encoded using an error coding dispersal storage function to produce the set of EDSs,

determining, by the one or more processing modules, whether a level of access requests for the DSN meets a predetermined threshold;

in response to determining that the level of access requests for the DSN meets the predetermined threshold, transitioning, by the one or more processing modules, from a first operational mode to a second operational mode;

determining, by the one or more processing modules, whether the level of access requests for the DSN is below the predetermined threshold; and

in response to determining that the level of access requests for the DSN is below the predetermined threshold, transitioning, by the one or more processing modules, from the second operational mode to the first operational mode.

2. The method of claim 1, wherein the first operational mode involves processing of access requests for EDSs and processing of one or more maintenance functions.

3. The method of claim 2, wherein the maintenance functions include at least one of rebuilding EDSs, migrating EDSs, balancing data load across memory devices, recording DSN statistics, and recording DSN debugging information.

4. The method of claim 2, wherein the maintenance functions include one or more functions that degrade performance of one or more access requests.

5. The method of claim 1, wherein the predetermined threshold is at least partially based on a probability of data loss, and further wherein the second operational mode has a higher probability of data loss than the first operational mode.

6. The method of claim 1, wherein the second operational mode includes processing of access requests for EDSs and queueing at least one maintenance function.

7. The method of claim 1, further comprising:

determining, by the one or more processing modules, whether a probability of data loss is above another predetermined threshold; and

in response to a determination that a probability of data loss is above another predetermined threshold, transitioning, by the one or more processing modules, from the second operational mode to the first operational mode.

8. The method of claim 7, wherein the probability of data loss is based on another probability that the DSN includes unrecoverable EDSs when less than a decode threshold number of EDSs of the set of EDSs is available.

9. The method of claim 1, wherein the level of access requests includes at least one of number of access requests for EDSs, a unit time to store requests for EDSs, and a unit time to retrieve requests for EDSs.

10. The method of claim 1, further comprising:

determining, by the one or more processing modules, whether one or more memory devices of the DSN is above predetermined storage threshold; and

in response to determining that the one or more memory devices of the DSN is above the predetermined storage threshold;

transitioning, by the one or more processing modules, from the second operational mode to the first operational mode.

11. A computer readable storage medium comprises:

at least one memory section that stores operational instructions that, when executed by one or more processing resources of a plurality of processing resources of one or more computing devices of a distributed network, causes the one or more computing devices to;

receive, by the plurality of processing resources, an access request for a set of encoded data slices (EDSs), wherein a data segment is encoded using an error coding dispersal storage function to produce the set of EDSs,

determine, by the plurality of processing resources, whether a level of access requests for the DSN meets a predetermined threshold;

when the level of access for the DSN meets a predetermined threshold, transitioning, by the plurality of processing resources, from a first operational mode to a second operational mode;

determine, by the plurality of processing resources, whether the level of access requests for the DSN is below the predetermined threshold; and

when the level of access requests for the DSN is below the predetermined threshold, transition, by the plurality of processing resources, from the second operational mode to the first operational mode.

12. The computer readable storage medium of claim 11, wherein the first operational mode involves processing of access requests for EDSs and processing of one or more maintenance functions.

13. The computer readable storage medium of claim 12, wherein the maintenance functions include at least one of rebuilding EDSs, migrating EDSs, balancing data load across memory devices, recording DSN statistics, and recording DSN debugging information.

14. The computer readable storage medium of claim 12, wherein the maintenance functions include one or more functions that degrade performance of one or more access requests.

15. The computer readable storage medium of claim 11, wherein the predetermined threshold is at least partially based on a probability of data loss, and further wherein the second operational mode has a higher probability of data loss than the first operational mode.

16. The computer readable storage medium of claim 11, wherein the second operational mode includes processing of access requests for EDSs and queueing at least one maintenance function.

17. The computer readable storage medium of claim 11, wherein the level of access requests includes at least one of number of access requests for EDSs, a unit time to store requests for EDSs, and a unit time to retrieve requests for EDSs.

18. The computer readable storage medium of claim 11, wherein the plurality of processing resources further causes the one or more computing devices to:

determine, whether one or more memory devices of the DSN is above predetermined storage threshold; and

when the one or more memory devices of the DSN is above the predetermined storage threshold;

transition from the second operational mode to the first operational mode.

19. A computing device of a group of computing devices of a distributed network, the computing device comprises:

an interface;

a local memory; and

a processing resource of a plurality of processing resources of the distributed network, wherein the processing resource is operably coupled to the interface and the local memory, and wherein the processing resource functions to;

receive an access request for a set of encoded data slices (EDSs), wherein a data segment is encoded using an error coding dispersal storage function to produce the set of EDSs,

determine whether a level of access requests for the DSN meets a predetermined threshold;

when the level of access for the DSN meets a predetermined threshold, transition from a first operational mode to a second operational mode;

determine whether the level of access requests for the DSN is below the predetermined threshold; and

when the level of access requests for the DSN is below the predetermined threshold, transition from the second operational mode to the first operational mode.

20. The computing device of claim 19, wherein the second operational mode includes access request processing and maintenance function queueing.