Adaptive resource utilization with request cancellation

• US 10,305,988 B2
• Filed: 11/02/2016
• Issued: 05/28/2019
• Est. Priority Date: 11/28/2011
• Status: Active Grant

• Current Assignee: Pure Storage, Inc.
• Original Assignee: International Business Machines Corporation
• Inventors: Dhuse, Greg R.
• Primary Examiner(s): Ndiaye, Cheikh T
• Assistant Examiner(s): Habtemariam, Melaku Y
• Application Number:
  US15/341,571
• Publication Number:
  US 20170054806A1
• Time in Patent Office: 937 Days
• Field of Search: 709205-207, 709217
• CPC Class Codes: G06F 11/108 Parity data distribution in semiconductor storages, e.g. in SSD
• CPC Class Codes: G06F 12/0607 Interleaved addressing
• CPC Class Codes: G06F 12/1408 by using cryptography for digital transmission H04L9/00
• CPC Class Codes: G06F 16/182 Distributed file systems
• CPC Class Codes: G06F 21/00 Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
• CPC Class Codes: G06F 2211/1028 Distributed, i.e. distributed RAID systems with parity
• CPC Class Codes: G06F 3/0608 Saving storage space on storage systems
• CPC Class Codes: G06F 3/0641 De-duplication techniques
• CPC Class Codes: G06F 3/067 Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
• CPC Class Codes: H04L 63/0428 wherein the data content is protected, e.g. by encrypting or encapsulating the payload
• CPC Class Codes: H04L 65/10 Architectures or entities
• CPC Class Codes: H04L 67/1097 for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
• CPC Class Codes: H04L 9/0825 using asymmetric-key encryption or public key infrastructure [PKI], e.g. key signature or public key certificates
• CPC Class Codes: H04L 9/3236 using cryptographic hash functions

Abstract

A computing device includes an interface configured to interface and communicate with a dispersed storage network (DSN), a memory that stores operational instructions, and a processing module operably coupled to the interface and memory such that the processing module, when operable within the computing device based on the operational instructions, is configured to perform various operations. The computing device receives a data object, dispersed error encodes the data object to generate a set of encoded data slices (EDSs), and determines whether there are a sufficient amount of write sequence operational resources of the DSN are available within the DSN to execute a write request for the set of EDSs to the DSN memory. The computing device transmits the set of EDSs to the DSN memory for storage or determines whether the write sequence operational resources may be modified for storage of the set of EDSs to the DSN memory.

Claims

1. A computing device comprising:

an interface configured to interface and communicate with a dispersed storage network (DSN);

memory that stores operational instructions; and

a processing module operably coupled to the interface and to the memory, wherein the processing module, when operable within the computing device based on the operational instructions, is configured to;

receive a data object for storage in DSN memory;

dispersed error encode the data object to generate a set of encoded data slices (EDSs), wherein the data object is segmented into a plurality of data segments, wherein a data segment of the plurality of data segments is dispersed error encoded in accordance with dispersed error encoding parameters to produce the set of EDSs that includes a pillar width number of EDSs, wherein a decode threshold number of EDSs of the set of EDSs are needed to recover the data segment, wherein the dispersed error encoding parameters include an encoding matrix with a size that is based on the pillar width number and the decode threshold number;

determine whether there are a sufficient amount of write sequence operational resources of the DSN are available within the DSN to execute a write request for the set of EDSs to the DSN memory, wherein the write sequence operational resources of the DSN include one or more queues in communication with the DSN memory that facilitate transmission of requests to the DSN memory and reception of responses from the DSN memory in accordance with a queue prioritization scheme;

when the sufficient amount of the write sequence operational resources of the DSN are determined to be available within the DSN to execute the write request for the set of EDSs to the DSN memory, transmit the set of EDSs to the DSN memory for storage therein;

when the sufficient amount of the write sequence operational resources of the DSN determined not to be available within the DSN to execute the write request for the set of EDSs to the DSN memory;

determine whether modification of the write sequence operational resources provides for the sufficient amount of the write sequence operational resources of the DSN to execute the write request for the set of EDSs to the DSN memory;

when modification of the write sequence operational resources provides for the sufficient amount of the write sequence operational resources of the DSN to execute the write request for the set of EDSs to the DSN memory, perform the modification of the write sequence operational resources to generate modified write sequence operational resources and transmit the set of EDSs to the DSN memory for storage therein based on the modified write sequence operational resources; and

when modification of the write sequence operational resources does not provide for the sufficient amount of the write sequence operational resources of the DSN to execute the write request for the set of EDSs to the DSN memory, transmit a response that indicates a write sequence operational resources failure issue to another computing device.

2. The computing device of claim 1, wherein the processing module, when operable within the computing device based on the operational instructions, is further configured to:

determine there are the sufficient amount of the write sequence operational resources of the DSN available within the DSN to execute the write request for the set of EDSs to the DSN memory based on a data size indicator associated with the write request for the set of EDSs to the DSN memory comparing favorably to the write sequence operational resources of the DSN.

3. The computing device of claim 1, wherein the processing module, when operable within the computing device based on the operational instructions, is further configured to:

determine there are the sufficient amount of the write sequence operational resources of the DSN available within the DSN to execute the write request for the set of EDSs to the DSN memory based on available DSN resources comparing favorably to the write sequence operational resources of the DSN.

4. The computing device of claim 1, wherein the processing module, when operable within the computing device based on the operational instructions, is further configured to:

perform the modification of the write sequence operational resources to generate the modified write sequence operational resources including to delete at least one other write request for the set of EDSs to the DSN memory or at least one other write request for another set of EDSs to the DSN memory.

5. The computing device of claim 1, wherein the processing module, when operable within the computing device based on the operational instructions, is further configured to:

determine whether the modification of the write sequence operational resources provides for the sufficient amount of the write sequence operational resources of the DSN to execute the write request for the set of EDSs to the DSN memory including to determine whether at least a write threshold number of favorable write responses have been received for at least one other write request for another set of EDSs to the DSN memory; and

determine that modification of the write sequence operational resources provides for the sufficient amount of the write sequence operational resources of the DSN to execute the write request for the set of EDSs to the DSN memory when the at least write threshold number of favorable write responses have been received for the at least one other write request for the another set of EDSs to the DSN memory, wherein a write threshold number of EDSs provides for a successful transfer of the set of EDSs from a first at least one location in the DSN to a second at least one location in the DSN.

6. The computing device of claim 1, wherein the computing device is located at a first premises that is remotely located from at least one storage unit (SU) of a plurality of SUs within the DSN memory that distributedly store the set of EDSs.

7. The computing device of claim 1 further comprising:

a storage unit (SU) of a plurality of SUs within the DSN memory that distributedly store the set of EDSs, a wireless smart phone, a laptop, a tablet, a personal computers (PC), a work station, or a video game device.

8. The computing device of claim 1, wherein the DSN includes at least one of a wireless communication system, a wire lined communication system, a non-public intranet system, a public internet system, a local area network (LAN), or a wide area network (WAN).

9. A computing device comprising:

an interface configured to interface and communicate with a dispersed storage network (DSN);

memory that stores operational instructions; and

a processing module operably coupled to the interface and to the memory, wherein the processing module, when operable within the computing device based on the operational instructions, is configured to;

receive a data object for storage in DSN memory;

dispersed error encode the data object to generate a set of encoded data slices (EDSs), wherein the data object is segmented into a plurality of data segments, wherein a data segment of the plurality of data segments is dispersed error encoded in accordance with dispersed error encoding parameters to produce the set of EDSs that includes a pillar width number of EDSs, wherein a decode threshold number of EDSs of the set of EDSs are needed to recover the data segment, wherein the dispersed error encoding parameters include an encoding matrix with a size that is based on the pillar width number and the decode threshold number;

determine whether there are a sufficient amount of write sequence operational resources of the DSN are available within the DSN to execute a write request for the set of EDSs to the DSN memory based on comparison of at least one of a data size indicator associated with the write request for the set of EDSs to the DSN memory or available DSN resources to the write sequence operational resources of the DSN, wherein the write sequence operational resources of the DSN include one or more queues in communication with the DSN memory that facilitate transmission of requests to the DSN memory and reception of responses from the DSN memory in accordance with a queue prioritization scheme;

when the sufficient amount of the write sequence operational resources of the DSN are determined to be available within the DSN to execute the write request for the set of EDSs to the DSN memory, transmit the set of EDSs to the DSN memory for storage therein;

when the sufficient amount of the write sequence operational resources of the DSN determined not to be available within the DSN to execute the write request for the set of EDSs to the DSN memory;

determine whether modification of the write sequence operational resources provides for the sufficient amount of the write sequence operational resources of the DSN to execute the write request for the set of EDSs to the DSN memory;

when modification of the write sequence operational resources provides for the sufficient amount of the write sequence operational resources of the DSN to execute the write request for the set of EDSs to the DSN memory, perform the modification of the write sequence operational resources to generate modified write sequence operational resources including to delete at least one other write request for the set of EDSs to the DSN memory or at least one other write request for another set of EDSs to the DSN memory and transmit the set of EDSs to the DSN memory for storage therein based on the modified write sequence operational resources; and

when modification of the write sequence operational resources does not provide for the sufficient amount of the write sequence operational resources of the DSN to execute the write request for the set of EDSs to the DSN memory, transmit a response that indicates a write sequence operational resources failure issue to another computing device.

10. The computing device of claim 9, wherein the processing module, when operable within the computing device based on the operational instructions, is further configured to:

determine whether the modification of the write sequence operational resources provides for the sufficient amount of the write sequence operational resources of the DSN to execute the write request for the set of EDSs to the DSN memory including to determine whether at least a write threshold number of favorable write responses have been received for at least one other write request for another set of EDSs to the DSN memory; and

determine that modification of the write sequence operational resources provides for the sufficient amount of the write sequence operational resources of the DSN to execute the write request for the set of EDSs to the DSN memory when the at least write threshold number of favorable write responses have been received for the at least one other write request for the another set of EDSs to the DSN memory, wherein a write threshold number of EDSs provides for a successful transfer of the set of EDSs from a first at least one location in the DSN to a second at least one location in the DSN.

11. The computing device of claim 9, wherein the computing device is located at a first premises that is remotely located from at least one storage unit (SU) of a plurality of SUs within the DSN memory that distributedly store the set of EDSs.

12. The computing device of claim 9 further comprising:

a storage unit (SU) of a plurality of SUs within the DSN memory that distributedly store the set of EDSs, a wireless smart phone, a laptop, a tablet, a personal computers (PC), a work station, or a video game device.

13. The computing device of claim 9, wherein the DSN includes at least one of a wireless communication system, a wire lined communication system, a non-public intranet system, a public internet system, a local area network (LAN), or a wide area network (WAN).

14. A method for execution by a computing device, the method comprising:

receiving, via an interface of the computing device to interface and communicate with a dispersed storage network (DSN), a data object for storage in DSN memory;

dispersed error encoding the data object to generate a set of encoded data slices (EDSs), wherein the data object is segmented into a plurality of data segments, wherein a data segment of the plurality of data segments is dispersed error encoded in accordance with dispersed error encoding parameters to produce the set of EDSs that includes a pillar width number of EDSs, wherein a decode threshold number of EDSs of the set of EDSs are needed to recover the data segment, wherein the dispersed error encoding parameters include an encoding matrix with a size that is based on the pillar width number and the decode threshold number;

determining whether there are a sufficient amount of write sequence operational resources of the DSN are available within the DSN to execute a write request for the set of EDSs to the DSN memory, wherein the write sequence operational resources of the DSN include one or more queues in communication with the DSN memory that facilitate transmission of requests to the DSN memory and reception of responses from the DSN memory in accordance with a queue prioritization scheme;

when the sufficient amount of the write sequence operational resources of the DSN are determined to be available within the DSN to execute the write request for the set of EDSs to the DSN memory, transmitting the set of EDSs to the DSN memory for storage therein;

when the sufficient amount of the write sequence operational resources of the DSN determined not to be available within the DSN to execute the write request for the set of EDSs to the DSN memory;

determining whether modification of the write sequence operational resources provides for the sufficient amount of the write sequence operational resources of the DSN to execute the write request for the set of EDSs to the DSN memory;

when modification of the write sequence operational resources provides for the sufficient amount of the write sequence operational resources of the DSN to execute the write request for the set of EDSs to the DSN memory, performing the modification of the write sequence operational resources to generate modified write sequence operational resources and transmit the set of EDSs to the DSN memory for storage therein based on the modified write sequence operational resources; and

when modification of the write sequence operational resources does not provide for the sufficient amount of the write sequence operational resources of the DSN to execute the write request for the set of EDSs to the DSN memory, transmitting a response that indicates a write sequence operational resources failure issue to another computing device.

15. The method of claim 14 further comprising:

determining there are the sufficient amount of the write sequence operational resources of the DSN available within the DSN to execute the write request for the set of EDSs to the DSN memory based on a data size indicator associated with the write request for the set of EDSs to the DSN memory comparing favorably to the write sequence operational resources of the DSN.

16. The method of claim 14 further comprising:

determining there are the sufficient amount of the write sequence operational resources of the DSN available within the DSN to execute the write request for the set of EDSs to the DSN memory based on available DSN resources comparing favorably to the write sequence operational resources of the DSN.

17. The method of claim 14 further comprising:

performing the modification of the write sequence operational resources to generate the modified write sequence operational resources including to delete at least one other write request for the set of EDSs to the DSN memory or at least one other write request for another set of EDSs to the DSN memory.

18. The method of claim 14 further comprising:

determining whether the modification of the write sequence operational resources provides for the sufficient amount of the write sequence operational resources of the DSN to execute the write request for the set of EDSs to the DSN memory including to determine whether at least a write threshold number of favorable write responses have been received for at least one other write request for another set of EDSs to the DSN memory; and

determining that modification of the write sequence operational resources provides for the sufficient amount of the write sequence operational resources of the DSN to execute the write request for the set of EDSs to the DSN memory when the at least write threshold number of favorable write responses have been received for the at least one other write request for the another set of EDSs to the DSN memory, wherein a write threshold number of EDSs provides for a successful transfer of the set of EDSs from a first at least one location in the DSN to a second at least one location in the DSN.

19. The method of claim 14, wherein the computing device includes a storage unit (SU) of a plurality of SUs within the DSN memory that distributedly store the set of EDSs, a wireless smart phone, a laptop, a tablet, a personal computers (PC), a work station, or a video game device.

20. The method of claim 14, wherein the DSN includes at least one of a wireless communication system, a wire lined communication system, a non-public intranet system, a public internet system, a local area network (LAN), or a wide area network (WAN).