Client provided request prioritization hints

• US 10,127,111 B2
• Filed: 09/28/2017
• Issued: 11/13/2018
• Est. Priority Date: 10/08/2012
• Status: Active Grant

• Current Assignee: Pure Storage, Inc.
• Original Assignee: International Business Machines Corporation
• Inventors: Alnafoosi, Ahmad, Baptist, Andrew D., Dhuse, Greg R., Resch, Jason K., Volvovski, Ilya
• Primary Examiner(s): Shin, Kyung H
• Application Number:
  US15/719,259
• Publication Number:
  US 20180018220A1
• Time in Patent Office: 411 Days
• CPC Class Codes: G06F 11/1076 Parity data used in redundant arrays of independent storages, e.g. in RAID systems
• CPC Class Codes: G06F 11/108 Parity data distribution in semiconductor storages, e.g. in SSD
• CPC Class Codes: G06F 11/1092 Rebuilding, e.g. when physically replacing a failing disk
• CPC Class Codes: G06F 16/215 Improving data quality; Data cleansing, e.g. de-duplication, removing invalid entries or correcting typographical errors
• CPC Class Codes: G06F 21/64 Protecting data integrity, e.g. using checksums, certificates or signatures
• CPC Class Codes: G06F 3/0619 in relation to data integrity, e.g. data losses, bit errors
• CPC Class Codes: G06F 3/064 Management of blocks
• CPC Class Codes: G06F 3/0659 Command handling arrangements, e.g. command buffers, queues, command scheduling
• CPC Class Codes: G06F 3/067 Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
• CPC Class Codes: G06F 9/5027 the resource being a machine, e.g. CPUs, Servers, Terminals
• CPC Class Codes: H04L 43/0852 Delays
• CPC Class Codes: H04L 47/70 Admission control; Resource allocation
• CPC Class Codes: H04L 63/08 for authentication of entities cryptographic mechanisms or cryptographic arrangements for entity authentication H04L9/32
• CPC Class Codes: H04L 63/101 Access control lists [ACL]
• CPC Class Codes: H04L 67/10 in which an application is distributed across nodes in the network software deployment G06F8/60; multiprogramming arrangements G06F9/46
• CPC Class Codes: H04L 67/1097 for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
• CPC Class Codes: H04L 67/61 taking into account QoS or priority requirements

Abstract

A computing device includes an interface configured to interface and communicate with a dispersed storage network (DSN), a memory that stores operational instructions, and a processing module operably coupled to the interface and memory such that the processing module, when operable within the computing device based on the operational instructions, is configured to perform various operations. For example, the computing device generates a prioritized request that includes at least one of a task for execution or a priority level based on information stored within a storage unit (SU) of a plurality of storage units (SUs) implemented within the DSN. Note that the information corresponds to a data object that is related to a set of encoded data slices (EDSs) that are distributedly stored within the DSN. The computing device then transmits the prioritized request to the SU and receives, from the SU, a response to the prioritized request.

Claims

1. A computing device comprising:

an interface configured to interface and communicate with a dispersed or distributed storage network (DSN);

memory that stores operational instructions; and

a processing module operably coupled to the interface and to the memory, wherein the processing module, when operable within the computing device based on the operational instructions, is configured to;

generate a prioritized request that includes at least one of a task for execution or a priority level based on information stored within a storage unit (SU) of a plurality of storage units (SUs) implemented within the DSN, wherein the information corresponds to a data object is segmented into a plurality of data segments, wherein a data segment of the plurality of data segments is dispersed error encoded in accordance with dispersed error encoding parameters to produce a set of encoded data slices (EDSs), wherein the set of EDSs are distributedly stored among a plurality of SUs, and wherein a decode threshold number of EDSs are needed to recover the data segment;

transmit the prioritized request to the SU; and

receive, from the SU, a response to the prioritized request, wherein the response is based on an execution priority level that indicates a priority value level relative to other execution priority levels of other prioritized requests when the SU determines to execute the prioritized request.

2. The computing device of claim 1, wherein the response includes a rejection level when the SU determines not to execute the prioritized request;

and the processing module, when operable within the computing device based on the operational instructions, is further configured to;

re-transmit the prioritized request to the SU;

or

generate another prioritized request that includes another priority level based on information stored within the SU of the plurality of SUs implemented within the DSN and transmit the another prioritized request to the SU.

3. The computing device of claim 1, wherein the priority level is based on at least one of a previous response corresponding to the prioritized request, a request type of the prioritized request, a timing requirement associated of the prioritized request, a priority input prioritized request, or a data type associated with the prioritized request.

4. The computing device of claim 1, wherein the execution priority level is determined by the SU and is based on at least one of a current loading level of the SU, at least one execution priority level of at least one previously queued prioritized request, or a priority level of the prioritized request.

5. The computing device of claim 1, wherein the processing module, when operable within the computing device based on the operational instructions, is further configured to:

receive, from the SU when the SU determines to execute the prioritized request, a subsequent response that includes a result of execution of the prioritized request as generated by the SU.

6. The computing device of claim 1, wherein:

a read threshold number of EDSs provides for reconstruction of the data segment;

a write threshold number of EDSs provides for a successful transfer of the set of EDSs from a first at least one location in the DSN to a second at least one location in the DSN;

the set of EDSs is of pillar width and includes a pillar number of EDSs;

each of the decode threshold number, the read threshold number, and the write threshold number is less than the pillar number; and

the write threshold number is greater than or equal to the read threshold number that is greater than or equal to the decode threshold number.

7. The computing device of claim 1 further comprising:

one of the plurality of SUs within the DSN, a wireless smart phone, a laptop, a tablet, a personal computers (PC), a work station, or a video game device.

8. The computing device of claim 1, wherein the DSN includes at least one of a wireless communication system, a wire lined communication system, a non-public intranet system, a public internet system, a local area network (LAN), or a wide area network (WAN).

9. A computing device comprising:

an interface configured to interface and communicate with a dispersed or distributed storage network (DSN);

memory that stores operational instructions; and

a processing module operably coupled to the interface and to the memory, wherein the processing module, when operable within the computing device based on the operational instructions, is configured to;

generate a prioritized request that includes at least one of a task for execution or a priority level based on information stored within a storage unit (SU) of a plurality of storage units (SUs) implemented within the DSN, wherein the information corresponds to a data object is segmented into a plurality of data segments, wherein a data segment of the plurality of data segments is dispersed error encoded in accordance with dispersed error encoding parameters to produce a set of encoded data slices (EDSs), wherein the set of EDSs are distributedly stored among a plurality of SUs, and wherein a decode threshold number of EDSs are needed to recover the data segment;

transmit the prioritized request to the SU;

when the SU determines to execute the prioritized request;

receive, from the SU, a response to the prioritized request, wherein the response is based on an execution priority level that indicates a priority value level relative to other execution priority levels of other prioritized requests; and

receive, from the SU, a subsequent response that includes a result of execution of the prioritized request as generated by the SU; and

when the SU determines not to execute the prioritized request;

receive, from the SU, another response to the prioritized request that includes a rejection level; and

re-transmit the prioritized request to the SU;

or

generate another prioritized request that includes another priority level based on information stored within the SU of the plurality of SUs implemented within the DSN and transmit the another prioritized request to the SU.

10. The computing device of claim 9, wherein:

the priority level is based on at least one of a previous response corresponding to the prioritized request, a request type of the prioritized request, a timing requirement associated of the prioritized request, a priority input prioritized request, or a data type associated with the prioritized request; and

the execution priority level is determined by the SU and is based on at least one of a current loading level of the SU, at least one execution priority level of at least one previously queued prioritized request, or a priority level of the prioritized request.

11. The computing device of claim 9, wherein:

a read threshold number of EDSs provides for reconstruction of the data segment;

a write threshold number of EDSs provides for a successful transfer of the set of EDSs from a first at least one location in the DSN to a second at least one location in the DSN;

the set of EDSs is of pillar width and includes a pillar number of EDSs;

each of the decode threshold number, the read threshold number, and the write threshold number is less than the pillar number; and

the write threshold number is greater than or equal to the read threshold number that is greater than or equal to the decode threshold number.

12. The computing device of claim 9 further comprising:

one of the plurality of SUs within the DSN, a wireless smart phone, a laptop, a tablet, a personal computers (PC), a work station, or a video game device.

13. The computing device of claim 9, wherein the DSN includes at least one of a wireless communication system, a wire lined communication system, a non-public intranet system, a public internet system, a local area network (LAN), or a wide area network (WAN).

14. A method for execution by a computing device, the method comprising:

generating a prioritized request that includes at least one of a task for execution or a priority level based on information stored within a storage unit (SU) of a plurality of storage units (SUs) implemented within a dispersed or distributed storage network (DSN), wherein the information corresponds to a data object is segmented into a plurality of data segments, wherein a data segment of the plurality of data segments is dispersed error encoded in accordance with dispersed error encoding parameters to produce a set of encoded data slices (EDSs), wherein the set of EDSs are distributedly stored among a plurality of SUs, and wherein a decode threshold number of EDSs are needed to recover the data segment;

transmitting, via an interface of the computing device configured to interface and communicate with the DSN, the prioritized request to the SU; and

receiving, via the interface and from the SU, a response to the prioritized request, wherein the response is based on an execution priority level that indicates a priority value level relative to other execution priority levels of other prioritized requests when the SU determines to execute the prioritized request.

15. The method of claim 14, wherein the response includes a rejection level when the SU determines not to execute the prioritized request;

and further comprising;

re-transmitting, via the interface, the prioritized request to the SU;

or

generating another prioritized request that includes another priority level based on information stored within the SU of the plurality of SUs implemented within the DSN and transmitting, via the interface, the another prioritized request to the SU.

16. The method of claim 14, wherein the priority level is based on at least one of a previous response corresponding to the prioritized request, a request type of the prioritized request, a timing requirement associated of the prioritized request, a priority input prioritized request, or a data type associated with the prioritized request.

17. The method of claim 14, wherein the execution priority level is determined by the SU and is based on at least one of a current loading level of the SU, at least one execution priority level of at least one previously queued prioritized request, or a priority level of the prioritized request.

18. The method of claim 14 further comprising:

receiving, via the interface and from the SU when the SU determines to execute the prioritized request, a subsequent response that includes a result of execution of the prioritized request as generated by the SU.

19. The method of claim 14, wherein:

a read threshold number of EDSs provides for reconstruction of the data segment;

a write threshold number of EDSs provides for a successful transfer of the set of EDSs from a first at least one location in the DSN to a second at least one location in the DSN;

the set of EDSs is of pillar width and includes a pillar number of EDSs;

each of the decode threshold number, the read threshold number, and the write threshold number is less than the pillar number; and

the write threshold number is greater than or equal to the read threshold number that is greater than or equal to the decode threshold number.

20. The method of claim 14, wherein at least one of:

the computing device includes a SU of the plurality of SUs within the DSN, a wireless smart phone, a laptop, a tablet, a personal computers (PC), a work station, or a video game device;

or

the DSN includes at least one of a wireless communication system, a wire lined communication system, a non-public intranet system, a public internet system, a local area network (LAN), or a wide area network (WAN).