Accessing a dispersed storage network

• US 9,923,838 B2
• Filed: 05/08/2015
• Issued: 03/20/2018
• Est. Priority Date: 06/30/2014
• Status: Active Grant

• Current Assignee: Pure Storage, Inc.
• Original Assignee: International Business Machines Corporation
• Inventors: Resch, Jason K., Dhuse, Greg, Motwani, Manish, Baptist, Andrew, Leggette, Wesley, Khadiwala, Ravi
• Primary Examiner(s): Nguyen, Phuoc
• Application Number:
  US14/707,943
• Publication Number:
  US 20150381730A1
• Time in Patent Office: 1,047 Days
• Field of Search: 709212-216
• CPC Class Codes: G06F 3/0616 in relation to life time, e.g. increasing Mean Time Between Failures [MTBF]
• CPC Class Codes: G06F 3/0623 in relation to content
• CPC Class Codes: G06F 3/0647 Migration mechanisms
• CPC Class Codes: G06F 3/067 Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
• CPC Class Codes: G06F 3/0685 Hybrid storage combining heterogeneous device types, e.g. hierarchical storage, hybrid arrays
• CPC Class Codes: H04L 47/70 Admission control; Resource allocation
• CPC Class Codes: H04L 67/1097 for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]

Abstract

A method begins by a dispersed storage (DS) processing module of a dispersed storage network (DSN) receiving a DSN access request regarding at least one data segment of a data object. The method continues with the processing module performing a scoring function using one or more properties of the DSN access request and one or more properties of DSN memory of the DSN to produce a storage scoring resultant, where the DSN memory includes a plurality of storage units that are logically arranged into a plurality of storage pools. The method continues with the processing module utilizing the storage scoring resultant to identify a set of storage units of the plurality of storage units affiliated with a given storage pool of the plurality of storage pools. The method continues with the processing module sending a set of access requests to the set of storage units regarding the DSN access request.

Claims

1. A method for execution by one or more processing modules of one or more computing devices of a dispersed storage network (DSN), the method comprises:

receiving a DSN access request regarding at least one data segment of a data object;

performing a scoring function using one or more properties of the DSN access request and one or more properties of DSN memory of the DSN to produce a storage scoring resultant, wherein the DSN memory includes a plurality of storage units that are logically arranged into a plurality of storage pools;

utilizing the storage scoring resultant to identify a set of storage units of the plurality of storage units affiliated with a given storage pool of the plurality of storage pools; and

sending a set of access requests to the set of storage units regarding the DSN access request.

2. The method of claim 1 further comprises:

when the storage scoring resultant identifies the given storage pool, utilizing one or more other properties of the DSN memory to identify storage units affiliated with the given storage pool; and

using the identified storage units as the set of storage units.

3. The method of claim 1 further comprises:

when the storage scoring resultant identifies a pillar width number of storage units, utilizing one or more properties of storage units in the pillar width number of storage units to identify at least a decode threshold number of storage units; and

using the decode threshold number of storage units as the set of storage units.

4. The method of claim 1 further comprises:

when the storage scoring resultant identifies particular memory devices within storage units of the plurality of storage units, utilizing one or more properties of storage units in a pillar width number of storage units to identify at least a decode threshold number of storage units;

utilizing one or more properties of memory devices within storage units of the at least a decode threshold number of storage units to identify the set of storage units; and

sending the set of access requests to the set of storage units regarding the DSN access request, wherein the set of access requests includes indications of particular memory devices within the set of storage units, wherein the indications of particular memory devices are based on the one or more properties of the memory devices.

5. The method of claim 1, wherein the performing the scoring function further comprises:

selecting a resource level relating to the DSN memory; and

selecting the one or more properties of the DSN memory from a plurality of properties of the DSN memory based on the selected resource level.

6. The method of claim 5 further comprises:

calculating, based on the selected resource level, a plurality of storage values based on the one or more properties of the DSN access request and the one or more properties of DSN memory; and

performing a ranking function of the plurality of storage values to produce the storage scoring resultant.

7. The method of claim 1, wherein the performing the scoring function further comprises:

selecting a storage pool level indication as a resource level;

selecting a storage pool identifier and a storage pool weighting factor for each of the plurality of storage pools to produce a plurality of storage pool identifiers and a plurality of storage pool weighting factors, wherein the one or more properties of DSN memory includes the plurality of storage pool identifiers and the plurality of storage pool weighting factors;

selecting a source name of the DSN access request as the one or more properties of the DSN access request;

performing a series of functions on the source name based on the plurality of storage pool identifiers and the plurality of storage pool weighting factors to produce a plurality of storage values; and

performing a ranking function of the plurality of storage values to produce the storage scoring resultant.

8. The method of claim 7, wherein a series of the series of functions comprises:

a deterministic function of the source name and one of the storage pool identifiers to produce an interim result;

a normalizing function of the interim result to produce a normalized interim result; and

a scoring function of the normalized interim result and a corresponding one of the storage pool weighting factors to produce a storage value of the plurality of storage values.

9. The method of claim 1, wherein the performing the scoring function further comprises:

selecting a storage unit level indication as a resource level;

selecting a storage site-storage unit identifier and a storage site-storage weighting factor for each of the plurality of storage units to produce a plurality of storage site-storage unit identifiers and a plurality of storage site-storage unit weighting factors, wherein the one or more properties of DSN memory includes the plurality of storage site-storage unit identifiers and the plurality of storage site-storage unit weighting factors;

selecting a source name of the DSN access request as the one or more properties of the DSN access request;

performing a series of functions on the source name based on the plurality of storage site-storage unit identifiers and the plurality of storage site-storage unit weighting factors to produce a plurality of storage values; and

performing a ranking function of the plurality of storage values to produce the storage scoring resultant.

10. A non-transitory computer readable storage medium comprises:

at least one memory section that stores operational instructions that, when executed by one or more processing modules of one or more computing devices of a dispersed storage network (DSN), causes the one or more computing devices to;

receive a DSN access request regarding at least one data segment of a data object;

perform a scoring function using one or more properties of the DSN access request and one or more properties of DSN memory of the DSN to produce a storage scoring resultant, wherein the DSN memory includes a plurality of storage units that are logically arranged into a plurality of storage pools;

utilize the storage scoring resultant to identify a set of storage units of the plurality of storage units affiliated with a given storage pool of the plurality of storage pools; and

send a set of access requests to the set of storage units regarding the DSN access request.

11. The non-transitory computer readable storage medium of claim 10 further comprises:

the at least one memory section stores further operational instructions that, when executed by the one or more processing modules, causes the one or more computing devices of the DSN to;

when the storage scoring resultant identifies the given storage pool, utilize one or more other properties of the DSN memory to identify storage units affiliated with the given storage pool; and

use the identified storage units as the set of storage units.

12. The non-transitory computer readable storage medium of claim 10 further comprises:

the at least one memory section stores further operational instructions that, when executed by the one or more processing modules, causes the one or more computing devices of the DSN to;

when the storage scoring resultant identifies a pillar width number of storage units, utilize one or more properties of storage units in the pillar width number of storage units to identify at least a decode threshold number of storage units; and

use the decode threshold number of storage units as the set of storage units.

13. The non-transitory computer readable storage medium of claim 10 further comprises:

the at least one memory section stores further operational instructions that, when executed by the one or more processing modules, causes the one or more computing devices of the DSN to;

when the storage scoring resultant identifies particular memory devices within storage units of the plurality of storage units, utilize one or more properties of storage units in a pillar width number of storage units to identify at least a decode threshold number of storage units;

utilize one or more properties of memory devices within storage units of the at least a decode threshold number of storage units to identify the set of storage units; and

send the set of access requests to the set of storage units regarding the DSN access request, wherein the set of access requests includes indications of particular memory devices within the set of storage units, wherein the indications of particular memory devices are based on the one or more properties of the memory devices.

14. The non-transitory computer readable storage medium of claim 10, wherein the one or more processing modules functions to execute the operational instructions stored by the at least one memory section to cause the one or more computing devices of the DSN to further perform the scoring function by:

selecting a resource level relating to the DSN memory; and

selecting the one or more properties of the DSN memory from a plurality of properties of the DSN memory based on the selected resource level.

15. The non-transitory computer readable storage medium of claim 14 further comprises:

the at least one memory section stores further operational instructions that, when executed by the one or more processing modules, causes the one or more computing devices of the DSN to;

calculate, based on the selected resource level, a plurality of storage values based on the one or more properties of the DSN access request and the one or more properties of DSN memory; and

perform a ranking function of the plurality of storage values to produce the storage scoring resultant.

16. The non-transitory computer readable storage medium of claim 10, wherein the one or more processing modules functions to execute the operational instructions stored by the at least one memory section to cause the one or more computing devices of the DSN to further perform the scoring function by:

selecting a storage pool level indication as a resource level;

selecting a storage pool identifier and a storage pool weighting factor for each of the plurality of storage pools to produce a plurality of storage pool identifiers and a plurality of storage pool weighting factors, wherein the one or more properties of DSN memory includes the plurality of storage pool identifiers and the plurality of storage pool weighting factors;

selecting a source name of the DSN access request as the one or more properties of the DSN access request;

performing a series of functions on the source name based on the plurality of storage pool identifiers and the plurality of storage pool weighting factors to produce a plurality of storage values; and

performing a ranking function of the plurality of storage values to produce the storage scoring resultant.

17. The non-transitory computer readable storage medium of claim 16, wherein a series of the series of functions comprises:

a deterministic function of the source name and one of the storage pool identifiers to produce an interim result;

a normalizing function of the interim result to produce a normalized interim result; and

a scoring function of the normalized interim result and a corresponding one of the storage pool weighting factors to produce a storage value of the plurality of storage values.

18. The non-transitory computer readable storage medium of claim 10, wherein the one or more processing modules functions to execute the operational instructions stored by the at least one memory section to cause the one or more computing devices of the DSN to further perform the scoring function by:

selecting a storage unit level indication as a resource level;

selecting a storage site-storage unit identifier and a storage site-storage weighting factor for each of the plurality of storage units to produce a plurality of storage site-storage unit identifiers and a plurality of storage site-storage unit weighting factors, wherein the one or more properties of DSN memory includes the plurality of storage site-storage unit identifiers and the plurality of storage site-storage unit weighting factors;

selecting a source name of the DSN access request as the one or more properties of the DSN access request;

performing a series of functions on the source name based on the plurality of storage site-storage unit identifiers and the plurality of storage site-storage unit weighting factors to produce a plurality of storage values; and

performing a ranking function of the plurality of storage values to produce the storage scoring resultant.

19. A computing device of a group of computing devices of a dispersed storage network (DSN), the computing device comprises:

an interface;

a local memory; and

a processing module operably coupled to the interface and the local memory, wherein the processing module functions to;

receive, via the interface, a DSN access request regarding at least one data segment of a data object;

perform a scoring function using one or more properties of the DSN access request and one or more properties of DSN memory of the DSN to produce a storage scoring resultant, wherein the DSN memory includes a plurality of storage units that are logically arranged into a plurality of storage pools;

utilize the storage scoring resultant to identify a set of storage units of the plurality of storage units affiliated with a given storage pool of the plurality of storage pools; and

send, via the interface, a set of access requests to the set of storage units regarding the DSN access request.

20. The computing device of claim 19, wherein the processing module further functions to:

when the storage scoring resultant identifies the given storage pool, utilize one or more other properties of the DSN memory to identify storage units affiliated with the given storage pool; and

use the identified storage units as the set of storage units.

21. The computing device of claim 19, wherein the processing module further functions to:

when the storage scoring resultant identifies a pillar width number of storage units, utilize one or more properties of storage units in the pillar width number of storage units to identify at least a decode threshold number of storage units; and

use the decode threshold number of storage units as the set of storage units.

22. The computing device of claim 19, wherein the processing module further functions to:

when the storage scoring resultant identifies particular memory devices within storage units of the plurality of storage units, utilize one or more properties of storage units in a pillar width number of storage units to identify at least a decode threshold number of storage units;

utilize one or more properties of memory devices within storage units of the at least a decode threshold number of storage units to identify the set of storage units; and

send, via the interface, the set of access requests to the set of storage units regarding the DSN access request, wherein the set of access requests includes indications of particular memory devices within the set of storage units, wherein the indications of particular memory devices are based on the one or more properties of the memory devices.

23. The computing device of claim 19, wherein the processing module functions to further perform the scoring function by:

selecting a resource level relating to the DSN memory; and

selecting the one or more properties of the DSN memory from a plurality of properties of the DSN memory based on the selected resource level.

24. The computing device of claim 23, wherein the processing module further functions to:

calculate, based on the selected resource level, a plurality of storage values based on the one or more properties of the DSN access request and the one or more properties of DSN memory; and

perform a ranking function of the plurality of storage values to produce the storage scoring resultant.

25. The computing device of claim 19, wherein the processing module functions to further perform the scoring function by:

selecting a storage pool level indication as a resource level;

selecting a storage pool identifier and a storage pool weighting factor for each of the plurality of storage pools to produce a plurality of storage pool identifiers and a plurality of storage pool weighting factors, wherein the one or more properties of DSN memory includes the plurality of storage pool identifiers and the plurality of storage pool weighting factors;

selecting a source name of the DSN access request as the one or more properties of the DSN access request;

performing a series of functions on the source name based on the plurality of storage pool identifiers and the plurality of storage pool weighting factors to produce a plurality of storage values; and

performing a ranking function of the plurality of storage values to produce the storage scoring resultant.

26. The computing device of claim 25, wherein a series of the series of functions comprises:

a deterministic function of the source name and one of the storage pool identifiers to produce an interim result;

a normalizing function of the interim result to produce a normalized interim result; and

a scoring function of the normalized interim result and a corresponding one of the storage pool weighting factors to produce a storage value of the plurality of storage values.

27. The computing device of claim 19, wherein the processing module functions to further perform the scoring function by:

selecting a storage unit level indication as a resource level;

selecting a storage site-storage unit identifier and a storage site-storage weighting factor for each of the plurality of storage units to produce a plurality of storage site-storage unit identifiers and a plurality of storage site-storage unit weighting factors, wherein the one or more properties of DSN memory includes the plurality of storage site-storage unit identifiers and the plurality of storage site-storage unit weighting factors;

selecting a source name of the DSN access request as the one or more properties of the DSN access request;

performing a series of functions on the source name based on the plurality of storage site-storage unit identifiers and the plurality of storage site-storage unit weighting factors to produce a plurality of storage values; and

performing a ranking function of the plurality of storage values to produce the storage scoring resultant.