Multi-level stage locality selection on a large system

• US 10,394,476 B2
• Filed: 08/08/2017
• Issued: 08/27/2019
• Est. Priority Date: 04/30/2014
• Status: Active Grant

• Current Assignee: Pure Storage, Inc.
• Original Assignee: Pure Storage, Inc.
• Inventors: Baptist, Andrew D., Resch, Jason K., Volvovski, Ilya
• Primary Examiner(s): Schell, Joseph O
• Application Number:
  US15/671,670
• Publication Number:
  US 20170351454A1
• Time in Patent Office: 749 Days
• CPC Class Codes: G06F 11/0727 in a storage system, e.g. in a DASD or network based storage system drivers for digital recording or reproducing units G06F3/06; circuits for error detection or correction within digital recording or reproducing units G11B20/18; for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS], H04L67/1097
• CPC Class Codes: G06F 11/0754 by exceeding limits
• CPC Class Codes: G06F 11/1076 Parity data used in redundant arrays of independent storages, e.g. in RAID systems
• CPC Class Codes: G06F 11/2058 using more than 2 mirrored copies
• CPC Class Codes: G06F 11/2094 Redundant storage or storage space G06F11/2056 takes precedence
• CPC Class Codes: G06F 3/0619 in relation to data integrity, e.g. data losses, bit errors
• CPC Class Codes: G06F 3/0631 by allocating resources to storage systems
• CPC Class Codes: G06F 3/0638 Organizing or formatting or addressing of data
• CPC Class Codes: G06F 3/064 Management of blocks
• CPC Class Codes: G06F 3/0644 Management of space entities, e.g. partitions, extents, pools
• CPC Class Codes: G06F 3/0653 Monitoring storage devices or systems
• CPC Class Codes: G06F 3/067 Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
• CPC Class Codes: H04L 2209/34 Encoding or coding, e.g. Huffman coding or error correction
• CPC Class Codes: H04L 67/1097 for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
• CPC Class Codes: H04L 9/0618 Block ciphers, i.e. encrypting groups of characters of a plain text message using fixed encryption transformation

Abstract

A method for execution by a computing device of a dispersed storage network (DSN). The method begins with obtaining a plurality of write requests. The method continues where for a write request of the plurality of write requests, the computing device generates a vault identification and a generation number. The method continues where the computing device obtains a rounded timestamp and a capacity factor and generates a temporary object number based on the rounded timestamp and the capacity factor. The method continues where the computing device generates a temporary source name based on the vault identification, the generation number, and the temporary object number. The method continues where the computing device identifies a set of storage units of a plurality of sets of storage units of the DSN based on the temporary source name.

Claims

1. A method for execution by a computing device of a dispersed storage network (DSN), the method comprises:

obtaining a plurality of write requests; and

for a write request of the plurality of write requests;

generating a vault identification and a generation number;

obtaining a rounded timestamp and a capacity factor;

generating a temporary object number based on the rounded timestamp and the capacity factor;

generating a temporary source name based on the vault identification, the generation number, and the temporary object number; and

identifying a set of storage units of a plurality of sets of storage units of the DSN based on the temporary source name.

2. The method of claim 1, wherein the temporary object number is generated by performing a first deterministic function on the rounded timestamp and the capacity factor.

3. The method of claim 1 further comprises:

generating an object number modifier based on the rounded timestamp and the capacity factor;

combining the temporary source name and the object number modifier to produce a source name, wherein the source name includes the vault identification, the generation number and an object number, wherein the temporary object number is modified based on the object number modifier to produce the object number;

dispersed storage error encoding one or more data segments of the write request to produce one or more sets of encoded data slices;

generating one or more sets of slice names using the source name, wherein the one or more sets of slice names correspond to the one or more sets of encoded data slices; and

issuing at least one set of write slice requests to the set of storage units, wherein the at least one set of write slice requests includes the one or more sets of encoded data slices and the one or more sets of slice names.

4. The method of claim 3, wherein the object number modifier is generated by performing a second deterministic function on the rounded timestamp and the capacity factor.

5. The method of claim 1, wherein the capacity factor includes at least one of:

an expected processing performance level of a set of storage units of the plurality of sets of storage units of the DSN; and

an expected processing performance level of the computing device.

6. The method of claim 1, wherein the obtaining the capacity factor includes at least one of:

determining the capacity factor based on performance information for available sets of storage units;

performing a lookup;

interpreting an error message; and

identifying a capacity level of the computing device.

7. The method of claim 1, wherein the obtaining the rounded timestamp comprises one of:

during a time period, generating the rounded timestamp by rounding a current timestamp up to an end of the time period; and

receiving the rounded timestamp.

8. The method of claim 1, wherein the generating the vault identification and the generation number includes one or more of:

performing a registry lookup;

accessing a requesting entity to vault identification (ID) table; and

determining a current generation number indicator for the vault ID.

9. A computing device of a dispersed storage network (DSN) comprises:

memory;

an interface; and

a processing module operably coupled to the memory and the interface, wherein the processing module is operable to;

obtain a plurality of write requests; and

for a write request of the plurality of write requests;

generate a vault identification and a generation number;

obtain a rounded timestamp and a capacity factor;

generate a temporary object number based on the rounded timestamp and the capacity factor;

generate a temporary source name based on the vault identification, the generation number, and the temporary object number; and

identify a set of storage units of a plurality of sets of storage units of the DSN based on the temporary source name.

10. The computing device of claim 9, wherein the processing module is operable to generate the temporary object number by performing a first deterministic function on the rounded timestamp and the capacity factor.

11. The computing device of claim 9, wherein the processing module is further operable to:

generate an object number modifier based on the rounded timestamp and the capacity factor;

combine the temporary source name and the object number modifier to produce a source name, wherein the source name includes the vault identification, the generation number and an object number, wherein the temporary object number is modified based on the object number modifier to produce the object number;

dispersed storage error encode data of the write request to produce one or more sets of encoded data slices;

generate one or more sets of slice names using the source name, wherein the one or more sets of slice names correspond to the one or more sets of encoded data slices; and

issue at least one set of write slice requests to the set of storage units, wherein the at least one set of write slice requests includes the one or more sets of encoded data slices and the one or more sets of slice names.

12. The computing device of claim 11, wherein the processing module is further operable to generate the object number modifier by performing a second deterministic function on the rounded timestamp and the capacity factor.

13. The computing device of claim 9, wherein the capacity factor includes at least one of:

an expected processing performance level of a set of storage units of the plurality of sets of storage units of the DSN; and

an expected processing performance level of the computing device.

14. The computing device of claim 9, wherein the processing module is operable to obtain the capacity factor by at least one of:

determining the capacity factor based on performance information for available sets of storage units;

performing a lookup;

interpreting an error message; and

identifying a capacity level of the computing device.

15. The computing device of claim 9, wherein processing module is operable to obtain the rounded timestamp by:

during a time period, generating the rounded timestamp by rounding a current timestamp up to an end of the time period; and

receiving the rounded timestamp.

16. The computing device of claim 9, wherein the processing module is operable to generate the vault identification and the generation number by one or more of:

performing a registry lookup;

accessing a requesting entity to vault identification (ID) table; and

determining a current generation number indicator for the vault ID.