Non-temporarily storing temporarily stored data in a dispersed storage network

• US 10,102,068 B2
• Filed: 08/01/2016
• Issued: 10/16/2018
• Est. Priority Date: 06/25/2012
• Status: Active Grant

• Current Assignee: Pure Storage, Inc.
• Original Assignee: International Business Machines Corporation
• Inventors: Gladwin, S. Christopher, Markison, Timothy W., Dhuse, Greg, Shirley, Jr., Thomas Franklin, Leggette, Wesley, Resch, Jason K., Grube, Gary W.
• Primary Examiner(s): Butler, Sarai E
• Application Number:
  US15/224,839
• Publication Number:
  US 20160342474A1
• Time in Patent Office: 806 Days
• Field of Search: 714 61, 714 62
• CPC Class Codes: G06F 11/1076 Parity data used in redundant arrays of independent storages, e.g. in RAID systems
• CPC Class Codes: G06F 12/1458 by checking the subject access rights
• CPC Class Codes: G06F 21/00 Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
• CPC Class Codes: G06F 21/6218 to a system of files or objects, e.g. local or distributed file system or database
• CPC Class Codes: G06F 2211/1028 Distributed, i.e. distributed RAID systems with parity
• CPC Class Codes: G06F 3/06 Digital input from, or digital output to, record carriers , e.g. RAID, emulated record carriers or networked record carriers
• CPC Class Codes: G06F 3/0619 in relation to data integrity, e.g. data losses, bit errors
• CPC Class Codes: G06F 3/064 Management of blocks
• CPC Class Codes: G06F 3/067 Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
• CPC Class Codes: H03M 13/2903 Methods and arrangements specifically for encoding, e.g. parallel encoding of a plurality of constituent codes
• CPC Class Codes: H04L 67/1097 for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]

Abstract

A method includes dispersed storage error encoding a data object in accordance with temporary parameters. The method further includes generating a first source name. The method further includes sending, in accordance with the first source name, the first sets of encoded data slices to a first set of storage units for temporary storage therein. When a determination is made to permanently store the data object, the method further includes recovering the data object from the first sets of encoded data slices. The method further includes dispersed storage error encoding the recovered data object in accordance with permanent parameters to produce second sets of encoded data slices. The method further includes generating a second source name. The method further includes sending, in accordance with the second source name, the second sets of encoded data slices to a second set of storage units for permanent storage therein.

Claims

1. A method for execution by a computing device of a dispersed storage network (DSN), the method comprises:

dispersed storage error encoding a data object in accordance with temporary parameters to produce a first plurality of sets of encoded data slices;

generating a first source name for the first plurality of sets of encoded data slices;

sending, in accordance with the first source name, the first plurality of sets of encoded data slices to a first set of storage units for temporary storage therein;

when a determination is made to permanently store the data object;

retrieving, from the first set of storage units, a decode threshold number of encoded data slices per set of the first plurality of sets of encoded data slices;

recovering the data object from the decode threshold number of encoded data slices per set of the first plurality of sets of encoded data slices;

dispersed storage error encoding the recovered data object in accordance with permanent parameters to produce a second plurality of sets of encoded data slices;

generating a second source name for the second plurality of sets of encoded data slices; and

sending, in accordance with the second source name, the second plurality of sets of encoded data slices to a second set of storage units for permanent storage therein.

2. The method of claim 1 further comprises:

the temporary parameters including a first pillar width number and first decode threshold number, wherein a first level of redundancy corresponds to a difference between the first pillar width number and the first decode threshold number; and

the permanent parameters including a second pillar width number and second decode threshold number, wherein a second level of redundancy corresponds to a difference between the second pillar width number and the second decode threshold number, and the second level of redundancy is greater than the first level of redundancy.

3. The method of claim 1, wherein generating the first source name comprises:

identifying desired storage attributes for temporary storage of the first plurality of sets of encoded data slices;

selecting a function based on the desired storage attributes;

generating a write operation regarding the first plurality of sets of encoded data slices; and

performing a deterministic function on the write operation using the desired storage attributes to produce the first source name, which corresponds to DSN addresses within a range of DSN addresses attributable to the first set of storage units.

4. The method of claim 3 further comprises:

generating a plurality of sets of slice names for the first plurality of sets of encoded data slices based on the deterministic function and on the first source name.

5. The method of claim 1, wherein generating the second source name comprises:

identifying desired storage attributes for permanent storage of the second plurality of sets of encoded data slices;

selecting a function based on the desired storage attributes;

generating a write operation regarding the second plurality of sets of encoded data slices; and

performing a deterministic function on the write operation using the desired storage attributes to produce the second source name, which corresponds to DSN addresses within a range of DSN addresses attributable to the second set of storage units.

6. The method of claim 5 further comprises:

generating a plurality of sets of slice names for the second plurality of sets of encoded data slices based on the deterministic function and on the second source name.

7. A dispersed storage (DS) module comprises:

a first module, when operable within a computing device of a dispersed storage network (DSN), causes the computing device to;

dispersed storage error encode a data object in accordance with temporary parameters to produce a first plurality of sets of encoded data slices;

generate a first source name for the first plurality of sets of encoded data slices;

send, in accordance with the first source name, the first plurality of sets of encoded data slices to a first set of storage units for temporary storage therein; and

a second module, when operable within the computing device, causes the computing device to, when a determination is made to permanently store the data object;

retrieve, from the first set of storage units, a decode threshold number of encoded data slices per set of the first plurality of sets of encoded data slices;

recover the data object from the decode threshold number of encoded data slices per set of the first plurality of sets of encoded data slices;

dispersed storage error encode the recovered data object in accordance with permanent parameters to produce a second plurality of sets of encoded data slices;

generate a second source name for the second plurality of sets of encoded data slices; and

send, in accordance with the second source name, the second plurality of sets of encoded data slices to a second set of storage units for permanent storage therein.

8. The DS module of claim 7 further comprises:

the temporary parameters including a first pillar width number and first decode threshold number, wherein a first level of redundancy corresponds to a difference between the first pillar width number and the first decode threshold number; and

the permanent parameters including a second pillar width number and second decode threshold number, wherein a second level of redundancy corresponds to a difference between the second pillar width number and the second decode threshold number, and the second level of redundancy is greater than the first level of redundancy.

9. The DS module of claim 7, wherein the first module, when operable within the computing device, further causes the computing device to generate the first source name by:

identifying desired storage attributes for temporary storage of the first plurality of sets of encoded data slices;

selecting a function based on the desired storage attributes;

generating a write operation regarding the first plurality of sets of encoded data slices; and

performing a deterministic function on the write operation using the desired storage attributes to produce the first source name, which corresponds to DSN addresses within a range of DSN addresses attributable to the first set of storage units.

10. The DS module of claim 9, wherein the first module, when operable within the computing device, further causes the computing device to:

generate a plurality of sets of slice names for the first plurality of sets of encoded data slices based on the deterministic function and on the first source name.

11. The DS module of claim 7, wherein the second module, when operable within the computing device, further causes the computing device to generate the second source name by:

identifying desired storage attributes for permanent storage of the second plurality of sets of encoded data slices;

selecting a function based on the desired storage attributes;

generating a write operation regarding the second plurality of sets of encoded data slices; and

performing a deterministic function on the write operation using the desired storage attributes to produce the second source name, which corresponds to DSN addresses within a range of DSN addresses attributable to the second set of storage units.

12. The DS module of claim 11, wherein the second module, when operable within the computing device, further causes the computing device to:

generate a plurality of sets of slice names for the second plurality of sets of encoded data slices based on the deterministic function and on the second source name.