Upgrading devices in a dispersed storage network

• US 10,157,051 B2
• Filed: 07/22/2016
• Issued: 12/18/2018
• Est. Priority Date: 03/02/2012
• Status: Expired due to Fees

• Current Assignee: Pure Storage, Inc.
• Original Assignee: International Business Machines Corporation
• Inventors: Baptist, Andrew D., Clifone, Bart R., Cocagne, Thomas D., Kumar, Sanjaya, Motwani, Manish, Peake, Andrew G., Resch, Jason K., Shirley, Jr., Thomas F., Vas, Sebastien
• Primary Examiner(s): Channavajjala, Srirama T
• Application Number:
  US15/217,052
• Publication Number:
  US 20160328228A1
• Time in Patent Office: 879 Days
• CPC Class Codes: G06F 11/0727 in a storage system, e.g. in a DASD or network based storage system drivers for digital recording or reproducing units G06F3/06; circuits for error detection or correction within digital recording or reproducing units G11B20/18; for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS], H04L67/1097
• CPC Class Codes: G06F 11/0751 Error or fault detection not based on redundancy power supply failures G06F1/30; network fault management H04L41/06
• CPC Class Codes: G06F 11/0766 Error or fault reporting or storing
• CPC Class Codes: G06F 11/1076 Parity data used in redundant arrays of independent storages, e.g. in RAID systems
• CPC Class Codes: G06F 16/137 Hash-based content-based indexing of textual data G06F16/31
• CPC Class Codes: G06F 16/1824 implemented using Network-attached Storage [NAS] architecture distributed or networked storage systems G06F3/067; protocols for distributed storage of data in a network H04L67/1097
• CPC Class Codes: G06F 16/2365 Ensuring data consistency and integrity
• CPC Class Codes: G06F 16/9027 Trees
• CPC Class Codes: G06F 3/067 Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
• CPC Class Codes: G06F 8/65 Updates security arrangements therefor G06F21/57
• CPC Class Codes: H04L 67/1097 for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
• CPC Class Codes: H04L 67/34 involving the movement of software or configuration parameters network booting or remote initial program loading [RIPL] G06F9/4416

Abstract

A method for execution by a dispersed storage and task (DST) processing unit includes obtaining distributed storage and task network (DSTN) address range information for each memory device of a set of memory devices associated with a storage unit targeted for an upgrade; obtaining a list of slice names associated with selected slices stored in each memory device of the storage unit; retrieving the selected slices associated with the list of slice names; generating an integrity check value for the selected slices; storing one or more of: the integrity check value, the selected slices, or the list of slice names as original integrity information in a memory; and enabling an upgrade sequence of the DST execution unit.

Claims

1. A method for execution by a dispersed storage and task (DST) processing unit that includes a processor, the method comprises:

obtaining distributed storage and task network (DSTN) address range information for each memory device of a set of memory devices associated with a storage unit targeted for an upgrade;

obtaining a list of slice names associated with selected slices stored in each memory device of the storage unit, wherein a data segment was dispersed storage error encoded to produce a set of encoded data slices for storage in a set of storage units that includes the storage unit, and wherein the set of encoded data slices includes at least one of the selected slices;

retrieving the selected slices associated with the list of slice names;

generating an integrity check value for the selected slices;

storing one or more of;

the integrity check value, the selected slices, or the list of slice names as original integrity information in a memory;

enabling an upgrade sequence of the storage unit;

retrieving additional integrity information for the storage unit; and

comparing the additional integrity information to the original integrity information, and indicating an unfavorable condition when the comparison is unfavorable.

2. The method of claim 1 wherein obtaining the list of the selected slice names includes selecting a portion of the address range based on the DSTN address range information, generating a list request, sending the list request to the storage unit, and receiving a list response from the storage unit that includes the list of the selected slice names.

3. The method of claim 1 wherein retrieving the selected slices includes generating read slice requests that includes the selected slice names, sending the read slice requests to the storage unit, and receiving the selected slices from the storage.

4. The method of claim 1 wherein the selected slices include two or more slices for a corresponding slice name of the list of the selected slice names when more than one revision is associated with the corresponding slice name.

5. The method of claim 1 wherein the memory is associated with one of:

the storage unit, a DST client module of the DST processing unit, or another storage unit.

6. The method of claim 1 wherein generating the integrity check value utilizes a hashing function to produce a hash value over the selected slices as the integrity check value.

7. The method of claim 1 wherein enabling the upgrade sequence includes at least one of:

caching new slices being written to the storage unit prior to the upgrade sequence, or sending the new slices to an alternate storage unit.

8. The method of claim 1 wherein the additional integrity information is retrieved for the storage unit after the upgrade sequence.

9. The method of claim 1 further comprising:

determining that the additional integrity information compares unfavorably to the original integrity information when the integrity check value fails to match an additional integrity check value included in the additional integrity information.

10. The method of claim 1 further comprising:

initiating a rebuilding process when the additional integrity information compares unfavorably to the original integrity information.

11. The method of claim 1 further comprising:

when the additional integrity information compares unfavorably to the original integrity information, identifying not corrupted slices of the storage unit; and

generating an indication that the upgrade sequence was successful with respect to the not corrupted slices of the storage unit.

12. A processing system of a dispersed storage and task (DST) processing unit comprises:

at least one processor;

a memory that stores operational instructions, that when executed by the at least one processor cause the processing system to;

obtain distributed storage and task network (DSTN) address range information for each memory device of a set of memory devices associated with a storage unit targeted for an upgrade;

obtain a list of slice names associated with selected slices stored in each memory device of the storage unit, wherein a data segment was dispersed storage error encoded to produce a set of encoded data slices for storage in a set of storage units that includes the storage unit, and wherein the set of encoded data slices includes at least one of the selected slices;

retrieve the selected slices associated with the list of slice names;

generate an integrity check value for the selected slices;

store one or more of;

the integrity check value, the selected slices, or the list of slice names as original integrity information;

enable an upgrade sequence of the storage unit;

retrieve additional integrity information for the storage unit; and

compare the additional integrity information to the original integrity information, and indicate an unfavorable condition when the comparison is unfavorable.

13. The processing system of claim 12 wherein obtaining the DSTN address range information includes at least one of:

receiving the address range information, performing a lookup in a DSTN address to physical location table, generating an address range request, retrieving an address range of a previous upgrade, or initiating a query requesting the DSTN address range information.

14. The processing system of claim 12 wherein obtaining the list of the selected slice names includes selecting a portion of the address range based on the DSTN address range information, generating a list request, sending the list request to the storage unit, and receiving a list response from the storage unit that includes the list of the selected slice names.

15. The processing system of claim 12 wherein retrieving the selected slices includes generating read slice requests that includes the selected slice names, sending the read slice requests to the storage unit, and receiving the selected slices from the storage.

16. The processing system of claim 12 wherein the selected slices include two or more slices for a corresponding slice name of the list of the selected slice names when more than one revision is associated with the corresponding slice name.

17. The processing system of claim 12 wherein enabling the upgrade sequence includes at least one of:

caching new slices being written to the storage unit prior to the upgrade sequence, or sending the new slices to an alternate storage unit.

18. A non-transitory computer readable storage medium comprises:

at least one memory section that stores operational instructions that, when executed by a processing system of a dispersed storage network (DSN) that includes a processor and a memory, causes the processing system to;

obtain distributed storage and task network (DSTN) address range information for each memory device of a set of memory devices associated with a storage unit targeted for an upgrade;

obtain a list of slice names associated with selected slices stored in each memory device of the storage unit, wherein a data segment was dispersed storage error encoded to produce a set of encoded data slices for storage in a set of storage units that includes the storage unit, and wherein the set of encoded data slices includes at least one of the selected slices;

retrieve the selected slices associated with the list of slice names;

generate an integrity check value for the selected slices;

store one or more of;

the integrity check value, the selected slices, or the list of slice names as original integrity information in a memory;

enable an upgrade sequence of the storage unit;

retrieve additional integrity information for the storage unit; and

compare the additional integrity information to the original integrity information, and indicate an unfavorable condition when the comparison is unfavorable.