Validating system registry files in a dispersed storage network

• US 10,157,094 B2
• Filed: 09/12/2016
• Issued: 12/18/2018
• Est. Priority Date: 04/30/2015
• Status: Active Grant

• Current Assignee: Pure Storage, Inc.
• Original Assignee: International Business Machines Corporation
• Inventors: Cocagne, Thomas D., Resch, Jason K.
• Primary Examiner(s): RIZK, SAMIR WADIE
• Application Number:
  US15/262,808
• Publication Number:
  US 20160378586A1
• Time in Patent Office: 827 Days
• CPC Class Codes: G06F 11/0727 in a storage system, e.g. in a DASD or network based storage system drivers for digital recording or reproducing units G06F3/06; circuits for error detection or correction within digital recording or reproducing units G11B20/18; for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS], H04L67/1097
• CPC Class Codes: G06F 11/0751 Error or fault detection not based on redundancy power supply failures G06F1/30; network fault management H04L41/06
• CPC Class Codes: G06F 11/0769 Readable error formats, e.g. cross-platform generic formats, human understandable formats
• CPC Class Codes: G06F 11/079 Root cause analysis, i.e. error or fault diagnosis in a hardware test environment G06F11/22; in a software test environment G06F11/36
• CPC Class Codes: G06F 11/1092 Rebuilding, e.g. when physically replacing a failing disk
• CPC Class Codes: G06F 16/00 Information retrieval; Database structures therefor; File system structures therefor
• CPC Class Codes: G06F 16/182 Distributed file systems
• CPC Class Codes: G06F 16/2365 Ensuring data consistency and integrity
• CPC Class Codes: G06F 2211/1028 Distributed, i.e. distributed RAID systems with parity
• CPC Class Codes: G06F 3/0619 in relation to data integrity, e.g. data losses, bit errors
• CPC Class Codes: G06F 3/064 Management of blocks
• CPC Class Codes: G06F 3/067 Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
• CPC Class Codes: G06N 3/04 Architecture, e.g. interconnection topology
• CPC Class Codes: G06N 3/045 Combinations of networks
• CPC Class Codes: G06N 3/06 Physical realisation, i.e. hardware implementation of neural networks, neurons or parts of neurons
• CPC Class Codes: G06N 3/065 Analogue means
• CPC Class Codes: G06N 3/08 Learning methods

Abstract

A method for execution by a dispersed storage and task (DST) execution unit includes receiving system registry integrity data via a network that corresponds to a plurality of system registry files, a request for a subset of the plurality of system registry files is generated for transmission to a dispersed storage network (DSN) unit via the network. The subset of system registry files are received from the DSN unit via the network. Integrity check data is generated based on the received subset of the plurality of system registry files and the system registry integrity data, where the integrity check data includes a verification indicator. The system registry files are stored in memory when the verification indicator indicates that verification was successful.

Claims

1. A method for execution by a dispersed storage and task (DST) execution unit that includes a processor, the method comprises:

receiving system registry integrity data via a network, wherein the system registry integrity data corresponds to a plurality of system registry files;

generating a request for a subset of the plurality of system registry files for transmission to a first dispersed storage network (DSN) unit via the network;

receiving the subset of the plurality of system registry files from the first DSN unit via the network;

generating integrity check data based on the received subset of the plurality of system registry files and the system registry integrity data, wherein the integrity check data includes a verification indicator; and

storing the system registry files in memory when the verification indicator indicates that verification was successful.

2. The method of claim 1, wherein the system registry integrity data includes a plurality of file identifiers corresponding to the plurality of system registry files and a plurality of integrity values corresponding to the plurality of system registry files.

3. The method of claim 2, wherein the plurality of integrity values are cryptographic hash values corresponding to the plurality of system registry files.

4. The method of claim 2, wherein the integrity check data is generated by calculating at least one integrity check value by performing a function on the received subset of the plurality of system registry files, and comparing the at least one integrity check value to a corresponding at least one of the plurality of integrity values of the system registry integrity data, and wherein the verification indicator indicates that verification was successful when the at least one integrity check value compares favorably to the corresponding at least one of the plurality of integrity values.

5. The method of claim 1, further comprising:

generating a system files status request for transmission to a set of DSN units via the network, wherein the system files status request indicates the subset of the plurality of system registry files;

receiving a plurality of system file statuses via the network from at least one of the set of DSN units; and

selecting the first DSN unit from the set of DSN units based on the plurality of system file statuses.

6. The method of claim 5, further comprising:

selecting the set of DSN units from a plurality of DSN units further based on at least one of;

proximity to the DST execution unit, an expected network loading level, a DST processing unit performance level, a network performance level, or DSN configuration information.

7. The method of claim 5, wherein the first DSN unit is selected from the set of DSN units in response to a one of the plurality of system file statuses corresponding to the first DSN unit indicating that the subset of the plurality of system registry files are available.

8. The method of claim 5, further comprising:

selecting a second DSN from the set of DSN units, wherein a first one of the plurality of system file statuses corresponding to the first DSN unit and a second one of the plurality of system file statuses corresponding to the second DSN unit indicate that a first portion of the subset are available from the first DSN unit and a second portion of the subset are available from the second DSN unit, and wherein the first portion and the second portion collectively include all of the system registry files of the subset; and

generating a request for the second portion of the subset for transmission via the network to the second DSN, and receiving the second portion of the subset in response via the network.

9. The method of claim 1, further comprising:

generating a verification error notification for transmission via the network when the verification indicator indicates that verification was unsuccessful.

10. The method of claim 1, further comprising:

generating a system file status update for transmission via the network to a plurality of DSN units when the verification indicator indicates that verification was successful, wherein the system file status update indicates that the subset of the plurality of system registry files are available.

11. A processing system of a dispersed storage and task (DST) execution unit comprises:

at least one processor;

a memory that stores operational instructions, that when executed by the at least one processor cause the processing system to;

receive system registry integrity data via a network, wherein the system registry integrity data corresponds to a plurality of system registry files;

generate a request for a subset of the plurality of system registry files for transmission to a first dispersed storage network (DSN) unit via the network;

receive the subset of the plurality of system registry files from the first DSN unit via the network;

generate integrity check data based on the received subset of the plurality of system registry files and the system registry integrity data, wherein the integrity check data includes a verification indicator; and

store the system registry files in memory when the verification indicator indicates that verification was successful.

12. The processing system of claim 11, wherein the system registry integrity data includes a plurality of file identifiers corresponding to the plurality of system registry files and a plurality of integrity values corresponding to the plurality of system registry files.

13. The processing system of claim 12, wherein the plurality of integrity values are cryptographic hash values corresponding to the plurality of system registry files.

14. The processing system of claim 12, wherein the integrity check data is generated by calculating at least one integrity check value by performing a function on the received subset of the plurality of system registry files, and comparing the at least one integrity check value to a corresponding at least one of the plurality of integrity values of the system registry integrity data, and wherein the verification indicator indicates that verification was successful when the at least one integrity check value compares favorably to the corresponding at least one of the plurality of integrity values.

15. The processing system of claim 11, wherein the operational instructions, when executed by the at least one processor, further cause the processing system to:

generate a system files status request for transmission to a set of DSN units via the network, wherein the system files status request indicates the subset of the plurality of system registry files;

receive a plurality of system file statuses via the network from at least one of the set of DSN units; and

select the first DSN unit from the set of DSN units based on the plurality of system file statuses.

16. The processing system of claim 15, wherein the operational instructions, when executed by the at least one processor, further cause the processing system to:

select the set of DSN units from a plurality of DSN units further based on at least one of;

proximity to the DST execution unit, an expected network loading level, a DST processing unit performance level, a network performance level, or DSN configuration information.

17. The processing system of claim 15, wherein the first DSN unit is selected from the set of DSN units in response to a one of the plurality of system file statuses corresponding to the first DSN unit indicating that the subset of the plurality of system registry files are available.

18. The processing system of claim 15, wherein the operational instructions, when executed by the at least one processor, further cause the processing system to:

select a second DSN from the set of DSN units, wherein a first one of the plurality of system file statuses corresponding to the first DSN unit and a second one of the plurality of system file statuses corresponding to the second DSN unit indicate that a first portion of the subset are available from the first DSN unit and a second portion of the subset are available from the second DSN unit, and wherein the first portion and the second portion collectively include all of the system registry files of the subset; and

generate a request for the second portion of the subset for transmission via the network to the second DSN, and receiving the second portion of the subset in response via the network.

19. The processing system of claim 11, wherein the operational instructions, when executed by the at least one processor, further cause the processing system to:

generate a verification error notification for transmission via the network when the verification indicator indicates that verification was unsuccessful.

20. A non-transitory computer readable storage medium comprises:

at least one memory section that stores operational instructions that, when executed by a processing system of a dispersed storage network (DSN) that includes a processor and a memory, causes the processing system to;

receive system registry integrity data via a network, wherein the system registry integrity data corresponds to a plurality of system registry files;

generate a request for a subset of the plurality of system registry files for transmission to a first DSN unit via the network;

receive the subset of the plurality of system registry files from the first DSN unit via the network;

generate integrity check data based on the received subset of the plurality of system registry files and the system registry integrity data, wherein the integrity check data includes a verification indicator; and

store the system registry files in memory when the verification indicator indicates that verification was successful.