Storage unit for use in a dispersed storage network

• US 10,379,773 B2
• Filed: 08/29/2016
• Issued: 08/13/2019
• Est. Priority Date: 08/29/2016
• Status: Active Grant

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Baptist, Andrew D., Cilfone, Bart R., Dhuse, Greg R., Leggette, Wesley B., Lester, James L., Mark, Zachary J., Motwani, Manish, Resch, Jason K.
• Primary Examiner(s): Dudek, Jr., Edward J
• Application Number:
  US15/250,223
• Publication Number:
  US 20180059984A1
• Time in Patent Office: 1,079 Days
• CPC Class Codes: G06F 11/108 Parity data distribution in semiconductor storages, e.g. in SSD
• CPC Class Codes: G06F 12/0292 using tables or multilevel address translation means G06F12/023 takes precedence; address translation in virtual memory systems G06F12/10
• CPC Class Codes: G06F 2212/1008 Correctness of operation, e.g. memory ordering
• CPC Class Codes: G06F 2212/1016 Performance improvement
• CPC Class Codes: G06F 2212/1032 Reliability improvement, data loss prevention, degraded operation etc
• CPC Class Codes: G06F 2212/1044 Space efficiency improvement
• CPC Class Codes: G06F 2212/154 Networked environment
• CPC Class Codes: G06F 2212/163 Server or database system
• CPC Class Codes: G06F 2212/263 Network storage, e.g. SAN or NAS
• CPC Class Codes: G06F 3/0635 by changing the path, e.g. traffic rerouting, path reconfiguration
• CPC Class Codes: G06F 3/064 Management of blocks
• CPC Class Codes: G06F 3/067 Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]

Abstract

A storage unit for use within a dispersed storage network comprises an interface and a processing module operable to receive encoded data slices from a dispersed storage network client. The encoded data slices are associated with DSN logical addresses and the storage unit is allocated a range of DSN logical addresses in which the DSN logical addresses are found. The storage unit determines whether to store the encoded data slices in local memory of the storage unit or store them in remote memory. When the storage unit determines to store the encoded data slice to the remote memory it converts the DSN logical address into a local storage unit logical address and outputs the encoded data slices to the remote memory.

Claims

1. A storage unit for use within a dispersed storage network comprises:

an interface; and

a processing module configured to;

receive an encoded data slice from a dispersed storage network client, wherein the encoded data slice is associated with a DSN logical address and wherein the storage unit is allocated a range of DSN logical addresses and the DSN logical address is within the allocated range of DSN logical addresses;

determine whether to store the encoded data slice in internal local memory of the storage unit or store the encoded data slice in remote memory;

in response to determining to store the encoded data slice to the remote memory, convert the DSN logical address into a local storage unit logical address;

output, via the interface, the encoded data slice to the remote memory in accordance with the local storage unit logical address; and

maintain a remote storage configuration associated with the remote memory, wherein the remote storage configuration includes information sufficient to retrieve, by the storage unit, the encoded data slice from the remote memory, wherein the processing module is further configured to perform maintenance operations on the remote memory, the maintenance operations relating to at least one of storage capacity expansion, memory reallocation, or load balancing.

2. The storage unit of claim 1 further comprises:

in response to determining to store the encoded data slice in the internal local memory, convert the DSN logical address to a physical local memory address.

3. The storage unit of claim 1, wherein the remote storage configuration includes information sufficient to determine at least one of slice name range, capacity or performance.

4. The storage unit of claim 1, wherein the remote storage configuration includes information sufficient to determine an application programming interface to interact with the remote memory for operations associated with encoded data slice access.

5. The storage unit of claim 1, wherein the remote storage configuration includes information sufficient to determine a network protocol to interact with the remote memory for encoded data slice access.

6. The storage unit of claim 1, wherein the remote storage configuration includes information sufficient to determine encryption keys for storing encoded data slices in the remote memory.

7. The storage unit of claim 1, wherein the remote storage configuration includes information sufficient to determine a name translation layer algorithm to translate encoded data slice names in the remote storage configuration.

8. The storage unit of claim 1, wherein the remote storage configuration includes information sufficient to determine at least one of trusted certificates, authentication authorities or credentials for authentication of the remote memory.

9. The storage unit of claim 1, wherein the remote storage configuration includes information sufficient to determine signing keys for storing encoded data slices in the remote memory.

10. A method for execution by a storage unit within a dispersed storage network comprises:

receiving an encoded data slice from a dispersed storage client, wherein the encoded data slice is associated with a DSN logical address and wherein the storage unit is allocated a range of DSN logical addresses and the DSN logical address is within the allocated range of DSN logical addresses;

determining whether to store the encoded data slice in internal local memory of the storage unit or to store the encoded data slice in remote memory;

in response to determining to store the encoded data slice to the remote memory, convert the DSN logical address into a local storage unit logical address;

outputting the encoded data slice to the remote memory in accordance with the local storage unit logical address;

maintaining a remote storage configuration associated with the remote memory, wherein the remote storage configuration includes information sufficient to retrieve, by the storage unit, the encoded data slice from the remote memory; and

performing a maintenance operation on the remote memory, the maintenance operation relating to at least one of storage capacity expansion, memory reallocation, or load balancing.

11. The method of claim 10 further comprises:

in response to determining to store the encoded data slice in the internal local memory, convert the DSN logical address to a physical local memory address.

12. The method of claim 10, wherein the remote storage configuration includes information sufficient to determine at least one of slice name range, capacity or performance.

13. The method of claim 10, wherein the remote storage configuration includes information sufficient to determine an application programming interface to interact with the remote memory for operations associated with encoded data slice access.

14. The method of claim 10, wherein the remote storage configuration includes information sufficient to determine a name translation layer algorithm for translating encoded data slice names in the remote storage configuration.

15. The method of claim 10, wherein the remote storage configuration includes information sufficient to determine at least one of trusted certificates, authentication authorities or credentials for authentication of the remote memory.

16. The method of claim 10, wherein the remote storage configuration includes information sufficient to determine at least one of encryption or signing keys for storing encoded data slices in the remote memory.