ELASTIC STORAGE IN A DISPERSED STORAGE NETWORK

• US 20180032269A1
• Filed: 07/26/2016
• Published: 02/01/2018
• Est. Priority Date: 07/26/2016
• Status: Active Grant

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Leggette, Wesley B., Motwani, Manish, Ober, Brian F., Resch, Jason K.
• Granted Patent: US 10,459,790 B2
• Time in Patent Office: Days
• CPC Class Codes: G06F 11/1076 Parity data used in redundant arrays of independent storages, e.g. in RAID systems

Abstract

A method for execution by a dispersed storage and task (DST) processing unit includes: generating an encoded data slice from a dispersed storage encoding of a data object and determining when the encoded data slice will not be stored in local dispersed storage. When the encoded data slice will not be stored in the local dispersed storage, the encoded data slice is stored via at least one elastic slice in an elastic dispersed storage, an elastic storage pointer is generated indicating a location of the elastic slice in the elastic dispersed storage, and the elastic storage pointer is stored in the local dispersed storage.

Claims

1. A method for execution by a dispersed storage and task (DST) processing unit that includes a processor, the method comprises:

generating an encoded data slice from a dispersed storage encoding of a data object;

determining when the encoded data slice will not be stored in local dispersed storage;

when the encoded data slice will not be stored in the local dispersed storage;

storing the encoded data slice via at least one elastic slice in an elastic dispersed storage;

generating an elastic storage pointer indicating a location of the elastic slice in the elastic dispersed storage; and

storing the elastic storage pointer in the local dispersed storage.

2. The method of claim 1 wherein determining when the encoded data slice will not be stored in local dispersed storage is based on at least one of:

an available storage capacity of the local dispersed storage, a comparison of elastic storage cost to local storage cost, a security requirement associated with the data object, an access parameter associated with the data object, or a status parameter of the local dispersed storage.

3. The method of claim 1 wherein the elastic storage pointer includes a DSN memory identifier associated with the elastic dispersed storage, a data object identifier, a namespace location associated with the elastic dispersed storage, a slice name associated with the elastic slice, a slice name associated with the encoded data slice, or a revision identifier associated with the encoded data slice.

4. The method of claim 1 wherein storing the encoded data slice via the elastic slice is performed by:

storing the encoded data slice as the at least one elastic slice.

5. The method of claim 1 wherein storing the encoded data slice via the elastic slice is performed by:

dispersed storage encoding the encoded data slice into a plurality of elastic slices; and

storing the plurality of elastic slices in a plurality of storage units of the elastic dispersed storage.

6. The method of claim 1 wherein storing the encoded data slice via the elastic slice is performed by:

sending the encoded data slice to another DST processing unit associated with the elastic dispersed storage for dispersed storage encoding the encoded data slice into a plurality of elastic slices and storage of the plurality of elastic slices in a plurality of storage units of the elastic dispersed storage.

7. The method of claim 1 further comprising:

receiving a write request response from the local dispersed storage in response to the storing of the elastic storage pointer.

8. The method of claim 1 further comprising:

sending a read request to the local dispersed storage for the encoded data slice; and

receiving a response to the read request from the local dispersed storage that includes the encoded data slice as recovered from the elastic dispersed storage.

9. A processing system of a dispersed storage and task (DST) processing unit comprises:

at least one processor;

a memory that stores operational instructions, that when executed by the at least one processor cause the processing system to;

generate an encoded data slice from a dispersed storage encoding of a data object;

determine when the encoded data slice will not be stored in local dispersed storage;

when the encoded data slice will not be stored in the local dispersed storage;

store the encoded data slice via at least one elastic slice in an elastic dispersed storage;

generate an elastic storage pointer indicating a location of the elastic slice in the elastic dispersed storage; and

store the elastic storage pointer in the local dispersed storage.

10. The processing system of claim 9 wherein determining when the encoded data slice will not be stored in local dispersed storage is based on at least one of:

an available storage capacity of the local dispersed storage, a comparison of elastic storage cost to local storage cost, a security requirement associated with the data object, an access parameter associated with the data object, or a status parameter of the local dispersed storage.

11. The processing system of claim 9 wherein the elastic storage pointer includes a DSN memory identifier associated with the elastic dispersed storage, a data object identifier, a namespace location associated with the elastic dispersed storage, a slice name associated with the elastic slice, a slice name associated with the encoded data slice, or a revision identifier associated with the encoded data slice.

12. The processing system of claim 9 wherein storing the encoded data slice via the elastic slice is performed by:

storing the encoded data slice as the at least one elastic slice.

13. The processing system of claim 9 wherein storing the encoded data slice via the elastic slice is performed by:

dispersed storage encoding the encoded data slice into a plurality of elastic slices; and

storing the plurality of elastic slices in a plurality of storage units of the elastic dispersed storage.

14. The processing system of claim 9 wherein storing the encoded data slice via the elastic slice is performed by:

sending the encoded data slice to another DST processing unit associated with the elastic dispersed storage for dispersed storage encoding the encoded data slice into a plurality of elastic slices and storage of the plurality of elastic slices in a plurality of storage units of the elastic dispersed storage.

15. The processing system of claim 9 wherein a write request response is received from the local dispersed storage in response to the storing of the elastic storage pointer.

16. The processing system of claim 9 wherein the operational instructions, when executed by the at least one processor, further cause the processing system to:

send a read request to the local dispersed storage for the encoded data slice; and

receive a response to the read request from the local dispersed storage that includes the encoded data slice as recovered from the elastic dispersed storage.

17. A non-transitory computer readable storage medium comprises:

at least one memory section that stores operational instructions that, when executed by a processing system of a dispersed storage network (DSN) that includes a processor and a memory, causes the processing system to;

generate an encoded data slice from a dispersed storage encoding of a data object;

determine when the encoded data slice will not be stored in local dispersed storage;

when the encoded data slice will not be stored in the local dispersed storage;

store the encoded data slice via at least one elastic slice in an elastic dispersed storage;

generate an elastic storage pointer indicating a location of the elastic slice in the elastic dispersed storage; and

store the elastic storage pointer in the local dispersed storage.

18. The non-transitory computer readable storage medium of claim 17 wherein determining when the encoded data slice will not be stored in local dispersed storage is based on at least one of:

an available storage capacity of the local dispersed storage, a comparison of elastic storage cost to local storage cost, a security requirement associated with the data object, an access parameter associated with the data object, or a status parameter of the local dispersed storage.

19. The non-transitory computer readable storage medium of claim 17 wherein the elastic storage pointer includes a DSN memory identifier associated with the elastic dispersed storage, a data object identifier, a namespace location associated with the elastic dispersed storage, a slice name associated with the elastic slice, a slice name associated with the encoded data slice, a revision identifier associated with the encoded data slice.

20. The non-transitory computer readable storage medium of claim 17 wherein storing the encoded data slice via the elastic slice is performed by:

sending the encoded data slice to another DST processing unit associated with the elastic dispersed storage for dispersed storage encoding the encoded data slice into a plurality of elastic slices and storage of the plurality of elastic slices in a plurality of storage units of the elastic dispersed storage.