Combined slice objects in alternate memory locations

• US 10,067,822 B2
• Filed: 09/26/2016
• Issued: 09/04/2018
• Est. Priority Date: 09/26/2016
• Status: Active Grant

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Baptist, Andrew D., Dhuse, Greg R., Khadiwala, Ravi V., Leggette, Wesley B., Lester, James L., Resch, Jason K.
• Primary Examiner(s): Chung, Phung M
• Application Number:
  US15/276,270
• Publication Number:
  US 20180089022A1
• Time in Patent Office: 708 Days
• CPC Class Codes: G06F 11/1044 with specific ECC/EDC distribution
• CPC Class Codes: G06F 11/1076 Parity data used in redundant arrays of independent storages, e.g. in RAID systems
• CPC Class Codes: H04L 67/1097 for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]

Abstract

A method for execution by a computing device of a dispersed storage network (DSN), the method beings by obtaining a plurality of sets of encoded data slices for storage in the DSN. The method continues by determining whether to store two or more encoded data slices of the plurality of sets of encoded data slices in alternative memory. When determined to store the two or more encoded data slices in the alternative memory, the method continues by determining a combining protocol regarding the two or more encoded data slices. The method continues by combining, in accordance with the combining protocol, the two or more encoded data slices into at least one combined slice object (CSO) and sending the at least one CSO to the alternative memory and sending remaining encoded data slices of the plurality of sets of encoded data slices to a set of storage units of the DSN.

Claims

1. A method for execution by a computing device of a dispersed storage network (DSN), the method comprises:

obtaining a plurality of sets of encoded data slices for storage in the DSN, wherein a data segment of a data object is dispersed storage error encoded to produce a set of encoded data slices of the plurality of sets of encoded data slices;

determining whether to store two or more encoded data slices of the plurality of sets of encoded data slices in alternative memory;

when determined to store the two or more encoded data slices in the alternative memory, determining a combining protocol regarding the two or more encoded data slices;

combining, in accordance with the combining protocol, the two or more encoded data slices into at least one combined slice object;

sending the at least one combined slice object to the alternative memory; and

sending remaining encoded data slices of the plurality of sets of encoded data slices to a set of storage units of the DSN.

2. The method of claim 1, wherein the alternative memory comprises one or more of:

a storage unit;

the set of storage units;

a second set of storage units;

a managing unit;

DSN memory of another DSN;

cloud-based storage service;

an integrity processing unit; and

a local memory device.

3. The method of claim 1 further comprises:

sending the two or more encoded data slices to two or more storage units of the set of storage units for storage therein.

4. The method of claim 1, wherein the combining protocol comprises one or more of:

combining encoded data slices of the two or more encoded data slices based on a common pillar number;

combining encoded data slices of the two or more encoded data slices based on a common segment number;

combining encoded data slices of the two or more encoded data slices based on a subset of pillar numbers; and

combining encoded data slices of the two or more encoded data slices based on a subset of segment numbers.

5. The method of claim 1, wherein the determining whether to store the two or more encoded data slices in alternative memory comprises:

determining performance metrics of the alternative memory and the set of storage units, wherein the performance metrics include one or more of;

cost;

latency;

bandwidth;

available storage; and

historical performance.

6. The method of claim 1 further comprises:

receiving a read request that includes one or more sets of encoded data slices of the plurality of sets of encoded data slices that includes the two or more encoded data slices;

determining a read weighting factor for the alternative memory; and

when the read weighting factor is favorable;

retrieving the combined slice object from the alternative memory; and

retrieving one or more subsets of encoded data slices of the one or more sets of encoded

data slices from some storage units of the set of storage units.

7. The method of claim 6 further comprises:

when the read weighting factor is unfavorable;

retrieving a read threshold number of encoded data slices of the one or more sets of encoded data slices from the read threshold number of storage units of the set of storage units.

8. The method of claim 6 further comprises:

determining a second read weighting factor for the set of storage units;

comparing the read weighting factor with the second read weighting factor; and

when the read weighting factor compares favorably to the second read weighting factor, indicating the read weighting factor is favorable.

9. A computing device:

an interface;

memory; and

a processing module operably coupled to the interface and memory, wherein the processing module is operable to;

obtain a plurality of sets of encoded data slices for storage in a dispersed storage network (DSN), wherein a data segment of a data object is dispersed storage error encoded to produce a set of encoded data slices of the plurality of sets of encoded data slices;

determine whether to store two or more encoded data slices of the plurality of sets of encoded data slices in alternative memory;

when determined to store the two or more encoded data slices in the alternative memory, determine a combining protocol regarding the two or more encoded data slices;

combine, in accordance with the combining protocol, the two or more encoded data slices into at least one combined slice object;

send, via the interface, the at least one combined slice object to the alternative memory; and

send, via the interface, remaining encoded data slices of the plurality of sets of encoded data slices to a set of storage units of the DSN.

10. The computing device of claim 9, wherein the alternative memory comprises one or more of:

a storage unit;

the set of storage units;

a second set of storage units;

a managing unit;

DSN memory of another DSN;

cloud-based storage service;

an integrity processing unit; and

a local memory device.

11. The computing device of claim 9, wherein the processing module is further operable to:

send, via the interface, the two or more encoded data slices to two or more storage units of the set of storage units for storage therein.

12. The computing device of claim 9, wherein the processing module is further operable to perform the combining protocol by one or more of:

combining encoded data slices of the two or more encoded data slices based on a common pillar number;

combining encoded data slices of the two or more encoded data slices based on a common segment number;

combining encoded data slices of the two or more encoded data slices based on a subset of pillar numbers; and

combining encoded data slices of the two or more encoded data slices based on a subset of segment numbers.

13. The computing device of claim 9, wherein the processing module is further operable to determine whether to store the two or more encoded data slices in alternative memory by:

determining performance metrics of the alternative memory and the set of storage units, wherein the performance metrics include one or more of;

cost;

latency;

bandwidth;

available storage; and

historical performance.

14. The computing device of claim 9, wherein the processing module is further operable to:

receive a read request that includes one or more sets of encoded data slices of the plurality of sets of encoded data slices that includes the two or more encoded data slices;

determine a read weighting factor for the alternative memory; and

when the read weighting factor is favorable;

retrieve the combined slice object from the alternative memory; and

retrieve one or more subsets of encoded data slices of the one or more sets of encoded data slices from some storage units of the set of storage units.

15. The computing device of claim 14, wherein the processing module is further operable to:

when the read weighting factor is unfavorable;

retrieve a read threshold number of encoded data slices of the one or more sets of encoded data slices from the read threshold number of storage units of the set of storage units.

16. The computing device of claim 14, wherein the processing module is further operable to:

determine a second read weighting factor for the set of storage units;

compare the read weighting factor with the second read weighting factor; and

when the read weighting factor compares favorably to the second read weighting factor, indicate the read weighting factor is favorable.