LARGE SCALE DISPERSED STORAGE NETWORK USING SET TOP BOXES AND CENTRALIZED CONTROL

• US 20190056998A1
• Filed: 10/24/2018
• Published: 02/21/2019
• Est. Priority Date: 11/25/2009
• Status: Abandoned Application

• Current Assignee: Pure Storage, Inc.
• Original Assignee: International Business Machines Corporation
• Inventors: Grube, Gary W., Markison, Timothy W.
• Application Number:
  US16/169,571
• Publication Number:
  US 20190056998A1
• Time in Patent Office: Days
• CPC Class Codes: G06F 11/1076 Parity data used in redundant arrays of independent storages, e.g. in RAID systems
• CPC Class Codes: G06F 11/1088 Reconstruction on already foreseen single or plurality of spare disks
• CPC Class Codes: G06F 16/182 Distributed file systems
• CPC Class Codes: H04L 67/1097 for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]

Abstract

A method for a dispersed storage network (DSN) includes determining a storage/retrieval method including storing/retrieving the data file locally in the set top box as a data file, storing encoded data slices of the data file in set top boxes or storing encoded data slices of the data file in DSN memory. For storing/retrieving in set top boxes or in DSN memory, the set top box sends a subscription request message and determines a storage/retrieval designation to include any of: store locally, store indirect, or store direct; and for a determination of indirect, the set top boxe sends the data file to the DS processing unit; and for direct, determines operational parameters, creates encoded data slices of the data file in accordance with the operational parameters, determines storage locations and sends the encoded data slices to other set top boxes.

Claims

1. A method for execution by one or more processing modules of a set top box of a dispersed storage network (DSN), the method comprises:

determining cable network parameters when the set top box has a data file to store;

determining a storage method where the storage method includes storing the data file locally in the set top box as a data file or storing error encoded (EC) data slices of the data file in one or more of;

set top boxes or DSN memory;

prepare and send a subscription request message to a DS processing unit based on a storage method of storing EC data slices of the data file in one or more of;

set top boxes or the DSN memory;

receiving a subscription request response message and saving the subscription request response as a subscription status;

based on an approved subscription status, determining a storage method where the storage method includes storing the EC data slices locally in the set top box or storing error encoded (EC) data slices indirectly or directly in another set top box or in DSN memory;

storing at least some of the EC data slices locally in set top box memory based on the storage method to be stored local;

sending, based on an indirect storage method, the data file to a DS processing unit for encoding and disperse storing of the EC data slices on another set top box or in DSN memory;

creating, based on a direct storage method, EC data slices of the data file, in accordance with operational parameters, utilizing an error coding dispersal storage function;

sending the EC data slices to determined storage locations with a store command;

receiving confirmation of storage messages from the set top boxes that store the slices; and

saving set top box identifiers of set top boxes where the set top box received confirmation of storage messages.

2. The method of claim 1, wherein the cable network parameters include one or more of:

a cable system architecture, a proximal indicator for other set top boxes, a set top box affiliation group with a current set top box, access restrictions, average bit rate, peak bit rate, lowest bit rate, estimate sustained bandwidth, connectivity uptime, or network availability.

3. The method of claim 1, wherein the determining the cable network parameters is based on measuring metrics or a lookup of previously stored metrics.

4. The method of claim 3, wherein the set top box continuously measures the metrics and saves measurement results in local memory.

5. The method of claim 1, wherein the determining a storage method is based on one of more of:

the cable network parameters, a data file type, a data file size, a security indicator, a performance requirement, a cost requirement, a preference, or a command.

6. The method of claim 1, wherein the determining to store locally includes when the cable network parameters fall below desired thresholds.

7. The method of claim 1, wherein the determining to store slices in other set top boxes includes when the cable network parameters indicate other set top boxes with performance parameters above minimum thresholds.

8. The method of claim 1, wherein the subscription request message includes one or more of:

a subscription request command, a set top box ID, the cable network parameters, a data file type, a data file size, a security indicator, a performance requirement, a cost requirement, a preference, or a command.

9. The method of claim 1, wherein the subscription request response message is based on one or more of:

a subscription request command, a set top box ID, cable network parameters, a data file type, a data file size, a security indicator, a performance requirement, a cost requirement, a preference, an estimated security, an estimated performance, an estimated cost, an estimated memory availability, or a command.

10. The method of claim 1, wherein the subscription request response includes one or more of:

subscription approved or not approved, a minimum threshold of operation of the cable network parameters, approved to store slices indirectly by sending the data file to the DS processing unit, approved to create and store slices directly to other set top boxes, estimated memory availability, or the DSN memory.

11. The method of claim 1, wherein the direct storage method includes the store direct method based on one or more of:

the subscription status indicates that the set top box was approved to create and store slices directly to other set top boxes, an estimated memory availability for the other set top boxes is greater than a data file size by at least a threshold, or the cable network parameters indicate favorable conditions.

12. The method of claim 1, wherein the determining the operational parameters is based on one or more of:

the subscription status, the cable network parameters, an estimated memory availability, a data file type, a data file size, a security indicator, a performance requirement, a cost requirement, a preference, or a command.

13. The method of claim 1, wherein the determining the operational parameters includes a relatively larger number of pillars with respect to a read threshold with a relatively low number when the cable network parameters indicate unfavorable connectivity.

14. The method of claim 1, wherein the determined storage locations are based on one or more of:

subscription status, the cable network parameters, estimated memory availability, a data file type, a data file size, a security indicator, a performance requirement, a cost requirement, a preference, and a command.

15. The method of claim 1, wherein the set top box utilizes set top box identifiers to subsequently retrieve the EC data slices.

16. A method for execution by one or more processing modules of a set top box of a dispersed storage network (DSN), the method comprises:

receiving a store error encoded (EC) data slice command and associated EC data slices;

determining cable network parameters;

determining a subscription status;

determining a set top box memory status;

based on a favorable subscription status and favorable set top box memory status, storing at least some of the EC data slices locally in the set top box memory; and

based on an unfavorable subscription status or an unfavorable set top box memory status, rejecting storing of at least some of the EC data slices locally in the set top box memory; and

preparing and sending a message indicating a resolution on storage of the EC data slices in the set top box memory.

17. The method of claim 16, wherein the message indicating a resolution on storage of EC data slices in the set top box memory includes, for storing of at least some of the EC data slice(s) locally in the set top box, EC data slice names and a set top box ID.

18. A method for execution by one or more processing modules of a set top box of a dispersed storage network (DSN), the method comprises:

receiving, from a requester, a retrieve error encoded (EC) data slice command and associated EC data slice name(s);

determining cable network parameters;

determining a subscription status;

determining set top box memory status;

based on a favorable subscription status and favorable set top box memory status, retrieving and sending, to the requester, at least some of the EC data slices stored locally in the set top box; and

based on an unfavorable subscription status or an unfavorable set top box memory status, rejecting retrieving of at least some of the EC data slices stored locally in the set top box; and

preparing and sending a message indicating a resolution on retrieval of the EC data slices stored in the set top box memory.

19. The method of claim 18, wherein the message indicating a resolution of retrieval of EC data slices stored in the set top box memory includes, for the retrieving of at least some of the EC data slices stored locally in the set top box, a listing of retrieved EC data slice names and a set top box ID.

20. The method of claim 18, wherein the favorable set top box memory status includes the requested EC data slices still being present and their integrity intact and the unfavorable set top box memory status includes missing slices, corrupted slices, tampered slices.