Content-based encoding in a multiple routing path communications system

• US 10,298,957 B2
• Filed: 11/17/2017
• Issued: 05/21/2019
• Est. Priority Date: 10/06/2010
• Status: Active Grant

• Current Assignee: Pure Storage, Inc.
• Original Assignee: International Business Machines Corporation
• Inventors: Dhuse, Greg R., Baptist, Andrew D., Volvovski, Ilya, Grube, Gary W., Markison, Timothy W., Gladwin, S. Christopher, Resch, Jason K.
• Primary Examiner(s): Knapp, Justin R
• Application Number:
  US15/817,104
• Publication Number:
  US 20180077428A1
• Time in Patent Office: 550 Days
• Field of Search: None
• CPC Class Codes: G06F 11/1076 Parity data used in redundant arrays of independent storages, e.g. in RAID systems
• CPC Class Codes: G06F 11/3006 where the computing system is distributed, e.g. networked systems, clusters, multiprocessor systems multiprogramming arrangements G06F9/46; allocation of resources G06F9/50
• CPC Class Codes: G06F 11/3034 where the computing system component is a storage system, e.g. DASD based or network based digital input from or digital output to record carriers G06F3/06; digital recording or reproducing G11B20/18; for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS], H04L67/1097
• CPC Class Codes: G06F 11/3409 for performance assessment
• CPC Class Codes: G06F 16/182 Distributed file systems
• CPC Class Codes: G06F 2201/81 Threshold
• CPC Class Codes: G06F 2211/1028 Distributed, i.e. distributed RAID systems with parity
• CPC Class Codes: G06F 3/0644 Management of space entities, e.g. partitions, extents, pools
• CPC Class Codes: H03M 13/05 using block codes, i.e. a predetermined number of check bits joined to a predetermined number of information bits H03M13/2906 takes precedence
• CPC Class Codes: H03M 13/356 Unequal error protection [UEP]
• CPC Class Codes: H03M 13/373 with erasure correction and erasure determination, e.g. for packet loss recovery or setting of erasures for the decoding of Reed-Solomon codes
• CPC Class Codes: H03M 13/3761 using code combining, i.e. using combining of codeword portions which may have been transmitted separately, e.g. Digital Fountain codes, Raptor codes or Luby Transform [LT] codes
• CPC Class Codes: H04L 1/0045 Arrangements at the receiver end
• CPC Class Codes: H04L 1/007 Unequal error protection for format H04L1/0078; for codes per se H03M13/35
• CPC Class Codes: H04L 1/0076 Distributed coding, e.g. network coding, involving channel coding coding in both space and time H04L1/0618; cooperative diversity H04B7/022
• CPC Class Codes: H04L 45/12 Shortest path evaluation
• CPC Class Codes: H04L 45/24 Multipath
• CPC Class Codes: H04L 45/30 Routing of multiclass traffic
• CPC Class Codes: H04L 49/15 Interconnection of switching modules
• CPC Class Codes: H04L 63/00 Network architectures or network communication protocols for network security cryptographic mechanisms or cryptographic arrangements for secret or secure communication H04L9/00; network architectures or network communication protocols for wireless network security H04W12/00; security arrangements for protecting computers or computer systems against unauthorised activity G06F21/00
• CPC Class Codes: H04L 63/102 : Entity profiles
• CPC Class Codes: H04L 65/70 : Media network packetisation
• CPC Class Codes: H04L 65/80 : Responding to QoS
• CPC Class Codes: H04L 67/1097 : for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
• CPC Class Codes: H04L 69/24 : Negotiation of communication capabilities
• CPC Class Codes: H04N 19/66 : involving data partitioning, i.e. separation of data into packets or partitions according to importance

Abstract

A method includes partitioning a data file into first priority data and second priority data. The method further includes determining first error coding dispersal storage function parameters for the first priority data based on first transmission reliability level and second error coding dispersal storage function parameters for the second priority data based on second transmission reliability level. The method further includes dispersed error encoding the first priority data using the first error coding dispersal storage function parameters to produce first plurality of sets of encoded data slices and dispersed error encoding the second priority data using the second error coding dispersal storage function parameters to produce second plurality of sets of encoded data slices. The method further includes selecting one or more routing paths from a plurality of candidate routing paths and transmitting the first plurality of sets of encoded data slices via the one or more routing paths.

Claims

1. A method comprises:

partitioning, by a computing device of a dispersed storage network (DSN), a data file into first priority data and second priority data based on a data prioritization scheme, wherein the first priority data has a higher priority than the second priority data;

determining, by the computing device, first error coding dispersal storage function parameters for the first priority data based on a first transmission reliability level;

determining, by the computing device, second error coding dispersal storage function parameters for the second priority data based on a second transmission reliability level, wherein the first transmission reliability level has a greater transmission reliability than the second transmission reliability level;

dispersed error encoding, by the computing device, the first priority data using the first error coding dispersal storage function parameters to produce a first plurality of sets of encoded data slices;

dispersed error encoding, by the computing device, the second priority data using the second error coding dispersal storage function parameters to produce a second plurality of sets of encoded data slices;

selecting, by the computing device, one or more routing paths from a plurality of candidate routing paths; and

transmitting, by the computing device, the first plurality of sets of encoded data slices via the one or more routing paths.

2. The method of claim 1, wherein the data prioritization scheme comprises one or more of:

a data type indicator;

a data analysis;

a data size indicator;

a priority indicator;

a security indicator;

buffer bits;

authentication indicator;

performance indicator;

a lookup;

a message; and

a predetermination.

3. The method of claim 1, wherein the partitioning the data file comprises:

partitioning, as the data file, video information, wherein the first priority data includes a video header, addressing information, parity information, and a plurality of base video frames and the second priority data includes a plurality of difference video frames information and a plurality of buffer bits.

4. The method of claim 1, wherein the selecting the one or more routing paths comprises one or more of:

selecting the one or more routing paths is based on the first plurality of sets of encoded data slices;

selecting the one or more routing paths is based on the second plurality of sets of encoded data slices;

selecting the one or more routing paths is based on routing path transmission reliability level;

selecting the one or more routing paths is based on the plurality of candidate routing paths;

selecting the one or more routing paths is based on routing requirements;

selecting the one or more routing paths is based on historical routing path performance;

selecting the one or more routing paths is based on estimated routing path performance;

selecting the one or more routing paths is based on a message;

selecting the one or more routing paths is based on a lookup;

selecting the one or more routing paths is based on a predetermination; and

selecting the one or more routing paths is based on a command.

5. The method of claim 1, wherein the plurality of candidate routing paths are selected based on a minimum transmission level requirement of the data file.

6. The method of claim 1 further comprises:

transmitting, by the computing device, the second plurality of sets of encoded data slices via the one or more routing paths.

7. The method of claim 1 further comprises:

selecting, by the computing device, one or more other routing paths from the plurality of candidate routing paths; and

transmitting, by the computing device, the second plurality of sets of encoded data slices via the one or more other routing paths.

8. A computing device of a dispersed storage network (DSN), the computing device comprises:

an interface;

memory; and

a processing module operably coupled to the memory and the interface, wherein the processing module is operable to;

partition a data file into first priority data and second priority data based on a data prioritization scheme, wherein the first priority data has a higher priority than the second priority data;

determine first error coding dispersal storage function parameters for the first priority data based on a first transmission reliability level;

determine second error coding dispersal storage function parameters for the second priority data based on a second transmission reliability level, wherein the first transmission reliability level has a greater transmission reliability than the second transmission reliability level;

dispersed error encode the first priority data using the first error coding dispersal storage function parameters to produce a first plurality of sets of encoded data slices;

dispersed error encode the second priority data using the second error coding dispersal storage function parameters to produce a second plurality of sets of encoded data slices;

select one or more routing paths from a plurality of candidate routing paths; and

transmit the first plurality of sets of encoded data slices via the one or more routing paths.

9. The computing device of claim 8, wherein the data prioritization scheme comprises one or more of:

a data type indicator;

a data analysis;

a data size indicator;

a priority indicator;

a security indicator;

buffer bits;

authentication indicator;

performance indicator;

a lookup;

a message; and

a predetermination.

10. The computing device of claim 8, wherein the processing module is operable to partition the data file by:

partitioning, as the data file, video information, wherein the first priority data includes a video header, addressing information, parity information, and a plurality of base video frames and the second priority data includes a plurality of difference video frames information and a plurality of buffer bits.

11. The computing device of claim 8, wherein the processing module is operable to select the one or more routing paths by one or more of:

selecting the one or more routing paths is based on the first plurality of sets of encoded data slices;

selecting the one or more routing paths is based on the second plurality of sets of encoded data slices;

selecting the one or more routing paths is based on routing path transmission reliability level;

selecting the one or more routing paths is based on the plurality of candidate routing paths;

selecting the one or more routing paths is based on routing requirements;

selecting the one or more routing paths is based on historical routing path performance;

selecting the one or more routing paths is based on estimated routing path performance;

selecting the one or more routing paths is based on a message;

selecting the one or more routing paths is based on a lookup;

selecting the one or more routing paths is based on a predetermination; and

selecting the one or more routing paths is based on a command.

12. The computing device of claim 8, wherein the processing module is operable to select the plurality of candidate routing paths based on a minimum transmission level requirement of the data file.

13. The computing device of claim 8, wherein the processing module is further operable to:

transmit the second plurality of sets of encoded data slices via the one or more routing paths.

14. The computing device of claim 8, wherein the processing module is further operable to:

select one or more other routing paths from the plurality of candidate routing paths; and

transmit the second plurality of sets of encoded data slices via the one or more other routing paths.