Dispersed storage with variable slice length and methods for use therewith
First Claim
1. A method for execution by one or more processing modules of one or more computing devices of a dispersed storage network (DSN), the method comprises:
- selecting a first slice length for a first data segment of a data object to be stored in the DSN;
selecting a second slice length for a second data segment of the data object to be stored in the DSN;
encoding the first data segment using a first dispersed storage error coding function to produce a first set of data slices in accordance with the first slice length;
encoding the second data segment using a second dispersed storage error coding function to produce a second set of data slices in accordance with the second slice length;
selecting a first storage file based on the first slice length;
selecting a second storage file based on the second slice length;
generating a first storage file identifier (ID) that indicates the first storage file;
generating a second storage file identifier (ID) that indicates the second storage file;
generating a first set of DSN addresses corresponding to the first set of data slices and a second set of DSN addresses corresponding to the second set of data slices, wherein the first set of DSN addresses each include the first storage file ID and a corresponding one of a first plurality of offset identifiers (IDs) and the second set of DSN addresses each include the second storage file ID and a corresponding one of a second plurality of offset identifiers (IDs);
writing the first set of data slices in accordance with the first set of DSN addresses;
writing the second set of data slices in accordance with the second set of DSN addresses;
updating a directory to associate the first set of DSN addresses with an identifier of the first data segment; and
updating the directory to associate the second set of DSN addresses with an identifier of the second data segment.
4 Assignments
0 Petitions
Accused Products
Abstract
A dispersed storage processing unit selects a slice length for a data segment to be stored in a dispersed storage network (DSN). The data segment is encoded using a dispersed storage error coding function to produce a set of data slices in accordance with the slice length. A storage file is selected based on the slice length. A storage file identifier (ID) is generated that indicates the storage file. A set of DSN addresses are generated corresponding to the set of data slices, wherein the set of DSN addresses each include the storage file ID and a corresponding one of a plurality of offset identifiers (IDs). The set of data slices are written in accordance with the set of DSN addresses. A directory is updated to associate the set of DSN addresses with an identifier of the data segment.
-
Citations
20 Claims
-
1. A method for execution by one or more processing modules of one or more computing devices of a dispersed storage network (DSN), the method comprises:
-
selecting a first slice length for a first data segment of a data object to be stored in the DSN; selecting a second slice length for a second data segment of the data object to be stored in the DSN; encoding the first data segment using a first dispersed storage error coding function to produce a first set of data slices in accordance with the first slice length; encoding the second data segment using a second dispersed storage error coding function to produce a second set of data slices in accordance with the second slice length; selecting a first storage file based on the first slice length; selecting a second storage file based on the second slice length; generating a first storage file identifier (ID) that indicates the first storage file; generating a second storage file identifier (ID) that indicates the second storage file; generating a first set of DSN addresses corresponding to the first set of data slices and a second set of DSN addresses corresponding to the second set of data slices, wherein the first set of DSN addresses each include the first storage file ID and a corresponding one of a first plurality of offset identifiers (IDs) and the second set of DSN addresses each include the second storage file ID and a corresponding one of a second plurality of offset identifiers (IDs); writing the first set of data slices in accordance with the first set of DSN addresses; writing the second set of data slices in accordance with the second set of DSN addresses; updating a directory to associate the first set of DSN addresses with an identifier of the first data segment; and updating the directory to associate the second set of DSN addresses with an identifier of the second data segment. - View Dependent Claims (2, 3, 4, 5, 6, 7)
-
-
8. A dispersed storage processing unit of a dispersed storage network (DSN) comprises:
-
at least one module, when operable within a computing device, that causes the computing device to; select a first slice length for a first data segment of a data object to be stored in the DSN; select a second slice length for a second data segment of the data object to be stored in the DSN; encode the first data segment using a first dispersed storage error coding function to produce a first set of data slices in accordance with the first slice length; encode the second data segment using a second dispersed storage error coding function to produce a second set of data slices in accordance with the second slice length; select a first storage file based on the first slice length; select a second storage file based on the second slice length; generate a first storage file identifier (ID) that indicates the first storage file; generate a second storage file identifier (ID) that indicates the second storage file; generate a first set of DSN addresses corresponding to the first set of data slices and a second set of DSN addresses corresponding to the second set of data slices, wherein the first set of DSN addresses each include the first storage file ID and a corresponding one of a first plurality of offset identifiers (IDs) and the second set of DSN addresses each include the second storage file ID and a corresponding one of a second plurality of offset identifiers (IDs); write the first set of data slices in accordance with the first set of DSN addresses; write the second set of data slices in accordance with the second set of DSN addresses; update a directory to associate the first set of DSN addresses with an identifier of the first data segment; and update the directory to associate the second set of DSN addresses with an identifier of the second data segment. - View Dependent Claims (9, 10, 11, 12, 13, 14)
-
-
15. A non-transitory computer readable storage medium comprises:
-
at least one memory section that stores operational instructions that, when executed by one or more processing modules of one or more computing devices of a dispersed storage network (DSN), causes the one or more computing devices to; select a first slice length for a first data segment of a data object to be stored in the DSN; select a second slice length for a second data segment of the data object to be stored in the DSN; encode the first data segment using a first dispersed storage error coding function to produce a first set of data slices in accordance with the first slice length; encode the second data segment using a second dispersed storage error coding function to produce a second set of data slices in accordance with the second slice length; select a first storage file based on the first slice length; select a second storage file based on the second slice length; generate a first storage file identifier (ID) that indicates the first storage file; generate a second storage file identifier (ID) that indicates the second storage file; generate a first set of DSN addresses corresponding to the first set of data slices and a second set of DSN addresses corresponding to the second set of data slices, wherein the first set of DSN addresses each include the first storage file ID and a corresponding one of a first plurality of offset identifiers (IDs) and the second set of DSN addresses each include the second storage file ID and a corresponding one of a second plurality of offset identifiers (IDs); write the first set of data slices in accordance with the first set of DSN addresses; write the second set of data slices in accordance with the second set of DSN addresses; update a directory to associate the first set of DSN addresses with an identifier of the first data segment; and update the directory to associate the second set of DSN addresses with an identifier of the second data segment. - View Dependent Claims (16, 17, 18, 19, 20)
-
Specification