COMMAND LINE INTERPRETER FOR ACCESSING A DATA OBJECT STORED IN A DISTRIBUTED STORAGE NETWORK

• US 20140344284A1
• Filed: 07/23/2014
• Published: 11/20/2014
• Est. Priority Date: 07/16/2008
• Status: Active Grant

• Current Assignee: Pure Storage, Inc.
• Original Assignee: Cleversafe Incorporated (International Business Machines Corporation)
• Inventors: Motwani, Manish, Gladwin, S. Christopher, Young, Jesse Louis, England, Matthew Michael
• Granted Patent: US 9,411,818 B2
• Time in Patent Office: Days
• US Class Current: 707/741
• CPC Class Codes: G06F 11/1008 in individual solid state devices G06F11/1004 takes precedence
• CPC Class Codes: G06F 11/1044 with specific ECC/EDC distribution
• CPC Class Codes: G06F 16/182 Distributed file systems
• CPC Class Codes: G06F 16/24 Querying
• CPC Class Codes: G06F 2211/1059 Parity-single bit-RAID5, i.e. RAID 5 implementations
• CPC Class Codes: H04L 67/1097 for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]

Abstract

A user device includes a DSN interface operably coupled with a DSN memory and a DS processing module for storing and retrieving a data object from the DSN memory, wherein the data object is partitioned into a plurality of data segments and wherein each of the plurality of data segments is stored in the DSN memory as a plurality of encoded data slices that are generated based on an error encoding dispersal function. The user device also includes a command line interpreter operable to interpret a file command as a request to display the data object by an application program, determine the data object is stored in the DSN memory and request the DSN processing module to retrieve the data object from the DSN memory and provide the data object to the application program.

Claims

1. A method for displaying a data object, comprises:

interpreting a file command to display the data object by a command line interpreter operating on a user device, wherein the file command includes a file name of the data object;

determining the data object is stored in a distributed storage network (DSN) memory based on the file name;

requesting a DSN processing module to retrieve the data object from the DSN memory by;

translating the filename into a virtual DSN address to determine a location in the DSN memory of the data object, wherein the filename includes a vault identifier of a virtual DSN address space assigned to the user device; and

retrieving the data object from the DSN memory.

2. The method of claim 1, wherein the file name for the data object includes a domain name for the DSN memory, a data object name and a file type identifier.

3. The method of claim 1, wherein the data object is stored as a plurality of data segments, wherein a data segment of the plurality of data segments is stored as an X number of encoded data slices and wherein a threshold number T corresponds to a threshold value of the plurality of encoded data slices needed to reconstruct the data segment using an error encoding dispersal storage function and wherein X>

T.

4. The method of claim 3, wherein retrieving the data object from the DSN memory includes:

retrieving at least the threshold number T of the X number of encoded data slices from the DSN memory; and

reconstructing the data object from at least the threshold number T of encoded data slices.

5. The method of claim 4, further comprising:

determining a plurality of virtual slice addresses for at least the threshold number T encoded data slices using the virtual DSN address, wherein a virtual slice address includes;

a slice index based on the vault identifier and a pillar identifier that identifies a pillar associated with the data slice; and

a source data name containing an identifier of the data object.

6. The method of claim 3, further comprising:

retrieving the data object by the DSN processing module by streaming sequential data segments of the plurality of data segments of the data object.

7. The method of claim 6, wherein retrieving the data object by the DSN processing module by streaming sequential data segments of the plurality of data segments of the data object includes:

translating the filename into a virtual DSN address to determine a location of the data object in the DSN memory;

identifying a next sequential data segment of the plurality of data segments to generate an identified data segment;

retrieving at least the threshold number T of encoded data slices for the identified data segment from the DSN memory;

reconstructing the identified data segment from at least the threshold number T of the encoded data slices to produce a reconstructed data segment; and

providing the reconstructed data segment for display on the user device.

8. The method of claim 7, further comprising:

determining an application program to process the data object based on the file command including;

determining a file type of the data object based on the file type identifier, wherein the file type is a multimedia file; and

identifying a multimedia player to display the data object based on the file type; and

requesting the multimedia player to input the data object and process the data object for display.

9. The method of claim 8, further comprising:

processing the reconstructed data segment by the multimedia player to generate multimedia content; and

transmitting the multimedia content by the multimedia player to a graphical user interface for display on the user device.

10. A user device for retrieving a data object, comprises:

a distributed storage network (DSN) interface that is operably coupled to interface with a DSN memory, wherein the data object is stored in the DSN memory;

a command line interpreter operating in the user device operable to;

interpret a file command to retrieve the data object, wherein the file command includes a file name of the data object and wherein the filename includes a vault identifier of a virtual DSN address space assigned to the user device; and

determine the data object is stored in the DSN memory based on the file name; and

a processing module operable to;

receive a request from the command line interface to retrieve the data object from the DSN memory;

translate the filename of the data object into a virtual DSN address to determine a location in the DSN memory of the data object using the vault identifier of the virtual DSN address space assigned to the user device;

retrieve the data object from the determined location in the DSN memory by retrieving at least a number T of a plurality of encoded data slices for the data object from the DSN memory, wherein the number T corresponds to a number of the plurality of encoded data slices for the data object needed to reconstruct the data object based on the error encoding dispersal storage function; and

reconstructing the data object from at least the number T of the plurality of encoded data slices.

11. The user device of claim 10, wherein the file name for the data object includes a local drive of the user device that is mapped to the DSN memory and wherein the command line interpreter is further operable to determine that the data object is stored in the DSN memory based on the local drive.

12. The user device of claim 10, wherein the command line interpreter is further operable to:

determine a file type of the data object based on the file type identifier, wherein the file type is a multimedia file; and

identify a multimedia player to display the data object based on the file type.

13. The user device of claim 12, wherein the DS processing module is operable to:

retrieve the data object from the DSN memory by streaming sequential data segments of a plurality of data segments of the data object.

14. The user device of claim 13, wherein the DS processing module is operable to:

identify a next sequential data segment of the plurality of data segments to generate an identified data segment;

retrieve at least the number T of the plurality of encoded data slices for the identified data segment from the DSN memory;

reconstruct the identified data segment from at least the number T of the plurality of encoded data slices to produce a reconstructed data segment; and

providing the reconstructed data segment to the multimedia player.

15. The user device of claim 14, wherein the multimedia player is operable to:

process the reconstructed data segment to generate multimedia content; and

transmit the multimedia content to a graphical user interface for display.

16. The user device of claim 10, wherein the processing module is further operable to store the data object in the DSN memory by:

assigning an address to the data object from the virtual DSN address space associated with the user device;

partitioning the data object into a plurality of data segments;

generating a plurality of encoded data slices based on an error encoding dispersal function;

assigning a slice name to each of the plurality of encoded data slices, wherein the slice name includes the vault identifier that identifies the virtual DSN address space associated with the user device; and

storing the data object in the DSN memory.

17. A user device, comprises:

a distributed storage network (DSN) interface that is operably coupled to interface with a DSN memory;

a command line interpreter operable to interpret a file command to store a data object in the DSN memory; and

a DS processing module coupled to the DSN interface operable for storing the data object in the DSN memory by;

partitioning the data object into a plurality of data segments;

for each of the plurality of data segments, generating a plurality of encoded data slices based on an error encoding dispersal function; and

assigning a slice name to each of the plurality of encoded data slices, wherein the slice name includes a vault identifier that identifies a virtual DSN address space associated with the user device and storing the plurality of encoded data slices in the DSN memory.

18. The user device of claim 17, wherein the DS processing module is operable to generate a file name for the data object, wherein the file name includes a domain name for the DSN memory, a data object name and a file type identifier.

19. The user device of claim 18, wherein the DS processing module is operable to store the plurality of encoded data slices in the DSN memory by:

assigning the plurality of encoded data slices to a plurality of pillars of the DSN memory for storing the data object, wherein a data slice of each of the plurality of data segments of the data object is assigned to one of the pillars of the plurality of pillars.

20. The user device of claim 19, wherein the slice name further includes:

a slice index based on the vault identifier and a pillar identifier that identifies a pillar associated with the data slice; and

a source data name containing an identifier of the data object.