Command line interpreter for accessing a data object stored in a distributed storage network

• US 9,411,818 B2
• Filed: 07/23/2014
• Issued: 08/09/2016
• Est. Priority Date: 07/16/2008
• Status: Expired due to Fees

• Current Assignee: Pure Storage, Inc.
• Original Assignee: International Business Machines Corporation
• Inventors: Motwani, Manish, Gladwin, S. Christopher, Young, Jesse Louis, England, Matthew Michael
• Primary Examiner(s): Uddin, Mohammed R
• Application Number:
  US14/338,504
• Publication Number:
  US 20140344284A1
• Time in Patent Office: 748 Days
• Field of Search: 707/736, 707/781, 707/802, 707/770, 707/827, 707/999.001, 707/999.002, 707/999.101
• US Class Current: 1/1
• CPC Class Codes: G06F 11/1008 in individual solid state devices G06F11/1004 takes precedence
• CPC Class Codes: G06F 11/1044 with specific ECC/EDC distribution
• CPC Class Codes: G06F 16/182 Distributed file systems
• CPC Class Codes: G06F 16/24 Querying
• CPC Class Codes: G06F 2211/1059 Parity-single bit-RAID5, i.e. RAID 5 implementations
• CPC Class Codes: H04L 67/1097 for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]

Abstract

A user device includes a DSN interface operably coupled with a DSN memory and a DS processing module for storing and retrieving a data object from the DSN memory, wherein the data object is partitioned into a plurality of data segments and wherein each of the plurality of data segments is stored in the DSN memory as a plurality of encoded data slices that are generated based on an error encoding dispersal function. The user device also includes a command line interpreter operable to interpret a file command as a request to display the data object by an application program, determine the data object is stored in the DSN memory and request the DSN processing module to retrieve the data object from the DSN memory and provide the data object to the application program.

Claims

1. A method for displaying a data object, comprises:

interpreting a file command to display the data object by a command line interpreter operating on a user device, wherein the file command includes a file name of the data object;

determining the data object is stored in a distributed storage network (DSN) memory based on the file name, wherein the data object is stored as a plurality of data segments, wherein a data segment of the plurality of data segments is stored as an X number of encoded data slices and wherein a threshold number T corresponds to a threshold value of the X number of encoded data slices needed to reconstruct the data segment using an error encoding dispersal storage function and wherein X>

T;

requesting a DSN processing module to retrieve the data object from the DSN memory by;

translating the file name into a virtual DSN address to determine a location in the DSN memory of the data object, wherein the file name includes a vault identifier of a virtual DSN address space assigned to the user device; and

retrieving the data object from the DSN memory.

2. The method of claim 1, wherein the file name for the data object includes a domain name for the DSN memory, a data object name and a file type identifier.

3. The method of claim 1, wherein retrieving the data object from the DSN memory includes:

retrieving at least the threshold number T of the X number of encoded data slices from the DSN memory; and

reconstructing the data object from at least the threshold number T of encoded data slices.

4. The method of claim 3, further comprising:

determining a plurality of virtual slice addresses for at least the threshold number T encoded data slices using the virtual DSN address, wherein a virtual slice address includes;

a slice index based on the vault identifier and a pillar identifier that identifies a pillar associated with a data slice; and

a source data name containing an identifier of the data object.

5. The method of claim 1, further comprising:

retrieving the data object by the DSN processing module by streaming sequential data segments of the plurality of data segments of the data object.

6. The method of claim 5, wherein retrieving the data object by the DSN processing module by streaming sequential data segments of the plurality of data segments of the data object includes:

translating the file name into a virtual DSN address to determine a location of the data object in the DSN memory;

identifying a next sequential data segment of the plurality of data segments to generate an identified data segment;

retrieving at least the threshold number T of encoded data slices for the identified data segment from the DSN memory;

reconstructing the identified data segment from at least the threshold number T of the encoded data slices to produce a reconstructed data segment; and

providing the reconstructed data segment for display on the user device.

7. The method of claim 6, further comprising:

determining an application program to process the data object based on the file command including;

determining a file type of the data object based on a file type identifier, wherein the file type is a multimedia file; and

identifying a multimedia player to display the data object based on the file type; and

requesting the multimedia player to input the data object and process the data object for display.

8. The method of claim 7, further comprising:

processing the reconstructed data segment by the multimedia player to generate multimedia content; and

transmitting the multimedia content by the multimedia player to a graphical user interface for display on the user device.

9. A user device for retrieving a data object, comprises:

a distributed storage network (DSN) interface that is operably coupled to interface with a DSN memory, wherein the data object is stored in the DSN memory;

a command line interpreter operating in the user device operable to;

interpret a file command to retrieve the data object, wherein the file command includes a file name of the data object and wherein the file name includes a vault identifier of a virtual DSN address space assigned to the user device; and

determine the data object is stored in the DSN memory based on the file name, wherein the data object is stored as a plurality of data segments, wherein a data segment of the plurality of data segments is stored as an X number of encoded data slices and wherein a threshold number T corresponds to a threshold value of the X number of encoded data slices needed to reconstruct the data segment using an error encoding dispersal storage function and wherein X>

T; and

a processing module operable to;

receive a request from the command line interpreter to retrieve the data object from the DSN memory;

translate the file name of the data object into a virtual DSN address to determine a location in the DSN memory of the data object using the vault identifier of the virtual DSN address space assigned to the user device;

retrieve the data object from the determined location in the DSN memory by retrieving, for each data segment of the plurality of data segments, at least the threshold number T of encoded data slices; and

reconstructing the plurality of data segments of the data object from the pluralities of the at least the threshold number T of encoded data slices.

10. The user device of claim 9, wherein the file name for the data object includes a local drive of the user device that is mapped to the DSN memory and wherein the command line interpreter is further operable to determine that the data object is stored in the DSN memory based on the local drive.

11. The user device of claim 9, wherein the command line interpreter is further operable to:

determine a file type of the data object based on a file type identifier, wherein the file type is a multimedia file; and

identify a multimedia player to display the data object based on the file type.

12. The user device of claim 11, wherein the processing module is operable to:

retrieve the data object from the DSN memory by streaming sequential data segments of the plurality of data segments of the data object.

13. The user device of claim 12, wherein the processing module is operable to:

identify a next sequential data segment of the plurality of data segments to generate an identified data segment;

retrieve the at least the threshold number T of encoded data slices for the identified data segment from the DSN memory;

reconstruct the identified data segment from the at least the threshold number T of encoded data slices to produce a reconstructed data segment; and

providing the reconstructed data segment to the multimedia player.

14. The user device of claim 13, wherein the multimedia player is operable to:

process the reconstructed data segment to generate multimedia content; and

transmit the multimedia content to a graphical user interface for display.

15. The user device of claim 9, wherein the processing module is further operable to store the data object in the DSN memory by:

assigning an address to the data object from the virtual DSN address space associated with the user device;

partitioning the data object into the plurality of data segments;

generating, for the plurality of data segments, a plurality of the X number of encoded data slices based on an error encoding dispersal function;

assigning a plurality of X number of slice names to each of the plurality of the X number of encoded data slices, wherein the slice name includes the vault identifier that identifies the virtual DSN address space associated with the user device; and

storing the data object in the DSN memory as the plurality of the X number of encoded data slices in accordance with the plurality of X number of slice names.

16. A user device comprises:

a distributed storage network (DSN) interface that is operably coupled to interface with a DSN memory;

a command line interpreter operable to interpret a file command to store a data object in the DSN memory; and

a processing module coupled to the DSN interface operable for storing the data object in the DSN memory by;

partitioning the data object into a plurality of data segments;

for each of the plurality of data segments, generating a plurality of encoded data slices based on an error encoding dispersal function; and

assigning a slice name to each of the plurality of encoded data slices, wherein the slice name includes a vault identifier that identifies a virtual DSN address space associated with the user device, storing the plurality of encoded data slices in the DSN memory, a slice index based on the vault identifier and a pillar identifier that identifies a pillar associated with a data slice; and

a source data name containing an identifier of the data object.

17. The user device of claim 16, wherein the processing module is operable to generate a file name for the data object, wherein the file name includes a domain name for the DSN memory, a data object name and a file type identifier.

18. The user device of claim 17, wherein the processing module is operable to store the plurality of encoded data slices in the DSN memory by:

assigning the plurality of encoded data slices to a plurality of pillars of the DSN memory for storing the data object, wherein a data slice of each of the plurality of data segments of the data object is assigned to one of the pillars of the plurality of pillars.