Dispersed storage network with parameter search and methods for use therewith

• US 9,501,366 B2
• Filed: 06/26/2014
• Issued: 11/22/2016
• Est. Priority Date: 09/30/2005
• Status: Expired due to Fees

• Current Assignee: Bissell Inc.
• Original Assignee: International Business Machines Corporation
• Inventors: Resch, Jason K.
• Primary Examiner(s): Zele, Krista
• Assistant Examiner(s): FORMAN, JAMES Q
• Application Number:
  US14/315,716
• Publication Number:
  US 20140310310A1
• Time in Patent Office: 880 Days
• Field of Search: 726/2
• US Class Current: 1/1
• CPC Class Codes: G06F 11/0709 in a distributed system consisting of a plurality of standalone computer nodes, e.g. clusters, client-server systems
• CPC Class Codes: G06F 11/0751 Error or fault detection not based on redundancy power supply failures G06F1/30; network fault management H04L41/06
• CPC Class Codes: G06F 11/1076 Parity data used in redundant arrays of independent storages, e.g. in RAID systems
• CPC Class Codes: G06F 11/1464 for networked environments
• CPC Class Codes: G06F 11/2038 with a single idle spare processing component
• CPC Class Codes: G06F 11/2048 where the redundant components share neither address space nor persistent storage
• CPC Class Codes: G06F 11/2094 Redundant storage or storage space G06F11/2056 takes precedence
• CPC Class Codes: G06F 16/172 Caching, prefetching or hoarding of files
• CPC Class Codes: G06F 16/9535 Search customisation based on user profiles and personalisation
• CPC Class Codes: G06F 2201/80 Database-specific techniques
• CPC Class Codes: G06F 2211/1028 Distributed, i.e. distributed RAID systems with parity
• CPC Class Codes: G06F 3/0617 in relation to availability
• CPC Class Codes: G06F 3/0619 in relation to data integrity, e.g. data losses, bit errors
• CPC Class Codes: G06F 3/0635 by changing the path, e.g. traffic rerouting, path reconfiguration
• CPC Class Codes: G06F 3/065 Replication mechanisms
• CPC Class Codes: G06F 3/067 Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
• CPC Class Codes: H04L 63/10 for controlling access to devices or network resources
• CPC Class Codes: H04L 67/1097 for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]

Abstract

A method begins with a processing module receiving a search parameter. The method further includes the processing module searching for a data object stored in the DSN based on the search parameter. The searching begins by determining a data segment of the data object. The searching continues by retrieving a plurality of slices corresponding to the data segment and regenerating the data segment therefrom. The searching continues by determining when the data segment satisfies the search parameter. The searching continues by retrieving the data object from the DSN when the data segment satisfies the search parameter.

Claims

1. A method for execution by one or more processing modules of one or more computing devices of a dispersed storage network (DSN), the method comprises:

receiving at least one search parameter;

identifying a data object based on stored metadata of the data object having a similar aspect to the at least one search parameter, wherein the data object is divided into a plurality of data segments, and wherein the plurality of data segments is dispersed storage error encoded into a plurality of sets of encoded data slices and stored in DSN memory;

retrieving the set of encoded data slices from storage units of the DSN memory;

regenerating a data segment of the plurality of data segments from the set of encoded data slices;

regenerating metadata for the regenerated data segment;

comparing one or more aspects of the regenerated metadata of the regenerated data segment with the at least one search parameter;

when the one or more aspects of the regenerated metadata of the regenerated data segment matches one or more of the at least one search parameter, retrieving the plurality of sets of encoded data slices from the DSN memory;

reconstructing the data object by decoding the plurality of sets of encoded data slices to produce the plurality of data segments and combining the plurality of data segments to produce the data object;

when the one or more aspects of the regenerated metadata of the regenerated data segment matches one or more of the at least one search parameter, identifying another data object based on stored metadata of the other data object having a similar aspect to a search parameter of the at least one search parameter;

retrieving a second set of encoded data slices of a second data segment of the other data object from the storage units of the DSN memory;

regenerating the second data segment of the other data object from the second set of encoded data slices;

regenerating metadata for the regenerated second data segment;

comparing one or more aspects of the regenerated metadata of the regenerated second data segment with the at least one search parameter; and

when the one or more aspects of the regenerated metadata of the regenerated other data segment matches one or more of the at least one search parameter, retrieving a second plurality of sets of encoded data slices corresponding to the other data object from the DSN memory.

2. The method of claim 1 wherein the regenerated metadata of the regenerated data segment includes at least one of:

a type of data, a keyword, a phrase, a pattern, a priority indicator, a security indicator, a user identifier, or a timestamp.

3. A dispersed storage (DS) processing unit for use in a dispersed storage network (DSN) comprises:

an interface;

memory that stores instructions; and

a processing module operably coupled to the interface and to the memory, wherein the processing module includes hardware that executes the instructions to;

receive at least one search parameter;

identify a data object based on stored metadata of the data object having a similar aspect to the at least one search parameter, wherein the data object is divided into a plurality of data segments, and wherein the plurality of data segments is dispersed storage error encoded into a plurality of sets of encoded data slices and stored in DSN memory;

retrieve the set of encoded data slices from storage units of the DSN memory;

regenerate a data segment of the plurality of data segments from the set of encoded data slices;

regenerate metadata for the regenerated data segment;

compare one or more aspects of the regenerated metadata of the regenerated data segment with the at least one search parameter;

when the one or more aspects of the regenerated metadata of the regenerated data segment matches one or more of the at least one search parameter, retrieve the plurality of sets of encoded data slices from the DSN memory;

reconstruct the data object by decoding the plurality of sets of encoded data slices to produce the plurality of data segments and combining the plurality of data segments to produce the data object;

when the one or more aspects of the regenerated metadata of the regenerated data segment substantially matches one or more of the at least one search parameter, identify another data object based on stored metadata of the other data object having a similar aspect to a search parameter of the at least one search parameter;

retrieve a second set of encoded data slices of a second data segment of the other data object from the storage units of the DSN memory;

regenerate the second data segment of the other data object from the second set of encoded data slices;

regenerate metadata for the regenerated second data segment;

compare one or more aspects of the regenerated metadata of the regenerated second data segment with the at least one search parameter; and

when the one or more aspects of the regenerated metadata of the regenerated other data segment matches one or more of the at least one search parameter, retrieve a second plurality of sets of encoded data slices corresponding to the other data object from the DSN memory.

4. The DS processing unit of claim 3 wherein the regenerated metadata of the regenerated data segment includes at least one of:

a type of data, a keyword, a phrase, a pattern, a priority indicator, a security indicator, a user identifier, or a timestamp.

5. A non-transitory computer readable storage medium comprises:

at least one memory section that stores operational instructions that, when executed by one or more processing modules of one or more computing devices of a dispersed storage network (DSN), causes the one or more computing devices to;

receive at least one search parameter;

identify a data object based on stored metadata of the data object having a similar aspect to the at least one search parameter, wherein the data object is divided into a plurality of data segments, and wherein the plurality of data segments is dispersed storage error encoded into a plurality of sets of encoded data slices and stored in DSN memory;

retrieve the set of encoded data slices from storage units of the DSN memory;

regenerate a data segment of the plurality of data segments from the set of encoded data slices;

regenerate metadata for the regenerated data segment;

compare one or more aspects of the regenerated metadata of the regenerated data segment with the at least one search parameter;

when the one or more aspects of the regenerated metadata of the regenerated data segment matches one or more of the at least one search parameter, retrieve the plurality of sets of encoded data slices from the DSN memory;

reconstruct the data object by decoding the plurality of sets of encoded data slices to produce the plurality of data segments and combining the plurality of data segments to produce the data object;

when the one or more aspects of the regenerated metadata of the regenerated data segment matches one or more of the at least one search parameter, identify another data object based on stored metadata of the other data object having a similar aspect to a search parameter of the at least one search parameter;

retrieve a second set of encoded data slices of a second data segment of the other data object from the storage units of the DSN memory;

regenerate the second data segment of the other data object from the second set of encoded data slices;

regenerate metadata for the regenerated second data segment;

compare one or more aspects of the regenerated metadata of the regenerated second data segment with the at least one search parameter; and

when the one or more aspects of the regenerated metadata of the regenerated other data segment substantially matches one or more of the at least one search parameter, retrieve a second plurality of sets of encoded data slices corresponding to the other data object from the DSN memory.

6. The non-transitory computer readable storage medium of claim 5 wherein the regenerated metadata of the regenerated data segment includes at least one of:

a type of data, a keyword, a phrase, a pattern, a priority indicator, a security indicator, a user identifier, or a timestamp.