Generating dispersed storage network event records

• US 9,852,017 B2
• Filed: 07/12/2012
• Issued: 12/26/2017
• Est. Priority Date: 07/27/2011
• Status: Expired due to Fees

• Current Assignee: Pure Storage, Inc.
• Original Assignee: International Business Machines Corporation
• Inventors: Dhuse, Greg, Vedpathak, Yogesh Ramesh
• Primary Examiner(s): Christensen, Scott B
• Assistant Examiner(s): Do, Lam
• Application Number:
  US13/547,769
• Publication Number:
  US 20130031247A1
• Time in Patent Office: 1,993 Days
• Field of Search: None
• CPC Class Codes: G06F 11/0727 in a storage system, e.g. in a DASD or network based storage system drivers for digital recording or reproducing units G06F3/06; circuits for error detection or correction within digital recording or reproducing units G11B20/18; for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS], H04L67/1097
• CPC Class Codes: G06F 11/0769 Readable error formats, e.g. cross-platform generic formats, human understandable formats
• CPC Class Codes: G06F 11/0778 Dumping, i.e. gathering error/state information after a fault for later diagnosis
• CPC Class Codes: G06F 11/079 Root cause analysis, i.e. error or fault diagnosis in a hardware test environment G06F11/22; in a software test environment G06F11/36
• CPC Class Codes: G06F 11/1076 Parity data used in redundant arrays of independent storages, e.g. in RAID systems
• CPC Class Codes: G06F 11/1092 Rebuilding, e.g. when physically replacing a failing disk
• CPC Class Codes: G06F 11/3006 where the computing system is distributed, e.g. networked systems, clusters, multiprocessor systems multiprogramming arrangements G06F9/46; allocation of resources G06F9/50
• CPC Class Codes: G06F 11/3034 where the computing system component is a storage system, e.g. DASD based or network based digital input from or digital output to record carriers G06F3/06; digital recording or reproducing G11B20/18; for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS], H04L67/1097
• CPC Class Codes: G06F 11/3072 where the reporting involves data filtering, e.g. pattern matching, time or event triggered, adaptive or policy-based reporting
• CPC Class Codes: G06F 11/3086 where the reporting involves the use of self describing data formats, i.e. metadata, markup languages, human readable formats
• CPC Class Codes: G06F 11/321 Display for diagnostics, e.g. diagnostic result display, self-test user interface
• CPC Class Codes: G06F 11/3419 by assessing time
• CPC Class Codes: G06F 11/3476 Data logging G06F11/14, G06F11/2205 take precedence
• CPC Class Codes: G06F 11/3485 for I/O devices

Abstract

A method begins by a dispersed storage (DS) processing module collecting an event record, a record regarding processing of an event request, and a plurality of records regarding processing of a plurality of sub-event requests to produce a collection of records. The event record includes information regarding an event, wherein the event is a user access operation or a system administrative operation initiated by a device affiliated with the DSN. The record regarding processing of the event request includes information regarding a dispersed storage (DS) processing module of the DSN processing the event request to produce the plurality of sub-event requests. The plurality of records regarding processing of the plurality of sub-event requests includes information regarding a plurality of DS units of the DSN processing the plurality of sub-event requests. The method continues with the DS processing module evaluating the collection of records to produce performance information regarding the DSN.

Claims

1. A method comprises:

sending, by a user device affiliated with a dispersed storage network (DSN), an event request that identifies an event, where the event is a data access operation;

generating, by the user device, an event record regarding the event;

processing, by a dispersed storage (DS) processing module, the event request to produce a plurality of sub-event requests, wherein the plurality of sub-event requests are related on one or more levels of processing of a set of error encoded data slices, wherein a data object is segmented into a plurality of data segments, a data segment of the plurality of data segments is dispersed storage error encoded in accordance with parameters of an error coding dispersal function to produce the set of error encoded data slices, wherein the parameters of an error coding dispersal function specifies that the set of error encoded data slices includes a pillar number of error encoded data slices that are distributedly stored across a plurality of DS units of the DSN such that no more than one error encoded data slice of the set of error encoded data slices is stored on any one DS unit of the plurality of DS units, wherein the error coding dispersal function also specifies a matrix having a first dimension corresponding to the pillar number and a second dimension that corresponds to a number of data segments of the plurality of data segments into which the data object is segmented, wherein at least one DS unit of the plurality of DS units stores error encoded data slices from different sets of error encoded data slices that are based on different data segments of the plurality of data segments, wherein the parameters of the error coding dispersal function also include a read threshold such that a read threshold number of error encoded data slices provides for reconstruction of the data segment and a write threshold such that a write threshold number of set of error encoded data slices provides for a successful transfer of the set of error encoded data slices from a first at least one location in the DSN to a second at least one location in the DSN, wherein the write threshold is greater than or equal to the read threshold for the pillar number of error encoded data slices;

generating, by the DS processing module, a record regarding the processing of the event request, wherein the record includes a first step descriptor corresponding to the read threshold number of error encoded data slices being read when the data access operation corresponds to a read operation of the data object, wherein the record includes a second step descriptor corresponding to the write threshold number of error encoded data slices being written when the data access operation corresponds to a write operation of the data object;

sending, by the DS processing module, the plurality of sub-event requests to the plurality of DS units of the DSN that distributedly store the set of error encoded data slices;

processing, by the plurality of DS units, the plurality of sub-event requests to produce a plurality of access operation responses and a plurality of records regarding processing of the plurality of sub-event requests;

processing, by the DS processing module, at least some of the plurality of access operation responses to produce a data access response and providing the data access response to the user device;

collecting, by a DS managing unit affiliated with the DSN, the event record, the record regarding the processing of the event request, and the plurality of records regarding the processing of the plurality of sub-event requests to produce a collection of records; and

evaluating, by the DS managing unit, the collection of records to produce performance information regarding the DSN.

2. The method of claim 1, wherein the event record comprises:

identity of the user device;

an event identifier (ID) associated with the event;

information regarding initiation of the event; and

information regarding completion of the event.

3. The method of claim 1, wherein the record regarding the processing of the event request comprises:

identity of the DS processing module;

an event identifier (ID) associated with the processing of the event request;

a parent event ID associated with the event;

information regarding initiation of the processing of the event request; and

information regarding completion of the processing of the event request.

4. The method of claim 1, wherein a record of the plurality of records regarding the processing of the plurality of sub-event requests comprises:

identity of one of the plurality of DS units;

an event identifier (ID) associated with the processing of a corresponding one of the plurality of sub-event requests by the one of the plurality of DS units;

a parent event ID associated with the event request;

information regarding initiation of the processing of the corresponding one of the plurality of sub-event requests; and

information regarding completion of the processing of the corresponding one of the plurality of sub-event requests.

5. The method of claim 1, wherein the evaluating comprises at least one of:

a performance response time of the DS processing module and of one or more of the plurality of DS units;

performance reliability of the DS processing module and of the one or more of the plurality of DS units; and

accessibility of the DS processing module and of one or more of the plurality of DS units.

6. The method of claim 1 further comprises:

collecting, by the DS managing unit;

a plurality of event records regarding a plurality of events;

a plurality of records regarding processing of a plurality of event requests; and

a plurality of sets of records regarding processing of sets of sub-event requests, wherein a set of the plurality of sets of records is regarding the processing of a set of sub-event requests of one of the plurality of event requests; and

aggregating, by the DS managing unit, the plurality of event records, the plurality of records regarding processing of the plurality of event requests, and the plurality of sets of records regarding processing the sets of sub-event requests to produce a plurality of collection of records.

7. A method for execution by a DS managing unit affiliated with a dispersed storage network (DSN), the method comprises:

collecting an event record, a record regarding processing of an event request, and a plurality of records regarding processing of a plurality of sub-event requests to produce a collection of records, wherein;

the event record including information regarding an event, wherein the event is data access operation initiated by a user device affiliated with the DSN;

the record regarding processing of the event request including information regarding a dispersed storage (DS) processing module of the DSN processing the event request to produce the plurality of sub-event requests, wherein the plurality of sub-event requests are related on one or more levels of processing of a set of error encoded data slices, wherein a data object is segmented into a plurality of data segments, a data segment of the plurality of data segments is dispersed storage error encoded in accordance with parameters of an error coding dispersal function to produce the set of error encoded data slices,

wherein the parameters of an error coding dispersal function specifies that the set of error encoded data slices includes a pillar number of error encoded data slices that are distributedly stored across a plurality of DS units of the DSN such that no more than one error encoded data slice of the set of error encoded data slices is stored on any one DS unit of the plurality of DS units, wherein the error coding dispersal function also specifies a matrix having a first dimension corresponding to the pillar number and a second dimension that corresponds to a number of data segments of the plurality of data segments into which the data object is segmented, wherein at least one DS unit of the plurality of DS units stores error encoded data slices from different sets of error encoded data slices that are based on different data segments of the plurality of data segments, wherein the parameters of the error coding dispersal function also include a read threshold such that a read threshold number of error encoded data slices provides for reconstruction of the data segment and a write threshold such that a write threshold number of set of error encoded data slices provides for a successful transfer of the set of error encoded data slices from a first at least one location in the DSN to a second at least one location in the DSN, wherein the write threshold is greater than or equal to the read threshold for the pillar number of error encoded data slices;

the record regarding processing of the event request also including a first step descriptor corresponding to the read threshold number of error encoded data slices being read when the data access operation corresponds to a read operation of the data object, wherein the record includes a second step descriptor corresponding to the write threshold number of error encoded data slices being written when the data access operation corresponds to a write operation of the data object; and

the plurality of records regarding processing of the plurality of sub-event requests including information regarding the plurality of DS units of the DSN that distributedly store the set of error encoded data slices processing the plurality of sub-event requests; and

evaluating the collection of records to produce performance information regarding the DSN.

8. The method of claim 7, wherein the event record comprises:

identity of the user device;

an event identifier (ID) associated with the event;

information regarding initiation of the event; and

information regarding completion of the event.

9. The method of claim 7, wherein the record regarding the processing of the event request comprises:

identity of the DS processing module;

an event identifier (ID) associated with the processing of the event request;

a parent event ID associated with the event;

information regarding initiation of the processing of the event request; and

information regarding completion of the processing of the event request.

10. The method of claim 7, wherein a record of the plurality of records regarding the processing of the plurality of sub-event requests comprises:

identity of one of the plurality of DS units;

an event identifier (ID) associated with the processing of a corresponding one of the plurality of sub-event requests by the one of the plurality of DS units;

a parent event ID associated with the event request;

information regarding initiation of the processing of the corresponding one of the plurality of sub-event requests; and

information regarding completion of the processing of the corresponding one of the plurality of sub-event requests.

11. The method of claim 7, wherein the evaluating comprises at least one of:

a performance response time of the DS processing module and of one or more of the plurality of DS units;

performance reliability of the DS processing module and of the one or more of the plurality of DS units; and

accessibility of the DS processing module and of one or more of the plurality of DS units.

12. The method of claim 7 further comprises:

collecting;

a plurality of event records regarding a plurality of events;

a plurality of records regarding processing of a plurality of event requests; and

a plurality of sets of records regarding processing of sets of sub-event requests, wherein a set of the plurality of sets of records is regarding the processing of a set of sub-event requests of one of the plurality of event requests; and

aggregating the plurality of event records, the plurality of records regarding processing of the plurality of event requests, and the plurality of sets of records regarding processing the sets of sub-event requests to produce a plurality of collection of records.

13. A dispersed storage network (DSN) comprises:

a dispersed storage (DS) managing unit comprising;

an interface configured to interface and communicate with the DSN;

memory that stores operational instructions; and

a processing module operably coupled to the interface and to the memory, wherein the processing module, when operable within the DS managing unit based on the operational instructions, is configured to;

collect an event record, a record regarding processing of an event request, and a plurality of records regarding processing of a plurality of sub-event requests to produce a collection of records, wherein;

the event record including information regarding an event, wherein the event is a data access operation initiated by a user device affiliated with the DSN;

the record regarding processing of the event request including information regarding a dispersed storage (DS) processing module of the DSN processing the event request to produce the plurality of sub-event requests, wherein the plurality of sub-event requests are related on one or more levels of processing of a set of error encoded data slices, wherein a data object is segmented into a plurality of data segments, a data segment of the plurality of data segments is dispersed storage error encoded in accordance with parameters of an error coding dispersal function to produce the set of error encoded data slices, wherein the parameters of an error coding dispersal function specifies that the set of error encoded data slices includes a pillar number of error encoded data slices that are distributedly stored across a plurality of DS units of the DSN such that no more than one error encoded data slice of the set of error encoded data slices is stored on any one DS unit of the plurality of DS units, wherein the error coding dispersal function also specifies a matrix having a first dimension corresponding to the pillar number and a second dimension that corresponds to a number of data segments of the plurality of data segments into which the data object is segmented, wherein at least one DS unit of the plurality of DS units stores error encoded data slices from different sets of error encoded data slices that are based on different data segments of the plurality of data segments, wherein the parameters of the error coding dispersal function also include a read threshold such that a read threshold number of error encoded data slices provides for reconstruction of the data segment and a write threshold such that a write threshold number of set of error encoded data slices provides for a successful transfer of the set of error encoded data slices from a first at least one location in the DSN to a second at least one location in the DSN, wherein the write threshold is greater than or equal to the read threshold for the pillar number of error encoded data slices;

the record regarding processing of the event request also including a first step descriptor corresponding to the read threshold number of error encoded data slices being read when the data access operation corresponds to a read operation of the data object, wherein the record includes a second step descriptor corresponding to the write threshold number of error encoded data slices being written when the data access operation corresponds to a write operation of the data object; and

the plurality of records regarding processing of the plurality of sub-event requests including information regarding a plurality of DS units of the DSN that distributedly store the set of error encoded data slices processing the plurality of sub-event requests; and

further configured to;

evaluate the collection of records to produce performance information regarding the DSN.

14. The dispersed storage network (DSN) of claim 13, wherein the event record comprises:

identity of the user device;

an event identifier (ID) associated with the event;

information regarding initiation of the event; and

information regarding completion of the event.

15. The dispersed storage network (DSN) of claim 13, wherein the record regarding the processing of the event request comprises:

identity of a DS processing module;

an event identifier (ID) associated with the processing of the event request;

a parent event ID associated with the event;

information regarding initiation of the processing of the event request; and

information regarding completion of the processing of the event request.

16. The dispersed storage network (DSN) of claim 15, wherein a record of the plurality of records regarding the processing of the plurality of sub-event requests comprises:

identity of one of a plurality of DS units;

an event identifier (ID) associated with the processing of a corresponding one of the plurality of sub-event requests by the one of the plurality of DS units;

a parent event ID associated with the event request;

information regarding initiation of the processing of the corresponding one of the plurality of sub-event requests; and

information regarding completion of the processing of the corresponding one of the plurality of sub-event requests.

17. The dispersed storage network (DSN) of claim 13, wherein the evaluate the collection of records to produce performance information regarding the DSN is performed by at least one of:

a performance response time of the DS processing module and of one or more of the plurality of DS units;

performance reliability of the DS processing module and of the one or more of the plurality of DS units; and

accessibility of the DS processing module and of one or more of the plurality of DS units.

18. The dispersed storage network (DSN) of claim 13 further comprises:

the processing module, when operable within the dispersed storage (DS) managing unit based on the operational instructions, is further configured to;

collect;

a plurality of event records regarding a plurality of events;

a plurality of records regarding processing of a plurality of event requests; and

a plurality of sets of records regarding processing of sets of sub-event requests, wherein a set of the plurality of sets of records is regarding the processing of a set of sub-event requests of one of the plurality of event requests; and

aggregate the plurality of event records, the plurality of records regarding processing of the plurality of event requests, and the plurality of sets of records regarding processing the sets of sub-event requests to produce a plurality of collection of records.