Unified logs and device statistics

• US 10,678,619 B2
• Filed: 09/26/2017
• Issued: 06/09/2020
• Est. Priority Date: 07/27/2011
• Status: Active Grant

• Current Assignee: Pure Storage, Inc.
• Original Assignee: Pure Storage, Inc.
• Inventors: Dhuse, Greg R., Vedpathak, Yogesh R.
• Primary Examiner(s): Kudirka, Joseph R
• Application Number:
  US15/716,169
• Publication Number:
  US 20180018210A1
• Time in Patent Office: 987 Days
• CPC Class Codes: G06F 11/0727 in a storage system, e.g. in a DASD or network based storage system drivers for digital recording or reproducing units G06F3/06; circuits for error detection or correction within digital recording or reproducing units G11B20/18; for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS], H04L67/1097
• CPC Class Codes: G06F 11/0769 Readable error formats, e.g. cross-platform generic formats, human understandable formats
• CPC Class Codes: G06F 11/0778 Dumping, i.e. gathering error/state information after a fault for later diagnosis
• CPC Class Codes: G06F 11/079 Root cause analysis, i.e. error or fault diagnosis in a hardware test environment G06F11/22; in a software test environment G06F11/36
• CPC Class Codes: G06F 11/1076 Parity data used in redundant arrays of independent storages, e.g. in RAID systems
• CPC Class Codes: G06F 11/1092 Rebuilding, e.g. when physically replacing a failing disk
• CPC Class Codes: G06F 11/3006 where the computing system is distributed, e.g. networked systems, clusters, multiprocessor systems multiprogramming arrangements G06F9/46; allocation of resources G06F9/50
• CPC Class Codes: G06F 11/3034 where the computing system component is a storage system, e.g. DASD based or network based digital input from or digital output to record carriers G06F3/06; digital recording or reproducing G11B20/18; for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS], H04L67/1097
• CPC Class Codes: G06F 11/3072 where the reporting involves data filtering, e.g. pattern matching, time or event triggered, adaptive or policy-based reporting
• CPC Class Codes: G06F 11/3086 where the reporting involves the use of self describing data formats, i.e. metadata, markup languages, human readable formats
• CPC Class Codes: G06F 11/321 Display for diagnostics, e.g. diagnostic result display, self-test user interface
• CPC Class Codes: G06F 11/3419 by assessing time
• CPC Class Codes: G06F 11/3476 Data logging G06F11/14, G06F11/2205 take precedence
• CPC Class Codes: G06F 11/3485 for I/O devices

Abstract

A computing device includes an interface configured to interface and communicate with a dispersed storage network (DSN), a memory that stores operational instructions, and a processing module operably coupled to the interface and memory such that the processing module, when operable within the computing device based on the operational instructions, is configured to perform various operations. The computing device detects a state change within the DSN based on at least one signal received via an interface. The computing device obtains a state descriptor, a timestamp, and state parameters. The computing device then generates a log record entry based on aggregation of the state change, the state descriptor, the timestamp, and/or the state parameters. The computing device then facilitates storage of the log record entry within event memory of the DSN.

Claims

1. A computing device comprising:

an interface configured to interface and communicate with a dispersed or distributed storage network (DSN);

memory that stores operational instructions; and

a processing module operably coupled to the interface and to the memory, wherein the processing module, when operable within the computing device based on the operational instructions, is configured to;

receive, from a storage unit (SU) of the DSN, a signal via the interface, wherein the signal is in response to a read request from a user for an encoded data slice (EDS) of a set of encoded data slices (EDSs), wherein the SU includes a set of memory devices and the EDS is stored in a memory device of the set of memory devices;

based on the signal, detect a state change for the SU;

obtain a state descriptor;

obtain a timestamp;

obtain state parameters;

generate a log record entry based on aggregation of the state change, the state descriptor, the timestamp, and the state parameters; and

facilitate storage of the log record entry within event memory of the DSN.

2. The computing device of claim 1, wherein at least one:

detection of the state change is based on at least one of a software flag, a message, a predetermination, a process output, a pattern match, a valid state table, or a previous state condition;

obtaining the state descriptor is based on at least one of the state change, lookup, generating the state descriptor, a state descriptor table lookup, retrieving the state descriptor, or receiving the state descriptor in response to sending a query;

obtaining the timestamp is based on at least one of querying a time module, receiving the timestamp, or retrieving the timestamp;

or

obtaining the state parameters is based on at least one of the state change, the state descriptor, the timestamp, a state parameters table lookup, retrieving the state parameters, an error message, a parameter table lookup, a parameter history record lookup, or receiving a state parameter in response to sending the query or another query;

or

facilitating the storage of the log record entry within event memory of the DSN is based on at least one of storing the log record entry within locally within the memory or transmitting the log record entry to another computing device within the DSN.

3. The computing device of claim 1, wherein the processing module, when operable within the computing device based on the operational instructions, is further configured to:

determine to generate a statistics record;

obtain one or more quantitative descriptor types;

obtain a quantitative descriptor value for each of the one or more quantitative descriptor types;

obtain another timestamp;

generate a statistics record entry including to generate at least one of one or more entries of fields of the statistics record entry including a reporting entity identifier (ID), a step of at least one of a process or event, the another timestamp, the one or more quantitative descriptor types, or one or more quantitative descriptor values corresponding to each of the one more quantitative descriptor types; and

facilitate storage of the statistics record entry within event memory of the DSN.

4. The computing device of claim 3, wherein at least one:

determination to generate the statistics record is based on at least one of an error message, a state change, a time period, an event, a software flag, a message, a predetermination, a process output, a pattern match, a previous state condition, a previous statistic, a statistical correlation output, a request, or receipt of a slice storage error message;

obtaining the one or more descriptor types is based on at least one of a lookup, a system condition, configuration information, a retrieval, a query, receiving an error message, or a memory utilization indicator;

or

obtaining the quantitative descriptor value for each of the one or more quantitative descriptor types is based on at least one of query, receiving an error message, a historical record lookup, another statistics record entry, or a value source indicator table lookup.

5. The computing device of claim 1, wherein:

a decode threshold number of EDSs are needed to recover the data segment;

a read threshold number of EDSs provides for reconstruction of the data segment;

a write threshold number of EDSs provides for a successful transfer of the set of EDSs from a first at least one location in the DSN to a second at least one location in the DSN;

the set of EDSs is of pillar width and includes a pillar number of EDSs;

each of the decode threshold number, the read threshold number, and the write threshold number is less than the pillar number; and

the write threshold number is greater than or equal to the read threshold number that is greater than or equal to the decode threshold number.

6. The computing device of claim 1, wherein the computing device is located at a first premises that is remotely located from a second premises of at least one SU of the plurality of SUs within the DSN.

7. The computing device of claim 1 further comprising:

a SU of the plurality of SUs within the DSN, a wireless smart phone, a laptop, a tablet, a personal computer (PC), a work station, or a video game device.

8. The computing device of claim 1, wherein the DSN includes at least one of a wireless communication system, a wire lined communication system, a non-public intranet system, a public internet system, a local area network (LAN), or a wide area network (WAN).

9. A computing device comprising:

an interface configured to interface and communicate with a dispersed or distributed storage network (DSN);

memory that stores operational instructions; and

a processing module operably coupled to the interface and to the memory, wherein the processing module, when operable within the computing device based on the operational instructions, is configured to;

receive, from a storage unit (SU) of the DSN, a signal via the interface, wherein the signal is in response to a read request from a user for an encoded data slice (EDS) of a set of encoded data slices (EDSs), wherein the SU includes a set of memory devices and the EDS is stored in a memory device of the set of memory devices;

based on the signal, detect a state change for the SU;

obtain a state descriptor based on at least one of the state change, lookup, generating the state descriptor, a state descriptor table lookup, retrieving the state descriptor, or receiving the state descriptor in response to sending a query;

obtain a timestamp based on at least one of querying a time module, receiving the timestamp, or retrieving the timestamp;

obtain state parameters based on at least one of the state change, the state descriptor, the timestamp, a state parameters table lookup, retrieving the state parameters, an error message, a parameter table lookup, a parameter history record lookup, or receiving a state parameter in response to sending the query or another query;

generate a log record entry based on aggregation of the state change, the state descriptor, the timestamp, and the state parameters; and

facilitate storage of the log record entry within event memory of the DSN based on at least one of storing the log record entry within locally within the memory or transmitting the log record entry to another computing device within the DSN.

10. The computing device of claim 9, wherein the processing module, when operable within the computing device based on the operational instructions, is further configured to:

determine to generate a statistics record;

obtain one or more quantitative descriptor types;

obtain a quantitative descriptor value for each of the one or more quantitative descriptor types;

obtain another timestamp;

generate a statistics record entry including to generate at least one of one or more entries of fields of the statistics record entry including a reporting entity identifier (ID), a step of at least one of a process or event, the another timestamp, the one or more quantitative descriptor types, or one or more quantitative descriptor values corresponding to each of the one more quantitative descriptor types; and

facilitate storage of the statistics record entry within event memory of the DSN.

11. The computing device of claim 10, wherein at least one:

determination to generate the statistics record is based on at least one of an error message, a state change, a time period, an event, a software flag, a message, a predetermination, a process output, a pattern match, a previous state condition, a previous statistic, a statistical correlation output, a request, or receipt of a slice storage error message;

obtaining the one or more descriptor types is based on at least one of a lookup, a system condition, configuration information, a retrieval, a query, receiving an error message, or a memory utilization indicator;

or

obtaining the quantitative descriptor value for each of the one or more quantitative descriptor types is based on at least one of query, receiving an error message, a historical record lookup, another statistics record entry, or a value source indicator table lookup.

12. The computing device of claim 9, wherein:

a decode threshold number of EDSs are needed to recover the data segment;

a read threshold number of EDSs provides for reconstruction of the data segment;

a write threshold number of EDSs provides for a successful transfer of the set of EDSs from a first at least one location in the DSN to a second at least one location in the DSN;

the set of EDSs is of pillar width and includes a pillar number of EDSs;

each of the decode threshold number, the read threshold number, and the write threshold number is less than the pillar number; and

the write threshold number is greater than or equal to the read threshold number that is greater than or equal to the decode threshold number.

13. The computing device of claim 9 further comprising:

a SU of the plurality of SUs within the DSN, a wireless smart phone, a laptop, a tablet, a personal computer (PC), a work station, or a video game device; and

wherein;

the DSN includes at least one of a wireless communication system, a wire lined communication system, a non-public intranet system, a public internet system, a local area network (LAN), or a wide area network (WAN).

14. A method for execution by a computing device, the method comprising:

receiving, from a storage unit (SU) of a dispersed or distributed storage network (DSN), a signal via an interface of the computing device that is configured to interface and communicate with the DSN, wherein the signal is in response to a read request from a user for an encoded data slice (EDS) of a set of encoded data slices (EDSs), wherein the SU includes a set of memory devices and the EDS is stored in a memory device of the set of memory devices;

based on the signal, detecting a state change for the SU;

obtaining a state descriptor;

obtaining a timestamp;

obtaining state parameters;

generating a log record entry based on aggregation of the state change, the state descriptor, the timestamp, and the state parameters; and

facilitating storage of the log record entry within event memory of the DSN.

15. The method of claim 14, wherein at least one:

detection of the state change is based on at least one of a software flag, a message, a predetermination, a process output, a pattern match, a valid state table, or a previous state condition;

obtaining the state descriptor is based on at least one of the state change, lookup, generating the state descriptor, a state descriptor table lookup, retrieving the state descriptor, or receiving the state descriptor in response to sending a query;

obtaining the timestamp is based on at least one of querying a time module, receiving the timestamp, or retrieving the timestamp;

or

obtaining the state parameters is based on at least one of the state change, the state descriptor, the timestamp, a state parameters table lookup, retrieving the state parameters, an error message, a parameter table lookup, a parameter history record lookup, or receiving a state parameter in response to sending the query or another query;

or

facilitating the storage of the log record entry within event memory of the DSN is based on at least one of storing the log record entry within locally within the memory or transmitting the log record entry to another computing device within the DSN.

16. The method of claim 14 further comprising:

determining to generate a statistics record;

obtaining one or more quantitative descriptor types;

obtaining a quantitative descriptor value for each of the one or more quantitative descriptor types;

obtaining another timestamp;

generating a statistics record entry including to generate at least one of one or more entries of fields of the statistics record entry including a reporting entity identifier (ID), a step of at least one of a process or event, the another timestamp, the one or more quantitative descriptor types, or one or more quantitative descriptor values corresponding to each of the one more quantitative descriptor types; and

facilitating storage of the statistics record entry within event memory of the DSN.

17. The method of claim 16, wherein at least one:

determination to generate the statistics record is based on at least one of an error message, a state change, a time period, an event, a software flag, a message, a predetermination, a process output, a pattern match, a previous state condition, a previous statistic, a statistical correlation output, a request, or receipt of a slice storage error message;

obtaining the one or more descriptor types is based on at least one of a lookup, a system condition, configuration information, a retrieval, a query, receiving an error message, or a memory utilization indicator;

or

obtaining the quantitative descriptor value for each of the one or more quantitative descriptor types is based on at least one of query, receiving an error message, a historical record lookup, another statistics record entry, or a value source indicator table lookup.

18. The method of claim 14, wherein:

a decode threshold number of EDSs are needed to recover the data segment;

a read threshold number of EDSs provides for reconstruction of the data segment;

a write threshold number of EDSs provides for a successful transfer of the set of EDSs from a first at least one location in the DSN to a second at least one location in the DSN;

the set of EDSs is of pillar width and includes a pillar number of EDSs;

each of the decode threshold number, the read threshold number, and the write threshold number is less than the pillar number; and

the write threshold number is greater than or equal to the read threshold number that is greater than or equal to the decode threshold number.

19. The method of claim 14, wherein the computing device includes a SU of the plurality of SUs within the DSN, a wireless smart phone, a laptop, a tablet, a personal computer (PC), a work station, or a video game device.

20. The method of claim 14, wherein the DSN includes at least one of a wireless communication system, a wire lined communication system, a non-public intranet system, a public internet system, a local area network (LAN), or a wide area network (WAN).