Method and system for on-demand aggregated logging for distributed systems

• US 9,626,328 B1
• Filed: 06/19/2013
• Issued: 04/18/2017
• Est. Priority Date: 06/19/2013
• Status: Active Grant

• Current Assignee: EMC Corporation (Dell Technologies Inc.)
• Original Assignee: Emc IP Holding Company LLC (Dell Technologies Inc.)
• Inventors: Mukherjee, Gourav, Kumar, Vinod, Pradhan, Pankaj, Jha, Ravi Ranjan
• Primary Examiner(s): Thieu, Benjamin M
• Application Number:
  US13/921,335
• Time in Patent Office: 1,399 Days
• CPC Class Codes: G06F 11/3006 where the computing system is distributed, e.g. networked systems, clusters, multiprocessor systems multiprogramming arrangements G06F9/46; allocation of resources G06F9/50
• CPC Class Codes: G06F 11/3476 Data logging G06F11/14, G06F11/2205 take precedence
• CPC Class Codes: G06F 15/163 Interprocessor communication
• CPC Class Codes: G06F 17/40 Data acquisition and logging for input to computer G06F3/00

Abstract

On-demand aggregated logging for distributed systems is described. An identification of a logging condition is received via a first user interface. The logging condition is sent to multiple logging elements, wherein each of the multiple logging elements is executing on a corresponding one of multiple distributed systems components. A logging element determines whether a local runtime condition matches the logging condition. The logging element sends a local log associated with the local runtime condition to an aggregating logger, wherein the local log is supplemented with information that identifies the logging condition, in response to a determination that the local runtime condition matches the logging condition. The aggregating logger creates an aggregated log based on the local log and the supplemented information. The aggregated log is output via a second user interface to enable resolution of a problem associated with the multiple distributed systems components.

Claims

1. A system for on-demand aggregated logging for distributed systems, the system comprising:

a processor-based application executed on a computer and configured to;

receive, by an aggregating logger, an identification of a logging condition via a first user interface, the logging condition corresponding to a problem associated with at least one of a plurality of distributed systems components;

send, by the aggregating logger, the logging condition to each logging element of a plurality of logging elements, each logging element being executed on a corresponding one of the plurality of distributed systems components;

receive, by the aggregating logger, a local log from at least one logging element of the plurality of logging elements when a determination is made by the at least one logging element that a local runtime condition matches the logging condition received by the at least one logging element, the local log being supplemented with information that identifies the logging condition received by the at least one logging element;

create, by the aggregating logger, an aggregated log based on the local log and the supplemented information; and

output, via a second user interface, the aggregated log that enables resolution of a problem associated with the plurality of distributed systems components.

2. The system of claim 1, wherein the logging condition comprises at least one of a user identifier, an application identifier, an activity identifier, and an identifier associated with the corresponding one of the plurality of distributed systems components.

3. The system of claim 1, wherein receiving the local log from the at least one logging element comprises one of receiving the local log prior to storage of the local log on the corresponding one of the plurality of distributed systems components, receiving the local log concurrent with storage of the local log on the corresponding one of the plurality of distributed systems components, and receiving the local log after storage of the local log on the corresponding one of the plurality of distributed systems components.

4. The system of claim 1, wherein receiving the local log comprises receiving the local log from a message storage, the local log being stored being previously stored to the message storage based on at least one of a duration of time that the local log is stored in the message storage, a remaining capacity associated with the message storage, and a number of local logs stored in the message storage.

5. The system of claim 1, wherein the supplemented information further comprises at least one of a distributed system component identifier, a log message identifier, and a request identifier.

6. The system of claim 1, wherein the processor-based application is configured to:

register the corresponding one of the plurality of distributed systems components; and

create an identifier for the corresponding one of the plurality of distributed systems components.

7. The system of claim 1, wherein the processor-based application is configured to:

receiving, by the aggregating logger, an activity list from the at least one logging element associated with the corresponding one of the plurality of distributed systems components, wherein the logging condition is based on an activity of the activity list.

8. A computer-implemented method for on-demand aggregated logging for distributed systems, the method comprising:

receiving, by an aggregating logger, an identification of a logging condition via a first user interface, the logging condition corresponding to a problem associated with at least one of a plurality of distributed systems components;

sending, by the aggregating logger, the logging condition to each logging element of a plurality of logging elements, each logging element being executed on a corresponding one of the plurality of distributed systems components;

receiving, by the aggregating logger, a local log from at least one logging element of the plurality of logging elements when a determination is made by the at least one logging element that a local runtime condition matches the logging condition received by the at least one logging element, the local log being supplemented with information that identifies the logging condition received by the at least one logging element;

creating, by the aggregating logger, an aggregated log based on the local log and the supplemented information; and

outputting, via a second user interface, the aggregated log that enables resolution of a problem associated with the plurality of distributed systems components.

9. The method of claim 8, wherein the logging condition comprises at least one of a user identifier, an application identifier, an activity identifier, and an identifier associated with the corresponding one of the plurality of distributed systems components.

10. The method of claim 8, wherein receiving the local log from the at least one logging element comprises one of receiving the local log prior to storage of the local log on the corresponding one of the plurality of distributed systems components, receiving the local log concurrent with storage of the local log on the corresponding one of the plurality of distributed systems components, and receiving the local log after storage of the local log on the corresponding one of the plurality of distributed systems components.

11. The method of claim 8, wherein receiving the local log comprises receiving the local log from a message storage, the local log being stored being previously stored to the message storage based on at least one of a duration of time that the local log is stored in the message storage, a remaining capacity associated with the message storage, and a number of local logs stored in the message storage.

12. The method of claim 8, wherein the supplemented information further comprises at least one of a distributed system component identifier, a log message identifier, and a request identifier.

13. The method of claim 8, wherein the method further comprises:

registering the corresponding one of the plurality of distributed systems components; and

creating an identifier for the corresponding one of the plurality of distributed systems components.

14. The method of claim 8, wherein the method further comprises receiving, by the aggregating logger, an activity list from the at least one logging element associated with the corresponding one of the plurality of distributed systems components, wherein the logging condition is based on an activity of the activity list.

15. A computer program product, comprising a non-transitory computer-readable medium having a computer-readable program code embodied therein, the computer-readable program code adapted to be executed by one or more processors to implement a method for on-demand aggregated logging for distributed systems, the method comprising:

receiving, by an aggregating logger, an identification of a logging condition via a first user interface, the logging condition corresponding to a problem associated with at least one of a plurality of distributed systems components;

sending, by the aggregating logger, the logging condition to each logging element of a plurality of logging elements, each logging element being executed on a corresponding one of the plurality of distributed systems components;

receiving, by the aggregating logger, a local log from at least one logging element of the plurality of logging elements when a determination is made by the at least one logging element that a local runtime condition matches the logging condition received by the at least one logging element, the local log being supplemented with information that identifies the logging condition received by the at least one logging element;

creating, by the aggregating logger, an aggregated log based on the local log and the supplemented information; and

outputting, via a second user interface, the aggregated log that enables resolution of a problem associated with the plurality of distributed systems components.

16. The computer program product of claim 15, wherein the logging condition comprises at least one of a user identifier, an application identifier, an activity identifier, and an identifier associated with the corresponding one of the plurality of distributed systems components.

17. The computer program product of claim 15, wherein receiving the local log from the at least one logging element comprises one of receiving the local log prior to storage of the local log on the corresponding one of the plurality of distributed systems components, receiving the local log concurrent with storage of the local log on the corresponding one of the plurality of distributed systems components, and receiving the local log after storage of the local log on the corresponding one of the plurality of distributed systems components.

18. The computer program product of claim 15, wherein receiving the local log comprises receiving the local log from a message storage, the local log being stored being previously stored to the message storage based on at least one of a duration of time that the local log is stored in the message storage, a remaining capacity associated with the message storage, and a number of local logs stored in the message storage.

19. The computer program product of claim 15, wherein the supplemented information further comprises at least one of a distributed system component identifier, a log message identifier, and a request identifier.

20. The computer program product of claim 15, wherein the method further comprises:

registering the corresponding one of the plurality of distributed systems components; and

creating an identifier for the corresponding one of the plurality of distributed systems components.