Log management system and method for distributed computing systems

• US 10,027,534 B1
• Filed: 05/27/2015
• Issued: 07/17/2018
• Est. Priority Date: 05/27/2015
• Status: Active Grant

• Current Assignee: Emc IP Holding Company LLC (Dell Technologies Inc.)
• Original Assignee: VCE IP Holding Company LLC (Dell Technologies Inc.)
• Inventors: Mahapatra, Akshaya, Rao, Vandana
• Primary Examiner(s): Lai, Michael C
• Application Number:
  US14/723,006
• Time in Patent Office: 1,147 Days
• Field of Search: 709226
• CPC Class Codes: H04L 41/069 using logs of notifications; Post-processing of notifications
• CPC Class Codes: H04L 41/0853 by actively collecting configuration information or by backing up configuration information
• CPC Class Codes: H04L 41/40 using virtualisation of network functions or resources, e.g. SDN or NFV entities
• CPC Class Codes: H04L 43/0817 by checking functioning
• CPC Class Codes: H04L 43/20 the monitoring system or the monitored elements being virtualised, abstracted or software-defined entities, e.g. SDN or NFV
• CPC Class Codes: H04L 47/783 Distributed allocation of resources, e.g. bandwidth brokers

Abstract

A log management system includes a computer executable application that may be executed to obtain a first log entry from a first resource of a distributed computing system having multiple resources, and obtain resource information about at least one other resource of the distributed computing system that is correlated with the first resource. From the resource information, the application obtains one or more log entries from the correlated resource, and displays the first log entry and the correlated log entry on a display.

Claims

1. A log management system comprising:

a computing device comprising at least one processor and at least one memory to store instructions that are executed by the at least one processor to;

obtain a first log entry from a first resource of a distributed computing system;

append a unique identifier to the first log entry, the unique identifier based on information obtained from a data packet encapsulating the first log entry;

obtain resource information regarding the first resource by performing a lookup using the unique identifier, the resource information identifying resources of the distributed computing system correlated to the first resource;

identify, from the resource information, a second resource of the distributed computing system, the second resource correlated to the first resource;

obtain a second log entry from the second resource;

generate a combined log entry from the first log entry and the second log entry, the combined log entry including data from each of the first log entry and the second log entry; and

display the combined log entry on a display.

2. The log management system of claim 1, wherein the distributed computing system comprises a virtualized computing environment, the first resource comprises a hardware resource of the distributed computing system, and the second resource comprises a logical resource representation of the hardware resource.

3. The log management system of claim 2, wherein the logical resource representation is generated by an operations management application that administers operation of the distributed computing system.

4. The log management system of claim 1, wherein the distributed computing system comprises a computing cluster, and the first resource and the second resource comprise hardware resources of the computing cluster, wherein the resource information comprises a common dependency shared by the first resource and the second resource.

5. The log management system of claim 1, wherein the instructions are executed to append a timestamp to the first log entry and the second log entry.

6. The log management system of claim 1, wherein at least a portion of the instructions comprise a modular software component configured on a log aggregation and analysis application.

7. The log management system of claim 1, wherein the instructions are executed to determine the unique identifier by obtaining a source address from a data packet transmitted by the first resource, the unique identifier being of the first resource.

8. The log management system of claim 7, wherein the instructions are executed to correlate the second resource with the first resource by accessing a hash table that stores the unique identifier of the first resource and a unique identifier of the second resource, the first resource and the second resource correlated by at least one of (i) the first resource comprising a virtual machine that is executed on the second resource, the second resource comprising a host of the virtual machine;

(ii) a communication link between the first resource and the second resource;

(iii) a source of electrical power commonly shared by the first resource and the second resource; and

(iv) a similar type and version of operating system used by the first resource and the second resource.

9. The log management system of claim 1, wherein the unique identifier is based on a source address of the data packet.

10. A log management method comprising:

obtaining, using an application stored in a non-transitory medium and executed on at least one processor, a first log entry from a first resource of a distributed computing system having a plurality of resources;

appending a unique identifier to the first log entry, the unique identifier based on information obtained from a data packet encapsulating the first log entry;

obtaining resource information regarding the first resource by performing a lookup using the unique identifier, the resource information identifying resources of the distributed computing system correlated to the first resource;

identifying, from the resource information, a second resource of the distributed computing system, the second resource correlated to the first resource;

obtaining a second log entry from the second resource;

generating a combined log entry from the first log entry and the second log entry, the combined log entry including data from each of the first log entry and the second log entry; and

displaying the combined log entry on a display.

11. The log management method of claim 10, further comprising generating, by an operations management application that administers operation of the distributed computing system, wherein the second resource includes a logical resource representation, and the distributed computing system operates in a virtualized computing environment.

12. The log management method of claim 10, wherein the first resource is correlated with the second resource according to a common dependency shared by the first resource and the second resource.

13. The log management method of claim 10, further comprising appending a timestamp to the first log entry and the second log entry.

14. The log management method of claim 10, determining the unique identifier is based on a source address of the data packet, the unique identifier being of the first resource.

15. The log management method of claim 10, further comprising storing the first log entry and the second log entry in at least one memory.

16. One or more non-transitory tangible computer-readable storage media storing computer-executable instructions that, when executed by one or more processors, cause the one or more processors to:

obtain a first log entry from a first resource of a distributed computing system;

obtain resource information regarding the first resource, the resource information identifying resources of the distributed computing system correlated to the first resource;

append a unique identifier to the first log entry, the unique identifier based on information obtained from a data packet encapsulating the first log entry;

identify, from the resource information, a second resource of the distributed computing system by performing a lookup using the unique identifier, the second resource correlated to the first resource;

obtain a second log entry from the second resource;

generate a combined log entry from the first log entry and the second log entry, the combined log entry including data from each of the first log entry and the second log entry; and

display the combined log entry on a display.

17. The non-transitory tangible computer-readable storage media of claim 16, wherein the second resource comprises a logical resource representation and the distributed computing system operates in a virtualized computing environment, the non-transitory tangible computer-readable storage media further including instructions that, when executed by the one or more processor, cause the one or more processors to generate the second resource.

18. The non-transitory tangible computer-readable storage media of claim 16, further including instructions that, when executed by the one or more processor, cause the one or more processors to correlate the second resource with the first resource according to the resource information, the resource information including a common dependency shared by the first resource and the second resource.

19. The non-transitory tangible computer-readable storage media of claim 16, further including instructions that, when executed by the one or more processor, cause the one or more processors to determine the unique identifier, the unique identifier being of the first resource, and append the unique identity identifier of the first resource and a timestamp to the first log entry.

20. The non-transitory tangible computer-readable storage media of claim 16, wherein the unique identifier is based on a source address of the data packet.