Monitoring an application environment

• US 9,576,010 B2
• Filed: 03/16/2015
• Issued: 02/21/2017
• Est. Priority Date: 02/27/2004
• Status: Expired due to Fees

• Current Assignee: eBay Inc.
• Original Assignee: eBay Inc.
• Inventors: Kumar, Abhinav, Purumala, Ravinder, Singh, Premendra
• Primary Examiner(s): THAI, HANH B
• Application Number:
  US14/659,058
• Publication Number:
  US 20150186436A1
• Time in Patent Office: 708 Days
• Field of Search: 707/609, 707/741
• US Class Current: 1/1
• CPC Class Codes: G06F 11/3409 for performance assessment
• CPC Class Codes: G06F 11/3452 Performance evaluation by statistical analysis
• CPC Class Codes: G06F 11/3476 Data logging G06F11/14, G06F11/2205 take precedence
• CPC Class Codes: G06F 11/3495 for systems
• CPC Class Codes: G06F 16/13 File access structures, e.g. distributed indices arrangements of input from, or output to, record carriers G06F3/06
• CPC Class Codes: G06F 16/2228 Indexing structures
• CPC Class Codes: G06F 2201/805 Real-time
• CPC Class Codes: G06F 2201/87 Monitoring of transactions
• CPC Class Codes: G06F 2201/875 Monitoring of systems including the internet

Abstract

In various embodiments, a system and related method for organizing transactional data from an application environment is disclosed. In some embodiments, a system includes a file system and one or more daemon indexers in electrical communication with the file system. The file system is arranged as a non-relational and serverless file system to allow for cost-effectiveness with ready scalability. The file system is to receive, in substantially real-time, unsorted transactional data from a publishing module. The one or more daemon indexers are arranged to receive the unsorted transactional data from the file system, organize the unsorted transactional data by operational characteristics, and store the organized transactional data on the file system. Other systems and methods are disclosed.

Claims

1. A method to organize transactional data, the method including:

reading the transactional data from an instrumented plurality of hardware-based application servers in substantially real-time as the transactional data are produced, the plurality of hardware-based application servers being instrumented to monitor a predetermined set of activities and parameters of a respective one of the plurality of hardware-based application servers;

communicating messages reflecting the set of activities and parameters;

receiving the transactional data from a file system within an application environment, the transactional data including operations data from the instrumented plurality of hardware-based application servers within the application environment;

organizing the transactional data by operational characteristics based on the operations of the plurality of hardware-based application servers;

indexing the data in a non-relational manner; and

storing the indexed data.

2. The method of claim 1, wherein the transactional data are organized by time, space, and functionality.

3. The method of claim 1, wherein the transactional data are received in substantially real-time from the plurality of hardware-based application servers.

4. The method of claim 1, further comprising:

receiving a user request to the transactional data;

accepting and sorting the user request to the transactional data by a first geographic region; and

preparing a response to the user request based on the indexed data.

5. The method of claim 4, further comprising:

making a determination of a second geographic region to which the user request is to be directed; and

directing the user request to the second geographic region.

6. The method of claim 4, further comprising:

breaking out portions of the user request; and

sorting the user request by related sets.

7. The method of claim 1, further comprising:

parsing the received transactional data into operational data and business-related data, the operational data including errors and warnings generated by the hardware-based plurality of servers, the business-related data including calls requesting customer support; and

making a determination of operational characteristics associated with the transactional data.

8. The method of claim 1, further comprising making a determination whether the organized transactional data are useful for a context in which a user request is presented.

9. A system to organize transactional data, the system including:

an instrumented plurality of hardware-based application servers within an application environment, the instrumentation to monitor a predetermined set of activities and parameters of a respective one of the plurality of hardware-based application servers and to communicate the messages reflecting the set of activities and parameters;

a file system arranged as a non-relational and serverless file system, the file system to receive, in substantially real-time, unsorted transactional data from publishing modules contained within each of the instrumented plurality of hardware-based application servers;

one or more hardware-based daemon indexers coupled to the file system to;

receive the unsorted transactional data from the file system, the transactional data including operations data from the instrumented plurality of hardware-based application servers;

organize the unsorted transactional data by operational characteristics based on the operations of the plurality of instrumented hardware-based application servers; and

store the organized transactional data on the file system.

10. The system of claim 9, further comprising an application module to provide application services within the application environment.

11. The system of claim 9, wherein the file system is a disk array.

12. The system of claim 9, further comprising a plurality of harvesters to collect the transactional data from the plurality of hardware-based application servers.

13. The system of claim 9, wherein the one or more hardware-based daemon indexers are further configured to index and store the transactional data, on a substantially real-time basis, by a time parameter, a functionality parameter, and a space parameter.

14. The system of claim 13, wherein the space parameter relates to a geographic location.

15. The system of claim 9, wherein the file system is in direct electrical communication with the one or more daemon indexers with no intermediary server located therebetween.

16. The system of claim 9, further comprising a trace aggregator in electrical communication with the file system to accept a user request relating to the transactional data within a first geographic region.

17. The system of claim 16, where the trace aggregator is further to make a determination of a second geographic region to which the user request is to be directed based on a determination of a load within the system.

18. The system of claim 16, wherein the trace aggregator is further to break out and sort the user request by related sets.

19. The system of claim 16, further comprising a web service module to:

sort the user requests request by geography, time, and function; and

receive a response to the user request from the file system.

20. A tangible computer-readable storage medium having no transitory signals, the tangible computer-readable storage medium containing instructions that, when executed by one or more processors, cause the one or more processors to perform operations comprising:

reading transactional data from an instrumented plurality of hardware-based application servers in substantially real-time as the transactional data are produced, the plurality of hardware-based application servers being instrumented to monitor a predetermined set of activities and parameters of a respective one of the plurality of hardware-based application servers;

communicating the monitoring client communicating messages reflecting the set of activities and parameters;

receiving the transactional data from a file system within an application environment, the transactional data including operations data from the instrumented plurality of hardware-based application servers within the application environment;

organizing the transactional data by operational characteristics based on the operations of the plurality of hardware-based application servers;

indexing the data in a non-relational manner; and

storing the indexed data.