Collection of web server performance metrics to a centralized database for reporting and analysis

• US 9,330,051 B1
• Filed: 11/27/2007
• Issued: 05/03/2016
• Est. Priority Date: 11/27/2007
• Status: Active Grant

• Current Assignee: T-Mobile Innovations LLC (Deutsche Telekom AG)
• Original Assignee: Sprint Communications Company LP (Deutsche Telekom AG)
• Inventors: Washburn, Brian John, Martin, Justin Alan, Johnson, Shaun Michael, Hayward, Brian Elwood, Kelley, Devin
• Primary Examiner(s): Vostal, O. C.
• Application Number:
  US11/945,398
• Time in Patent Office: 3,080 Days
• Field of Search: 709/224
• US Class Current: 1/1
• CPC Class Codes: G06F 15/173 using an interconnection network, e.g. matrix, shuffle, pyramid, star, snowflake
• CPC Class Codes: G06F 16/1734 Details of monitoring file system events, e.g. by the use of hooks, filter drivers, logs
• CPC Class Codes: H04L 43/0817 by checking functioning

Abstract

Systems, methods, and computer-readable media are provided for, among other things, generating web server performance metrics from log file information and storing the metrics offline in a centralized database. A collector accesses log file information from a log file for a web server and generates web server performance metrics on a per web page basis. The web server metrics include a number of requests for a web page, error count for the web page, average response time for the web page, total number of bytes transferred for the web page, and a number of times a service level objection for the web page was exceeded. The web server metrics are stored in a centralized database such that the metrics are available for offline web server performance reporting and analysis.

Claims

1. One or more non-transitory computer-storage media embodying computer-useable instructions for performing a method comprising:

accessing, on a computing device comprising a microprocessor and a memory, separate from a web server, log file information from a log file for the web server, the log file information including entries for web server transactions associated with a plurality of users of client devices during an interval period for each of a plurality of web pages maintained by the web server;

parsing the log file information;

grouping the parsed log file information by web page, wherein grouping comprises forming a group of the entries associated with the plurality of users of client devices and corresponding to a particular web page, wherein each entry in the group of entries corresponds to the particular web page, and wherein a first entry in the group of entries has a first directory path and a second entry in the group has a second directory path which is different from the first directory path, wherein the first directory path is associated with a first user and the second directory path is associated with a second user;

calculating web server performance metrics on a per web page basis for the interval period based on the parsed log file information, wherein the web server performance metrics include for at least a portion of the plurality of web pages;

a number of web page requests, error counts, average response time over substantially all requests during the interval, total number of bytes, and a number of times a service level objective was not met; and

storing the web server performance metrics, as separately calculated for each of the plurality of web pages, in a database.

2. The one or more computer-storage media of claim 1,

wherein accessing the log file information from the log file comprises:

determining a total byte count for the log file recorded from a previous log file access;

determining a location in the log file corresponding with the total byte count; and

retrieving the log file information from the log file following the location in the log file corresponding with the total byte count.

3. The one or more computer-storage media of claim 1, wherein the method further comprises recording a total byte count for the log file.

4. The one or more computer-storage media of claim 1, wherein forming the group of the entries associated with a particular web page comprises identifying a pattern within the a directory path associated with an entry from the plurality of entries and determining that the pattern corresponds with the particular web page.

5. The one or more computer-storage media of claim 4, wherein forming the group is performed using a file mapping a plurality of directory path patterns with corresponding web pages.

6. The one or more computer-storage media of claim 1, wherein the method includes determining that one or more of the entries are excludable entries based on one or more IP addresses associated with the one or more excludable entries, and excluding the one or more excludable entries when calculating the web page performance metrics.

7. The one or more computer-storage media of claim 6, wherein the one or more IP addresses are listed in a configuration file providing a list of a plurality of IP addresses for exclusion.

8. The one or more computer-storage media of claim 1, wherein a number of times a service level objective was not met for a particular web page is determined by:

(1) accessing a file containing service level objectives for at least a portion of the plurality of web pages to determine the service level objective for the particular web page, wherein the service level objective is a predetermined response time for the particular web page; and

(2) comparing response times in the log file information for the particular web page against the predetermined response time to determine the number of response times that exceed the predetermined response time.

9. The one or more computer-storage media of claim 1, wherein the method further includes providing a timestamp associated with the interval period with the web server performance metrics.

10. One or more non-transitory computer-storage media embodying computer-useable components which, when executed by one or more computing devices comprising a microprocessor and a memory, generate web server performance metrics for facilitating web server performance analysis, the computer-useable components including:

a log file access component that accesses log file information from a log file for a web server at a predetermined sampling rate, the log file including a plurality of entries for web server transactions for a plurality of web pages maintained by the web server, the web server transactions including, for each web page, web page requests and responses associated with a plurality of users of client devices;

a parser that parses the log file information;

a total accumulator for calculating the web server performance metrics on a per web page basis based on the parsed log file information, wherein the total accumulator forms a group of entries associated with users in the plurality of users of client devices and corresponding to a particular web page, wherein each entry in the group of entries corresponds to the particular web page, by identifying a pattern within a directory path associated with the entry and determining that the pattern corresponds with the particular web page, wherein the total accumulator calculates the web server performance metrics for interval periods corresponding with the predetermined sampling rate, and wherein the web server performance metrics include, for each web page, a total number of web page requests for the web page, an error count for the web page, an average response time over substantially all requests during the interval period for the web page, a total number bytes transferred for the web page, and a number of times a service level objective was exceeded for the web page;

wherein the web server performance metrics from the total accumulator are stored in a database external to the web server separately for each of the plurality of web pages.

11. The one or more computer-storage media of claim 10, wherein when the log file access component access log file information from the log file, the log file access component accesses a file indicating a total number of bytes for the log file from a previous log file access to determine a starting point within the log file for retrieving the log file information.

12. The one or more computer-storage media of claim 10, wherein the total accumulator accesses a file mapping a plurality of directory path patterns with corresponding web pages.

13. The one or more computer-storage media of claim 10, wherein the total accumulator determines that one or more of the plurality of entries are excludable entries based on one or more IP addresses associated with the one or more excludable entries, and excludes the one or more excludable entries when calculating the web page performance metrics.

14. The one or more computer-storage media of claim 13, wherein the total accumulator exclude the one or more entries based on a configuration file providing a list of a plurality of IP addresses for exclusion.

15. The one or more computer-storage media of claim 10, wherein the total accumulator determines the number of times a service level objective was exceeded for each web page by:

(1) accessing a file containing service level objectives for at least a portion of the plurality of web pages to determine the service level objective for each web page, wherein the service level objective is a predetermined response time for each web page; and

(2) comparing response times in the log file information for each web page against the predetermined response time to determine the number of response times that exceed the predetermined response time for each web page.

16. The one or more computer-storage media of claim 10, wherein the web server performance metrics includes a corresponding timestamp associated with the interval period with the web server performance metrics.

17. A collector, comprising one or more computing devices including a microprocessor and a memory embodying computer-useable instructions for performing a method of storing web server performance metrics, the method comprising:

calculating web server performance metrics on a per web page basis based on a grouping of web server transactions associated with a plurality of users of client devices for each web page, wherein for a given web page the grouping includes a group of entries comprising web page requests from the plurality of users of client devices and corresponding to the given web page;

storing the web server performance metrics in a data structure maintained in a database, wherein the data structure includes;

a first data field containing data representing a web page identifier for a web page;

a second data field containing data representing a total number requests from the plurality of users of client devices for the web page during an interval period;

a third data field containing data representing an error count for the web page during the interval period;

a fourth data field containing data representing an average response time for the web page during the interval period;

a fifth data field containing data representing a total number of bytes transferred for the web page during the interval period; and

a sixth data field containing data representing a number of times a service level objective for the web page was exceeded during the time interval.

18. The collector of claim 17, wherein the data structure further includes a seventh data field containing data representing a timestamp associated with the time interval.