Application-Layer Monitoring of Communication Between One or More Database Clients and One or More Database Servers

• US 20090138487A1
• Filed: 01/26/2009
• Published: 05/28/2009
• Est. Priority Date: 09/03/2004
• Status: Active Grant

• Current Assignee: CF DB EZ LLC (FIG LLC (d/b/a Fortress Investment Group LLC))
• Original Assignee: Crossroads Systems (Texas) Incorporated (Crossroads Systems, Inc.)
• Inventors: Ewing, David B., Martindale, Rick A.
• Granted Patent: US 7,895,160 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 11/3409 for performance assessment
• CPC Class Codes: G06F 11/3495 for systems
• CPC Class Codes: G06F 16/217 Database tuning G06F16/2282 takes precedence; database performance monitoring G06F11/3409
• CPC Class Codes: G06F 2201/80 Database-specific techniques
• CPC Class Codes: G06F 2201/81 Threshold
• CPC Class Codes: G06F 2201/865 Monitoring of software
• CPC Class Codes: G06F 2201/885 Monitoring specific for caches
• CPC Class Codes: H04L 67/125 involving control of end-device applications over a network
• CPC Class Codes: Y10S 707/99931 Database or file accessing
• CPC Class Codes: Y10S 707/99942 Manipulating data structure, e.g. compression, compaction, compilation
• CPC Class Codes: Y10S 707/99943 Generating database or data structure, e.g. via user interface

Abstract

One embodiment includes a system for application-layer monitoring of communication between one or more database clients and one or more database servers. The system includes one or more decoders residing at a decoding layer above a network layer. The decoders reside at a first network location between one or more database clients residing at one or more second network locations and one or more database servers residing at one or more third network locations. The decoders receive database messages communicated from the database clients and intended for the database servers and database messages communicated from the database servers and intended for the database clients, decode the database messages, and extract query-language statements from the database messages. The system also includes a monitoring application residing at an application layer above the decoding layer. The monitoring application resides at the first network location. The monitoring application receives query-language statements extracted at the decoders and records observations on the database messages based on the query-language statements extracted at the decoders.

Claims

1. A system for application-layer monitoring of communication between one or more database clients and one or more database servers, the system comprising:

one or more decoders residing at a decoding layer above a network layer, the decoders residing at a first network location between one or more database clients residing at one or more second network locations and one or more database servers residing at one or more third network locations, the decoders being operable to;

receive database messages communicated from the database clients and intended for the database servers and database messages communicated from the database servers and intended for the database clients;

decode the database messages; and

extract query-language statements from the database messages; and

a monitoring application residing at an application layer above the decoding layer, the monitoring application residing at the first network location, the monitoring application being operable to receive query-language statements extracted at the decoders and record observations on the database messages based at least in part on the query-language statements extracted at the decoders.

2. The system of claim 1, further comprising a database message interface at the network layer and at the first network location, the database message interface operable, in a passive mode, to receive communication between the database clients and the database servers for communication to the decoders.

3. The system of claim 1, further comprising a database message interface at the network layer and at the first network location, the database message interface operable, in a proxy mode, to receive communication between the database clients and the database servers for communication to the decoders.

4. The system of claim 1, wherein observations on the database messages based at least in part on the query-language statements extracted at the decoders comprise one or more of the following:

subject database instances of the query-language statements;

vendors of database implementations of the subject database instances;

software and versions of the software in the database implementations;

network protocols and versions of the network protocols used to communicate the database messages;

protocol drivers at the database servers, versions of the protocol drivers, and application programming interfaces (APIs) at the database servers;

devices hosting the subject database instances of the query-language statements;

hostnames, Internet Protocol (LP) addresses, Media Access Control (MAC) addresses, and network ports of the database servers;

operating systems (OSs), versions of the OSs, and attributes of the OSs of devices hosting the subject database instances;

protocol drivers at the clients, versions of the protocol drivers, and APIs at the clients;

devices hosting the clients;

application frameworks at the clients;

hostnames, IP addresses, MAC addresses, and network ports of the clients 12;

OSs, versions of the OSs, and attributes of the OSs of the clients 12;

a number of queries communicated from each of the clients to each of one or more database instances; and

a rate at which queries communicated from each of the clients to each of one or more database instances.

5. The system of claim 1, wherein observations on the database messages based at least in part on the query-language statements extracted at the decoders comprise full text of the query-language statements.

6. The system of claim 1, wherein observations on the database messages based at least in part on the query-language statements extracted at the decoders comprise timestamps in the query-language statements.

7. The system of claim 1, wherein observations on the database messages based at least in part on the query-language statements extracted at the decoders comprise times to complete responses to queries from clients.

8. The system of claim 7, wherein an observation comprising a time to complete a response to a query from a client indicates a first portion of the time to complete the response attributable to the client and a second portion of the time to complete the response attributable to a database server.

9. The system of claim 7, wherein observations on the database messages based at least in part on the query-language statements extracted at the decoders comprise one or more average times to complete responses to queries from clients.

10. The system of claim 1, wherein observations on the database messages based at least in part on the query-language statements extracted at the decoders comprise statistics on each of one or more subsets of the query-language statements, the subsets being defined according to user input.

11. The system of claim 1, wherein the monitoring application is further operable to provide user access to recorded observations based at least in part on the query-language statements extracted at the decoders using a graphical user interface (GUI) comprising at least one or more of:

a statistical display of recorded observations;

a historical display of recorded observations; and

a tabular display of recorded observations;

12. The system of claim 1, wherein a single nonblocking control thread drives the decoders and the monitoring application according to message events in an event queue.

13. The system of claim 12, wherein, to drive the decoders, the nonblocking control thread communicates function calls to the decoders comprising buffers pointing to frames of database messages in memory at the first network location without communicating the frames of the database messages to the decoders or assembling the database messages and communicating the database messages to the decoders.

14. The system of claim 1, wherein the decoders are each operable to decode particular database messages of particular database implementations different from each other.

15. The system of claim 14, wherein the decoders comprise at least:

a first decoder operable to decode Distributed Relational Database Architecture (DRDA) database messages;

a second decoder operable to decode Tabular Data Stream (TDS) database messages; and

a third decoder operable to decode OracleNet database messages.

16. The system of claim 1, further comprising a database message interface residing at the network layer and at the first network location, the database message interface being operable to:

receive frames of database messages from the clients and the database servers and write the frames to memory at the first network location for processing at the decoders; and

communicate frames of database messages from memory at the first network location to the clients and the database servers without assembling the frames.

17. The system of claim 1, further comprising a normalization module residing at a query-language layer above the decoding layer, the normalization module being operable to receive query-language statements extracted at the decoders and, before the caching application receives the query-language statements, normalize the query-language statements for processing at the monitoring application

18. The system of claim 17, wherein normalizing a query-language statement comprises one or more of:

capitalizing all letters in the query-language statement;

reordering terms in the query-language statement according to a predetermined order; and

modifying one or more clauses in the query-language statement according to a predetermined clause equivalency.

19. The system of claim 1, further comprising a parser residing at a query-language layer above the decoding layer, the parser being operable to receive query-language statements extracted at the decoders and, before the caching application receives the query-language statements, parse the query-language statements for processing at the caching application.

20. The system of claim 1, wherein the network layer comprises a Transport Control Protocol over Internet Protocol (TCP/IP) interface or an Interprocess Communication (IPC) interface.

21-72. -72. (canceled)