Providing application-layer functionality between one or more database clients and one or more database servers

• US 7,529,753 B1
• Filed: 09/03/2004
• Issued: 05/05/2009
• Est. Priority Date: 09/03/2004
• Status: Expired due to Fees

• Current Assignee: CF DB EZ LLC (FIG LLC (d/b/a Fortress Investment Group LLC))
• Original Assignee: Crossroads Systems (Texas) Incorporated (Crossroads Systems, Inc.)
• Inventors: Ewing, David B.
• Primary Examiner(s): Cottingham, John
• Assistant Examiner(s): Patel, Viresh R
• Application Number:
  US10/933,790
• Time in Patent Office: 1,705 Days
• Field of Search: 707/100, 707/104.1, 707/103.X, 707/103.R, 707/1, 709/224, 709/225
• US Class Current: 1/1
• CPC Class Codes: G06F 16/252 between a Database Management System and a front-end application
• CPC Class Codes: Y10S 707/99934 Query formulation, input preparation, or translation
• CPC Class Codes: Y10S 707/99935 Query augmenting and refining, e.g. inexact access

Abstract

One embodiment includes a system providing application-layer functionality between one or more database clients and one or more database servers. The system includes one or more decoders residing at a decoding layer above a network layer. The decoders reside at a first network location between one or more database clients residing at one or more second network locations and one or more database servers residing at one or more third network locations. The decoders receive database messages communicated from the database clients and intended for the database servers and database messages communicated from the database servers and intended for the database clients, decode the database messages, and extract query-language statements from the database messages. The system also includes an application residing at an application layer above the decoding layer. The application resides at the first network location. The application receives and processes query-language statements extracted at the decoders.

Claims

1. A computer accessible storage hardware having thereon stored a system for providing application-layer functionality between one or more database clients and one or more database servers, the system comprising:

one or more decoders residing at a decoding layer above a network layer, the decoders residing at a first network location between one or more database clients residing at one or more second network locations and one or more database servers residing at one or more third network locations, the decoders being operable to;

receive database messages communicated from the database clients and intended for the database servers and database messages communicated from the database servers and intended for the database clients;

decode the database messages;

extract query-language statements from the database messages;

a caching application residing at an application layer above the decoding layer, the caching application residing at the first network location, the caching application being operable to;

receive query-language statements extracted at the decoders comprising queries;

receive query-language statements extracted at the decoders comprising query results corresponding to the queries;

record the queries and the query results corresponding to the queries in a cache residing at the first network location wherein the queries are associated with a corresponding query result;

a monitoring application operable to receive query-language statements extracted at the decoders and record observations on the database messages based at least in part on the query-language statements extracted at the decoders, wherein at least one observation is associated with a query result stored in the cache and communicate one or more observations associated with the queries to one or more computing systems at a fourth network location according to the needs of the one or more computer systems, wherein at least one of the computer systems maintains a web cache and is operable to modify the web cache based upon the communicated observations wherein observations on the database messages based at least in part on the query-language statement extracted at the decoders comprise the following;

subject database instances of the query-language statements;

network protocols and versions of the network protocols used to communicate the database messages;

devices hosting the subject database instances of the query-language statements;

hostnames, Internet Protocol (IP) addresses, Media Access Control (MAC) addresses, and network ports of the database servers;

operating systems (OSs), versions of the OSs, and attributes of the OSs of devices hosting the subject database instances;

devices hosting the clients; and

a number of queries communicated from each of the clients to each of one or more database instances; and

an application residing at an application layer above the decoding layer, the application residing at the first network location, the application being operable to receive and process query-language statements extracted at the decoders.

2. The computer accessible storage hardware of claim 1, wherein the caching application is further operable to communicate query results corresponding to the queries from the cache to the clients.

3. The computer accessible storage hardware of claim 1, wherein the caching application is further operable to:

receive query-language statements extracted at the decoders comprising write messages; and

invalidate records of queries and query results corresponding to the queries according to the write messages.

4. The computer accessible storage hardware of claim 1 wherein the monitoring application is further operable to provide user access to recorded observations based at least in part on the query-language statements extracted at the decoders using a graphical user interface (GUI) comprising at least one or more of:

a statistical display of recorded observations;

a historical display of recorded observations; and

a tabular display of recorded observations.

5. The computer accessible storage hardware of claim 1, wherein a single nonblocking control thread drives the decoders and the application according to message events in an event queue.

6. The computer accessible storage hardware of claim 5, wherein, to drive the decoders, the nonblocking control thread communicates function calls to the decoders comprising buffers pointing to frames of database messages in memory at the first network location without communicating the frames of the database messages to the decoders or assembling the database messages and communicating the database messages to the decoders.

7. The computer accessible storage hardware of claim 1, wherein the decoders are each operable to decode particular database messages of particular database implementations different from each other.

8. The computer accessible storage hardware of claim 7, wherein the decoders comprise at least:

a first decoder operable to decode Distributed Relational Database Architecture (DRDA) database messages;

a second decoder operable to decode Tabular Data Stream (TDS) database messages; and

a third decoder operable to decode OracleNet database messages.

9. The computer accessible storage hardware of claim 1, further comprising a database message interface residing at the network layer and at the first network location, the database message interface being operable to:

receive frames of database messages from the clients and the database servers and write the frames to memory at the first network location for processing at the decoders; and

communicate frames of database messages from memory at the first network location to the clients and the database servers without assembling the frames.

10. The computer accessible storage hardware of claim 1, further comprising a normalization module residing at a query-language layer above the decoding layer, the normalization module being operable to receive query-language statements extracted at the decoders and, before the application receives the query-language statements, normalize the query-language statements for processing at the application.

11. The computer accessible storage hardware of claim 10, wherein normalizing a query-language statement comprises one or more of:

capitalizing all letters in the query-language statement;

reordering terms in the query-language statement according to a predetermined order; and

modifying one or more clauses in the query-language statement according to a predetermined clause equivalency.

12. The computer accessible storage hardware of claim 1, further comprising a parser residing at a query language layer above the decoding layer, the parser being operable to receive query-language statements extracted at the decoders and, before the application receives the query-language statements, parse the query-language statements for processing at the application.

13. The computer accessible storage hardware of claim 1, wherein the network layer comprises a Transport Control Protocol over Internet Protocol (TCP/IP) interface or an Interprocess Communication (IPC) interface.

14. The computer accessible storage hardware of claim 1, wherein at least some of the query-language statements are Structured Query Language (SQL) statements.

15. A computer accessible storage hardware having thereon stored computer-executable instructions for implementing the method of:

at a decoding layer above a network layer at a first network location between one or more database clients residing at one or more second network locations and one or more database servers residing at one or more third network locations;

receiving database messages communicated from the database clients and intended for the database servers and database messages communicated from the database servers and intended for the database clients;

decoding the database messages; and

extracting query-language statements from the database messages;

at an application layer above the decoding layer, a caching application operable for;

receiving query-language statements extracted at the decoders comprising queries;

receiving query-language statements extracted at the decoders comprising query results corresponding to the queries; and

recording the queries and the query results corresponding to the queries in a cache residing at the first network location wherein the queries are associated with a corresponding query result;

and a monitoring application operable to receive query-language statements extracted at the decoders and record observations on the database messages based at least in part on the query-language statements extracted at the decoders, wherein at least one observation is associated with a query result stored in the cache and communicate one or more observations associated with the queries to one or more computing systems at a fourth network location according to the needs of the one or more computer systems, wherein at least one of the computer systems maintains a web cache and is operable to modify the web cache based upon the communicated observations wherein observations on the database messages based at least in part on the query-language statement extracted at the decoders comprise the following;

subject database instances of the query-language statements;

network protocols and versions of the network protocols used to communicate the database messages;

devices hosting the subject database instances of the query-language statements;

hostnames, Internet Protocol (IP) addresses, Media Access Control (MAC) addresses, and network ports of the database servers;

operating systems (OSs), versions of the OSs, and attributes of the OSs of devices hosting the subject database instances;

devices hosting the clients; and

a number of queries communicated from each of the clients to each of one or more database instances;

and

at an application layer above the decoding layer at the first network location, receiving and processing query-language statements extracted at the decoding layer; and

at the application layer, communicating query results corresponding to the queries to the clients.

16. The computer accessible storage hardware of claim 15, further comprising, at the application layer:

receiving query-language statements extracted at the decoders comprising write messages; and

invalidating records of queries and query results corresponding to the queries according to the write messages.

17. The computer accessible storage hardware of claim 15, further comprising, at the application layer, providing user access to recorded observations based at least in part on the query-language statements extracted at the decoding layer using a graphical user interface (GUI) comprising at least one or more of:

a statistical display of recorded observations;

a historical display of recorded observations; and

a tabular display of recorded observations.

18. The computer accessible storage hardware of claim 15, wherein a single nonblocking control thread drives the decoding layer and the application layer according to message events in an event queue.

19. The computer accessible storage hardware of claim 18, wherein, to drive the decoding layer, the nonblocking control thread communicates function calls to the decoding layer comprising buffers pointing to frames of database messages in memory at the first network location without communicating the frames of the database messages to the decoding layer or assembling the database messages and communicating the database messages to the decoding layer.

20. The computer accessible storage hardware of claim 15, wherein decoding database messages comprises decoding database messages of database implementations different from each other.

21. The computer accessible storage hardware of claim 20, wherein decoding database messages comprises decoding Distributed Relational Database Architecture (DRDA) database messages, Tabular Data Stream (TDS) database messages, and OracleNet database messages.

22. The computer accessible storage hardware of claim 15, further comprising, at the network layer at the first network location:

receiving frames of database messages from the clients and the database servers and writing the frames to memory at the first network location for processing at the decoding layer; and

communicating frames of database messages from memory at the first network location to the clients and the database servers without assembling the frames.

23. The computer accessible storage hardware of claim 15, further comprising, at a query-language layer above the decoding layer at the first network location, receiving query-language statements extracted at the decoding layer and, before the application receives the query-language statements, normalizing the query-language statements for processing at the application.

24. The computer accessible storage hardware of claim 23, wherein normalizing a query-language statement comprises one or more of:

capitalizing all letters in the query-language statement;

reordering terms in the query-language statement according to a predetermined order; and

modifying one or more clauses in the query-language statement according to a predetermined clause equivalency.

25. The computer accessible storage hardware of claim 15, further comprising, at a query-language layer above the decoding layer at the first network location, receiving query-language statements extracted at the decoding layer and, before the application layer receives the query-language statements, parsing the query-language statements for processing at the application layer.

26. The computer accessible storage hardware of claim 15, wherein the network layer comprises a Transport Control Protocol over Internet Protocol (TCP/IP) interface or an Interprocess Communication (IPC) interface.

27. The computer accessible storage hardware of claim 15, wherein at least some of the query-language statements are Structured Query Language (SQL) statements.

28. A computer accessible storage hardware having stored thereon computer-executable instructions for providing application layer functionality between one or more database clients and one or more database servers, the computer executable instructions operable to:

at a decoding layer above a network layer at a first network location between one or more database clients residing at one or more second network locations and one or more database servers residing at one or more third network locations;

receive database messages communicated from the database clients and intended for the database servers and database messages communicated from the database servers and intended for the database clients;

decode the database messages;

extract query-language statements from the database messages;

at a decoding layer above a network layer at a first network location between one or more database clients residing at one or more second network locations and one or more database servers residing at one or more third network locations;

receiving database messages communicated from the database clients and intended for the database servers and database messages communicated from the database servers and intended for the database clients;

decoding the database messages; and

extracting query-language statements from the database messages;

at an application layer above the decoding layer, a caching application operable for;

receiving query-language statements extracted at the decoders comprising queries;

receiving query-language statements extracted at the decoders comprising query results corresponding to the queries; and

recording the queries and the query results corresponding to the queries in a cache residing at the first network location wherein the queries are associated with a corresponding query result;

and a monitoring application operable to receive query-language statements extracted at the decoders and record observations on the database messages based at least in part on the query-language statements extracted at the decoders, wherein at least one observation is associated with a query result stored in the cache and communicate one or more observations associated with the queries to one or more computing systems at a fourth network location according to the needs of the one or more computer systems, wherein at least one of the computer systems maintains a web cache and is operable to modify the web cache based upon the communicated observations wherein observations on the database messages based at least in part on the query-language statement extracted at the decoders comprise the following;

subject database instances of the query-language statements;

network protocols and versions of the network protocols used to communicate the database messages;

devices hosting the subject database instances of the query-language statements;

hostnames, Internet Protocol (IP) addresses, Media Access Control (MAC) addresses, and network ports of the database servers;

operating systems (OSs), versions of the OSs, and attributes of the OSs of devices hosting the subject database instances;

devices hosting the clients; and

a number of queries communicated from each of the clients to each of one or more database instances;

and

at an application layer above the decoding layer at the first network location, process the query-language statements extracted at the decoding layer.

29. The computer accessible storage hardware of claim 28, wherein the instructions are further operable, at the application layer, to communicate query results corresponding to the queries from the cache to the clients.

30. The computer accessible storage hardware of claim 28, wherein the instructions are further operable, at the application layer, to:

receive query-language statements extracted at the decoders comprising write messages;

invalidate records of queries and query results corresponding to the queries according to the write messages; and

communicate the write messages to the one or more clients.

31. The computer accessible storage hardware of claim 28, wherein the instructions are further operable, at the application layer, to provide user access to recorded observations based at least in part on the query-language statements extracted at the decoding layer using a graphical user interface (GUI) comprising at least one or more of:

a statistical display of recorded observations;

a historical display of recorded observations; and

a tabular display of recorded observations.

32. The computer accessible storage hardware of claim 28, wherein a single nonblocking control thread drives the decoding layer and the application layer according to message events in an event queue.

33. The computer accessible storage hardware of claim 32, wherein, to drive the decoding layer, the nonblocking control thread communicates function calls to the decoding layer comprising buffers pointing to frames of database messages in memory at the first network location without communicating the frames of the database messages to the decoding layer or assembling the database messages and communicating the database messages to the decoding layer.

34. The computer accessible storage hardware of claim 28, wherein the instructions are operable, at the decoding layer, to decode database messages of database implementations different from each other.

35. The computer accessible storage hardware of claim 34, wherein the instructions are operable, at the decoding layer, to decode Distributed Relational Database Architecture (DRDA) database messages, Tabular Data Stream (TDS) database messages, and OracleNet database messages.

36. The computer accessible storage hardware of claim 28, wherein the instructions are further operable, at the network layer at the first network location, to:

receive frames of database messages from the clients and the database servers and write the frames to memory at the first network location for processing at the decoding layer, and

communicate frames of database messages from memory at the first network location to the clients and the database servers without assembling the frames.

37. The computer accessible storage hardware of claim 28, wherein the instructions are further operable, at a query-language layer above the decoding layer at the first network location, to receive query-language statements extracted at the decoding layer and, before the application receives the query-language statements, normalize the query-language statements for processing at the application.

38. The computer accessible storage hardware of claim 37, wherein normalizing a query-language statement comprises one or more of:

capitalizing all letters in the query-language statement;

reordering terms in the query-language statement according to a predetermined order; and

modifying one or more clauses in the query-language statement according to a predetermined clause equivalency.

39. The computer accessible storage hardware of claim 28, wherein the instructions are further operable, at a query-language layer above the decoding layer at the first network location, to receive query-language statements extracted at the decoding layer and, before the application layer receives the query-language statements, parse the query-language statements for processing at the application layer.

40. The computer accessible storage hardware of claim 28, wherein the network layer comprises a Transport Control Protocol over Internet Protocol (TCP/IP) interface or an Interprocess Communication (IPC) interface.

41. The computer accessible storage hardware of claim 28, wherein at least some of the query-language statements are Structured Query Language (SQL) statements.