Connection pool management for backend servers using common interface

• US 6,105,067 A
• Filed: 06/05/1998
• Issued: 08/15/2000
• Est. Priority Date: 06/05/1998
• Status: Expired due to Term

• Current Assignee: Snap, Inc.
• Original Assignee: International Business Machines Corporation
• Inventors: Batra, Virinder Mohan
• Primary Examiner(s): VU, VIET DUY
• Application Number:
  US09/092,928
• Time in Patent Office: 802 Days
• Field of Search: 709/102, 709/104, 709/105, 709/201, 709/202, 709/203, 709/217, 709/219, 709/223, 709/224, 709/225, 709/226, 709/227, 709/228, 709/300, 709/302
• US Class Current: 709/227
• CPC Class Codes: H04L 12/5692 Selection among different networks
• CPC Class Codes: H04L 67/01 Protocols
• CPC Class Codes: H04L 67/02 based on web technology, e.g. hypertext transfer protocol [HTTP]
• CPC Class Codes: H04L 67/1001 for accessing one among a plurality of replicated servers
• CPC Class Codes: H04L 67/10015 Access to distributed or replicated servers, e.g. using brokers
• CPC Class Codes: H04L 67/14 Session management for real-time applications in data packet communications networks H04L65/1066
• CPC Class Codes: H04L 69/329 in the application layer [OSI layer 7]
• CPC Class Codes: H04L 9/40 Network security protocols

Abstract

A technique, system, and computer program for enhancing performance of the computers in a Web environment. This is done by creating a pool of connections between a Web server and backend data servers, reducing the overhead required for accessing the data servers and enabling the applications running on the Web server to be faster. Many different types of connections may be maintained concurrently in the pool, to similar or different data servers. A common interface to the pool is used, regardless of the type of backend data server connection, making programs which use the pool easier (and therefore less costly) to write and support. Options are defined for optimizing the number of connections in the pool.

Claims

1. In a computing environment having a connection to a network, computer readable code readable by a computer system in said environment, for improving server performance by managing a pool of network connections to backend data servers, comprising:

an application server;

one or more backend data servers;

a connection pool;

a connection pool manager for managing said connection pool, further comprising;

a subprocess for establishing one or more network connections, each of said network connections connecting said application server to a particular one of said one or more backend data servers;

a subprocess for entering said established connections into said connection pool, wherein each of said entered connections has associated therewith (1) a connection type to identify said particular one and (2) zero or more additional characteristics of said entered connection; and

a subprocess for managing said entered connections in said connection pool, further comprising;

a subprocess for receiving a request from a servlet, wherein said request is for assignment of a suitable connection and uses a common application programming interface (API) to said connection pool manager, said common API specifying (1) a desired connection type and (2) zero or more specialized extensions for desired characteristics of said suitable connection; and

a subprocess for assigning said suitable connection to said servlet for use by said servlet when said desired connection type and said zero or more desired characteristics in said specialized extensions are available in one of said entered connections.

2. Computer readable code according to claim 1, wherein said subprocess for assigning said suitable connection further comprises:

a subprocess for establishing a new network connection, when said suitable connection cannot be located in said connection pool, and a maximum pool size has not been reached; and

a subprocess for returning an error otherwise.

3. Computer readable code according to claim 2, wherein said subprocess for assigning said suitable connection further comprises a subprocess for waiting a specified period of time for said suitable connection to become available in said connection pool, prior to operation of said subprocess for establishing said new network connection, when said request from said servlet specifies a wait-retry parameter using said common API and said parameter has a true value, and wherein said specified period of time may also be specified on said request using said common API.

4. Computer readable code according to claim 2, wherein said subprocess for managing said entered connections further comprises:

a subprocess for disconnecting one or more of said network connections from selected ones of said connected backend data servers upon detecting that said one or more network connections has been idle longer than a maximum idle time; and

a subprocess for removing said disconnected connections from said connection pool.

5. Computer readable code according to claim 2, wherein said subprocess for managing said entered connections further comprises:

a subprocess for unassigning one or more of said assigned connections from said servlet to which said unassigned connection was assigned, upon detecting that said one or more assigned connections has been unused longer than a maximum time; and

a subprocess for making said unassigned connections available in said connection pool.

6. A system for improving server performance by managing a pool of network connections in a computing environment, comprising:

an application server;

one or more backend data servers;

a connection pool;

a connection pool manager for managing said connection pool, further comprising;

means for establishing one or more network connections, each of said network connections connecting said application server to a particular one of said one or more backend data servers;

means for entering said established connections into said connection pool, wherein each of said entered connections has associated therewith (1) a connection type to identify said particular one and (2) zero or more additional characteristics of said entered connection; and

means for managing said entered connections in said connection pool, further comprising;

means for receiving a request from a servlet, wherein said request is for assignment of a suitable connection and uses a common application programming interface (API) to said connection pool manager, said common API specifying (1) a desired connection type and (2) zero or more specialized extensions for desired characteristics of said suitable connection; and

means for assigning said suitable connection to said servlet for use by said servlet when said desired connection type and said zero or more desired characteristics in said specialized extensions are available in one of said entered connections.

7. The system according to claim 6, wherein said means for assigning said suitable connection further comprises:

means for establishing a new network connection, when said suitable connection cannot be located in said connection pool, and a maximum pool size has not been reached; and

means for returning an error otherwise.

8. The system according to claim 7, wherein said means for assigning said suitable connection further comprises means for waiting a specified period of time for said suitable connection to become available in said connection pool, prior to operation of said means for establishing said new network connection, when said request from said servlet specifies a wait-retry parameter using said common API and said parameter has a true value, and wherein said specified period of time may also be specified on said request using said common API.

9. The system according to claim 7, wherein said means for managing said entered connections further comprises:

means for disconnecting one or more of said network connections from selected ones of said connected backend data servers upon detecting that said one or more network connections has been idle longer than a maximum idle time; and

means for removing said disconnected connections from said connection pool.

10. The system according to claim 7, wherein said means for managing said entered connections further comprises:

means for unassigning one or more of said assigned connections from said servlet to which said unassigned connection was assigned, upon detecting that said one or more assigned connections has been unused longer than a maximum time; and

means for making said unassigned connections available in said connection pool.

11. A method for improving server performance by managing a connection pool of network connections by a connection pool manager in a computing environment, comprising the steps of:

establishing one or more network connections, each of said network connections connecting an application server to a particular one of one or more backend data servers;

entering said established connections into said connection pool, wherein each of said entered connections has associated therewith (1) a connection type to identify said particular one and (2) zero or more additional characteristics of said entered connection; and

managing said entered connections in said connection pool, further comprising the steps of;

receiving a request from a servlet, wherein said request is for assignment of a suitable connection and uses a common application programming interface (API) to said connection pool manager, said common API specifying (1) a desired connection type and (2) zero or more specialized extensions for desired characteristics of said suitable connection; and

assigning said suitable connection to said servlet for use by said servlet when said desired connection type and said zero or more desired characteristics in said specialized extensions are available in one of said entered connections.

12. The method according to claim 11, wherein said assigning said suitable connection step further comprises the steps of:

establishing a new network connection, when said suitable connection cannot be located in said connection pool, and a maximum pool size has not been reached; and

returning an error otherwise.

13. The method according to claim 12, wherein said assigning said suitable connection step further comprises the step of waiting a specified period of time for said suitable connection to become available in said connection pool, prior to operation of said step of establishing said new network connection, when said request from said servlet specifies a wait-retry parameter using said common API and said parameter has a true value, and wherein said specified period of time may also be specified on said request using said common API.

14. The method according to claim 12, wherein said managing said entered connections step further comprises the steps of:

disconnecting one or more of said network connections from selected ones of said connected backend data servers upon detecting that said one or more network connections has been idle longer than a maximum idle time; and

removing said disconnected connections from said connection pool.

15. The method according to claim 12, wherein said managing said entered connections step further comprises the steps of:

unassigning one or more of said assigned connections from said servlet to which said unassigned connection was assigned, upon detecting that said one or more assigned connections has been unused longer than a maximum time; and

making said unassigned connections available in said connection pool.