Methods and apparatus for directing a flow of data between a client and multiple servers

• US 6,850,982 B1
• Filed: 12/19/2000
• Issued: 02/01/2005
• Est. Priority Date: 12/19/2000
• Status: Active Grant

• Current Assignee: Cisco Technology, Inc. (Cisco Systems, Inc.)
• Original Assignee: Cisco Technology, Inc. (Cisco Systems, Inc.)
• Inventors: Siegel, Kenneth P.
• Primary Examiner(s): Etienne, Ario
• Assistant Examiner(s): SALAD, ABDULLAHI ELMI
• Application Number:
  US09/741,495
• Time in Patent Office: 1,505 Days
• Field of Search: 709/226, 709/227, 709/228, 709/203, 709/219, 709/238, 709/239, 709/234, 709/224, 709/223, 709/229, 709/217, 709/218, 370/352, 370/401, 713/201, 707/10
• US Class Current: 709/227
• CPC Class Codes: H04L 67/1001 for accessing one among a plurality of replicated servers
• CPC Class Codes: H04L 67/1014 based on the content of a request
• CPC Class Codes: H04L 67/1023 based on a hash applied to IP addresses or costs
• CPC Class Codes: H04L 67/1029 using data related to the state of servers by a load balancer
• CPC Class Codes: H04L 67/56 Provisioning of proxy services store-and-forward switching systems in data switching networks H04L12/54
• CPC Class Codes: H04L 67/567 Integrating service provisioning from a plurality of service providers

Abstract

The invention is directed to techniques for managing communication between a client and multiple servers over a network through an intermediary network device (e.g., content switch). In response to a request for content from a client, the network device selects a server to respond to the request. The network device includes a flow manager that manages the flow of data from the server through the network device to the client. In response to a second request, the network device may select a different server to respond to the request. In this case, the flow manager manages the flow of data from the new server through the network device transparently for the client, so that the client communicates only through the network device regardless of which server is providing the response to the requests.

Claims

1. In a network device, a method for managing communication between a client and multiple servers, the method comprising the steps of:

receiving a set of data requests, each data request belonging to a single connection session;

providing a first data pathway between the client and a first server through the network device in response to a first data request of the set of data requests, the first data pathway including a portion of the first data pathway that extends between the client and the network device, wherein the step of providing the first data pathway comprises the steps of;

establishing, as the portion of the first data pathway, a first network connection between the client and the network device;

establishing a second network connection between the network device and the first server; and

providing a second data pathway between the client and a second server through the network device in response to a second data request of the set of data requests, the second data pathway including the portion of the first data pathway that extends between the client and the network device, wherein the step of providing the second data pathway comprises the steps of;

maintaining the first network connection between the client and the network device;

establishing a third network connection between the network device and the second server; and

prior to the step of establishing the third network connection, sending a request to the first server to close the second network connection between the network device and the first server.

2. The method of claim 1, wherein the step of providing the first data pathway comprises the step of:

selecting, as a destination of the first data pathway, the first server from the multiple servers based on a content type indicated by the first data request.

3. The method of claim 1, wherein the step of providing the second data pathway comprises the step of:

selecting, as a destination of the second data pathway, the second server from the multiple servers based on a content type indicated by the second data request.

4. The method of claim 1, wherein the step of providing a first data pathway comprises the steps of:

receiving a synchronization signal from the client;

providing a first initial sequence number to the client that initializes a sequence space based on a first set of network device sequence numbers provided from the network device to the client;

receiving a second initial sequence number from the first server;

generating a first modification value; and

modifying a first set of server sequence numbers based on the first modification value to provide a second set of network device sequence numbers from the network device to the client that preserves the sequence space initialized by the first initial sequence number provided to the client.

5. The method of claim 4, wherein the step of providing the second data pathway comprises the steps of:

receiving a third initial sequence number from the second server;

generating a second modification value; and

modifying a second set of server sequence numbers based on the second modification value to provide a third set of network device sequence numbers from the network device to the client, the third set of network device sequence numbers preserving the sequence space initialized by the first initial sequence number provided to the client.

6. The method of claim 1, wherein the step of establishing the third network connection between the network device and the second server includes the step of:

forming the third network connection in response to sending the request from the network device to the first server to close the second network connection in order to prevent intermingling of first transmissions from the first server with second transmissions from the second server.

7. A network device for managing communication between a client and multiple servers, the network device comprising:

an input/output controller; and

a flow manager in communication with the input/output controller, wherein;

the input/output controller is configured to receive a set of data requests, each data request belonging to a single connection session;

the flow manager is configured to;

provide a first data pathway between the client and a first server through the input/output controller in response to a first data request of the set of data requests, the first data pathway including a portion of the first data pathway that extends between the client and the input/output controller;

establish, as the portion of the first data pathway, a first network connection between the client and the network device;

establish a second network connection between the network device and the first server;

provide a second data pathway between the client and a second server through the input/output controller in response to a second data request of the set of data requests, the second data pathway including the portion of the first data pathway that extends between the client and the input/output controller;

maintain the first network connection between the client and the network device;

establish a third network connection between the network device and the second server, and

send, prior to establishing the third network connection, a request to the first server to close the second network connection between the network device and the first server.

8. The network device of claim 7, wherein the flow manager is configured to select, as a destination of the first data pathway, the first server from the multiple servers based on a content type indicated by the first data request.

9. The network device of claim 7, wherein the flow manager is configured to select, as a destination of the second data pathway, the second server from the multiple servers based on a content type indicated by the second data request.

10. The network device of claim 7, wherein:

the input/output controller is configured to receive a synchronization signal from the client;

the flow manager is configured to provide a first initial sequence number to the client that initializes a sequence space based on a first set of network device sequence numbers provided from the network device to the client;

the input/output controller is configured to receive a second initial sequence number from the first server;

the flow manager is configured to generate a first modification value; and

the flow manager is configured to modify a first set of server sequence numbers based on the first modification value to provide a second set of network device sequence numbers from the network device to the client that preserves the sequence space initialized by the first initial sequence number provided by the network device to the client.

11. The network device of claim 10, wherein:

the input/output controller is configured to receive a third initial sequence number from the second server;

the flow manager is configured to generate a second modification value; and

the flow manager is configured to modify a second set of server sequence numbers based on the second modification value to provide a third set of network device sequence numbers from the network device to the client, the third set of network device sequence numbers preserving the sequence space initialized by the first initial sequence number provided by the network device to the client.

12. The network device of claim 7, wherein the flow manager is further configured to establish the third network connection between the network device and the second server in response to the request from the network device to the first server to close the second network connection in order to prevent intermingling of first transmissions from the first server with second transmissions from the second server.

13. A network device for managing communication between a client and multiple servers, the network device comprising:

an input/output controller; and

managing means for managing data flow, the managing means in communication with the input/output controller, wherein;

the input/output controller is configured to receive a set of data requests, each data request belonging to a single connection session;

the managing means is configured to;

provide a first data pathway between the client and a first server through the input/output controller in response to a first data request of the set of data requests, the first data pathway including a portion of the first data pathway that extends between the client and the input/output controller;

establish, as the portion of the first data pathway, a first network connection between the client and the network device;

establish a second network connection between the network device and the first server;

provide a second data pathway between the client and a second server through the input/output controller in response to a second data request of the set of data requests, the second data pathway including the portion of the first data pathway that extends between the client and the input/output controller;

maintain the first network connection between the client and the network device;

establish a third network connection between the network device and the second server, and

send, prior to establishing the third network connection, a request to the first server to close the second network connection between the network device and the first server.

14. A computer program product that includes a computer readable medium having instructions stored thereon for managing communications in a network device between a client and multiple servers, such that the instructions, when carried out by a computer, cause the computer to perform the steps of:

receiving a set of data requests, each data request belonging to a single connection session;

providing a first data pathway between the client and a first server through the network device in response to a first data request of the set of data requests, the first data pathway including a portion of the first data pathway that extends between the client and the network device, wherein the step of providing the first data pathway comprises the steps of;

establishing, as the portion of the first data pathway, a first network connection between the client and the network device;

establishing a second network connection between the network device and the first server; and

providing a second data pathway between the client and a second server through the network device in response to a second data request of the set of data requests, the second data pathway including the portion of the first data pathway that extends between the client and the network device, wherein the step of providing the second data pathway comprises the steps of;

maintaining the first network connection between the client and the network device;

establishing a third network connection between the network device and the second server; and

prior to the step of establishing the third network connection, sending a request to the first server to close the second network connection between the network device and the first server.

15. A computer program propagated signal product embodied in a propagated medium, having instructions for managing communications in a network device between a client and multiple servers, such that the instructions, when carried out by a computer, cause the computer to perform the steps of:

receiving a set of data requests, each data request belonging to a single connection session;

providing a first data pathway between the client and a first server through the network device in response to a first data request of the set of data requests, the first data pathway including a portion of the first data pathway that extends between the client and the network device, wherein the step of providing the first data pathway comprises the steps of;

establishing, as the portion of the first data pathway, a first network connection between the client and the network device;

establishing a second network connection between the network device and the first server; and

providing a second data pathway between the client and a second server through the network device in response to a second data request of the set of data requests, the second data pathway including the portion of the first data pathway that extends between the client and the network device, wherein the step of providing the second data pathway comprises the steps of;

maintaining the first network connection between the client and the network device;

establishing a third network connection between the network device and the second server; and

prior to the step of establishing the third network connection, sending a request to the first server to close the second network connection between the network device and the first server.