Method and system for communicating a request packet in response to a state

• US 7,546,369 B2
• Filed: 06/01/2001
• Issued: 06/09/2009
• Est. Priority Date: 12/21/2000
• Status: Expired due to Term

• Current Assignee: Cloudrock LLC (Slingshot Technologies LLC)
• Original Assignee: Noatak Software LLC (Intellectual Ventures LLC)
• Inventors: Berg, Mitchell T.
• Primary Examiner(s): Avellino; Joseph E
• Application Number:
  US09/872,329
• Publication Number:
  US 20020116475A1
• Time in Patent Office: 2,930 Days
• Field of Search: 709217-219, 709227-229, 709/203, 709230-238, 370229-238
• US Class Current: 709/227
• CPC Class Codes: H04L 67/02 based on web technology, e.g. hypertext transfer protocol [HTTP]
• CPC Class Codes: H04L 67/1001 for accessing one among a plurality of replicated servers
• CPC Class Codes: H04L 67/10015 Access to distributed or replicated servers, e.g. using brokers
• CPC Class Codes: H04L 67/1008 based on parameters of servers, e.g. available memory or workload monitoring of computer activity G06F11/30
• CPC Class Codes: H04L 67/1012 based on compliance of requirements or conditions with available server resources
• CPC Class Codes: H04L 67/14 Session management for real-time applications in data packet communications networks H04L65/1066
• CPC Class Codes: H04L 67/142 Managing session states for stateless protocols; Signalling session states; State transitions; Keeping-state mechanisms
• CPC Class Codes: H04L 69/16 Implementation or adaptation of Internet protocol [IP], of transmission control protocol [TCP] or of user datagram protocol [UDP]
• CPC Class Codes: H04L 69/161 Implementation details of TCP/IP or UDP/IP stack architecture; Specification of modified or new header fields
• CPC Class Codes: H04L 69/163 In-band adaptation of TCP data exchange; In-band control procedures
• CPC Class Codes: H04L 69/164 Adaptation or special uses of UDP protocol
• CPC Class Codes: H04L 69/165 Combined use of TCP and UDP protocols; selection criteria therefor
• CPC Class Codes: H04L 69/22 Parsing or analysis of headers
• CPC Class Codes: H04L 69/329 in the application layer [OSI layer 7]
• CPC Class Codes: H04L 9/40 Network security protocols

Abstract

According to one embodiment, a first computing device receives an initialization packet originating from a client. In response to at least the initialization packet, the first computing device outputs a response packet to the client. Also, the first device receives a request packet originating from the client. In response to at least the request packet and a state of at least one of the first computing device and a second computing device, the first computing device outputs the request packet to the second computing device for performing an operation in response to the request packet.

Claims

1. An information processing system, comprising:

a first computing device having an intelligent network interface card, the intelligent network interface card configured to;

store an unattached connection endpoint in a temporary table in response to receiving an initialization packet originating from a client, wherein the unattached connection endpoint contains information associated with the client and the first computing device;

receive a request packet originating from the client; and

based on at least a state of the first computing device and a second computing device, selectively;

output a migration packet containing the information associated with the client and the first computing device to the second computing device;

remove the unattached connection endpoint from the temporary table in response to an acknowledgement indicating that the second computing device received the migration packet;

store information representing a connection with the client in a forward table; and

output the request packet to the second computing device by adding an encapsulation header to enable the second computing device to send a response packet to the client comprising information indicating the response packet was sent by the first computing device.

2. The system of claim 1 wherein the second computing device is configured to perform an operation of a software application in response to receipt of a request packet.

3. The system of claim 2 wherein the software application is a socket-based application.

4. The system of claim 2 wherein the operation includes outputting a response packet to the client, and wherein the first computing device is configured to selectively output the request packet to the second computing device for outputting the response packet to the client, such that the output response packet bypasses the first computing device.

5. The system of claim 1 wherein the intelligent network interface card is further configured to receive an initialization packet originating from the client, addressed by the client to the first computing device.

6. The system of claim 1 wherein the intelligent network interface card is further configured to receive an initialization packet originating from the client through a network comprising a global computer network.

7. The system of claim 6 wherein the migration packet is output through a network comprising a local area network.

8. The system of claim 1 wherein the unattached connection endpoint includes a group of sequence numbers associated with the connection.

9. The system of claim 8 wherein the first computing device is configured to selectively output a migration packet containing the information associated with the client and the first computing device and the group of sequence numbers associated with the connection to the second computing device for performing an operation in response to receiving the migration packet and the request packet, the operation including outputting a response packet to the client according to the group of sequence numbers, such that the output response packet bypasses the first computing device and appears to the client as received from the first computing device.

10. The system of claim 8 wherein the group of sequence numbers includes at least one start sequence number, at least one current sequence number, and at least one acknowledgement sequence number.

11. The system of claim 1 wherein the unattached connection endpoint includes an address of the first computing device;

and

wherein the request packet is output to the second computing device for performing an operation in response to receiving the migration packet and the request packet, the operation including outputting a response packet to the client with a source address that indicates the address of the first computing device, such that the output response packet bypasses the first computing device and appears to the client as received from the first computing device.

12. The system of claim 11 wherein the address includes an IP address.

13. The system of claim 12 wherein the address includes a port.

14. The system of claim 13 wherein the port is a TCP port.

15. The system of claim 13 wherein the port is a UDP port.

16. The system of claim 1, wherein the intelligent network interface card is further configured to output an initialization response packet to the client.

17. A method performed by an intelligent network interface controller of a first computing device of an information processing system, the method comprising:

storing an unattached connection endpoint in a temporary table in response to receiving an initialization packet originating from a client, wherein the unattached connection endpoint contains information associated with the client and the first computing device;

receiving a request packet originating from the client; and

based on at least a state of the first computing device and a second computing device, selectively;

outputting a packet containing the information associated with the client and the first computing device to the second computing device;

removing the unattached connection endpoint from the temporary table in response to receiving an acknowledgement packet indicating that the second computing device received the packet containing the information associated with the client and the first computing device; and

outputting the request packet to the second computing device for performing an operation in response to the request packet by adding an encapsulation header to the request packet;

wherein the operation includes outputting a response packet to the client comprising information indicating the response packet was sent from the first computing device.

18. The method of claim 17 wherein the operation is part of a software application.

19. The method of claim 18 wherein the software application is a socket-based application.

20. The method of claim 17, further comprising receiving an initialization packet originating from the client, wherein the initialization packet is addressed by the client to the first computing device, and wherein the receiving an initialization packet originating from the client comprises:

receiving the initialization packet in response to the addressing.

21. The method of claim 17, wherein the operation in response to the request packet comprises outputting a response packet to the client that bypasses the first computing device.

22. The method of claim 17, further comprising:

receiving an initialization packet originating from the client through a global computer network.

23. The method of claim 22, further comprising:

selectively outputting the request packet to the second computing device through a local area network.

24. The method of claim 17, comprising:

outputting a packet containing the information associated with the client and the first computing device to the second computing device for associating an application of the second computing device with the connection.

25. The method of claim 17, wherein the information associated with the client and the first computing device includes a group of sequence numbers associated with the connection.

26. The method of claim 25, further comprising outputting a packet containing the information associated with the client and the first computing device to the second computing device for outputting a response packet to the client according to the group of sequence numbers, such that the output response packet bypasses the first computing device.

27. The method of claim 25 wherein the group of sequence numbers includes at least one start sequence number, at least one current sequence number, and at least one acknowledgement sequence number.

28. The method of claim 17, wherein the packet containing the information associated with the client and the first computing device includes an address of the first computing device, an address of the second computing device, an address of the client, and a flag indicating the type of packet.

29. The method of claim 28 wherein the addresses include an IP address.

30. The method of claim 28, wherein the information associated with the client and the first computing device includes an address of the first computing device, an address of the second computing device, an address of the client, and a flag indicating the type of packet, such that the information associated with the client and the first computing device can be used to create an output response packet that bypasses the first computing device.

31. The method of claim 29 wherein the addresses include a port.

32. The method of claim 31 wherein the port is a TCP port.

33. The method of claim 31 wherein the port is a UDP port.

34. The method of claim 17, further comprising outputting an initialization response packet to the client.

35. A first intelligent network interface device, comprising:

a processor that is configured to;

maintain a state information table;

create an unattached connection endpoint in response to receiving an initialization packet from a client, wherein the unattached connection endpoint contains information associated with the client and the first intelligent network interface device;

receive an IP request packet from the client associated with the unattached connection endpoint; and

selectively, based at least in part on the state information table;

transmit a packet containing the information associated with the client and the first intelligent network interface device contained within the unattached connection endpoint to a second intelligent network interface device;

delete the unattached connection endpoint in response to receiving an acknowledgement indicating that the second intelligent network interface device received the packet containing the unattached connection endpoint information; and

transmit the request packet to the second intelligent network interface device by adding an encapsulation header, to enable the second intelligent network interface device to cause a response IP packet to be sent to the client that contains information indicating the response IP packet was sent from the first intelligent network interface device.

36. The first intelligent network interface device of claim 35, further coupled to a synchronization network for receiving synchronization information, wherein the processor is configured to maintain the state information table based at least on part on the received synchronization information.

37. The method of claim 35, wherein the processor is further configured to receive an initialization packet from the client, and to transmit an initialization response packet to the client.

38. A server farm, comprising:

a plurality of servers, each server comprising an intelligent network interface controller;

wherein the intelligent network interface controller of a first server of the plurality of servers is configured to;

store an unattached connection endpoint in response to receiving a SYN packet originating from a client, wherein the unattached connection endpoint contains information associated with the client and the first server;

receive a PUSH packet originating from the client; and

selectively, based at least in part on synchronization information transmitted between the plurality of servers;

output a migration packet containing the information associated with the client and the first server to an intelligent network interface controller of a second server;

delete the stored unattached connection endpoint in response to receiving an acknowledgement packet that indicates that the first computing device of the second server received the packet containing the information associated with the client and the first server; and

encapsulate and output the PUSH packet to the intelligent network interface controller of the second server to enable the second server to send a response packet to the client comprising information indicating the response packet was sent from the first server.

39. The server farm of claim 38, further comprising:

a first router, coupled to the first server and configured to transmit client requests to the first server; and

a second router, coupled to the second server and configured to transmit a response to the client from the second server;

wherein the response to the client transmitted by the second server bypasses the first router.

40. The server farm of claim 38 wherein each server can receive a client request.

41. The server farm of claim 38, wherein the intelligent network interface controller of the first server of the plurality of servers is further configured to:

receive a SYN packet originating from the client; and

output a SYN/ACK packet to the client.

42. A computer-readable memory medium containing instructions for controlling a computer processor associated with an intelligent network interface controller of a server among a plurality of servers to selectively load balance and direct network requests among the plurality of servers, by:

maintaining a state table associated with the plurality of servers;

creating an unattached endpoint in response to receiving an initialization packet originating from a client, and storing information that associates the unattached endpoint with the client and the server in a temporary table;

receiving a request packet generated by the client; and

selectively, based at least in part on the state information table;

outputting a migration packet containing the information that associates the unattached endpoint with the client and the server to a second processor residing in a different one of the plurality of servers;

deleting the information that associates the unattached endpoint with the client and the server from the temporary table in response to a packet from the second processor that indicates that the second processor received the migration packet and successfully processed it;

generating a forward packet that encapsulates the request packet; and

outputting the forward packet to the second processor to enable the second processor to output a response packet to the client that contains information indicating the response packet was sent from the server.

43. The computer-readable memory medium of claim 42, further comprising instructions that control the processor by:

when a forward packet is received, selectively generating a response packet for transmission to the client.

44. The computer-readable memory medium of claim 42 wherein the forward packet contains an encapsulation header that identifies client connection information.

45. The computer-readable memory medium of claim 42, containing further instructions for controlling a computer processor associated with an intelligent network interface controller of a server among a plurality of servers to selectively load balance and direct network requests among the plurality of servers, by:

receiving an initialization packet originating from the client; and

outputting an acknowledgment packet to the client.

46. A server having an intelligent network interface controller for use in a computer system server farm, the intelligent network interface controller comprising:

means for monitoring a state of the server farm;

means for receiving packets from a global network;

means for storing an unattached connection endpoint in a temporary table in response to receiving an initialization packet from the global network, wherein the unattached connection endpoint contains information associated with the client and the server;

means for selectively generating, based at least in part on the monitored state of the server farm, a first type of packet containing the information associated with the client and the server when a client request packet is received from the global network;

means for transmitting the first type of packet to a second server in the server farm, wherein the means for transmitting the first type of packet bypasses the means for receiving packets from the global network;

means for deleting the unattached connection endpoint from the temporary table in response to receiving a second type of packet from the second server;

means for generating a third type of packet that encapsulates the client request packet; and

means for transmitting the third type of packet to the second server to enable the second server to send a response packet to the client that contains information indicating the response packet was sent from the server.

47. The server of claim 46 wherein the means for receiving packets from a global network comprises a connection to a first local area network and the means for transmitting the first type of packet, the means for receiving a second type of packet, and the means for transmitting the third type of packet comprise a connection to a second local area network that is separate from the first local area network.

48. The server of claim 47 wherein the means for monitoring the state of the server farm comprises a connection to a synchronization network that is separate from the first local area network.

49. The server of claim 46, the intelligent network interface controller further comprising means for generating an acknowledgement packet and transmitting the acknowledgement packet via the global network when an initialization packet is received from the global network.

50. An information processing system, comprising:

a first computer system; and

a second computer system having an intelligent network interface card that is configured to;

store an unattached connection endpoint in a temporary table in response to receiving an initialization packet created by a client, the unattached connection endpoint containing information that identifies a connection with the client and including information associated with the client and the second computer system;

receive a request packet originating from the client directed to the connection;

based on at least a state of at least one of the first computer system and the second computing system, selectively;

output a packet containing the information that identifies the connection to an intelligent network interface card of the first computer system, thereby migrating the connection to the first computer system;

remove the unattached connection endpoint from the temporary table in response to receiving, from the first computer system, a packet that indicates that the first computer system received the packet containing the information identifying the connection; and

output a forwarded-request packet to the network interface card of the first computer system, the forwarded-request packet encapsulating the request packet and including both information identifying the connection and a field in a header of the forwarded-request packet indicating that the forwarded-request packet is a forwarded packet, to enable the first computer system to output a response packet to the client comprising information indicating the response packet was sent from the second computer system.

51. The information processing system of claim 50 wherein the intelligent network interface card of the second computer system selectively outputs the forwarded-request packet to an intelligent network interface card of the first computer system without using TCP splicing techniques.

52. The system of claim 50, wherein the intelligent network interface card of the second computer system is further configured to:

receive an initialization packet created by a client; and

output an initialization response packet to the client to set up the connection over a network.

53. A method of servicing client requests performed by an intelligent network interface controller, the method comprising:

receiving a client request packet;

selectively redistributing the received client request packet;

transmitting synchronization information; and

selectively migrating a client connection based at least in part on the transmitted synchronization information;

wherein the received client request packet is selectively redistributed and the client connection is selectively migrated by;

storing an unattached connection endpoint in a temporary table, wherein the unattached connection endpoint contains information associated with a connection with the client;

outputting a packet containing a copy of the information associated with the connection with the client;

removing the unattached connection endpoint from the temporary table in response to receiving an acknowledgement that indicates that the packet containing a copy of the information associated with the connection with the client was received;

encapsulating the client request packet; and

transmitting the encapsulated client request packet to enable a computing device to send a response packet to the client that contains information indicating the response packet was sent from the intelligent network interface controller.

54. The method of claim 53, further comprising:

maintaining a state information table based at least in part on the transmitted synchronization information.

55. The method of claim 53 wherein the selectively redistributing is based at least in part on the transmitted synchronization information.

56. The method of claim 53 further comprising performing an operation in response to the request packet.

57. The method of claim 56 wherein the operation is part of a socket-based software application.

58. The method of claim 53 wherein the client request packet is received through a first network comprising a global computer network.

59. The method of claim 58 wherein the received client request packet is redistributed through a second network comprising a local area network.

60. The method of claim 53 wherein the data structure includes a group of sequence numbers associated with the connection.

61. The method of claim 60, further comprising:

outputting a response packet to the client according to the group of sequence numbers.

62. An information processing system, comprising:

a first computing device configured to;

store information representing a connection with a client in a temporary table in response to receiving an initialization packet originating from the client, the information including a group of sequence numbers associated with the connection;

receive a request packet originating from the client; and

based on at least a state of the first computing device and a second computing device, selectively;

output a migration packet containing the information representing the connection with the client to the second computing device for performing an operation in response to receiving the migration packet and the request packet, the operation including outputting a response packet to the client according to the group of sequence numbers, such that the output response packet bypasses the first computing device and appears to the client as received from the first computing device;

remove the information representing the connection with the client from the temporary table in response to an acknowledgement indicating that the second computing device received the migration packet;

store information representing the connection with the client in a forward table; and

output the request packet to the second computing device.