Infiniband TM work queue to TCP/IP translation

• US 7,149,817 B2
• Filed: 02/15/2001
• Issued: 12/12/2006
• Est. Priority Date: 02/15/2001
• Status: Expired due to Fees

• Current Assignee: Intel Corporation
• Original Assignee: NetEffect, Inc. (Intel Corporation)
• Inventors: Pettey, Christopher J.
• Primary Examiner(s): Jaroenchonwanit, Bunjob
• Assistant Examiner(s): LEE, PHILIP C
• Application Number:
  US09/784,761
• Publication Number:
  US 20030014544A1
• Time in Patent Office: 2,126 Days
• Field of Search: 710/105, 710/3, 370/401, 370/228, 709/212, 709/232, 709/238, 375/371
• US Class Current: 709/250
• CPC Class Codes: H04L 67/1097 for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
• CPC Class Codes: H04L 69/16 Implementation or adaptation of Internet protocol [IP], of transmission control protocol [TCP] or of user datagram protocol [UDP]
• CPC Class Codes: H04L 69/161 Implementation details of TCP/IP or UDP/IP stack architecture; Specification of modified or new header fields
• CPC Class Codes: H04L 69/162 involving adaptations of sockets based mechanisms secure socket layer H04L63/168
• CPC Class Codes: H04L 69/163 In-band adaptation of TCP data exchange; In-band control procedures
• CPC Class Codes: H04L 69/168 specially adapted for link layer protocols, e.g. asynchronous transfer mode [ATM], synchronous optical network [SONET] or point-to-point protocol [PPP]
• CPC Class Codes: H04L 69/169 Special adaptations of TCP, UDP or IP for interworking of IP based networks with other networks protocols for interworking, protocol conversion H04L69/08
• CPC Class Codes: H04L 69/329 in the application layer [OSI layer 7]
• CPC Class Codes: H04L 9/40 Network security protocols

Abstract

A TCP-aware target adapter for accelerating TCP/IP connections between clients and servers, where the servers are interconnected over an Infiniband™ fabric and the clients are interconnected over a TCP/IP-based network. The TCP-aware target adapter includes an accelerated connection processor and a target channel adapter. The accelerated connection processor bridges TCP/IP transactions between the clients and the servers. The accelerated connection processor accelerates the TCP/IP connections prescribing Infiniband remote direct memory access operations to retrieve/provide transaction data from/to the servers. The target channel adapter is coupled to the accelerated connection processor. The target channel adapter supports Infiniband operations with the servers, including execution of the remote direct memory access operations to retrieve/provide the transaction data. The TCP/IP connections are accelerated by offloading TCP/IP processing otherwise performed by the servers to retrieve/provide said transaction data.

Claims

1. A TCP-aware target adapter, for accelerating TCP/IP connections between a plurality of clients and a plurality of servers, the plurality of servers being accessed via an Infiniband fabric, the plurality of clients being accessed via a TCP/IP network, the TCP-aware target adapter comprising:

an accelerated connection processor, configured to bridge TCP/IP transactions between the plurality of clients and the plurality of servers, wherein said accelerated connection processor accelerates the TCP/IP connections by bypassing a TCP/IP stack employed in one or more of the plurality of servers by issuing Infiniband remote direct memory access operations to retrieve/provide transaction data from/to the plurality of servers, wherein said accelerated connection processor comprises;

a connection correlator, configured to map TCP/IP connection parameters with a target work queue number for each of a plurality of accelerated TCP/IP connections, wherein said target work queue number corresponds to a work queue pair; and

a target channel adapter, coupled to said accelerated connection processor, configured to support Infiniband operations with the plurality of servers, and configured to execute said Infiniband remote direct memory access operations to retrieve/provide said transaction data responsive to said Infiniband remote direct memory access operations issued to said work queue pair, wherein said accelerated connection processor handles TCP/IP processing of said transaction data;

whereby the TCP/IP connections are accelerated by offloading TCP/IP processing performed by the plurality of servers to retrieve/provide said transaction data.

2. The TCP-aware target adapter as recited in claim 1, wherein said accelerated connection processor comprises:

a plurality of native network ports, each of said native network ports communicating with the plurality of clients in a native network protocol corresponding to the plurality of clients.

3. The TCP-aware target adapter as recited in claim 2, wherein said native network protocol comprises one of the following protocols:

Ethernet, Wireless Ethernet, Fiber Distributed Data Interconnect (FDDI), Attached Resource Computer Network (ARCNET), Synchronous Optical Network (SONET), Asynchronous Transfer Mode (ATM), and Token Ring.

4. The TCP-aware target adapter as recited in claim 2, wherein said accelerated connection processor supports TCP/IP transactions with the plurality of clients by receiving/transmitting native transactions in accordance with said native network protocol.

5. The TCP-aware target adapter as recited in claim 4, wherein said each of a plurality of accelerated TCP/IP connections comprises:

a plurality of said Infiniband remote direct memory access operations between a particular server and said target channel adapter to retrieve/provide particular transaction data from/to said particular server; and

corresponding native transactions between said accelerated connection processor and a particular client to provide/retrieve said particular transaction data to/from said particular client.

6. The TCP-aware target adapter as recited in claim 1, wherein said TCP/IP connection parameters comprise:

source TCP port number, destination TCP port number, source IP address, and destination IP address.

7. The TCP-aware target adapter as recited in claim 1, wherein said target work queue number corresponds to a host work queue number within a specific server, said specific server being designated by said accelerated connection processor to support said each of a plurality of accelerated TCP/IP connections with a specific client.

8. An apparatus in a server connected to an Infiniband fabric for implementing accelerated TCP/IP connections between the server and clients, the clients being connected to a TCP/IP network, the apparatus comprising:

a connection acceleration driver, configured to manage the accelerated TCP/IP connections, wherein said connection acceleration driver designates memory locations within server memory such that transaction data can be retrieved/provided via Infiniband remote direct memory access operations, wherein said connection acceleration driver comprises;

correlation logic, configured to map TCP/IP connection parameters with a host work queue number for each of the accelerated TCP/IP connections, wherein said host work queue number corresponds to a work queue pair; and

a host channel adapter, coupled to said connection acceleration driver, configured to execute Infiniband operations via the Infiniband fabric, and configured to execute direct memory access functions to retrieve/provide said transaction data responsive to said Infiniband remote direct memory access operations issued to said work queue pair, wherein an accelerated connection processor handles TCP/IP processing of said transaction data;

whereby the accelerated TCP/IP connections offload TCP/IP processing performed by the server by bypassing a TCP/IP stack employed in the server to retrieve/provide said transaction data.

9. The apparatus as recited in claim 8, wherein a particular accelerated TCP/IP connection comprises:

a plurality of said remote direct memory access operations between the server and a TCP-aware target adapter to retrieve/provide particular transaction data from/to a particular memory location; and

corresponding native transactions between said TCP-aware target adapter and a particular client to provide/retrieve said particular transaction data to/from said particular client.

10. The apparatus as recited in claim 8, wherein said connection acceleration driver further comprises:

native queue logic, configured to interpret a native network protocol corresponding to the clients, and configured to request/receive first Infiniband operations having native TCP/IP transactions to/from the clients that are embedded within Infiniband packets;

accelerated queue logic, configured to request second Infiniband operations to establish the accelerated TCP/IP connections, said second Infiniband operations designating said memory locations; and

a transport driver interface mux, coupled to said accelerated queue logic, configured to receive said memory locations from application programs, and configured to provide said memory locations to said accelerated queue logic.

11. The apparatus as recited in claim 10, wherein said transport driver interface mux is coupled via a transport driver interface to a TCP/IP stack within the server.

12. The apparatus as recited in claim 10, wherein said TCP/IP connection parameters comprise:

source TCP port number, destination TCP port number, source IP address, and destination IP address.

13. The apparatus as recited in claim 10, wherein said host work queue number corresponds to a target work queue number within a TCP-aware target adapter, said TCP-aware target adapter providing corresponding native transactions to the clients for said each of the accelerated TCP/IP connections.

14. An apparatus within a client-server environment for managing an accelerated TCP/IP connection between a server connected to an Infiniband fabric and a client connected to a TCP/IP network, the apparatus comprising;

a host driver, for providing a host work queue pair through which transaction data corresponding to the accelerated TCP/IP connection is transmitted/received via the Infiniband fabric; and

a TCP-aware target adapter, coupled to said host driver, for providing a target work queue pair corresponding to said host work queue pair, and for executing a remote direct memory access operation to receive/transmit said transaction data via the Infiniband fabric, wherein said TCP-aware target adapter receives/transmits said transaction data responsive to said remote direct memory access operation issued to said target work queue pair, and wherein said TCP-aware target adapter handles TCP/IP processing of said transaction data, said TCP-aware target adapter comprises;

a connection correlator, for mapping TCP/IP connection parameters for the accelerated connection with a target work queue number corresponding to said target work queue pair;

whereby the accelerated TCP/IP connection offloads TCP/IP processing performed by the server by bypassing a TCP/IP stack employed in the server to receive/transmit said transaction data.

15. The apparatus as recited in claim 14, wherein said TCP-aware target adapter further comprises:

a plurality of native network ports, each of said native network ports communicating with TCP/IP clients via a corresponding native network protocol.

16. The apparatus as recited in claim 15, wherein said corresponding native network protocol comprises one of the following protocols:

Ethernet, Wireless Ethernet, Fiber Distributed Data Interconnect (FDDI), Attached Resource Computer Network (ARCNET), Synchronous Optical Network (SONET), Asynchronous Transfer Mode (ATM), and Token Ring.

17. The apparatus as recited in claim 15, wherein said TCP-aware target adapter further comprises:

an accelerated connection processor, for supporting TCP/IP transactions with the client by receiving/transmitting native transactions in accordance with said corresponding native network protocol.

18. The apparatus as recited in claim 17, wherein said host driver comprises:

connection correlation logic, for associating said TCP/IP connection parameters for the accelerated connection with a host work queue number that correspond to said host work queue pair.

19. The apparatus as recited in claim 18, wherein said TCP/IP connection parameters comprise:

source TCP port number, destination TCP port number, source IP address, and destination IP address.

20. A method for accelerating TCP/IP connections in a client-server environment having clients that are connected to a TCP/IP network and servers that are connected to an Infiniband fabric, the method comprising:

mapping TCP/IP connection parameters for accelerated connections to corresponding host and target work queue numbers that correspond to host and target work queue pairs;

offloading TCP/IP processing performed by the servers by bypassing a TCP/IP stack employed in one or more of the servers by executing Infiniband remote direct memory access operations to retrieve/transmit data associated with the accelerated connections from/to memory within the servers;

issuing the Infiniband remote direct memory access operations to said target work queue pairs; and

providing the data to/from a TCP-aware target adapter responsive to said issuing;

wherein the TCP-aware target adapter handles TCP/IP processing of said data.

21. The method as recited in claim 20, wherein said mapping comprises:

intercepting the TCP/IP connection parameters from the requests to send/receive data from/to the servers; and

establishing Infiniband connections between the servers and a TCP-aware target adapter.

22. The method as recited in claim 21, wherein said executing comprises:

providing the TCP-aware target adapter with memory locations within the servers for transmission/reception of the data;

from the TCP-aware target adapter, transmitting the remote direct memory access operations to the servers; and

from the servers, providing remote direct memory access responses.

23. The method as recited in claim 20, further comprising:

generating TCP/IP transactions in a native network protocol to provide the data to the clients.

24. A method for offloading server TCP/IP processing in a client-server environment, comprising:

bypassing a TCP/IP stack employed in a server utilizing remote direct memory access operations via an Infiniband fabric to directly access data from/to server memory, wherein the data is provided to/from a TCP-aware target adapter, the TCP-aware target adapter providing native network ports that connect to clients, wherein said utilizing comprises;

mapping TCP/IP connection parameters for a particular TCP/IP connection with a work queue number that corresponds to a work queue pair within the TCP-aware target adapter;

issuing remote direct memory access requests to the work queue pair; and

providing the data to/from the TCP-aware target adapter responsive to said issuing, wherein the TCP-aware target adapter handles TCP/IP processing of said data; and

via the TCP-aware target adapter, generating native network transactions to transfer the data to/from clients.

25. The method as recited in claim 24, wherein said generating comprises:

formulating TCP headers, IP headers, and native network headers for messages to/from the clients based upon the TCP/IP connection parameters provided by said associating.

26. A TCP-aware target adapter, for accelerating TCP/IP connections between a plurality of clients and a plurality of server, the plurality of servers being accessed via an Infiniband fabric, the plurality of clients being accessed via a TCP/IP network, the TCP-aware target adapter comprising:

an accelerated connection processor, configured to bridge TCP/IP transactions between the plurality of clients and the plurality of servers, wherein said accelerated connection processor accelerates the TCP/IP connections by bypassing a TCP/IP stack employed in one or more of the plurality of servers by issuing remote direct memory access operations to retrieve/provide transaction data from/to the plurality of servers, and wherein said accelerated connection processor comprises;

a connection correlator, configured to map TCP/IP connection parameters which uniquely identify the TCP/IP connections with corresponding work queue numbers, wherein said work queue numbers correspond to work queue pairs; and

a target channel adapter, coupled to said accelerated connection processor, configured to support Infiniband operations with the plurality of servers, and configured to retrieve/provide said transaction data responsive to said remote direct memory access operations issued to said work queue pairs, wherein said accelerated connection processor handles TCP/IP processing of said transaction data, and configured to route said transaction data to/from the plurality of clients as embedded payloads within Infiniband packets;

whereby the TCP/IP connections are accelerated by offloading TCP/IP processing performed by the plurality of servers to retrieve/provide said transaction data.

27. The TCP-aware target adapter as recited in claim 26, wherein said accelerated connection processor supports TCP/IP transactions with the plurality of clients by formatting and processing native transactions in accordance with a native network protocol corresponding to the plurality of clients.

28. The TCP-aware target adapter as recited in claim 27, wherein said accelerated connection processor encapsulates outgoing TCP/IP transactions within Infiniband raw packets for transmission to the plurality of clients.

29. The TCP-aware target adapter as recited in claim 28, wherein said each of a plurality of accelerated TCP/IP connections comprises:

a plurality of said remote direct memory access operations between a particular server and said target channel adapter to retrieve/provide particular transaction data from/to said particular server; and

corresponding native transactions between said accelerated connection processor and a particular client to provide/retrieve said particular transaction data to/from said particular client, wherein said corresponding native transactions are encapsulated within Infiniband raw packets.

30. The TCP-aware target adapter as recited in claim 26, wherein said TCP/IP connection parameters comprise:

source TCP port number, destination TCP port number, source IP address, and destination IP address.

31. The TCP-aware target adapter as recited in claim 30, wherein said target work queue number corresponds to a host work queue number within a specific server, said specific server being designated by said accelerated connection processor to support said each of a plurality of accelerated TCP/IP connections with a specific client.

32. The TCP-aware target adapter as recited in claim 29, wherein said connection correlator associates native connection parameters with a target work queue number for said each of a plurality of unaccelerated TCP/IP connections.

33. The TOP-aware target adapter as recited in claim 32, wherein said native connection parameters comprise:

source MAC address and destination MAC address.

34. The TCP-aware target adapter as recited in claim 33, wherein said target work queue number corresponds to a host work queue number within a specific server, said specific server being designated by said accelerated connection processor to support said each of a plurality of unaccelerated TCP/IP connections with a specific client.

35. An Infiniband-to-native protocol translation apparatus, for routing TCP/IP transactions between a plurality of clients and a plurality of Infiniband devices, the plurality of Infiniband devices being accessed via an Infiniband fabric, the plurality of clients being accessed via a TCP/IP network, the Infiniband-to-native protocol translation apparatus comprising:

an unaccelerated connection processor, configured to bridge the TCP/IP transactions between the plurality of clients and the plurality of Infiniband devices by encapsulating/stripping TCP/IP packets within/from Infiniband raw packets, said unaccelerated connection processor comprising;

an unaccelerated connection correlator, for mapping native addresses to/from Infiniband local identifiers and work queue numbers, wherein said work queue numbers correspond to work queue pairs; and

a target channel adapter, coupled to said unaccelerated connection processor, configured to receive/transmit said Infiniband raw packets from/to the plurality of Infiniband devices responsive to remote direct memory access operations issued to said work queue pairs;

wherein said unaccelerated connection processor encapsulates/strips said TCP/IP packets within/from Infiniband raw packets according to said mapping.

36. The Infiniband-to-native protocol translation apparatus as recited in claim 35, wherein said native addresses comprise MAC addresses.

37. The Infiniband-to-native protocol translation apparatus as recited in claim 35, wherein said native addresses comprise IP addresses.

38. The Infiniband-to-native protocol translation apparatus as recited in claim 35, wherein said Infiniband local identifiers comprise source local identifier, destination local identifier, and work queue number.

39. The Infiniband-to-native protocol translation apparatus as recited in claim 38, wherein said Infiniband local identifiers map said TCP/IP transactions between a particular client and a server connected to an Infiniband fabric.

40. The Infiniband-to-native protocol translation apparatus as recited in claim 38, wherein said Infiniband local identifiers map said TCP/IP transactions between a particular client and a TCP-aware target adapter connected to an Infiniband fabric.