Reducing network latency

• US 9,258,390 B2
• Filed: 10/27/2011
• Issued: 02/09/2016
• Est. Priority Date: 07/29/2011
• Status: Active Grant

• Current Assignee: Xilinx, Inc. (Advanced Micro Devices, Inc.)
• Original Assignee: SolarFlare Communications Incorporated (Advanced Micro Devices, Inc.)
• Inventors: Pope, Steven L., Riddoch, David J., Mansley, Kieran
• Primary Examiner(s): Eskandarnia, Arvin
• Application Number:
  US13/283,420
• Publication Number:
  US 20130031268A1
• Time in Patent Office: 1,566 Days
• Field of Search: 709/237
• US Class Current: 1/1
• CPC Class Codes: H04L 47/2475 for supporting traffic characterised by the type of applications
• CPC Class Codes: H04L 69/161 Implementation details of TCP/IP or UDP/IP stack architecture; Specification of modified or new header fields
• CPC Class Codes: H04L 69/166 IP fragmentation; TCP segmentation
• CPC Class Codes: H04L 69/22 Parsing or analysis of headers
• CPC Class Codes: H04L 69/329 in the application layer [OSI layer 7]

Abstract

A method of transmitting data for use at a data processing system and network interface device, the data processing system being coupled to a network by the network interface device, the method comprising: forming a message template in accordance with a predetermined set of network protocols, the message template including at least in part one or more protocol headers; forming an application layer message in one or more parts; updating the message template with the parts of the application layer message; processing the message template in accordance with the predetermined set of network protocols so as to complete the protocol headers; and causing the network interface device to transmit the completed message over the network.

Claims

1. A method of transmitting data for use at a data processing system supporting an application, a software interface and a network protocol stack, the data processing system being coupled to a network by a network interface device, the method comprising:

the application;

forming one or more parts of a message for transmission;

causing a message to be generated by means of a first request to the software interface;

the software interface;

on receiving the first request, causing the network protocol stack to include said one or more parts of the message for transmission in the message and, in accordance with a predetermined set of protocols, form at least in part one or more protocol headers for the message for transmission;

and subsequently;

forming one or more further parts of the message for transmission;

causing the network protocol stack to include the one or more further parts of the message in the message and, on completion of the message for transmission, process the message in accordance with the predetermined set of protocols to complete the protocol headers; and

causing the network interface device to transmit the completed message over the network.

2. A method of transmitting data as claimed in claim 1, wherein the step of forming one or more further parts of the message for transmission is performed by the application and the step of causing the network protocol stack to include the one or more further parts of the message in the message is effected by means of a second request made by the application to the software interface.

3. A method of transmitting data as claimed in claim 2, wherein the application makes a series of second requests to the software interface, each second request being made on one or more further parts of the message for transmission becoming available to the application.

4. A method of transmitting data as claimed in claim 3, wherein the final request of the second request type in the series completes the message for transmission causing the network protocol stack to process the message in accordance with the predetermined set of protocols to complete the protocol headers and the network protocol stack to transmit the completed message.

5. A method of transmitting data as claimed in claim 1, wherein the network protocol stack comprises at least two parts:

a first part supported at the data processing system and a second part supported at the network interface device;

the first part being configured to perform the step of forming at least in part one or more protocol headers of the message for transmission, and the second part being configured to perform the step of processing the message so as to complete the protocol headers.

6. A method of transmitting data as claimed in claim 5, wherein the step of forming the one or more further parts of the message for transmission is performed at a data processing engine of the network interface device.

7. A method of transmitting data as claimed in claim 6, wherein the step of causing the second part of the network protocol stack to process the message to complete the protocol headers is performed in response to completing formation of the one or more further parts of the message for transmission.

8. A method of transmitting data as claimed in claim 5, wherein the first part of the network protocol stack is a user-level protocol stack.

9. A method of transmitting data as claimed in claim 1, wherein at least part of the message is held at the network interface device.

10. A method of transmitting data as claimed in claim 1, wherein the first request includes memory references to the one or more parts of a message for transmission.

11. A method of transmitting data as claimed in claim 1, further comprising, subsequent to the network protocol stack including said one or more parts of the message for transmission in the message, the network protocol stack performing segmentation of the message in accordance with a predetermined transport protocol such that the one or more parts of the message are transmitted over the network in one or more message segments by the network interface device.

12. A method of transmitting data as claimed in claim 11, further comprising, subsequent to the network protocol stack including said one or more further parts of the message for transmission in the message, the network protocol stack causing those segments of the message that correspond to the further parts of the message for transmission to be transmitted over the network by the network interface device.

13. A method of transmitting data as claimed in claim 12, wherein the step of the network protocol stack causing those segments of the message that correspond to the further parts of the message for transmission to be transmitted over the network completes the step of the network interface device transmitting the message over the network.

14. A method of transmitting data as claimed in claim 11, wherein the predetermined transport protocol is the transmission control protocol.

15. A method of transmitting data as claimed in claim 11, wherein the transport protocol is configured such that a message segment can carry a plurality of parts of the message for transmission that are not contiguous in the message for transmission.

16. A method as claimed in claim 15, wherein a message segment can include one or more header fields that determine the logical position within the message for transmission of the parts of the message in the message segment.

17. A method as claimed in claim 16, wherein the one or more header fields are formed in a TCP header option.

18. A method of transmitting data as claimed in claim 15, wherein all of the one or more parts of the message are transmitted over the network in a single message segment by the network interface device.

19. A method of transmitting data as claimed in claim 1, wherein at least part of the message is stored at the network interface device, that part of the message stored at the network interface device including the one or more parts of a message for transmission.

20. A method of transmitting data as claimed in claim 19, wherein the step of the network protocol stack including the one or more further parts of the message in the message comprises transferring the one or more further parts of the message into the message using one or more programmed I/O instructions.

21. A method of transmitting data as claimed in claim 19, wherein the step of the network protocol stack including the one or more further parts of the message in the message comprises:

for those further parts of the message that are below a predetermined length, transferring the one or more further parts of the message into the message using one or more programmed I/O instructions; and

for those further parts of the message that are above the predetermined length, transferring the one or more further parts of the message into the message by means of direct memory access by the network interface device.

22. A method of transmitting data as claimed in claim 1, wherein the software interface is configured to provide a dummy transmission function by means of which an application can cause the network protocol stack to process the message in accordance with the predetermined set of protocols as if for transmission by the network interface device, the method further comprising, prior to the step of the network interface device transmitting the message over the network, the application periodically calling the dummy transmission function to cause the network protocol stack to process the message in accordance with the predetermined set of protocols without causing the network interface device to transmit the processed message over the network.

23. A method of transmitting data as claimed in claim 22, wherein the step of calling the dummy transmission function comprises, prior to the network protocol stack processing the message in accordance with the predetermined set of protocols, the network protocol stack padding the message with data to fill the missing parts of the message for transmission.

24. A method of transmitting data as claimed in claim 1, wherein the message is a logical expression of the message for transmission.

25. A method of transmitting data as claimed in claim 1, wherein the software interface is an application programming interface.

26. A method of transmitting data as claimed in claim 1, wherein at least part of the network protocol stack is at user level.

27. A data processing system coupled to a network by a network interface device and comprising:

an application configured to form one or more parts of a message for transmission;

a network protocol stack configured to process messages for transmission in accordance with a predetermined set of network protocols;

a software interface configured to, in response to a first request, cause the network protocol stack to form at least in part one or more protocol headers of a message for transmission;

wherein the application is configured to, on forming one or more parts of a message for transmission, make a first request to the software interface to cause the network protocol stack to form a message comprising at least in part one or more protocol headers of a message for transmission and the one or more parts of the message for transmission;

and subsequently;

the network protocol stack being configured to, on one or more further parts of the message for transmission being formed, include the one or more further parts of the message in the message and, on completion of the message for transmission, process the message in accordance with the predetermined set of protocols to complete the protocol headers and cause the network interface device to transmit the completed message over the network.

28. A data processing system as claimed in claim 27, wherein the application is configured to form the one or more further parts of the message for transmission and to cause the network protocol stack to include the one or more further parts of the message in the message by means of a second request to the software interface.

29. A data processing system as claimed in claim 27, wherein the one or more further parts of the message for transmission are formed at the network interface device at a data processing engine of the network interface, and the network protocol stack comprises at least two parts:

a first part supported at the data processing system and a second part supported at the network interface device;

the first part being configured to perform the step of forming at least in part one or more protocol headers of the message for transmission, and the second part being configured to perform the step of processing the message so as to complete the protocol headers.

30. A method of transmitting data for use at a data processing system and network interface device, the data processing system being coupled to a network by the network interface device, the method comprising:

forming a message in accordance with a predetermined set of network protocols, the message including at least in part one or more protocol headers comprising header data; and

subsequently;

developing an application layer message in one or more parts;

updating the formed message with the parts of the application layer message;

processing the formed message in accordance with the predetermined set of network protocols to complete the protocol headers; and

causing the network interface device to transmit the completed message over the network.

31. A method of transmitting data as claimed in claim 30, wherein the step of forming a message is performed at a network protocol stack supported at the data processing system.

32. A method of transmitting data as claimed in claim 30, wherein the step of forming an application layer message is performed by one of an application supported at the data processing system, and a data processing engine of the network interface device or other peripheral device of the data processing system.

33. A method of transmitting data as claimed in claim 30, wherein the processing step is performed at a packet processing engine supported at the network interface device.

34. A data processing system coupled to a network, the data processing system comprising:

a network protocol stack configured to, in accordance with a predetermined set of network protocols, form a message including at least in part one or more protocol headers comprising header data; and

a message forming engine configured to develop an application layer message in one or more parts and, subsequently to the network protocol stack forming a message including at least one protocol header comprising header data, cause the one or more parts of the application layer message to be applied to the formed message;

wherein the network protocol stack is further configured to, on completion of applying the one or more parts of the application layer message to the formed message, process the formed message in accordance with the predetermined set of network protocols so as to complete the protocol headers and cause the completed message to be transmitted over the network.

35. A data processing system as claimed in claim 34, wherein the network protocol stack is supported at a network interface device arranged to couple the data processing system to the network.

36. A data processing system as claimed in claim 34, wherein the message forming engine is one or both of an application supported at the data processing system or a data processing engine at a network interface device arranged to couple the data processing system to the network.