Reducing network latency

• US 10,021,223 B2
• Filed: 08/31/2016
• Issued: 07/10/2018
• Est. Priority Date: 07/29/2011
• Status: Active Grant

• Current Assignee: Xilinx, Inc. (Advanced Micro Devices, Inc.)
• Original Assignee: SolarFlare Communications Incorporated (Advanced Micro Devices, Inc.)
• Inventors: Pope, Steven L., Riddoch, David J., Mansley, Kieran
• Primary Examiner(s): Eskandarnia, Arvin
• Application Number:
  US15/253,822
• Publication Number:
  US 20160373561A1
• Time in Patent Office: 678 Days
• CPC Class Codes: H04L 47/2475 for supporting traffic characterised by the type of applications
• CPC Class Codes: H04L 69/161 Implementation details of TCP/IP or UDP/IP stack architecture; Specification of modified or new header fields
• CPC Class Codes: H04L 69/166 IP fragmentation; TCP segmentation
• CPC Class Codes: H04L 69/22 Parsing or analysis of headers
• CPC Class Codes: H04L 69/329 in the application layer [OSI layer 7]

Abstract

A method of transmitting data for use at a data processing system and network interface device, the data processing system being coupled to a network by the network interface device, the method comprising: forming a message template in accordance with a predetermined set of network protocols, the message template including at least in part one or more protocol headers; forming an application layer message in one or more parts; updating the message template with the parts of the application layer message; processing the message template in accordance with the predetermined set of network protocols so as to complete the protocol headers; and causing the network interface device to transmit the completed message over the network.

Claims

1. A method of transmitting data for use at a data processing system supporting an application, an application programming interface and a network protocol stack, the data processing system being coupled to a network by a network interface device, the method comprising:

forming one or more protocol headers; and

subsequent to the forming of the one or more protocol headers, forming by the application one or more parts of a message for transmission;

causing by the application programming interface inclusion of said one or more parts of the message for transmission in the message, and one or more protocol headers, in accordance with a predetermined set of protocols, for the message for transmission;

on completion of the message for transmission, process the message in accordance with the predetermined set of protocols to complete the protocol headers; and

causing the network interface device to transmit the completed message over the network.

2. A method as claimed in claim 1, comprising forming one or more further parts of the message for transmission, and including one or more further parts of the message in said message.

3. A method of transmitting data as claimed in claim 2, wherein the step of forming the one or more further parts of the message for transmission is performed by the application and the step of causing the network protocol stack to include the one or more further parts of the message in the message comprises issuing, from the application, a second request to the application programming interface.

4. A method of transmitting data as claimed in claim 3, wherein the application makes a series of second requests to the application programming interface, each second request being made on at least one of the one or more further parts of the message for transmission becoming available to the application.

5. A method of transmitting data as claimed in claim 2, wherein the step of forming the one or more further parts of the message for transmission is performed at a data processing engine of the network interface device.

6. A method of transmitting data as claimed in claim 1, wherein the first part of the network protocol stack is a user-level protocol stack.

7. A method of transmitting data as claimed in claim 1, wherein at least part of the message is held at the network interface device.

8. A method of transmitting data as claimed in claim 1, wherein the first request includes memory references to the one or more parts of a message for transmission.

9. A method of transmitting data as claimed in claim 1, further comprising, the network protocol stack performing segmentation of the message in accordance with a predetermined transport protocol such that the one or more parts of the message are transmitted over the network in one or more message segments by the network interface device.

10. A method of transmitting data as claimed in claim 9, wherein the predetermined transport protocol is the transmission control protocol.

11. A method of transmitting data as claimed in claim 9, wherein the transport protocol is configured such that a message segment can carry a plurality of parts of the message for transmission that are not contiguous in the message for transmission.

12. A method of transmitting data as claimed in claim 1, wherein at least part of the message is stored at the network interface device, that part of the message stored at the network interface device including the one or more parts of a message for transmission.

13. A method of transmitting data as claimed in claim 1, wherein the message is a logical expression of the message for transmission.

14. A method of transmitting data as claimed in claim 1, wherein at least part of the network protocol stack is at user level.

15. A data processing system comprising:

an application configured to request transmission of a message via a network and to form one or more parts of the message for transmission;

a network protocol stack configured to, upon receipt of a request from the application to transmit a message via the network, form one or more protocol headers for the message in accordance with a predetermined set of network protocols and, subsequently to receipt of the request and subsequently to forming the one or more protocol headers, and upon receipt of the one or more parts of the message, include the one or more parts of the message and the one or more protocol headers in the message for transmission; and

a network interface device configured to transmit the message over a network, said network interface device configured to couple the data processing system to the network.

16. A method of transmitting data for use at a data processing system and network interface device, the data processing system being coupled to a network by the network interface device, the method comprising:

forming one or more protocol headers; and

forming a message in accordance with a predetermined set of network protocols, the message including at least in part the one or more protocol headers comprising header data;

subsequent to the forming of the one or more protocol headers, developing an application layer message in one or more parts;

updating the formed message with the parts of the application layer message;

processing the formed message in accordance with the predetermined set of network protocols to complete the protocol headers; and

transmitting by the network interface device the completed message over the network.

17. A method of transmitting data as claimed in claim 16, wherein the step of forming a message is performed at a network protocol stack, said network protocol stack being supported at least one of the data processing system and the network interface device.

18. A method of transmitting data as claimed in claim 16, wherein the step of forming an application layer message is performed by one of an application supported at the data processing system, and a data processing engine of the network interface device or other peripheral device of the data processing system.

19. A method of transmitting data as claimed in claim 16, wherein the processing step is performed at a packet at the network interface device.

20. A method as claimed in claim 16, wherein said updating of the formed message is carried out using an FPGA in said network interface device.

21. A method as claimed in claim 16, wherein said network interface device comprises a FPGA.

22. A method as claimed in claim 21, wherein said method comprises executing financial trading algorithms on said FPGA.

23. A method as claimed in claim 21, wherein said method further comprises receiving data at said FPGA from said network, forming a response thereto and outputting said response to the network.

24. A method as claimed in claim 23, wherein said response comprises a bid response.

25. A method as claimed in claim 21, wherein at least part of said application is provided by said FPGA.

26. A method as claimed in claim 21, wherein said FPGA is configured to process application layer messages.

27. A data processing system coupled to a network, the data processing system comprising:

a network interface device; and

a network protocol stack configured to, in accordance with a predetermined set of network protocols, form one or more protocol headers comprising header data and to provide the one or more protocol headers to the network interface device,

wherein the network interface device comprises a message forming engine configured to develop an application layer message in one or more parts and, upon receipt of the one or more protocol headers from the network protocol stack, cause the one or more parts of the application layer message to be applied to the application layer message to form a completed message, said network interface device configured to cause the completed message to be transmitted over the network.

28. A data processing system as claimed in claim 27, wherein the network protocol stack is supported at a network interface device arranged to couple the data processing system to the network.