Encapsulated accelerator

• US 9,600,429 B2
• Filed: 11/07/2012
• Issued: 03/21/2017
• Est. Priority Date: 12/09/2010
• Status: Active Grant

• Current Assignee: Xilinx, Inc. (Advanced Micro Devices, Inc.)
• Original Assignee: SolarFlare Communications Incorporated (Advanced Micro Devices, Inc.)
• Inventors: Pope, Steven L.
• Primary Examiner(s): Survillo, Oleg
• Application Number:
  US13/671,434
• Publication Number:
  US 20130080567A1
• Time in Patent Office: 1,595 Days
• Field of Search: 709/213, 709/223, 709/230, 709/250, 711/6, 711/202, 370/419
• US Class Current: 1/1
• CPC Class Codes: G06F 13/102 where the programme performs an interfacing function, e.g. device driver G06F13/105 takes precedence; scheduling within device drivers G06F9/52; contention policies within device drivers G06F9/4881
• CPC Class Codes: G06F 13/28 using burst mode transfer, e.g. direct memory access DMA, cycle steal G06F13/32 takes precedence
• CPC Class Codes: G06F 13/362 with centralised access control
• CPC Class Codes: G06F 13/385 for adaptation of a particular data processing system to different peripheral devices
• CPC Class Codes: G06F 13/4282 on a serial bus, e.g. I2C bus, SPI bus on daisy chain buses G06F13/4247
• CPC Class Codes: G06F 2213/0058 Bus-related hardware virtualisation
• CPC Class Codes: G06F 2213/3808 Network interface controller
• CPC Class Codes: G06Q 40/04 Trading; Exchange, e.g. stocks, commodities, derivatives or currency exchange
• CPC Class Codes: H04L 2212/00 Encapsulation of packets
• CPC Class Codes: H04L 49/9068 in the network interface card

Abstract

A data processing system comprising: a host computer system supporting a software entity and a receive queue for the software entity; a network interface device having a controller unit configured to provide a data port for receiving data packets from a network and a data bus interface for connection to a host computer system, the network interface device being connected to the host computer system by means of the data bus interface; and an accelerator module arranged between the controller unit and a network and having a first medium access controller for connection to the network and a second medium access controller coupled to the data port of the controller unit, the accelerator module being configured to: on behalf of the software entity, process incoming data packets received from the network in one or more streams associated with a first set of one or more network endpoints; encapsulate data resulting from said processing in network data packets directed to the software entity; and deliver the network data packets to the data port of the controller unit so as to cause the network data packets to be written to the receive queue of the software entity.

Claims

1. A data processing system comprising:

a host computer system supporting a software entity and a receive queue for the software entity;

a network interface device having a controller unit configured to provide a data interface for receiving data packets from a network and a data bus interface that connects to the host computer system, the network interface device being connected to the host computer system by means of the data bus interface; and

an accelerator module, addressable as a network endpoint, arranged between the controller unit and the network and having one or more interfaces that connect to the network and a second medium access controller coupled to the data interface of the controller unit, the accelerator module being configured to;

on behalf of the software entity, process incoming data packets received from the network in one or more streams associated with a first set of one or more network endpoints wherein incoming data packets that are not associated with the first set of one or more network endpoints are forwarded onto the controller unit;

encapsulate data resulting from said processing in network data packets directed to the software entity; and

deliver the network data packets to the data interface of the controller unit wherein the network data packets are written to the receive queue of the software entity upon delivery.

2. A data processing system as claimed in claim 1, wherein the software entity is configured to programme the first set of one or more network endpoints into the accelerator module.

3. A data processing system as claimed in claim 1, wherein said processing of incoming data packets by the accelerator module comprises parsing the incoming data packets so as to identify network messages carried therein that have one or more of a set of characteristics.

4. A data processing system as claimed in claim 3, wherein the software entity is configured to programme said set of characteristics into the accelerator module.

5. A data processing system as claimed in claim 3, wherein the data resulting from the processing of the incoming data packets comprise said identified network messages.

6. A data processing system as claimed in claim 1, wherein the software entity is a financial application configured to trade on a remote electronic exchange accessible over the network, the incoming data packets comprise financial messages, and said processing of the incoming data packets by the accelerator module comprises processing the financial messages so as to generate normalised financial data.

7. A data processing system as claimed in claim 6,

wherein said processing of incoming data packets by the accelerator module comprises parsing the incoming data packets so as to identify network messages carried therein that have one or more of a set of characteristics,

and wherein the said set of characteristics defines a set of security symbols.

8. A data processing system as claimed in claim 6, wherein the data resulting from the processing of the incoming data packets comprises said normalised financial data.

9. A network interface device as claimed in claim 1, wherein said processing of incoming data packets by the accelerator module comprises one or more of:

normalisation of financial information carried within financial messages of the incoming data packets;

serialisation of trades carried within financial messages of the incoming data packets and directed to an electronic exchange;

arbitration between financial message streams;

decompression or compression of data packet headers;

analysis of scientific data carried within the incoming data packets;

processing of digital audio and/or video data carried within the incoming data packets; and

in-line cryptographic functions performed on data carried within the incoming data packets.

10. A data processing system as claimed in claim 1, wherein the accelerator module is provided at the network interface device.

11. A data processing system as claimed in claim 10, wherein the controller unit and accelerator module are coupled to one another by means of a SERDES link.

12. A data processing system as claimed in claim 10, wherein the network interface device further comprises a physical network interface arranged to couple the one or more interfaces that connect to the network, of the accelerator module, to the network, the physical network interface supporting signalling over the network in accordance with a predetermined physical layer protocol.

13. A data processing system as claimed in claim 10, wherein the accelerator module further comprises additional interface logic operable to at least partially form memory transactions for performance over the data bus.

14. A data processing system as claimed in claim 13, wherein the accelerator module is configured to encapsulate said at least partially formed memory transactions in network data packets directed to a network endpoint of the controller unit so as to cause the controller unit to perform the memory transactions over the data bus.

15. A data processing system as claimed in claim 13, wherein the at least partially formed memory transactions generated at the additional interface logic are provided to the controller unit over an additional link provided between the accelerator module and the controller unit.

16. A data processing system as claimed in claim 13, wherein the additional interface comprises logic sufficient to at least partially form PCIe Transaction Layer Packets.

17. A data processing system as claimed in claim 10, wherein the controller unit is further coupled to the accelerator module by a Network Controller Sideband Interface and a software driver of the network interface device at the host computing system is configured to relay out-of-band control messages generated by the software entity to the accelerator module by means of the Network Controller Sideband Interface.

18. A data processing system as claimed in claim 1, wherein the host computing system includes a software driver configured to manage the accelerator module by means of driver commands encapsulated within network data packets and directed to a network endpoint of the accelerator.

19. A data processing system as claimed in claim 1, wherein the host computing system is a virtualised system having a privileged software domain including a first software driver for the controller unit and configured to present a virtual operating platform to first and second guest domains, the software entity being an application supported at the first guest software domain, and the second guest software domain having a driver library for said accelerator module, the software entity and driver library being accessible to one another as network endpoints.

20. A data processing system as claimed in claim 19, wherein the privileged software domain does not include a second software driver for the accelerator module.

21. A data processing system as claimed in claim 19, wherein the first guest software domain includes a transport library and the application is arranged to access the driver library and accelerator module by means of the transport library.

22. A data processing system as claimed in claim 19, wherein the privileged software domain is a hypervisor or virtual machine monitor.

23. A data processing system as claimed in claim 1, wherein the accelerator module or network interface device further comprises a memory configured for storing data generated by said processing performed by the accelerator module, and the software entity is configured to access said memory by means of a read request message encapsulated within a network data packet directed to an endpoint of the accelerator module.

24. A data processing system as claimed in claim 1, wherein the network interface device is an Ethernet network interface device and the one or more interfaces that connect to the network and one or more interfaces coupled to the data interface of the controller unit, of the accelerator module, are Ethernet MACs.

25. A data processing system as claimed in claim 1, wherein the accelerator module is located at a network entity distinct from the host computer system and network interface device and coupled to the controller unit by one or more network links.

26. A data processing system as claimed in claim 25, wherein the software entity is configured to cause the network to direct said one or more streams to the accelerator module in preference to the host computer system.

27. A data processing system comprising:

a host computer system supporting a software entity and a transmit queue for the software entity;

a network interface device having a controller unit configured to provide a data interface for transmitting data packets onto a network and a data bus interface that connects to the host computer system, the network interface device being connected to the host computer system by means of the data bus interface; and

an accelerator module, addressable as a network endpoint, arranged between the controller unit and the network and having one or more interfaces that connect to the network and one or more interfaces coupled to the data interface of the controller unit, the accelerator module being configured to;

on behalf of the software entity, process outgoing data packets received from the transmit queue in one or more streams associated with a first set of one or more network endpoints, wherein outgoing data packets that are not associated with the first set of one or more network endpoints are forwarded onto the network;

encapsulate data, resulting from said processing, in network data packets directed to said first set of one or more network endpoints; and

deliver the network data packets onto the network.

28. A data processing system as claimed in claim 27, wherein the software entity is configured to programme the first set of one or more network endpoints into the accelerator module.

29. A data processing system as claimed in claim 27, wherein said processing of outgoing data packets by the accelerator module comprises parsing the outgoing data packets so as to identify network messages carried therein that have one or more of a set of characteristics.

30. A data processing system as claimed in claim 29, wherein the software entity is configured to programme said set of characteristics into the accelerator module.

31. A data processing system as claimed in claim 29, wherein the data resulting from the processing of the incoming data packets comprise said identified network messages.

32. A data processing system as claimed in claim 27, wherein the host computing system includes a software driver configured to manage the accelerator module by means of driver commands encapsulated within network data packets and directed to a network endpoint of the accelerator.