VIRTUALISED RECEIVE SIDE SCALING

• US 20100333101A1
• Filed: 11/18/2008
• Published: 12/30/2010
• Est. Priority Date: 11/29/2007
• Status: Active Grant

• Current Assignee: Xilinx, Inc. (Advanced Micro Devices, Inc.)
• Original Assignee: SolarFlare Communications Incorporated (Advanced Micro Devices, Inc.)
• Inventors: Pope, Steven, Riddoch, David
• Granted Patent: US 8,543,729 B2
• Time in Patent Office: Days
• US Class Current: 718/103
• CPC Class Codes: H04L 47/10 Flow control; Congestion control
• CPC Class Codes: H04L 49/90 Buffering arrangements
• CPC Class Codes: H04L 49/9063 Intermediate storage in different physical parts of a node or terminal

Abstract

A method for receiving packet data by means of a data processing system having a plurality of processing cores and supporting a network interface device and a set of at least two software domains, each software domain carrying a plurality of data flows and each supporting at least two delivery channels, the method comprising: receiving at the network interface device packet data that is part of a particular data flow; selecting in dependence on one or more characteristics of the packet data a delivery channel of a particular one of the software domains, said delivery channel being associated with a particular one of the processing cores of the system; and mapping the incoming packet data into said selected delivery channel such that receive processing of the packet is performed by the same processing core that performed receive processing for preceding packets of that data flow.

Claims

1. A method for receiving packet data by means of a data processing system having a plurality of processing cores and supporting a network interface device and a set of at least two untrusted software domains, each untrusted software domain;

(a) carrying a plurality of data flows;

(b) supporting at least two delivery channels between the network interface device and the respective untrusted software domain; and

(c) being operable to perform receive processing of received packet data at a processing core of the data processing system, the method comprising;

receiving at the network interface device packet data that is part of a particular data flow;

selecting in dependence on one or more characteristics of the packet data a delivery channel of a particular one of the untrusted software domains, said delivery channel being associated with a particular one of the processing cores of the data processing system; and

mapping the incoming packet data into the said selected delivery channel such that receive processing of the packet data is performed in the untrusted software domain by the same processing core that performed receive processing for preceding packets of that data flow.

2. A method as claimed in claim 1, wherein at least some of the state of each delivery channel is supported at the network interface device.

3. A method as claimed in claim 1, wherein each delivery channel is arranged such that receive processing of all packet data accepted into a delivery channel is performed at the same processing core.

4. A method as claimed in claim 1, wherein the network interface performs at least some protocol processing of the packet data.

5. A method as claimed in claim 4, wherein the mapping step includes delivering a subset of the received packet data into the said delivery channel.

6. A method as claimed in claim 5, wherein the subset comprises payload data.

7. A method as claimed in claim 6, wherein the payload data is TCP payload data.

9. A method as claimed in claim 1, wherein the selecting step is performed at the network interface device.

10. A method as claimed in claim 1, wherein the data flow corresponds to a network socket of the particular untrusted software domain.

11. A method as claimed in claim 1, wherein the one or more characteristics of the packet data comprise one or more fields of the packet header.

12. A method as claimed in claim 1, wherein the selecting step comprises:

matching a first subset of the one or more characteristics of the packet data to a set of stored characteristics so as to identify the particular software domain; and

choosing, in dependence on a second subset of the one or more characteristics of the packet data, the delivery channel within the particular untrusted software domain.

13. A method as claimed in claim 12, wherein the matching step is performed by means of a filter.

14. A method as claimed in claim 12, wherein the choosing step is performed by means of a hash function.

15. A method as claimed in claim 14, wherein the hash function is a Toeplitz function and the choosing step further includes using an indirection table.

16. A method as claimed in claim 1, wherein the mapping step comprises:

writing the data packet to a delivery channel of the data processing system; and

delivering a notification event into a notification channel associated with the selected delivery channel.

17. A method as claimed in claim 16, wherein the notification channel is configured to, on receiving the notification event, cause an interrupt to be delivered to the processing core associated with the selected delivery channel.

18. A method as claimed in claim 16, wherein the notification channel is configured to, on receiving the notification event, cause a wakeup notification event to be delivered to an interrupting notification channel that is arranged to cause an interrupt to be delivered to a processing core.

19. A method as claimed in claim 18, wherein the said processing core is the processing core associated with the selected delivery channel.

20. A method as claimed in claim 1, wherein the network interface device performs stateless packet processing.

21. A method as claimed in claim 1, wherein the particular untrusted software domain is a virtualised operating system instance.

22. A method as claimed in claim 1, wherein the particular untrusted software domain is a user-level process.

23. A method as claimed in claim 1, wherein the untrusted software domains are virtualised operating systems having a lower privilege level than a system kernel or hypervisor supported by the data processing system.

24. A method as claimed in claim 1, wherein the untrusted software domains are applications having a lower privilege level than a system kernel or hypervisor supported by the data processing system.

25. A data processing system arranged to perform the method as claimed in claim 1.

8. (canceled)

26. A method for transmitting data packets onto a network by means of a data processing system having a plurality of processing cores and supporting a network interface device and a set of at least two untrusted software domains, each untrusted software domain:

(a) carrying a plurality of data flows;

(b) supporting at least two transmit channels between the network interface device and the respective untrusted software domain, and (c) being operable to process notification events associated with the transmission of data at a processing core of the data processing system, the method comprising;

at a particular one of the untrusted software domains, selecting in dependence on the data flow to which a set of data for transmission belongs, one of at least two transmit channels, said transmit channel being associated with a particular one of the processing cores of the data processing system; and

processing notification events associated with the transmission of data through the said transmit channel on the processing core associated with said transmit channel.

27. A method as claimed in claim 26, wherein the transmit channel has an associated notification channel to which notification events associated with the said transmit channel are delivered.

28. A method as claimed in claim 27, wherein the notification channel is associated with the particular processing core associated with the selected transmit channel.

29. A method as claimed in claim 27, wherein the notification channel is configured to, on receiving the notification event, cause an interrupt to be delivered to the particular processing core associated with the selected transmit channel.

30. A method as claimed in claim 27, wherein the notification channel is configured to, on receiving the notification event, cause a wakeup notification event to be delivered to an interrupting notification channel that is arranged to cause an interrupt to be delivered to a processing core.

31. A method as claimed in claim 30, wherein the said processing core is the processing core associated with the selected transmit channel.

32. A method as claimed in claim 26, wherein the untrusted software domain is a virtualised operating system instance.

33. A method as claimed in claim 26, wherein the untrusted software domain is a user-level process.

34. A method as claimed in claim 26, wherein the untrusted software domains are virtualised operating systems having a lower privilege level than a system kernel or hypervisor supported by the data processing system.

35. A method as claimed in claim 26, wherein the untrusted software domains are applications having a lower privilege level than a system kernel or hypervisor supported by the data processing system.

36. A data processing system arranged to perform the method as claimed in claim 26.

43. A method as claimed in claim 26, wherein the untrusted software domains are applications having a lower privilege level than a system kernel or hypervisor supported by the data processing system.

37. A data processing system arranged to receive and transmit packet data by means of a data processing system having a plurality of processing cores and supporting a network interface device and a set of at least two untrusted software domains, each untrusted software domain:

(a) carrying a plurality of data flows;

(b) supporting at least two delivery channels between the network interface device and the respective untrusted software domain;

(c) being operable to perform receive processing of received packet data at a processing core of the data processing system; and

(d) being operable to process notification events associated with the transmission of data at a processing core of the data processing system, the data processing system arranged to perform data receiving steps of;

receiving at the network interface device packet data that is part of a first data flow;

selecting in dependence on one or more characteristics of the packet data a delivery channel of a particular one of the untrusted software domains, said delivery channel being associated with a first one of the processing cores of the data processing system; and

mapping the incoming packet data into the said selected delivery channel such that receive processing of the packet data is performed in the untrusted software domain by the same processing core that performed receive processing for preceding packets of that first data flow,

the data processing system further arranged to perform data transmitting steps of;

at a particular one of the untrusted software domains, selecting in dependence on a second data flow to which a set of data for transmission belongs, one of at least two transmit channels, said selected transmit channel being associated with a second one of the processing cores of the data processing system; and

processing notification events associated with the transmission of data through the said selected transmit channel on the second processing core,

the data processing system further arranged to determine whether the first and second data flows are the same data flow, and if so, then to select the same processing core for both the data receiving steps of the first flow and the data transmitting steps of the second flow.

38. A method for managing interaction between a data processing system and a network interface device, the data processing system having a plurality of processing cores and supporting a set of at least two untrusted software domains, each untrusted software domain:

(a) carrying a plurality of data flows;

(b) supporting a set of at least two notification channels; and

(c) being operable to process notification events at a processing core of the data processing system, the method comprising;

at the network interface device, in response to processing data of a data flow of one of the untrusted software domains, selecting in dependence on one or more characteristics of the data flow one of the set of notification channels of the software domain, each notification channel being associated with a particular one of the processing cores of the data processing system;

delivering a notification event to the selected notification channel; and

responsive to delivering the notification event to the selected notification channel, causing an interrupt to be delivered to the processing core associated with the selected notification channel such that processing of the notification event is performed at that processing core by a processing entity of the software domain.

39. A method as claimed in claim 38, wherein the notification event indicates that one or more data packets have been received at the network interface device.

40. A method as claimed in claim 38, wherein the notification event indicates that one or more data packets have been transmitted by the network interface device.

41. A method as claimed in claim 38, wherein at least some protocol processing of the data packets is performed at the network interface device.

42. (canceled)