Network traffic management with queues affinitized to one or more cores

• US 10,715,424 B2
• Filed: 03/15/2017
• Issued: 07/14/2020
• Est. Priority Date: 12/06/2016
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: Malloy, Dmitry, Dabagh, Alireza, Silva, Gabriel, To, Khoa, Cardona, Omar, Stanwyck, Donald
• Primary Examiner(s): Rashid, Wissam
• Application Number:
  US15/459,223
• Publication Number:
  US 20180157514A1
• Time in Patent Office: 1,217 Days
• CPC Class Codes: H04L 2101/622 Layer-2 addresses, e.g. medium access control [MAC] addresses
• CPC Class Codes: H04L 45/306 Route determination based on the nature of the carried application
• CPC Class Codes: H04L 45/7453 using hashing

Abstract

Techniques of network traffic management in a computing device are disclosed. One example method includes receiving, at a main processor, a request from a network interface controller to perform network processing operations for packets assigned by the network interface controller to a queue of a virtual port of the network interface controller. The method also includes, in response to receiving the request, causing one of multiple cores of the main processor with which the queue of the virtual port is affinitized to perform the network processing operations to effect processing and transmission of the packets to an application executing in a virtual machine hosted on the computing device.

Claims

1. A method for network traffic management in a computing device having a network interface controller operatively coupled to a main processor with multiple cores, the method comprising:

receiving, at the network interface controller, a packet having a header and a payload;

assigning, at the network interface controller, the received packet to a virtual port of the network interface controller based on a destination medium access control (“

MAC”

) address contained in the header of the packet, wherein the virtual port includes multiple queues each affinitized with one of the cores in the main processor;

upon assigning the packet to the virtual port, further assigning, at the network interface controller, the packet to one of the queues in the virtual port based on one or more of a source IP address, a destination IP address, a source port, or a destination port included in the header of the packet; and

causing the core with which the queue is affinitized to execute network processing operations to forward the packet in the queue to a destination identified by the MAC address, the source IP address, the destination IP address, the source port, and the destination port included in the header of the packet.

2. The method of claim 1 wherein the MAC address included in the header of the packet identifies a virtual machine or a hypervisor executing on the computing device.

3. The method of claim 1 wherein assigning the packet to one of the queues includes:

calculating, at the network interface controller, a hash value of one or more of the source IP address, the destination IP address, the source port, or the destination port included in the header of the packet; and

identifying the queue as one corresponding to at least a portion of the calculated hash value in a table contained in the network interface controller.

4. The method of claim 1 wherein assigning the packet to the virtual port includes:

extracting the destination MAC address from the header of the packet, the destination MAC address identifies a virtual machine executing on the computing device; and

identifying the virtual port corresponding to the extracted MAC address and corresponding to the virtual machine.

5. The method of claim 1 wherein:

the destination MAC address identifies a virtual machine executing on the computing device;

the destination includes an application executing in the virtual machine; and

causing the core includes causing the core to execute network processing operations to forward the packet in the queue to the application executing in the virtual machine identified by the MAC address.

6. The method of claim 1 wherein:

the destination MAC address identifies a virtual machine executing on the computing device;

the destination includes an application executing in the virtual machine; and

causing the core includes causing the core to executing instructions to enforce communications security, perform network virtualization, translate network addresses, or maintain a communication flow state to forward the packet in the queue to the application executing in the virtual machine identified by the MAC address.

7. The method of claim 1 wherein:

the packet is a first packet having a first header;

the MAC address is a first MAC address; and

the method further includes;

receiving, at the network interface controller, a second packet having a second header containing a second MAC address that is the same as the first MAC address; and

assigning, at the network interface controller, the received second packet to the same virtual port of the network interface controller based on that the second MAC address is the same as the first MAC address.

8. The method of claim 1 wherein:

the packet is a first packet having a first header;

the MAC address is a first MAC address;

the virtual port is a first virtual port; and

the method further includes;

receiving, at the network interface controller, a second packet having a second header containing a second MAC address that is different than the first MAC address; and

assigning, at the network interface controller, the received second packet to a second virtual port of the network interface controller, the second MAC address being different than the first MAC address.

9. The method of claim 1 wherein:

the packet is a first packet having a first header;

the MAC address is a first MAC address and a first destination IP address;

the queue is a first queue; and

the method further includes;

receiving, at the network interface controller, a second packet having a second header containing a second MAC address that is the same as the first MAC address but a second destination IP address different than the first destination IP address;

assigning, at the network interface controller, the received second packet to the same virtual port of the network interface controller based on that the second MAC address is the same as the first MAC address; and

assigning, at the network interface controller, the second packet to a second queue in the same virtual port, the second queue being different than the first queue.

10. A computing device, comprising:

a main processor having multiple cores configured to execute instructions independently;

a network interface controller operatively coupled to the main processor, the network interface controller having;

a media access unit configured to receive a packet having a header and a payload from a computer network; and

a hardware circuitry operatively coupled to the media access unit, the hardware circuitry being configured to;

analyze the header of the received packet to assign the received packet to a virtual port of the network interface controller based on a destination medium access control (“

MAC”

) address contained in the header of the packet, the virtual port corresponding to a virtual machine hosted on the computing device and including multiple queues each affinitized with a core of the main processor; and

upon assigning the packet to the virtual port, further analyze the header of the packet to assign the packet to one of the multiple queues in the virtual port based on one or more of a source IP address, a destination IP address, a source port, or a destination port included in the header of the packet; and

a memory containing instructions executable by the main processor to cause the main processor to;

receive, at the main processor, a request from the network interface controller to perform network processing operations for the received packet in the assigned one of the multiple queues of the virtual port of the network interface controller; and

in response to receiving the request, perform the network processing operations at one of the cores with which the assigned one of the multiple queues of the virtual port is affinitized to effect processing and transmission of the packet to an application executing in the virtual machine hosted on the computing device and corresponding to the virtual port.

11. The computing device of claim 10 wherein the request includes a hardware interrupt from the network interface controller to the main processor.

12. The computing device of claim 10 wherein:

the request includes a hardware interrupt from the network interface controller to the main processor; and

to perform the network processing operations includes to schedule a remote procedure call on the one of the cores with which the assigned one of the multiple queues of the virtual port is affinitized and to cause the one of the cores to execute the scheduled remote procedure call to enforce communications security, to perform network virtualization, to translate network addresses, or to maintain a communication flow state.

13. The computing device of claim 10 wherein:

the packet is a first packet in a first queue of the virtual port;

the request is a first request;

the one of the cores is a first core;

the application is a first application; and

the instructions are executable by the main processor to cause the main processor to;

receive, at the main processor, a second request from the network interface controller to perform additional network processing operations for a second packet in a second queue of the same virtual port of the network interface controller; and

in response to receiving the second request, perform the additional network processing operations at a second core with which the second queue of the virtual port is affinitized to effect processing and transmission of the second packet to a second application executing in the same virtual machine hosted on the computing device.

14. The computing device of claim 10 wherein:

the packet is a first packet in a first queue of the virtual port;

the request is a first request;

the application is a first application; and

the instructions are executable by the main processor to cause the main processor to;

receive, at the main processor, a second request from the network interface controller to perform additional network processing operations for a second packet in a second queue of the same virtual port of the network interface controller, the second queue being affinitized with the same core of the main processor; and

in response to receiving the second request, perform the additional network processing operations at the one of the cores to effect processing and transmission of the second packet to a second application executing in the same virtual machine hosted on the computing device.

15. The computing device of claim 10 wherein:

the packet is a first packet in a first queue of a first virtual port;

the request is a first request;

the one of the cores is a first core;

the application is a first application; and

the instructions are executable by the main processor to cause the main processor to;

receive, at the main processor, a second request from the network interface controller to perform additional network processing operations for a second packet in a second queue of a second virtual port of the network interface controller, the second virtual port being different than the first virtual port; and

in response to receiving the second request, perform the additional network processing operations at a second core with which the second queue of the second virtual port is affinitized to effect processing and transmission of the second packet to a second application executing in the second virtual machine hosted on the computing device.

16. A method for network traffic management in a computing device having a network interface controller operatively coupled to a main processor with multiple cores, the network interface controller having multiple virtual ports each corresponding to a virtual machine hosted on the computing device and having multiple queues configured to receive and temporarily store packets, wherein each of the multiple queues is affinitized with a core of the main processor, wherein the method comprising:

receiving, at the network interface controller, a packet having a header and a payload from a computer network; and

in response to receiving the packet, using a hardware circuitry of the network interface controller to;

analyze the header of the received packet to assign the received packet to one of the multiple virtual ports of the network interface controller based on a destination medium access control (“

MAC”

) address contained in the header of the packet; and

upon assigning the packet to the one of the multiple virtual ports, further analyze the header of the packet to assign the packet to one of the multiple queues in the one of the multiple virtual ports based on one or more of a source IP address, a destination IP address, a source port, or a destination port included in the header of the packet;

receiving, at the main processor, a request from the network interface controller to perform network processing operations for the packet assigned by the network interface controller to the one of the multiple queues of the one of the multiple virtual ports of the network interface controller; and

in response to receiving the request, causing one of the cores with which the one of the multiple queues of the one of the multiple virtual ports is affinitized to perform the network processing operations to effect processing and transmission of the packet to an application executing in a virtual machine hosted on the computing device and corresponding to the one of the multiple virtual port.

17. The method of claim 16 wherein:

the request includes a hardware interrupt from the network interface controller to the main processor; and

performing the network processing operations includes scheduling a remote procedure call on the one of the cores with which the one of the multiple queues of the one of the multiple virtual ports is affinitized and causing the one of the cores to execute the scheduled remote procedure call to enforce communications security, to perform network virtualization, to translate network addresses, or to maintain a communication flow state.

18. The method of claim 16 wherein:

the packet is a first packet in a first queue of the virtual port;

the request is a first request;

the one of the cores is a first core;

the application is a first application; and

the method further includes;

receiving, at the main processor, a second request from the network interface controller to perform additional network processing operations for a second packet in a second queue of the same virtual port of the network interface controller; and

in response to receiving the second request, performing the additional network processing operations at a second core with which the second queue of the virtual port is affinitized to effect processing and transmission of the second packet to a second application executing in the same virtual machine hosted on the computing device.

19. The method of claim 16 wherein:

the packet is a first packet in a first queue of the virtual port;

the request is a first request;

the application is a first application; and

the method further includes;

receiving, at the main processor, a second request from the network interface controller to perform additional network processing operations for a second packet in a second queue of the same virtual port of the network interface controller, the second queue being affinitized with the same core of the main processor; and

in response to receiving the second request, performing the additional network processing operations at the one of the cores to effect processing and transmission of the second packet to a second application executing in the same virtual machine hosted on the computing device.

20. The method of claim 16 wherein:

the packet is a first packet in a first queue of a first virtual port;

the request is a first request;

the one of the cores is a first core;

the application is a first application; and

the method further includes;

receiving, at the main processor, a second request from the network interface controller to perform additional network processing operations for a second packet in a second queue of a second virtual port of the network interface controller, the second virtual port being different than the first virtual port; and

in response to receiving the second request, performing the additional network processing operations at a second core with which the second queue of the second virtual port is affinitized to effect processing and transmission of the second packet to a second application executing in the second virtual machine hosted on the computing device.