Traffic-dependent adaptive interrupt moderation

• US 10,380,047 B2
• Filed: 03/23/2015
• Issued: 08/13/2019
• Est. Priority Date: 04/07/2014
• Status: Active Grant

• Current Assignee: Mellanox Technologies Limited (NVIDIA Corporation)
• Original Assignee: Mellanox Technologies Limited (NVIDIA Corporation)
• Inventors: Degani, Yuval
• Primary Examiner(s): Alrobaye, Idriss N
• Assistant Examiner(s): Taylor, Brooke J
• Application Number:
  US14/664,988
• Publication Number:
  US 20150286594A1
• Time in Patent Office: 1,604 Days
• Field of Search: 710261
• CPC Class Codes: G06F 13/24 using interrupt G06F13/32 takes precedence
• CPC Class Codes: G06F 13/4234 being a memory bus
• CPC Class Codes: H04L 69/165 Combined use of TCP and UDP protocols; selection criteria therefor

Abstract

A method for communications includes receiving in a network interface controller (NIC) of a host computer incoming data packets from a network on multiple active rings. An average throughput rate of the incoming data packets is measured over the active rings. For each ring among a plurality of the active rings, a respective throughput rate of the incoming data packets on the ring is measured, and a respective interrupt moderation parameter of the ring is set responsively to a comparison of the respective throughput rate on the ring to the average throughput rate. Interrupts are issued from the NIC to a central processing unit (CPU) of the host computer in response to the incoming data packets on the ring at a rate determined in accordance with the respective interrupt moderation parameter.

Claims

1. A method for communications, comprising:

receiving in a network interface controller (NIC) of a host computer incoming data packets from a network on multiple active rings;

measuring a total average throughput rate of the incoming data packets over the multiple active rings; and

for each ring among a plurality of the multiple active rings;

measuring a respective throughput rate of the incoming data packets on the ring;

setting a respective interrupt moderation parameter of the ring responsively to a comparison of the respective throughput rate on the ring to the total average throughput rate over the multiple active rings; and

issuing interrupts from the NIC to a central processing unit (CPU) of the host computer in response to the incoming data packets on the ring at a rate determined in accordance with the respective interrupt moderation parameter.

2. The method according to claim 1, and comprising identifying one or more idle rings on which the respective throughput rate is less than a predefined idle threshold, and setting the respective interrupt moderation parameter value for the one or more idle rings to a predefined idle value.

3. The method according to claim 1, wherein setting the respective interrupt moderation parameter comprises, when the respective throughput rate on the ring is less than a predefined fraction of the total average throughput rate over the multiple active rings, setting the respective interrupt moderation parameter for the ring to a latency-mode value.

4. The method according to claim 3, wherein setting the respective interrupt moderation parameter comprises, when the respective throughput rate on the ring is greater than the predefined fraction of the total average throughput rate over the multiple active rings, setting the respective interrupt moderation parameter for the ring to a throughput-mode value.

5. The method according to claim 4, wherein setting the respective interrupt moderation parameter for the ring to the latency mode value comprises setting a minimum time between interrupts on the ring to zero, while setting the respective interrupt moderation parameter for the ring to the throughput-mode value comprises setting the minimum time between interrupts to a non-zero value.

6. The method according to claim 4, wherein the predefined fraction is a first fraction, and wherein setting the respective interrupt moderation parameter comprises, when the respective throughput rate on the ring is greater than the first fraction of the total average throughput rate over the multiple active rings but less than a second fraction of the total average throughput rate over the multiple active rings, setting the respective interrupt moderation parameter for the ring to a mid-range throughput value, and when the respective throughput rate on the ring is greater than the second fraction of the total average throughput rate over the multiple active rings, setting the respective interrupt moderation parameter for the ring to a high-throughput value, which is different from the mid-range throughput value.

7. The method according to claim 4, wherein setting the respective interrupt moderation parameter for the ring to the throughput-mode value comprises counting a number of the rings for which the respective throughput rate on the ring is greater than the predefined fraction of the total average throughput rate over the multiple active rings, and adjusting the throughput-mode value of the interrupt moderation parameter responsively to the number.

8. The method according to claim 1, wherein the rings are associated with different, respective cores of the CPU, and wherein setting the respective interrupt moderation parameter comprises setting different, respective values of the interrupt moderation parameter for the cores, depending upon the rings with which the cores are respectively associated.

9. Apparatus for communications, comprising:

a central processing unit (CPU);

a system memory; and

a network interface controller (NIC), which is configured to receive incoming data packets from a network on multiple active rings and to issue interrupts to the CPU in response to the incoming data packets at a rate determined, for each ring, in accordance with a respective interrupt moderation parameter that is set for the ring,

wherein the CPU is configured to measure an average throughput rate of the incoming data packets over the multiple active rings, as a function of the total throughput of all the rings divided by a count of the multiple active rings, and, for each ring among a plurality of the multiple active rings, to measure a respective throughput rate of the incoming data packets on the ring, and to set the respective interrupt moderation parameter of the ring responsively to a comparison of the respective throughput rate on the ring to the average throughput rate over the multiple active rings.

10. The apparatus according to claim 9, wherein the CPU is configured to identify one or more idle rings on which the respective throughput rate is less than a predefined idle threshold, and to set the respective interrupt moderation parameter value for the one or more idle rings to a predefined idle value.

11. The apparatus according to claim 9, wherein when the respective throughput rate on the ring is less than a predefined fraction of the average throughput rate over the multiple active rings, the respective interrupt moderation parameter for the ring is set to a latency-mode value.

12. The apparatus according to claim 11, wherein when the respective throughput rate on the ring is greater than the predefined fraction of the average throughput rate over the multiple active rings, the respective interrupt moderation parameter for the ring is set to a throughput-mode value.

13. The apparatus according to claim 12, wherein the interrupt moderation parameter comprises a minimum time between interrupts on the ring, and the latency-mode value of the minimum time between interrupts is set to zero, while the throughput-mode value of the minimum time between interrupts is set to a non-zero value.

14. The apparatus according to claim 12, wherein the predefined fraction is a first fraction, and wherein when the respective throughput rate on the ring is greater than the first fraction of the average throughput rate over the multiple active rings but less than a second fraction of the average throughput rate over the multiple active rings, the respective interrupt moderation parameter for the ring is set to a mid-range throughput value, and when the respective throughput rate on the ring is greater than the second fraction of the average throughput rate over the multiple active rings, the respective interrupt moderation parameter for the ring is set to a high-throughput value, which is different from the mid-range throughput value.

15. The apparatus according to claim 12, wherein the CPU is configured to count a number of the rings for which the respective throughput rate on the ring is greater than the predefined fraction of the average throughput rate over the multiple active rings, and to adjust the throughput-mode value of the interrupt moderation parameter responsively to the number.

16. The apparatus according to claim 9, wherein the rings are associated with different, respective cores of the CPU, and wherein the CPU is configured to set different, respective values of the interrupt moderation parameter for the cores, depending upon the rings with which the cores are respectively associated.

17. A computer software product, comprising a non-transitory computer-readable medium in which program instructions are stored, which instructions, when read by a computer that includes a CPU and a network interface controller (NIC), which is configured to receive incoming data packets from a network on multiple active rings and to issue interrupts to the CPU in response to the incoming data packets at a rate determined, for each ring, in accordance with a respective interrupt moderation parameter that is set for the ring, cause the computer to measure a collective average throughput rate of the incoming data packets over the multiple active rings and, for each ring among a plurality of the multiple active rings, to measure a respective throughput rate of the incoming data packets on the ring, and to set the respective interrupt moderation parameter of the ring responsively to a comparison of the respective throughput rate on the ring to the collective average throughput rate over the multiple active rings.