Transmit completion event batching

• US 7,562,366 B2
• Filed: 02/03/2005
• Issued: 07/14/2009
• Est. Priority Date: 02/03/2005
• Status: Active Grant

• Current Assignee: Xilinx, Inc. (Advanced Micro Devices, Inc.)
• Original Assignee: SolarFlare Communications Incorporated (Advanced Micro Devices, Inc.)
• Inventors: Riddoch, David, Pope, Steve, Roberts, Derek, Chiang, John Mingyung, Yu, Ching
• Primary Examiner(s): Zhen; Li B
• Assistant Examiner(s): VERDI, KIMBLEANN C
• Application Number:
  US11/050,483
• Publication Number:
  US 20060174251A1
• Time in Patent Office: 1,622 Days
• Field of Search: 719/314, 719/318
• US Class Current: 719/314
• CPC Class Codes: H04L 49/90 Buffering arrangements
• CPC Class Codes: H04L 49/901 using storage descriptor, e.g. read or write pointers
• CPC Class Codes: H04L 49/9047 including multiple buffers, e.g. buffer pools

Abstract

Method for managing a data transmit queue, for use with a host and a network interface device. Roughly described, the host writes data buffer descriptors into a transmit descriptor queue, and the network interface device writes events to notify the host when it has completed processing of a transmit data buffer. Each of the transmit completion event descriptors notify the host of completion of a plurality of the transmit data buffers.

Claims

1. A method for managing data transmission, for use with a host subsystem and a network interface device that can communicate with each other via a communication channel, the host subsystem having first and second transmit descriptor queues, comprising the steps of:

the network interface device retrieving first data buffer descriptors from the first transmit descriptor queue, each of the first data buffer descriptors identifying a respective transmit data buffer in the host subsystem;

the network interface device retrieving second data buffer descriptors from the second transmit descriptor queue, each of the second data buffer descriptors identifying a respective transmit data buffer in the host subsystem;

the network interface device retrieving data from the transmit data buffers identified by each of the first data buffer descriptors retrieved;

the network interface device retrieving data from the transmit data buffers identified by each of the second data buffer descriptors retrieved;

the network interface device writing a plurality of first transmit completion event descriptors into a first event queue accessible to the host subsystem, each of the first transmit completion event descriptors notifying the host subsystem of completion by the network interface device of the retrieval of data from a plurality of the transmit data buffers identified by the first data buffer descriptors; and

the network interface device writing a plurality of second transmit completion event descriptors into the first event queue, each of the second transmit completion event descriptors notifying the host subsystem of completion by the network interface device of the retrieval of data from a plurality of the transmit data buffers identified by the second data buffer descriptors,

each particular one of the first transmit completion event descriptors containing a queue label identifying the transmit descriptor queue from which the network interface device retrieved the first data buffer descriptors identifying the plurality of transmit data buffers covered by the particular first transmit completion event descriptor.

2. A method according to claim 1, further comprising the step of the host subsystem writing data buffer descriptors into the first transmit descriptor queue, the host subsystem limiting the number of data buffer descriptors that it writes into the first transmit descriptor queue in dependence upon the availability of space in the first event queue for writing first transmit completion event descriptors.

3. A method according to claim 1, further comprising the steps of:

the host subsystem writing the first data buffer descriptors into the first transmit descriptor queue beginning at a location in the first transmit descriptor queue identified by a first transmit descriptor queue write pointer;

the host subsystem updating the first transmit descriptor queue write pointer in dependence upon the number of first data buffer descriptors written; and

the host subsystem updating a first transmit descriptor queue read pointer in response to the first transmit completion event descriptors notifying the host subsystem of completion.

4. A method according to claim 3, wherein the first transmit descriptor queue comprises a wrap-around structure, further comprising the step of the host subsystem reporting a member of a group consisting of a queue overflow condition, a queue full condition, a queue high watermark condition and a queue low watermark condition, in response to a comparison between the first transmit descriptor queue read pointer and the first transmit descriptor queue write pointer.

5. A method according to claim 1, further comprising the step of the host subsystem, in response to one of the first transmit completion event descriptors notifying the host subsystem of completion, de-queuing from the first transmit descriptor queue the plurality of first data buffer descriptors represented by the first transmit completion event descriptors notifying the host subsystem of completion.

6. A method according to claim 5, further comprising the step of re-writing into the first transmit descriptor queue a data buffer descriptor de-queued in the step of de-queuing from the first transmit descriptor queue.

7. A method according to claim 1, wherein each of the transmit data buffers identified by first data buffer descriptors retrieved in the step of the network interface device retrieving first data buffer descriptors, is a respective contiguous region of memory in the host subsystem.

8. A method according to claim 7, wherein two of the contiguous regions of memory are of same size.

9. A method according to claim 1, wherein the number of transmit data buffers represented by each of the first transmit completion event descriptors is constant.

10. A method according to claim 9, further comprising the steps of:

programming the constant; and

subsequently the host subsystem writing the first data buffer descriptors into the first transmit descriptor queue.

11. A method according to claim 1, further comprising the step of the host subsystem writing the first data buffer descriptors into the first transmit descriptor queue.

12. A method according to claim 1, wherein the step of the network interface device retrieving data from the transmit data buffers identified by each of the first data buffer descriptors retrieved, and the step of the network interface device retrieving data from the transmit data buffers identified by each of the second data buffer descriptors retrieved, collectively comprises the steps of:

the network interface device retrieving data from a transmit data buffer identified by a first one of the first data buffer descriptors;

the network interface device subsequently retrieving data from a transmit data buffer identified by a first one of the second data buffer descriptors; and

the network interface device subsequently retrieving data from a transmit data buffer identified by a second one of the first data buffer descriptors,

the transmit data buffers identified by both the first and second ones of the first data buffer descriptors being included in a single one of the first transmit completion event descriptors.

13. A method according to claim 1, wherein the host subsystem further has a receive descriptor queue, the method further comprising the steps of:

the network interface device retrieving a third data buffer descriptor from the receive descriptor queue, the third descriptor identifying a receive data buffer in the host subsystem;

the network interface device writing data into the receive data buffer identified by the third data buffer descriptor retrieved; and

the network interface device writing a receive completion event descriptor into the first event queue, the receive completion event descriptor notifying the host subsystem of completion by the network interface device of the writing of data into the receive data buffer identified by the third data buffer descriptor.

14. A method according to claim 1, wherein the host subsystem further has a third transmit descriptor queue, further comprising the steps of:

the network interface device retrieving third data buffer descriptors from the third transmit descriptor queue, each of the third data buffer descriptors identifying a respective transmit data buffer in the host subsystem;

the network interface device retrieving data from the transmit data buffers identified by each of the third data buffer descriptors retrieved; and

the network interface device writing a plurality of third transmit completion event descriptors into a second event queue, each of the third transmit completion event descriptors notifying the host subsystem of completion by the network interface device of the retrieval of data from at least one of the transmit data buffers identified by the third data buffer descriptors.

15. A method for managing data transfer between a host subsystem and a network interface device that can communicate with each other via a communication channel, the host subsystem having at least one transmit descriptor queue including a first transmit descriptor queue, each of the transmit descriptor queues has associated therewith a respective queue label, comprising the steps of:

the network interface device retrieving first data buffer descriptors from the first transmit descriptor queue, each of the first data buffer descriptors identifying a respective transmit data buffer in the host subsystem;

the network interface device retrieving data from the transmit data buffers identified by each of the first data buffer descriptors retrieved; and

the network interface device writing a plurality of first transmit completion event descriptors into a first event queue accessible to the host subsystem, each of the first transmit completion event descriptors notifying the host subsystem of completion by the network interface device of the retrieval of data from at least one of the transmit data buffers identified by the first data buffer descriptors,

each particular one of the first transmit completion event descriptors containing information identifying the transmit descriptor queue from which the network interface device retrieved the first data buffer descriptors identifying the plurality of transmit data buffers covered by the particular first transmit completion event descriptor

and wherein the step of the network interface device writing a plurality of first transmit completion event descriptors includes the step of the network interface device copying into each particular one of the first transmit completion event descriptors, the queue label for the transmit descriptor queue from which the network interface device retrieved the first data buffer descriptors identifying the plurality of transmit data buffers covered by the particular first transmit completion event descriptor.

16. A method according to claim 15, further comprising the step of the host subsystem writing the first data buffer descriptors into the first transmit descriptor queue.

17. A method according to claim 15, wherein each of the first transmit completion event descriptors notifies the host subsystem of completion by the network interface device of the retrieval of data from a plurality of the transmit data buffers identified by the first data buffer descriptors.

18. A method for managing data transfer between a host subsystem and a network interface device that can communicate with each other via a communication channel, the host subsystem having a set of at least one transmit descriptor queue including a first transmit descriptor queue, each of the transmit descriptor queues in the set having associated therewith a respective programmable information field, comprising the steps of:

the network interface device retrieving first data buffer descriptors from the first transmit descriptor queue, each of the first data buffer descriptors identifying a respective transmit data buffer in the host subsystem;

the network interface device retrieving data from the transmit data buffers identified by each of the first data buffer descriptors retrieved; and

the network interface device writing a plurality of first transmit completion event descriptors into a first event queue accessible to the host subsystem, each of the first transmit completion event descriptors notifying the host subsystem of completion by the network interface device of the retrieval of data from at least one of the transmit data buffers identified by the first data buffer descriptors,

and each particular one of the first transmit completion event descriptors containing information copied from the programmable information field associated with the transmit descriptor queue from which the network interface device retrieved the first data buffer descriptors identifying the plurality of transmit data buffers covered by the particular first transmit completion event descriptor,

the method further comprising the step of programming the programmable information field associated with the first transmit descriptor queue, with information identifying the first transmit descriptor queue uniquely among at least all of the transmit descriptor queues.

19. A method according to claim 18, wherein each of the first transmit completion event descriptors notifies the host subsystem of completion by the network interface device of the retrieval of data from a plurality of the transmit data buffers identified by the first data buffer descriptors.

20. A method according to claim 19, further comprising the step of the host subsystem writing the first data buffer descriptors into the first transmit descriptor queue.

21. A method for managing data transmission, for use with a host subsystem and a network interface device that can communicate with each other via a communication channel, the host subsystem having a first transmit descriptor queue and a second descriptor queue, comprising the steps of:

the network interface device retrieving first data buffer descriptors from the first transmit descriptor queue, each of the first data buffer descriptors identifying a respective transmit data buffer in the host subsystem;

the network interface device retrieving second data buffer descriptors from the second descriptor queue, each of the second data buffer descriptors identifying a respective data buffer in the host subsystem;

the network interface device retrieving data from the transmit data buffers identified by each of the first data buffer descriptors retrieved;

the network interface device transferring data with the data buffers identified by each of the second data buffer descriptors retrieved;

the network interface device writing a plurality of first transmit completion event descriptors into a first event queue accessible to the host subsystem, each of the first transmit completion event descriptors notifying the host subsystem of completion by the network interface device of the retrieval of data from a plurality of the transmit data buffers identified by the first data buffer descriptors; and

the network interface device writing a plurality of second completion event descriptors into the first event queue, each of the second completion event descriptors notifying the host subsystem of completion by the network interface device of the transfer of data with at least one of the data buffers identified by the second data buffer descriptors,

each particular one of the first transmit completion event descriptors containing a queue label identifying the transmit descriptor queue from which the network interface device retrieved the first data buffer descriptors identifying the plurality of transmit data buffers covered by the particular first transmit completion event descriptor.

22. A method according to claim 21, wherein the step of the network interface device transferring data with the data buffers identified by each of the second data buffer descriptors retrieved, comprises the step of the network interface device writing data into the data buffers identified by each of the second data buffer descriptors retrieved.

23. A method according to claim 21, wherein the step of the network interface device transferring data with the data buffers identified by each of the second data buffer descriptors retrieved, comprises the step of the network interface device retrieving data from the data buffers identified by each of the second data buffer descriptors retrieved.

24. Computing apparatus having a host subsystem, for use with a network interface device in communication with the host subsystem via a peripheral bus, the host subsystem comprising:

a first transmit descriptor queue, the first transmit descriptor queue having a plurality of first data buffer descriptors each identifying a respective transmit data buffer in the host subsystem, the network interface device retrieving first data buffer descriptors from the first transmit descriptor queue; and

a first event queue having a plurality of first transmit completion event descriptors, each of the first transmit completion event descriptors notifying the host subsystem of completion by the network interface device of the retrieval of data from a plurality of the transmit data buffers identified by data buffer descriptors formerly in the first transmit descriptor queue, the network interface device writing the plurality of first transmit completion event descriptors into the first event queue,

wherein each particular one of the first transmit completion event descriptors contains information identifying a queue label for the transmit descriptor queue from which the network interface device retrieved the first data butter descriptors identifying the plurality of transmit data buffers covered by the particular first transmit completion event descriptor,

and wherein the network interface device copies into each particular one of the first transmit completion event descriptors, the queue label for the transmit descriptor queue from which the network interface device retrieved the first data buffer descriptors identifying the plurality of transmit data buffers covered by the particular first transmit completion event descriptor.

25. Apparatus according to claim 24, wherein in the host subsystem, the number of transmit data buffers represented by each of the first transmit completion event descriptors is constant.

26. Apparatus according to claim 24, wherein the host subsystem further comprises a second transmit descriptor queue, the second transmit descriptor queue having a plurality of second data buffer descriptors each identifying a respective transmit data buffer in the host subsystem,

wherein the first event queue further has a plurality of second transmit completion event descriptors, each of the second transmit completion event descriptors notifying the host subsystem of completion by the network interface device of the retrieval of data from a plurality of the transmit data buffers identified by data buffer descriptors formerly in the second transmit descriptor queue.