Network interface device employing a DMA command queue

• US 7,133,940 B2
• Filed: 05/14/2001
• Issued: 11/07/2006
• Est. Priority Date: 10/14/1997
• Status: Expired due to Fees

• Current Assignee: Alacritech, Inc.
• Original Assignee: Alacritech, Inc.
• Inventors: Philbrick, Clive M., Blightman, Stephen E. J., Starr, Daryl D.
• Primary Examiner(s): BATAILLE, PIERRE MICHE
• Application Number:
  US09/855,979
• Publication Number:
  US 20010021949A1
• Time in Patent Office: 2,003 Days
• Field of Search: 710/22, 710/305, 710/39, 710/310, 710/62, 710/308, 709/200, 709/239, 711/154
• US Class Current: 710/22
• CPC Class Codes: G06F 5/10 having a sequence of storage locations each being individually accessible for both enqueue and dequeue operations, e.g. using random access memory G06F5/065 takes precedence
• CPC Class Codes: H04L 49/90 Buffering arrangements
• CPC Class Codes: H04L 49/9063 Intermediate storage in different physical parts of a node or terminal
• CPC Class Codes: H04L 67/62 Establishing a time schedule for servicing the requests
• CPC Class Codes: H04L 67/63 Routing a service request depending on the request content or context
• CPC Class Codes: H04L 69/08 Protocols for interworking; Protocol conversion
• CPC Class Codes: H04L 69/12 Protocol engines
• CPC Class Codes: H04L 69/16 Implementation or adaptation of Internet protocol [IP], of transmission control protocol [TCP] or of user datagram protocol [UDP]
• CPC Class Codes: H04L 69/161 Implementation details of TCP/IP or UDP/IP stack architecture; Specification of modified or new header fields
• CPC Class Codes: H04L 69/163 In-band adaptation of TCP data exchange; In-band control procedures
• CPC Class Codes: H04L 69/166 IP fragmentation; TCP segmentation
• CPC Class Codes: H04L 69/22 Parsing or analysis of headers
• CPC Class Codes: H04L 69/32 Architecture of open systems interconnection [OSI] 7-layer type protocol stacks, e.g. the interfaces between the data link level and the physical level
• CPC Class Codes: H04L 9/40 Network security protocols

Abstract

A network interface device couples a host computer to a network. The network interface device includes a processor and a DMA controller. The processor causes the DMA controller to perform multiple DMA commands before the processor takes a particular software branch. The processor issues the DMA commands by placing the DMA commands in a memory and then pushing values indicative of the DMA commands onto a DMA command queue. The values are popped off the DMA command queue and are executed by the DMA controller one at a time. The DMA commands are executed in the same order that they were issued by the processor. The processor need not monitor multiple DMA commands to make sure they have all been completed before the software branch is taken, but rather the processor pops a DMA command complete queue to make sure that the last of the DMA commands has been completed.

Claims

1. An apparatus, comprising:

means for maintaining a DMA command queue and a DMA command complete queue on a network interface device and for causing values to be pushed onto the DMA command queue and for causing values to be popped from the DMA command complete queue, each of the values pushed onto the DMA command queue being indicative of one of a plurality of DMA commands; and

a DMA controller that executes the plurality of DMA commands such that the DMA commands are completed in a particular order, the DMA controller pushing values onto the DMA command complete queue, each of the values pushed onto the DMA command complete queue indicating completion of one of the plurality of DMA commands.

2. The apparatus of claim 1, wherein the means comprises a processor.

3. The apparatus of claim 1, wherein the means further comprises a hardware queue manager.

4. A network interface device, comprising:

queue manager hardware that maintains a DMA command queue and a DMA command complete queue;

a processor coupled to the queue manager hardware, the processor causing values to be pushed onto the DMA command queue, the processor causing values to be popped from the DMA command complete queue;

a DMA controller coupled to the queue manager hardware, the DMA controller executing DMA commands, the DMA commands executed being indicated by values popped off the DMA command queue, the DMA controller pushing values onto the DMA command complete queue;

local memory that temporarily stores a first portion of data transferred by execution of one or more DMA commands from data storage on a host coupled to the network interface device into the local memory, the local memory also temporarily storing a second portion of data transferred by execution of one or more DMA commands from the data storage on the host to the local memory; and

physical layer interface and media access control circuitry, the physical layer interface and media access control circuitry outputting the first and second portions of data from the network interface device to a network, the first and second portions of data being output in the form of a data payload of a network communication.

5. The network interface device of claim 4, wherein the local memory is dynamic random access memory (DRAM).

6. The network interface device of claim 5, wherein the queue manager hardware stores at least part of the DMA command queue and the DMA command complete queue in static random access memory (SRAM).

7. A method, comprising:

(a) pushing values onto a DMA command queue in an order, each of the values being indicative of a different one of a plurality of DMA commands, wherein the DMA command queue is maintained on a network interface device (NID), and wherein the NID performs fast-path transport and network layer protocol processing;

(b) popping the DMA command queue such that a DMA controller on the NID executes the plurality of DMA commands in the order in which the associated values were pushed onto the DMA command queue, the DMA controller being a part of the NID;

(c) the DMA controller pushing values onto a DMA command complete queue, each of the values pushed onto the DMA command complete queue indicating completion of one of the plurality of DMA commands; and

(d) popping the DMA command complete queue.

8. The method of claim 7, wherein the NID includes a first memory and a second memory, the method further comprising:

(e) receiving multiple frames of a session layer network message onto the NID and storing the frames in the first memory, wherein execution of one of the plurality of DMA commands in (b) results in a move of at least a part of one of the frames from the first memory to the second memory, and wherein execution of another of the plurality of DMA commands in (b) results in a move of at least a part of another of the frames from the first memory to the second memory.

9. The method of claim 7, wherein the NID is integrated into an integrated circuit taken from the group consisting of:

a memory controller integrated circuit, a graphics controller integrated circuit, an input/output integrated circuit, and a bridge integrated circuit, and wherein the integrated circuit of which the NID is a part is realized on a motherboard of a host computer.

10. The method of claim 8, wherein the DMA command complete queue is used to determine that the at least a part of one of the frames and the at least a part of another of the frames are both present in the second memory.

11. A method, comprising:

(a) using a DMA command queue to ensure that a plurality of DMA moves are completed in a particular sequence, each of the DMA moves being a move of information from one location on a network interface device to another location on the network interface device, the DMA command queue being maintained by queue manager hardware on the network interface device, the DMA moves being carried out by a DMA controller, the DMA controller being a part of the network interface device; and

(b) outputting at least part of the information from the network interface device, wherein a first of the plurality of DMA moves is a move of at least a part of a frame of a session layer message, and wherein a second of the plurality of DMA moves is a move of at least a part of a subsequent frame of the session layer message, wherein a processor pushes values onto the DMA command queue, each of the values being indicative of a different DMA command, and wherein the processor analyzes at least a part of the information moved in the first move, the processor doing the analyzing after the first move is complete.

12. The method of claim 11, wherein said one location on the network interface device is a dynamic random access memory (DRAM) and wherein said another location on the network interface device is a static random access memory (SRAM), wherein the first move is a move of information from a first buffer in the DRAM to a first buffer in the SRAM, and wherein the second move is a move of information from a second buffer in the DRAM to a second buffer in the SRAM.

13. The method of claim 11, wherein the processor does the analyzing before the second move is complete.

14. A method, comprising:

(a) using a DMA command queue to ensure that a plurality of DMA moves are completed in a particular sequence, each of the DMA moves being a move of information from one location on a network interface device to another location on the network interface device, the DMA command queue being maintained by queue manager hardware on the network interface device, the DMA moves being carried out by a DMA controller, the DMA controller being a part of the network interface device;

(b) the DMA controller pushing values onto a DMA command complete queue, each value indicating that one of the DMA moves has been carried out by the DMA controller;

(c) a processor on the network interface device popping values off the DMA command complete queue; and

(d) outputting at least part of the information from the network interface device.

15. The method of claim 14, wherein the information output in (b) is output from the network interface device to a host computer, the host computer being coupled to the network interace device.

16. The method of claim 14, wherein the information output in (b) is output from the network interface device to a network.

17. The method of claim 14, wherein a first of the plurality of DMA moves is a move of at least a part of a frame of a session layer message, and wherein a second of the plurality of DMA moves is a move of at least a part of a subsequent frame of the session layer message.

18. A method, comprising:

(a) maintaining on a network interface device a DMA command queue;

(b) a processor on the network interface device causing a value to be pushed onto the DMA command queue, the value being indicative of corresponding DMA command;

(c) popping a value off the DMA command queue, a DMA controller on the network interface device then executing a DMA command indicated by the popped value;

(d) repeating (b) and (c) such that a first portion of data is transferred from host storage to a local memory on the network interface device and such that a second portion of data is transferred from the host storage to the local memory on the network interface device; and

(e) after both the first portion and the second portion are present in the local memory, outputting the first and second portions of data from the network interface device to a network, the first and second portions making up at least a part of a data payload of a network communication, wherein the pushing of (b) occurs twice before the popping of (c) occurs once.

19. A method, comprising:

(a) maintaining on a network interface device a DMA command queue;

(b) a processor on the network interface device causing a value to be pushed onto the DMA command queue, the value being indicative of corresponding DMA command;

(c) popping a value off the DMA command queue, a DMA controller on the network interface device then executing a DMA command indicated by the popped value;

(d) repeating (b) and (c) such that a first portion of data is transferred from host storage to a local memory on the network interface device and such that a second portion of data is transferred from the host storage to the local memory on the network interface device;

(e) maintaining a DMA command complete queue on the network interface device, the DMA controller pushing values onto the DMA command complete queue, the processor popping values off the DMA command complete queue; and

(f) after both the first portion and the second portion are present in the local memory, outputting the first and second portions of data from the network interface device to a network, the first and second portions making up at least a part of a data payload of a network communication.

20. The method of claim 19, wherein the processor uses the DMA command complete queue to determine that the first and the second portions of data are both present in local memory on the network interface device.

21. The method of claim 19, wherein the network interface device comprises queue manager hardware, the queue manager hardware maintaining the DMA command queue and the DMA command complete queue in static random access memory (SRAM), wherein the processor, the queue manager hardware, the SRAM, and the DMA controller are all part of the same integrated circuit.

22. The method of claim 19, wherein each of the values on the DMA command queue is a DMA command.

23. The method of claim 19, wherein each of the values on the DMA command queue comprises a pointer to a DMA command.

24. The method of claim 19, wherein each of the values on the DMA command queue is a number that identifies a location where a DMA command is stored.

25. The method of claim 19, wherein the network interface device is an expansion card coupled to a host computer, the host storage being part of the host computer.

26. The method of claim 19, wherein the network interface device is a part of a host computer.

27. A method, comprising:

(a) maintaining on a network interface device a DMA command queue, the DMA command queue being maintained by queue manager hardware on the network interface device;

(b) a processor on the network interface device causing a value to be pushed onto the DMA command queue, the value being indicative of corresponding DMA command;

(c) popping a value off the DMA command queue, a DMA controller on the network interface device then executing a DMA command indicated by the popped value;

(d) repeating (b) and (c) such that a first portion of data is transferred from a first place on the network interface device to a second place on the network interface device, and such that a second portion of data is transferred from the first place on the network interface device to the second place on the network interface device;

(e) maintaining a DMA command complete queue on the network interface device, the DMA controller pushing values onto the DMA command complete queue, the processor popping values off the DMA command complete queue;

(f) after both the first portion and the second portion have been transferred to the second place in (d), the processor taking a software branch; and

(g) after taking the software branch, the processor outputting the first and second portions of data from the network interface device.

28. The method of claim 27, wherein the processor outputs the first and second portions of data in (f) to a network.

29. The method of claim 27, wherein the processor outputs the first and second portions of data in (f) to a host computer.

30. The method of claim 27, wherein the first place is a dynamic random access memory (DRAM) and wherein the second place is a bus interface.

31. The method of claim 27, wherein the first place is a bus interface and wherein the second place is a dynamic random access memory (DRAM).

32. The method of claim 27, wherein the first place is a bus interface and wherein the second place is a static random access memory (SRAM).

33. The method of claim 27, wherein the first place is a static random access memory (SRAM) and wherein the second place is a bus interface.