Computer system and network interface supporting dynamically optimized receive buffer queues

• US 7,307,998 B1
• Filed: 08/27/2002
• Issued: 12/11/2007
• Est. Priority Date: 08/27/2002
• Status: Active Grant

• Current Assignee: Valtrus Innovations Limited (f/k/a Dolya Holdco 9 Limited) (Key Patent Innovations Limited)
• Original Assignee: 3Com Corporation (HP Inc.)
• Inventors: Wang, Chi-Lie, Hu, BaoDong, Mitchell, Scott W.
• Primary Examiner(s): Pham, Chi
• Assistant Examiner(s): HOM, SHICK C
• Application Number:
  US10/229,361
• Time in Patent Office: 1,932 Days
• Field of Search: 370/233, 370/234, 370/412, 370/413, 370/414, 370/415, 370/416, 370/417, 370/418, 370/419, 710/52, 710/56, 710/57, 711/117, 711/118, 711/126
• US Class Current: 370/412
• CPC Class Codes: H04L 49/90 Buffering arrangements
• CPC Class Codes: H04L 49/9052 with buffers of different sizes
• CPC Class Codes: H04L 49/9063 Intermediate storage in different physical parts of a node or terminal

Abstract

A network interface comprises the first port on which incoming data is transmitted and received at the data transfer rate of the network, a buffer memory coupled to the first port, and a second port coupled with the buffer memory, and through which transfer of packets between the host system, and the buffer memory is executed. A driver in the host system allocates a plurality of sets of receive buffers, where each set of receive buffers is composed of receive buffers having different sizes. A receive buffer descriptor cache located at the interface level stores receive buffer descriptors corresponding to receive buffers in the plurality of sets. As incoming packets arrive at the interface, logic determines the size of the incoming packet and assigns the packet to a receive buffer descriptor in the receive buffer descriptor cache according to the determined size. Upload logic at the interface level manages the uploading of packets from the buffer memory to the host system using the assigned receive buffer descriptors. A driver in the host dynamically adjusts the sizes of receive buffers in response to statistics about packet size.

Claims

1. An interface in which packets are transferred between a network medium and a host system, comprising:

a first port adapted to be coupled to the network medium;

a second port adapted to be coupled to the host system;

buffer memory, coupled to the first and second ports, storing packets in transit between the first and second ports;

a receive buffer descriptor cache storing a plurality of sets of receive buffer descriptors, each set corresponding with a corresponding set of receive buffers, the sets of receive buffers including buffers allocated for storage of received packets, the receive buffer descriptors in a first one of said sets of receive buffer descriptors corresponding buffers having a buffer size specified according to a maximum packet size parameter, and the receive buffer descriptors in a second one of said sets of receive buffer descriptors corresponding buffers having a buffer size specified according to an intermediate packet size parameter smaller than said maximum;

logic, coupled with the buffer memory, to assign packets stored in the buffer memory to a receive buffer descriptor in one of said sets of receive buffer descriptors according to packet size; and

upload logic coupled to the buffer memory to manage uploading packets using the assigned receive buffer descriptors.

2. The interface of claim 1, including:

logic to determine the packet sizes of packets stored in the buffer memory.

3. The interface of claim 1, including logic to determine an average packet size over a set of packets received in the interface, and to report the average packet size to the host system.

4. The interface of claim 1, wherein said interface operates according to a network protocol having a maximum standard packet size and a maximum jumbo packet size larger than the maximum standard packet size, and the receive buffer descriptors in a third one of said sets of receive buffer descriptors corresponding buffers having a buffer size specified according to a maximum jumbo packet size parameter, and the receive buffer descriptors in a fourth one of said sets of receive buffer descriptors corresponding buffers having a buffer size specified according to a jumbo intermediate packet size parameter smaller than said maximum jumbo packet size parameter.

5. The interface of claim 1, wherein said interface operates according to a network protocol having a standard maximum packet size, and including:

logic to determine a first average size of incoming packets having a packet size less than or equal to said maximum standard packet size, and to determine a second average size of incoming packets having a packet size greater than said maximum standard packet size; and

logic to report the first and second average packet sizes to the host system.

6. The interface of claim 1, wherein said interface operates according to a network protocol having a maximum standard packet size corresponding to said maximum packet size, and a maximum jumbo packet size larger than the maximum standard packet size, and the receive buffer descriptors in a third one of said sets of receive buffer descriptors corresponding buffers having a buffer size specified according to a maximum jumbo packet size parameter, and the receive buffer descriptors in a fourth one of said sets of receive buffer descriptors corresponding buffers having a buffer size specified according to an average jumbo packet size parameter;

and including;

logic to determine a first average size of incoming packets having a packet size less than or equal to said maximum standard packet size and greater than a minimum valid packet size, and to determine a second average size of incoming packets having a packet size greater than said maximum standard packet size and less than or equal to said maximum jumbo packet size; and

logic to report the first and second average packet sizes to the host system.

7. The interface of claim 1, including logic to determine an average packet size over a set of packets received in the interface, and to report the average packet size to the host system, and wherein said intermediate packet size parameter is based on said average packet size.

8. A method for managing an interface in which packets are transferred through a buffer memory between a network medium and a host system, comprising:

providing a receive buffer descriptor cache in the interface storing a plurality of sets of receive buffer descriptors, each set corresponding with a corresponding set of receive buffers accessible via the host system, the sets of receive buffers including buffers allocated for storage of received packets, the receive buffer descriptors in a first one of said sets of receive buffer descriptors corresponding to receive buffers having a buffer size specified according to a maximum packet size parameter, and the receive buffer descriptors in a second one of said sets of receive buffer descriptors corresponding receive buffers having a buffer size specified according to an intermediate packet size parameter smaller than said maximum;

assigning packets stored in the buffer memory to a receive buffer descriptor in one of said sets of receive buffer descriptors according to packet size; and

uploading said packets using the assigned receive buffer descriptors.

9. The method of claim 8, including determining an average packet size over a set of packets received in the interface, and reporting the average packet size to the host system.

10. The method of claim 8, including classifying incoming packets into a plurality of classes according to size, and counting the number of packets in each class.

11. The method of claim 8, wherein said interface operates according to a network protocol having a maximum standard packet size and a maximum jumbo packet size larger than the maximum standard packet size;

the receive buffer descriptors in a third one of said sets of receive buffer descriptors corresponding buffers having a buffer size specified according to a maximum jumbo packet size parameter, and the receive buffer descriptors in a fourth one of said sets of receive buffer descriptors corresponding buffers having a buffer size specified according to a jumbo intermediate packet size parameter smaller than said maximum jumbo packet size parameter.

12. The method of claim 8, wherein said interface operates according to a network protocol having a maximum standard packet size, and including:

determining a first average size of incoming packets having a packet size less than or equal to said maximum standard packet size, and to determine a second average size of incoming packets having a packet size greater than said maximum standard packet size; and

reporting the first and second average packet sizes to the host system.

13. The method of claim 8, wherein said interface operates according to a network protocol having a maximum standard packet size corresponding to said maximum packet size, and a maximum jumbo packet size larger than the maximum standard packet size, and the receive buffer descriptors in a third one of said sets of receive buffer descriptors corresponding to receive buffers having a buffer size specified according to a maximum jumbo packet size parameter, and the receive buffer descriptors in a fourth one of said sets of receive buffer descriptors corresponding to receive buffers having a buffer size specified according to an average jumbo packet size parameter;

and including;

determining a first average size of incoming packets having a packet size less than or equal to said maximum standard packet size, and to determine a second average size of incoming packets having a packet size greater than said maximum standard packet size and less than or equal to said maximum jumbo packet size; and

reporting the first and second average packet sizes to the host system.

14. The method of claim 8, including determining an average packet size over a set of packets received in the interface, and to report the average packet size to the host system, and wherein said intermediate packet size parameter is based on said average packet size.

15. An integrated circuit for an interface in which packets are transferred between a network medium and a host system, the integrated circuit comprising:

medium access control (MAC) unit through which data transferred at a data transfer rate of 100 Megabits per second or higher;

a port through which data is transferred;

buffer memory, coupled to the MAC unit and the port, storing packets in transit between the network medium and the port;

a receive buffer descriptor cache storing a plurality of sets of receive buffer descriptors, each set corresponding with a corresponding set of receive buffers, the sets of receive buffers including buffers allocated for storage of received packets, the receive buffer descriptors in a first one of said sets of receive buffer descriptors corresponding buffers having a buffer size specified according to a maximum packet size parameter, and the receive buffer descriptors in a second one of said sets of receive buffer descriptors corresponding buffers having a buffer size specified according to an intermediate packet size parameter smaller than said maximum;

logic, coupled with the buffer memory, to assign packets stored in the buffer memory to a receive buffer descriptor in one of said sets of receive buffer descriptors according to packet size; and

upload logic coupled to the buffer memory to manage uploading packets using the assigned receive buffer descriptors.

16. The integrated circuit of claim 15, including:

logic to determine the packet sizes of packets stored in the buffer memory.

17. The integrated circuit of claim 15, including logic to determine an average packet size over a set of packets received in the interface, and to report the average packet size to the host system.

18. The integrated circuit of claim 15, wherein said interface operates according to a network protocol having a maximum standard packet size and a maximum jumbo packet size larger than the maximum standard packet size, and the receive buffer descriptors in a third one of said sets of receive buffer descriptors corresponding to receive buffers having a buffer size specified according to a maximum jumbo packet size parameter, and the receive buffer descriptors in a fourth one of said sets of receive buffer descriptors corresponding to receive buffers having a buffer size specified according to a jumbo intermediate packet size parameter smaller than said maximum jumbo packet size parameter.

19. The integrated circuit of claim 15, wherein said interface operates according to a network protocol having a standard maximum packet size, and including:

logic to determine a first average size of incoming packets having a packet size less than or equal to said maximum standard packet size, and to determine a second average size of incoming packets having a packet size greater than said maximum standard packet size; and

logic to report the first and second average packet sizes to the host system.

20. The integrated circuit of claim 15, wherein said interface operates according to a network protocol having a maximum standard packet size corresponding to said maximum

packet size, and a maximum jumbo packet size larger than the maximum standard packet size, and the receive buffer descriptors in a third one of said sets of receive buffer descriptors corresponding to receive buffers having a buffer size specified according to a maximum jumbo packet size parameter, and the receive buffer descriptors in a fourth one of said sets of receive buffer descriptors corresponding to receive buffers having a buffer size specified according to an average jumbo packet size parameter;

and including;

logic to determine a first average size of incoming packets having a packet size less than or equal to said maximum standard packet size, and to determine a second average size of incoming packets having a packet size greater than said maximum standard packet size and less than or equal to said maximum jumbo packet size; and

logic to report the first and second average packet sizes to the host system.

21. The integrated circuit of claim 15, including logic to determine an average packet size over a set of packets received in the interface, and to report the average packet size to the host system, and wherein said intermediate packet size parameter is based on said average packet size.

22. A method for managing an interface in which packets are transferred through a buffer memory between a network medium and a host system, comprising:

establishing a plurality of sets of receive buffers in the host system, each set of receive buffers including receive buffers having a buffer size specified for the set;

providing a cache memory having receive buffer descriptors corresponding to receive buffers in said plurality of sets in the host system;

storing packets received at the interface from the network medium in a buffer memory;

determining a size for the received packets, and assigning the received packets to one of the receive buffer descriptors in the cache memory according to the determined size;

classifying incoming packets into a plurality of classes according to size, and counting the number of packets in each class; and

using the assigned receive buffer descriptor to make packets available from the buffer memory.

23. The method of claim 22, including maintaining lists of receive buffer descriptors in the host system for said plurality of sets of receive buffers.

24. The method of claim 22, wherein said receive buffer descriptors comprise an address field for holding an address for a corresponding receive buffer in the host system, a data length field for holding a value indicating a length of a packet assigned to the entry, and a pointer field for holding a pointer to the assigned packet in the buffer memory.

25. The method of claim 22, including:

maintaining lists of receive buffer descriptors in the host system for said plurality of sets of receive buffers; and

storing a plurality of lists of receive buffer descriptors in said cache memory, the plurality of lists of receive buffer descriptors corresponding to said lists in the host system.

26. The method of claim 22, including:

maintaining statistics concerning packet size, and dynamically updating buffer sizes for at least one set of receive buffers in the plurality of sets.

27. The method of claim 22, including:

said cache memory comprises a receive buffer descriptor cache in the interface storing a plurality of sets of receive buffer descriptors, each set corresponding with a corresponding to a set of receive of receive buffers in the host system, the receive buffer descriptors in a first one of said sets of receive buffer descriptors corresponding to a set of receive buffers having a buffer size specified according to a maximum packet size parameter, and the receive buffer descriptors in a second one of said sets of receive buffer descriptors corresponding to a set of receive buffers having a buffer size specified according to an intermediate packet size parameter smaller than said maximum.

28. The method of claim 22, including determining an average packet size over a set of packets received in the interface, and reporting the average packet size to the host system.

29. The method of claim 22, wherein said interface operates according to a network protocol having a maximum standard packet size and a maximum jumbo packet size larger than the maximum standard packet size;

said cache memory comprises a receive buffer descriptor cache in the interface storing a plurality of sets of receive buffer descriptors, each set corresponding with a corresponding set of receive buffers accessible in the host system, the receive buffer descriptors in a first one of said sets of receive buffer descriptors corresponding to a set of receive buffers having a buffer size specified according to a maximum packet size parameter, and the receive buffer descriptors in a second one of said sets of receive buffer descriptors corresponding to a set of receive buffers having a buffer size specified according to an intermediate packet size parameter smaller than said maximum, the receive buffer descriptors in a third one of said sets of receive buffer descriptors corresponding to a set of receive buffers having a buffer size specified according to a maximum jumbo packet size parameter, and the receive buffer descriptors in a fourth one of said sets of receive buffer descriptors corresponding to a set of receive buffers having a buffer size specified according to a jumbo intermediate packet size parameter smaller than said maximum jumbo packet size parameter.

30. The method of claim 22, wherein said interface operates according to a network protocol having a standard maximum packet size, and including:

determining a first average size of incoming packets having a packet size less than or equal to said maximum standard packet size, and to determine a second average size of incoming packets having a packet size greater than said maximum standard packet size; and

reporting the first and second average packet sizes to the host system.

31. The method of claim 22, wherein said interface operates according to a network protocol having a maximum standard packet size corresponding to said maximum packet size, and a maximum jumbo packet size larger than the maximum standard packet size, and said cache memory comprises a receive buffer descriptor cache in the interface storing a plurality of sets of receive buffer descriptors, each set corresponding with a corresponding set of receive buffers accessible in the host system, the receive buffer descriptors in a first one of said sets of receive buffer descriptors corresponding to a set of receive buffers having a buffer size specified according to a maximum packet size parameter, and the receive buffer descriptors in a second one of said sets of receive buffer descriptors corresponding to a set of receive buffers having a buffer size specified according to an intermediate packet size parameter smaller than said maximum, the receive buffer descriptors in a third one of said sets of receive buffer descriptors corresponding to a set of receive buffers having a buffer size specified according to a maximum jumbo packet size parameter, and the receive buffer descriptors in fourth one of said sets of receive buffer descriptors corresponding to a set of receive buffers having a buffer size specified according to an average jumbo packet size parameter;

and including;

determining a first average size of incoming packets having a packet size less than or equal to said maximum standard packet size and greater than a minimum valid packet size, and to determine a second average size of incoming packets having a packet size greater than said maximum standard packet size and less than or equal to said maximum jumbo packet size;

reporting the first and second average packet sizes to the host system; and

updating the buffer sizes in sets of receive buffers corresponding to said second and fourth sets of receive buffer descriptors in response to said first and second averages.

32. The method of claim 22, including determining an average packet size over a set of packets received in the interface, and reporting the average packet size to the host system, and wherein said buffer size for one of said sets of receive buffers is based on said average packet size.

33. A data processing system, comprising:

a processor;

host memory;

a plurality of sets of receive buffers in the host memory, each set of receive buffers including receive buffers having a buffer size specified for the set;

a host bus system coupled to the processor and the host memory;

a network interface coupled to the host bus system, in which packets are transferred between a network medium and a host bus system, the network interface including;

a first port adapted to be coupled to the network medium;

a second port adapted to be coupled to the host bus system;

buffer memory, having an incoming data path coupled to the first port, storing packets in transit between the first and second ports;

cache memory in the interface, the cache memory having receive buffer descriptors corresponding to said sets of receive buffers in the host system, said cache memory comprising a receive buffer descriptor cache in the interface storing a plurality of sets of receive buffer descriptors, each set corresponding to a set of receive buffers, the receive buffer descriptors in a first one of said sets of receive buffer descriptors corresponding to a set of receive buffers having a buffer size specified according to a maximum packet size parameter, and the receive buffer descriptors in a second one of said sets of receive buffer descriptors corresponding to a set of receive buffers having a buffer size specified according to an intermediate packet size parameter smaller than said maximum;

logic to determine a size for received packets, and to assign the received packets to one of the receive buffer descriptors in the cache memory according to the determined size; and

logic to upload packets to the host system from the buffer memory using the receive buffer descriptor corresponding to the assigned entry in the cache memory.

34. The data processing system of claim 33, including a driver maintaining lists of receive buffer descriptors in the host system for said plurality of sets of receive buffers.

35. The data processing system of claim 33, wherein said receive buffer descriptors comprise an address field for holding an address for a corresponding receive buffer in the host system, a data length field for holding a value indicating a length of a packet assigned to the entry, and a pointer field for holding a pointer to the assigned packet in the buffer memory.

36. The data processing system of claim 33, including:

a driver maintaining lists of receive buffer descriptors in the host system for said plurality of sets of receive buffers; and

cache management logic storing a plurality of lists of receive buffer descriptors in said cache memory, the plurality of lists of receive buffer descriptors corresponding to said lists in the host system.

37. The data processing system of claim 33, including:

logic maintaining statistics concerning packet size, and dynamically updating buffer sizes for at least one set of receive buffers in the plurality of sets.

38. The data processing system of claim 33, including logic determining an average packet size over a set of packets received in the interface, and reporting the average packet size to the host system.

39. The data processing system of claim 33, including logic classifying incoming packets into a plurality of classes according to size, and counting the number of packets in each class.

40. The data processing system of claim 33, wherein said interface operates according to a network protocol having a maximum standard packet size and a maximum jumbo packet size larger than the maximum standard packet size;

said cache memory comprises a receive buffer descriptor cache in the interface storing a plurality of sets of receive buffer descriptors, each set corresponding with a corresponding set of receive buffers accessible in the host system, the receive buffer descriptors in a first one of said sets of receive buffer descriptors corresponding to a set of receive buffers having a buffer size specified according to a maximum packet size parameter, and the receive buffer descriptors in a second one of said sets of receive buffer descriptors corresponding to a set of receive buffers having a buffer size specified according to an intermediate packet size parameter smaller than said maximum, the receive buffer descriptors in a third one of said sets of receive buffer descriptors corresponding to a set of receive buffers having a buffer size specified according to a maximum jumbo packet size parameter, and the receive buffer descriptors in a fourth one of said sets of receive buffer descriptors corresponding to a set of receive buffers having a buffer size specified according to a jumbo intermediate packet size parameter smaller than said maximum jumbo packet size parameter.

41. The data processing system of claim 33, wherein said interface operates according to a network protocol having a standard maximum packet size, and including:

logic determining a first average size of incoming packets having a packet size less than or equal to said maximum standard packet size, and to determine a second average size of incoming packets having a packet size greater than said maximum standard packet size; and

logic reporting the first and second average packet sizes to the host system.

42. The data processing system of claim 33, wherein said interface operates according to a network protocol having a maximum standard packet size corresponding to said maximum packet size, and a maximum jumbo packet size larger than the maximum standard packet size, and said cache memory comprises a receive buffer descriptor cache in the interface storing a plurality of sets of receive buffer descriptors, each set corresponding with a corresponding set of receive buffers accessible in the host system, the receive buffer descriptors in a first one of said sets of receive buffer descriptors corresponding to a set of receive buffers having a buffer size specified according to a maximum packet size parameter, and the receive buffer descriptors in a second one of said sets of receive buffer descriptors corresponding to a set of receive buffers having a buffer size specified according to an intermediate packet size parameter smaller than said maximum, the receive buffer descriptors in a third one of said sets of receive buffer descriptors corresponding to a set of receive buffers having a buffer size specified according to a maximum jumbo packet size parameter, and the receive buffer descriptors in fourth one of said sets of receive buffer descriptors corresponding to a set of receive buffers having a buffer size specified according to an average jumbo packet size parameter;

and including;

logic determining a first average size of incoming packets having a packet size less than or equal to said maximum standard packet size and greater than a minimum valid packet size, and to determine a second average size of incoming packets having a packet size greater than said maximum standard packet size and less than or equal to said maximum jumbo packet size; and

logic reporting the first and second average packet sizes to the host system; and

a driver in the host system updating the buffer sizes in sets of receive buffers corresponding to said second and fourth sets of receive buffer descriptors in response to said first and second averages.

43. The data processing system of claim 33, including logic in the interface determining an average packet size over a set of packets received in the interface, and reporting the average packet size to the host system, and wherein said buffer size for one of said sets of receive buffers is based on said average packet size.

44. A computer program stored in machine readable form, executable by a processor for allocating receive buffers for a network interface, comprising:

logic to allocate receive buffers for packets incoming from the network interface, the receive buffers having locations and sizes specified by a plurality of sets of receive buffer descriptors, each set corresponding to a set of receive buffers, the receive buffer descriptors in a first one of said sets of receive buffer descriptors corresponding to a set of receive buffers having a buffer size specified according to a maximum packet size parameter, and the receive buffer descriptors in a second one of said sets of receive buffer descriptors corresponding to a set of receive buffers having a buffer size specified according to an intermediate packet size parameter smaller than said maximum; and

logic to dynamically update the sizes of the allocated receive buffers based on statistics related to packets being received through the network interface.

45. A data processing system, comprising:

a processor;

host memory;

a host bus system coupled to the processor and the host memory;

a receive buffer descriptor cache storing a plurality of sets of receive buffer descriptors, each set corresponding with a corresponding set of receive buffers, the sets of receive buffers including buffers allocated for storage of received packets, the receive buffer descriptors in a first one of said sets of receive buffer descriptors corresponding buffers having a buffer size specified according to a maximum packet size parameter, and the receive buffer descriptors in a second one of said sets of receive buffer descriptors corresponding buffers having a buffer size specified according to an intermediate packet size parameter smaller than said maximum;

logic to allocate receive buffers in host memory for packets incoming from the network interface, the receive buffers having locations and sizes specified by receive buffer descriptors; and

logic to dynamically update the sizes of the allocated receive buffers based on statistics related to packets being received through the network interface.