Methods and apparatus for flow-controllable multi-staged queues

• US 8,964,556 B2
• Filed: 07/09/2012
• Issued: 02/24/2015
• Est. Priority Date: 09/11/2008
• Status: Active Grant

• Current Assignee: Juniper Networks Incorporated
• Original Assignee: Juniper Networks Incorporated
• Inventors: Godbole, Avanindra, Sindhu, Pradeep, Frailong, Jean-Marc
• Primary Examiner(s): Yao, Kwang B
• Assistant Examiner(s): LOO, JUVENA W
• Application Number:
  US13/544,604
• Publication Number:
  US 20120275307A1
• Time in Patent Office: 960 Days
• Field of Search: 370229-2411, 370351-389
• US Class Current: 370/235
• CPC Class Codes: H04L 47/10 Flow control; Congestion control
• CPC Class Codes: H04L 47/11 Identifying congestion
• CPC Class Codes: H04L 47/26 using explicit feedback to the source, e.g. choke packets
• CPC Class Codes: H04L 47/263 Rate modification at the source after receiving feedback
• CPC Class Codes: H04L 47/266 Stopping or restarting the source, e.g. X-on or X-off
• CPC Class Codes: H04L 47/30 in combination with information about buffer occupancy at either end or at transit nodes
• CPC Class Codes: H04L 47/50 Queue scheduling
• CPC Class Codes: H04L 47/60 implementing hierarchical scheduling
• CPC Class Codes: H04L 49/505 Corrective measures
• CPC Class Codes: H04L 49/90 Buffering arrangements

Abstract

In one embodiment, a method includes sending a first flow control signal to a first stage of transmit queues when a receive queue is in a congestion state. The method also includes sending a second flow control signal to a second stage of transmit queues different from the first stage of transmit queues when the receive queue is in the congestion state.

Claims

1. An apparatus implemented in at least one of a memory or a processing device, comprising:

a first flow control module configured to send a first flow control signal based on data flow within a first flow control loop including (1) a first stage of transmit queues fanning into a second stage of transmit queues, (2) the second stage of transmit queues fanning into a physical link, and (3) the physical link; and

a second flow control module configured to define a second flow control signal based on data flow within a second flow control loop including (1) the second stage of transmit queues, and (2) the physical link, and excluding the first stage of transmit queues,

the second flow control module configured to send the second flow control signal such that a transmit queue from the second stage of transmit queues suspends transmission in response to the second flow control signal.

2. The apparatus of claim 1, further comprising:

a third flow control module configured to define a third flow control signal based on data flow associated with a third flow control loop including the physical link and excluding the first stage of transmit queues and the second stage of transmit queues.

3. The apparatus of claim 1, wherein the second flow control loop is a priority-based flow control loop.

4. The apparatus of claim 1, wherein the first stage of transmit queues includes a transmit queue at a first interface card and a transmit queue at a second interface card, the transmit queue at the first interface card and the transmit queue at the second interface card fanning into a transmit queue included in the second stage of transmit queues.

5. The apparatus of claim 1, wherein the first flow control signal includes a layer-2 flow control packet, the first flow control module being associated with a layer-2 device.

6. The apparatus of claim 1, wherein:

the first flow control signal includes an identifier of a transmit queue from the first stage of transmit queues and a suspension time value associated with the identifier of the transmit queue, and

the suspension time value being based on a first request to suspend transmission at a receive queue associated with the first stage of transmit queues and a second request to suspend transmission at the receive queue.

7. The apparatus of claim 1, wherein:

the first flow control signal includes an identifier of a transmit queue from the first stage of transmit queues and a suspension time value associated with the identifier of the transmit queue,

the suspension time value being based on a first request to suspend transmission at a receive queue associated with the first stage of transmit queues and a second request to suspend transmission at the receive queue, and

the suspension time is an average of a time period associated with the first request and a time period associated with the second request.

8. The apparatus of claim 1, wherein:

the first flow control signal includes an identifier of a transmit queue from the first stage of transmit queues and a suspension time value associated with the identifier of the transmit queue,

the suspension time value being based on a first request to suspend transmission at a receive queue associated with the first stage of transmit queues and a second request to suspend transmission at the receive queue, and

the suspension time value is a time period associated with the first request when the time period associated with the first request is greater than a time period associated with the second request.

9. The apparatus of claim 1, wherein:

the first flow control signal includes an identifier of a transmit queue from the first stage of transmit queues and a suspension time value associated with the identifier of the transmit queue,

the suspension time value being based on a first request to suspend transmission at a receive queue associated with the first stage of transmit queues and a second request to suspend transmission at the receive queue, and

the first flow control module configured to delay defining the first flow control signal for a wait time period, the first request and the second request being received within the wait time period.

10. The apparatus of claim 1, wherein:

the first flow control loop includes (1) a first stage of receive queues fanning into a second stage of receive queues, (2) the second stage of receive queues fanning into the physical link, and

the second flow control loop including the second stage of receive queues and excluding the first stage of receive queues.

11. A method, comprising:

defining a first flow control signal for a first stage of transmit queues based on a congestion state of a receive queue at a first time;

sending the first flow control signal to the first stage of transmit queues when the receive queue is in the congestion state at the first time;

defining a second flow control signal for a second stage of transmit queues different from the first stage of transmit queues based on the congestion state of the receive queue at a second time; and

sending the second flow control signal to the second stage of transmit queues when the receive queue is in the congestion state at the second time, the first stage of transmit queues including a first plurality of transmit queues that fan into a queue included in the second stage of transmit queues.

12. The method of claim 11, wherein the second stage of transmit queues includes a plurality of transmit queues that fan into a physical link different from the second stage of transmit queues and from the first stage of transmit queues.

13. The method of claim 11, wherein at least one transmit queue from the first plurality of transmit queues is at a first interface card, at least one transmit queue from the first plurality of transmit queues being at a second interface card.

14. The method of claim 11, wherein the second time is different than the first time.

15. The method of claim 11, wherein the first time corresponds to the second time.

16. The method of claim 11, wherein sending the first flow control signal is triggered in response to the receive queue changing from an available state to the congestion state prior to the first time, sending the second flow control signal being triggered in response to the receive queue changing from an available state to the congestion state prior to the second time.

17. An apparatus, comprising:

a first stage of transmit queues including a transmit queue at a first interface card and a transmit queue at a second interface card;

a second stage of transmit queues, the transmit queue at the first interface card and the transmit queue at the second interface card being fanned into a transmit queue included in the second stage of transmit queues; and

a control module configured to modify flow control for the first stage of transmit queues when a first flow control signal is received, the first flow control signal being associated with a first flow control loop including the first stage of transmit queues and the second stage of transmit queues,

the control module configured to modify flow control for the second stage of transmit queues when a second flow control signal is received, the second flow control signal being associated with a second flow control loop including the second stage of transmit queues and excluding the first stage of transmit queues.

18. The apparatus of claim 17, wherein the second stage of transmit queues includes a plurality of transmit queues that fan into a physical link, the first flow control loop and the second flow control loop each includes the physical link.

19. The apparatus of claim 17, wherein the second stage of transmit queues includes a plurality of transmit queues that fan into a physical link, the control module configured to modify flow control for the physical link when a third flow control signal is received, the third flow control signal being associated with a third flow control loop including the physical link and excluding the first stage of transmit queues and the second stage of transmit queues.

20. The apparatus of claim 17, wherein the first flow control signal is based on a layer-2 protocol.