Methods and apparatus for flow-controllable multi-staged queues

• US 9,876,725 B2
• Filed: 02/23/2015
• Issued: 01/23/2018
• Est. Priority Date: 09/11/2008
• Status: Active Grant

• Current Assignee: Juniper Networks Incorporated
• Original Assignee: Juniper Networks Incorporated
• Inventors: Godbole, Avanindra, Sindhu, Pradeep, Frailong, Jean-Marc
• Primary Examiner(s): YAO, KWANG BIN
• Assistant Examiner(s): Loo, Juvena
• Application Number:
  US14/628,726
• Publication Number:
  US 20150172196A1
• Time in Patent Office: 1,065 Days
• Field of Search: None
• CPC Class Codes: H04L 47/10 Flow control; Congestion control
• CPC Class Codes: H04L 47/11 Identifying congestion
• CPC Class Codes: H04L 47/26 using explicit feedback to the source, e.g. choke packets
• CPC Class Codes: H04L 47/263 Rate modification at the source after receiving feedback
• CPC Class Codes: H04L 47/266 Stopping or restarting the source, e.g. X-on or X-off
• CPC Class Codes: H04L 47/30 in combination with information about buffer occupancy at either end or at transit nodes
• CPC Class Codes: H04L 47/50 Queue scheduling
• CPC Class Codes: H04L 47/60 implementing hierarchical scheduling
• CPC Class Codes: H04L 49/505 Corrective measures
• CPC Class Codes: H04L 49/90 Buffering arrangements

Abstract

In one embodiment, a method includes sending a first flow control signal to a first stage of transmit queues when a receive queue is in a congestion state. The method also includes sending a second flow control signal to a second stage of transmit queues different from the first stage of transmit queues when the receive queue is in the congestion state.

Claims

1. A method, comprising:

sending a first flow control signal based on data flow within a first flow control loop including (1) a first stage of transmit queues fanning into a second stage of transmit queues, (2) the second stage of transmit queues fanning into a physical link, and (3) the physical link;

defining a second flow control signal based on data flow within a second flow control loop including (1) the second stage of transmit queues, and (2) the physical link, and excluding the first stage of transmit queues, the second flow control signal including instructions to suspend transmission at a transmit queue from the second stage of transmit queues; and

sending the second flow control signal such that the transmit queue from the second stage of transmit queues suspends transmission in response to the second flow control,

the first flow control signal includes an identifier of a transmit queue from the first stage of transmit queues and a suspension time value associated with the identifier of the transmit queue from the first stage of transmit queues,

the suspension time value being based on a first request to suspend transmission at a receive queue associated with the first stage of transmit queues and a second request to suspend transmission at the receive queue.

2. The method of claim 1, further comprising:

defining a third flow control signal based on data flow associated with a third flow control loop including the physical link and excluding the first stage of transmit queues and the second stage of transmit queues.

3. The method of claim 1, wherein the second flow control loop is a priority-based flow control loop.

4. The method of claim 1, wherein the first stage of transmit queues includes a transmit queue at a first interface card and a transmit queue at a second interface card, the transmit queue at the first interface card and the transmit queue at the second interface card fanning into a transmit queue included in the second stage of transmit queues.

5. The method of claim 1, wherein the first flow control signal includes a layer-2 flow control packet, the first flow control signal being associated with a layer-2 device.

6. The method of claim 1, wherein:

the suspension time is an average of a time period associated with the first request and a time period associated with the second request.

7. A non-transitory, processor-readable medium storing code representing instructions to be executed by a processor, the code comprising code to cause the processor to:

send a first flow control signal based on data flow within a first flow control loop including (1) a first stage of transmit queues fanning into a second stage of transmit queues, (2) the second stage of transmit queues fanning into a physical link, and (3) the physical link;

define a second flow control signal based on data flow within a second flow control loop including (1) the second stage of transmit queues, and (2) the physical link, and excluding the first stage of transmit queues, the second flow control signal including instructions to suspend transmission at a transmit queue from the second stage of transmit queues; and

send the second flow control signal such that the transmit queue from the second stage of transmit queues suspends transmission in response to the second flow control,

the first flow control signal includes an identifier of a transmit queue from the first stage of transmit queues and a suspension time value associated with the identifier of the transmit queue from the first stage of transmit queues,

the suspension time value being based on a first request to suspend transmission at as receive queue associated with the first stage of transmit queues and a second request to suspend transmission at the receive queue.

8. The non-transitory, processor-readable medium of claim 7, wherein:

the suspension time is an average of a time period associated with the first request and a time period associated with the second request.

9. The non-transitory, processor-readable medium of claim 7, wherein:

the suspension time is a time period associated with the first request when the time period associated with the first request is greater than a time period associated with the second request.

10. The non-transitory, processor-readable medium of claim 7, wherein:

the code further comprises code to cause the processor to delay defining the first flow control signal for a wait time period, the first request and the second request being received within the wait time period.

11. The non-transitory, processor-readable medium of claim 7, wherein the first stage of transmit queues includes a transmit queue at a first interface card and a transmit queue at a second interface card, the transmit queue at the first interface card and the transmit queue at the second interface card fanning into a transmit queue included in the second stage of transmit queues.

12. The non-transitory, processor-readable medium of claim 7, wherein the first flow control signal includes a layer-2 flow control packet, the first flow control signal being associated with a layer-2 device.

13. A non-transitory, processor-readable medium storing code representing instructions to be executed by a processor, the code comprising code to cause the processor to:

send a first flow control signal based on data flow within a first flow control loop including (1) a first stage of transmit queues fanning into a second stage of transmit queues, (2) the second stage of transmit queues fanning into a physical link, and (3) the physical link;

define a second flow control signal based on data flow within a second flow control loop including (1) the second stage of transmit queues, and (2)the physical link, and excluding the first stage of transmit queues, the second flow control signal including instructions to suspend transmission at a transmit queue from the second stage of transmit queues; and

send the second flow control signal such that the transmit queue from the second stage of transmit queues suspends transmission in response to the second flow control,

the first flow control loop includes (1) a first stage of receive queues fanning into a second stage of receive queues, and (2) the second stage of receive queues fanning into the physical link, and

the second flow control loop includes the second stage of receive queues and does not include the first stage of receive queues.

14. The non-transitory, processor-readable medium of claim 13, wherein:

the first flow control signal includes an identifier of a transmit queue from the first stage of transmit queues and a suspension time value associated with the identifier of the transmit queue from the first stage of transmit queues,

the suspension time value being based on a first request to suspend transmission at a receive queue associated with the first stage of transmit queues and a second request to suspend transmission at the receive queue.

15. The non-transitory, processor-readable medium of claim 13, wherein

the first flow control signal includes an identifier of a transmit queue from the first stage of transmit queues and a suspension time value associated with the identifier of the transmit queue from the first stage of transmit queues,

the suspension time value being based on a first request to suspend transmission at a receive queue associated with the first stage of transmit queues and a second request to suspend transmission at the receive queue, and

the suspension time is an average of a time period associated with the first request and a time period associated with the second request.

16. The non-transitory, processor-readable medium of claim 13, wherein:

the first flow control signal includes an identifier of a transmit queue from the first stage of transmit queues and a suspension time value associated with the identifier of the transmit queue from the first surge of transmit queues,

the suspension time value being based on a first request to suspend transmission at a receive queue associated with the first stage of transmit queues and a second request to suspend transmission at the receive queue, and

the suspension time is a time period associated with the first request when the time period associated with the first request is greater than a time period associated with the second request.

17. The non-transitory, processor-readable medium of claim 13, wherein:

the first flow control signal includes an identifier of a transmit queue from the first stage of transmit queues and a suspension time value associated with the identifier of the transmit queue from the first stage of transmit queues,

the suspension time value being based on a first request to suspend transmission at a receive queue associated with the first stage of transmit queues and a second request to suspend transmission at the receive queue, and

the code further comprises code to cause the processor to delay defining the first flow control signal for a wait time period, the first request and the second request being received within the wait time period.

18. The non-transitory, processor-readable medium of claim 13, wherein the first stage of transmit queues includes a transmit queue at a first interface card and a transmit queue at a second interface card, the transmit queue at the first interface card and the transmit queue at the second interface card fanning into a transmit queue included in the second stage of transmit queues.

19. The non-transitory, processor-readable medium of claim 13, wherein the first flow control signal includes a layer-2 flow control packet, the first flow control signal being associated with a layer-2 device.