Network per-flow rate limiting

• US 9,769,074 B2
• Filed: 03/15/2013
• Issued: 09/19/2017
• Est. Priority Date: 03/15/2013
• Status: Active Grant

• Current Assignee: Beijing Zitiao Network Technology Company Limited (ByteDance Ltd.)
• Original Assignee: International Business Machines Corporation
• Inventors: DeCusatis, Casimer, Krishnamurthy, Rajaram B.
• Primary Examiner(s): Crutchfield, Christopher
• Assistant Examiner(s): LINDENBAUM, ALAN LOUIS
• Application Number:
  US13/833,886
• Publication Number:
  US 20140269319A1
• Time in Patent Office: 1,649 Days
• Field of Search: None
• CPC Class Codes: H04L 43/0882 Utilisation of link capacity
• CPC Class Codes: H04L 47/12 Avoiding congestion; Recovering from congestion

Abstract

A method of monitoring data flow in a network is provided. The method includes: configuring a data flow including a plurality of data packets by a switch controller, the switch controller configured to control routing through the switch and switch configuration, wherein configuring includes storing an indication of a flow control policy in one or more of the data packets; monitoring a network switch receiving the data flow, wherein monitoring includes determining flow statistics in the switch; determining whether a congestion condition exists for the data flow based on the flow statistics and the flow control policy; and based on determining that the congestion condition exists for the data flow, performing a remedial action specific to the data flow to address the congestion condition.

Claims

1. A method of monitoring data flow in a network, comprising:

configuring a data flow including a plurality of data packets by a switch controller, the data flow received from a source and configured to be routed through one or more switches in a network to a destination, the switch controller configured to control routing of the data flow through a network switch, wherein configuring includes associating the data flow with a quality of service (QoS) flow control policy selected from a plurality of QoS flow control policies, each QoS flow control policy associated with one of a plurality of pre-set flow control levels, and storing an indication of a selected pre-set flow control level in one or more of the data packets of the data flow, each pre-set flow control level defining a threshold value of a flow statistic, wherein a value of the flow statistic exceeding the threshold value is indicative of a congestion condition;

storing the selected QoS flow control policy in a flow control queue in the network switch that is separate from ingress and egress queues and from a flow table of the switch, the flow control queue associating the selected QoS flow control policy with the data flow, the flow control queue configured to associate one or more of the plurality of QoS flow control policies with each specific data flow received by the switch;

monitoring the network switch receiving the data flow, wherein monitoring includes determining the value of the flow statistic in the switch associated with the data flow;

determining whether a congestion condition exists for the data flow based on comparing the value of the flow statistic and the threshold value defined by the pre-set flow control level associated with the selected QoS flow control policy; and

based on determining that the congestion condition exists for the data flow, performing a remedial action specific to the data flow to address the congestion condition.

2. The method of claim 1, wherein monitoring includes determining flow statistics for a plurality of data flows in the network switch.

3. The method of claim 2, wherein the remedial action is performed for one or more data flows whose flow statistics exceed the threshold.

4. The method of claim 1, wherein the flow statistic includes at least one of a queue depth statistic, an ingress queue flow rate and an egress queue flow rate.

5. The method of claim 1, wherein performing the remedial action includes at least one of rate-limiting the data flow, turning off the data flow in the switch, and re-routing the data flow.

6. The method of claim 1, wherein the indication of the selected pre-set flow control level is stored as data in a header of the one or more data packets.

7. A method of processing data flows in a network switch, comprising:

receiving a data flow at the network switch, the data flow including a plurality of data packets, the data flow received from a source and configured to be routed through one or more switches in a network to a destination, wherein one or more of the data packets includes an indication of a selected pre-set flow control level associated with a quality of service (QoS) flow control policy selected from a plurality of QoS flow control policies, each QoS flow control policy associated with one of a plurality of pre-set flow control levels, each pre-set flow control level defining a threshold value of a flow statistic, wherein a value of the flow statistic exceeding the threshold value is indicative of a congestion condition, the indication inserted into the one or more data packets by a switch controller;

storing the indication of the QoS flow control policy in a flow control queue in the network switch that is separate from ingress and egress queues and from a flow table of the switch, the flow control queue associating the selected QoS flow control policy with the data flow, the flow control queue configured to associate one or more of the plurality of QoS flow control policies with each specific data flow received by the switch; and

processing the data flow at the network switch according to instructions associated with the data flow and configured by a switch controller.

8. The method of claim 7, further comprising, based on the switch controller determining that the specified flow statistic for the data flow exceeds the threshold, receiving an instruction to perform a remedial action on the data flow.

9. The method of claim 8, wherein the remedial action includes at least one of adjusting a flow rate of the data flow, re-routing the data flow, and turning off the data flow.

10. The method of claim 7, wherein storing includes extracting the indication of the selected QoS flow control policy from a header of the one or more data packets and storing the indication with an identification of the data flow.

11. The method of claim 7, wherein the flow control queue is configured to store a plurality of QoS flow control policy indications, each QoS flow control policy indication associated with an identification of a different data flow being processed in the network switch.

12. A computer program product for monitoring data flow in a network, the computer program product comprising:

a non-transitory tangible storage medium readable by a processing circuit and storing instructions for execution by the processing circuit for performing a method comprising;

configuring a data flow including a plurality of data packets by a switch controller, the data flow received from a source and configured to be routed through one or more switches in a network to a destination, the switch controller configured to control routing of the data flow through a network switch, wherein configuring includes associating the data flow with a quality of service (QoS) flow control policy selected from a plurality of QoS flow control policies, each QoS flow control policy associated with one of a plurality of pre-set flow control levels, and storing an indication of a selected pre-set flow control level in one or more of the data packets of the data flow, each pre-set flow control level defining a threshold value of a flow statistic, wherein a value of the flow statistic exceeding the threshold value is indicative of a congestion condition;

storing the selected QoS flow control policy in a flow control queue in the network switch that is separate from ingress and egress queues and from a flow table of the switch, the flow control queue associating the selected QoS flow control policy with the data flow, the flow control queue configured to associate one or more of the plurality of QoS flow control policies with each specific data flow received by the switch controller;

monitoring the network switch receiving the data flow, wherein monitoring includes determining the value of the flow statistic in the switch;

determining whether a congestion condition exists for the data flow based on comparing the value of the flow statistic and the threshold value defined by the pre-set flow control level associated with the selected QoS flow control policy; and

based on determining that the congestion condition exists for the data flow, performing a remedial action specific to the data flow to address the congestion condition.

13. The computer program product of claim 12, wherein the flow control queue includes an indication of a QoS flow control policy specific to each data flow, the indication retrieved from data in a header of the one or more data packets.

14. The computer program product of claim 13, wherein the remedial action is performed for one or more data flows whose flow statistics exceed the threshold.

15. The computer program product of claim 12, wherein the network switch is an OpenFlow switch and the switch controller is an OpenFlow switch controller.

16. The computer program product of claim 12, wherein performing the remedial action includes at least one of rate-limiting the data flow, turning off the data flow in the switch, and re-routing the data flow.

17. A computer program product for processing data flows in a network switch, the computer program product comprising:

a non-transitory tangible storage medium readable by a processing circuit and storing instructions for execution by the processing circuit for performing a method comprising;

receiving a data flow at the network switch, the data flow including a plurality of data packets, the data flow received from a source and configured to be routed through one or more switches in a network to a destination, wherein one or more of the data packets includes an indication of a selected pre-set flow control level associated with a quality of service (QoS) flow control policy selected from a plurality of QoS flow control policies, each QoS flow control policy associated with one of a plurality of pre-set flow control levels, each pre-set flow control level defining a threshold value of a flow statistic, wherein a value of the flow statistic exceeding the threshold value is indicative of a congestion condition the indication inserted into the one or more data packets by a switch controller;

storing the indication of the QoS flow control policy in a flow control queue in the network switch that is separate from ingress and egress queues and from a flow table of the switch, the flow control queue associating the selected QoS flow control policy with the data flow, the flow control queue configured to associate one or more of the plurality of QoS flow control policies with each specific data flow received by the switch; and

processing the data flow at the network switch according to instructions associated with the data flow and configured by a switch controller.

18. The computer program product of claim 17, further comprising, based on the switch controller determining that the specified flow statistic for the data flow exceeds the threshold, receiving an instruction to perform a remedial action on the data flow.

19. The computer program product of claim 18, wherein the remedial action includes at least one of adjusting a flow rate of the data flow, re-routing the data flow, and turning off the data flow.

20. The computer program product of claim 17, wherein each QoS flow control policy indication is associated with an identification of a different data flow being processed in the network switch.

21. An apparatus for controlling a network switch, comprising:

a memory having computer readable computer instructions; and

a processor for executing the computer readable instructions, the instructions including;

configuring a data flow including a plurality of data packets by a switch controller, the data flow received from a source and configured to be routed through one or more switches in a network to a destination, the switch controller configured to control routing of the data flow through a network switch, wherein configuring includes associating the data flow with a quality of service (QoS) flow control policy selected from a plurality of QoS flow control policies, each QoS flow control policy associated with one of a plurality of pre-set flow control levels, and storing an indication of a selected pre-set flow control level in one or more of the data packets of the data flow, each pre-set flow control level defining a threshold value of a flow statistic, wherein a value of the flow statistic exceeding the threshold value is indicative of a congestion condition;

storing the selected QoS flow control policy in a flow control queue in the network switch that is separate from ingress and egress queues and from a flow table of the switch, the flow control queue associating the selected QoS flow control policy with the data flow, the flow control queue configured to associate one or more of the plurality of QoS flow control policies with each specific data flow received by the switch controller;

monitoring the network switch receiving the data flow, wherein monitoring includes determining the value of the flow statistics in the switch associated with the data flow;

determining whether a congestion condition exists for the data flow based on comparing the value of the flow statistic and the threshold value defined by the pre-set flow control level associated with the selected QoS flow control policy; and

based on determining that the congestion condition exists for the data flow, performing a remedial action specific to the data flow to address the congestion condition.

22. The apparatus of claim 21, wherein the flow control queue includes an indication of a QoS flow control policy specific to each of the plurality of data flows.

23. The apparatus of claim 22, wherein the remedial action is performed for one or more data flows whose flow statistics exceed the threshold.

24. The apparatus of claim 21, wherein performing the remedial action includes at least one of rate-limiting the data flow, turning off the data flow in the switch, and re-routing the data flow.