Data path performance measurement using test messages in a software defined network

• US 9,537,741 B2
• Filed: 07/25/2014
• Issued: 01/03/2017
• Est. Priority Date: 07/25/2014
• Status: Active Grant

• Current Assignee: Telefonaktiebolaget LM Ericsson
• Original Assignee: Telefonaktiebolaget LM Ericsson
• Inventors: Chakrabarti, Samita, Bachmutsky, Alexander
• Primary Examiner(s): MILLS, DONALD L
• Application Number:
  US14/341,760
• Publication Number:
  US 20160028603A1
• Time in Patent Office: 893 Days
• Field of Search: None
• US Class Current: 1/1
• CPC Class Codes: H04L 43/0852 Delays
• CPC Class Codes: H04L 43/087 Jitter
• CPC Class Codes: H04L 43/106 using time related information in packets, e.g. by adding timestamps
• CPC Class Codes: H04L 43/20 the monitoring system or the monitored elements being virtualised, abstracted or software-defined entities, e.g. SDN or NFV
• CPC Class Codes: H04L 43/50 Testing arrangements

Abstract

A method in a network controller of a control plane in a software defined network (SDN) coupled to a plurality of network elements (NEs) of a data plane in the SDN is described. The method includes at least sending a first control message to an ingress NE of the plurality of NEs to initiate a first test session; sending a second control message to an egress NE of the plurality of NEs to initiate a second test session; sending the test message to the ingress NE to cause the ingress NE to transmit the outgoing message from the ingress NE; receiving the first reply message from the ingress NE; receiving the second reply message from the egress NE; and calculating an indication of a delay between the ingress NE and the egress NE.

Claims

1. A method in a network controller of a control plane in a software defined network (SDN) coupled to a plurality of network elements (NEs) of a data plane in the SDN, comprising:

sending a first control message to an ingress NE of the plurality of NEs to initiate a first test session, wherein content of the first control message instructs the ingress NE to respond to an incoming test message sent from the network controller and received by the ingress NE with transmission of a first reply message to the network controller and with transmission toward a destination NE of an outgoing test message from the ingress NE, wherein the destination NE is in the SDN and is downstream from the ingress NE, and wherein the ingress NE is a first edge NE within the SDN;

sending a second control message to an egress NE of the plurality of NEs to initiate a second test session, wherein content of the second control message instructs the egress NE to respond to an incoming test message sent from an upstream NE and received by the egress NE with transmission of a second reply message to the network controller, wherein the egress NE is a second edge NE within the SDN;

sending the test message to the ingress NE to cause the ingress NE to transmit the outgoing test message from the ingress NE, wherein the outgoing test message from the ingress NE causes the receipt of the incoming test message received by the egress NE;

receiving the first reply message from the ingress NE, wherein the first reply message includes a first set of one or more timestamps, the first set of timestamps including a first received timestamp that indicates the time when the ingress NE received the incoming test message received by the ingress NE;

receiving the second reply message from the egress NE, wherein the second reply message includes a second set of one or more timestamps, the second set of timestamps including a second received timestamp that indicates the time when the egress NE received the incoming test message received by the egress NE;

calculating an indication of a delay between the ingress NE and the egress NE based on a difference in time between one timestamp of the first set of timestamps and one timestamp of the second set of timestamps; and

rerouting network traffic between the ingress NE and the egress NE in response to a determination that the indication of the delay between the ingress NE and the egress NE exceeds a threshold value.

2. The method of claim 1, wherein the first reply message further includes a first sent timestamp that indicates the time when the ingress NE sent the first reply message, and further comprising:

sending additional control messages to a set of one or more intermediate NEs of the plurality of NEs to initiate test sessions, wherein there is a network path from the ingress NE through the set of intermediate NEs to the egress NE, wherein content of the additional control messages instructs each one of the set of intermediate NEs to respond to receipt of an incoming test message from an upstream NE with transmission of a reply message to the network controller and with transmission along the network path of an outgoing test message from that intermediate NE, wherein the set of intermediate NEs is downstream of the ingress NE and upstream of the egress NE;

responsive to sending the incoming test message to the ingress NE, receiving from each of the set of intermediate NEs a reply message that includes one or more timestamps, the one or more timestamps including a received timestamp indicating when that intermediate NE received its incoming test message and a sent timestamp indicating the time that intermediate NE sent the reply message; and

calculating an indication of a delay between a first of the plurality of NEs and a second of the plurality of NEs based on the difference between one of the one or more timestamps indicated in the reply message of the first NE and one of the one or more timestamps indicated in the reply message of the second NE, wherein the first and second NEs are NEs in a set of the plurality of NEs that have sent reply messages to the network controller.

3. The method of claim 2, wherein each one of the set of intermediate NEs transmits its outgoing test message to a downstream NE that is along the network path and that is pre-selected by the network controller.

4. The method of claim 2, wherein the network controller further calculates a jitter indication along the network path by comparing one or more variations in a plurality of indications of delay between the NEs along the network path.

5. The method of claim 1, wherein the destination NE is the egress NE.

6. The method of claim 1, wherein the first control message further causes the ingress NE to set a destination address indicator of the outgoing test message received by the ingress NE to include a destination address of the destination NE before transmission of the outgoing test message by the ingress NE to the destination NE.

7. The method of claim 1, wherein a sender address indicator of the outgoing test message received by the ingress NE is an address of the network controller, and wherein the first reply message is sent to the network controller based on the address of the network controller in the sender address indicator.

8. The method of claim 1, wherein the test and reply messages are Two-Way Active Measurement Protocol (TWAMP) Test messages and the control messages are TWAMP Control messages.

9. A network controller of a control plane in a software defined network (SDN) coupled to a plurality of network elements (NEs) of a data plane in the SDN, comprising:

a processor and a memory, said memory containing instructions executable by the processor whereby the network controller is operative to;

send a first control message to an ingress NE of the plurality of NEs to initiate a first test session, wherein content of the first control message instructs the ingress NE to respond to an incoming test message sent from the network controller and received by the ingress NE with transmission of a first reply message to the network controller and with transmission toward a destination NE of an outgoing test message from the ingress NE, wherein the destination NE is in the SDN and is downstream from the ingress NE, and wherein the ingress NE is a first edge NE within the SDN;

send a second control message to an egress NE of the plurality of NEs to initiate a second test session, wherein content of the second control message instructs the egress NE to respond to an incoming test message sent from an upstream NE and received by the egress NE with transmission of a second reply message to the network controller, wherein the egress NE is a second edge NE within the SDN;

send the test message to the ingress NE to cause the ingress NE to transmit the outgoing test message from the ingress NE, wherein the outgoing test message from the ingress NE causes the receipt of the incoming test message received by the egress NE;

receive the first reply message from the ingress NE, wherein the first reply message includes a first set of one or more timestamps, the first set of timestamps including a first received timestamp that indicates the time when the ingress NE received the incoming test message received by the ingress NE;

receive the second reply message from the egress NE, wherein the second reply message includes a second set of one or more timestamps, the second set of timestamps including a second received timestamp that indicates the time when the egress NE received the incoming test message received by the egress NE;

calculate an indication of a delay between the ingress NE and the egress NE based on a difference in time between one timestamp of the first set of timestamps and the one timestamp of the second set of timestamps; and

reroute network traffic between the ingress NE and the egress NE in response to a determination that the indication of the delay between the ingress NE and the egress NE exceeds a threshold value.

10. The network controller of claim 9, wherein the first reply message further includes a first sent timestamp that indicates the time when the ingress NE sent the first reply message, and whereby the network controller is further operative to:

send additional control messages to a set of one or more intermediate NEs of the plurality of NEs to initiate test sessions, wherein there is a network path from the ingress NE through the set of intermediate NEs to the egress NE, wherein content of the additional control messages instructs each one of the set of intermediate NEs to respond to receipt of an incoming test message from an upstream NE with transmission of a reply message to the network controller and with transmission along the network path of an outgoing test message from that intermediate NE, wherein the set of intermediate NEs is downstream of the ingress NE and upstream of the egress NE;

responsive to the sending of the incoming test message to the ingress NE, receive a from each of the set of intermediate NEs a reply message that includes one or more timestamps, the one or more timestamps including a received timestamp indicating when that intermediate NE received its incoming test message and a sent timestamp indicating the time that intermediate NE sent the reply message; and

calculate an indication of a delay between a first of the plurality of NEs and a second of the plurality of NEs based on the difference between one of the one or more timestamps indicated in the reply message of the first NE and one of the one or more timestamps indicated in the reply message of the second NE, wherein the first and second NEs are NEs in a set of the plurality of NEs that have sent reply messages to the network controller.

11. The network controller of claim 10, wherein each one of the set of intermediate NEs transmits its outgoing test message to a downstream NE that is along the network path and that is pre-selected by the network controller.

12. The network controller of claim 10, wherein the network controller further calculates a jitter indication along the network path by comparing one or more variations in a plurality of indications of delay between the NEs along the network path.

13. The network controller of claim 9, wherein the destination NE is the egress NE.

14. The network controller of claim 9, wherein the first control message further causes the ingress NE to set a destination address indicator of the outgoing test message received by the ingress NE to include a destination address of the destination NE before transmission of the outgoing test message by the ingress NE to the destination NE.

15. The network controller of claim 9, wherein a sender address indicator of the outgoing test message received by the ingress NE is an address of the network controller, and wherein the first reply message is sent to the network controller based on the address of the network controller in the sender address indicator.

16. The network controller of claim 9, wherein the test and reply messages are Two-Way Active Measurement Protocol (TWAMP) Test messages and the control messages are TWAMP Control messages.

17. A non-transitory computer-readable storage medium having instructions stored therein, wherein the instructions, when executed by a processor of a network controller of a control plane in a software defined network (SDN) coupled to a plurality of network elements (NEs) of a data plane in the SDN, cause the processor to perform operations comprising:

sending a first control message to an ingress NE of the plurality of NEs to initiate a first test session, wherein content of the first control message instructs the ingress NE to respond to an incoming test message sent from the network controller and received by the ingress NE with transmission of a first reply message to the network controller and with transmission toward a destination NE of an outgoing test message from the ingress NE, wherein the destination NE is in the SDN and is downstream from the ingress NE, and wherein the ingress NE is a first edge NE within the SDN;

sending a second control message to an egress NE of the plurality of NEs to initiate a second test session, wherein content of the second control message instructs the egress NE to respond to an incoming test message sent from an upstream NE and received by the egress NE with transmission of a second reply message to the network controller, wherein the egress NE is a second edge NE within the SDN;

sending the test message to the ingress NE to cause the ingress NE to transmit the outgoing test message from the ingress NE, wherein the outgoing test message from the ingress NE causes the receipt of the incoming test message received by the egress NE;

receiving the first reply message from the ingress NE, wherein the first reply message includes a first set of one or more timestamps, the first set of timestamps including a first received timestamp that indicates the time when the ingress NE received the incoming test message received by the ingress NE;

receiving the second reply message from the egress NE, wherein the second reply message includes a second set of one or more timestamps, the second set of timestamps including a second received timestamp that indicates the time when the egress NE received the incoming test message received by the egress NE;

calculating an indication of a delay between the ingress NE and the egress NE based on a difference in time between one timestamp of the first set of timestamps and one timestamp of the second set of timestamps; and

rerouting network traffic between the ingress NE and the egress NE in response to a determination that the indication of the delay between the ingress NE and the egress NE exceeds a threshold value.

18. The non-transitory computer-readable storage medium of claim 17, wherein the first reply message further includes a first sent timestamp that indicates the time when the ingress NE sent the first reply message, the operations further comprising:

sending additional control messages to a set of one or more intermediate NEs of the plurality of NEs to initiate test sessions, wherein there is a network path from the ingress NE through the set of intermediate NEs to the egress NE, wherein content of the additional control messages instructs each one of the set of intermediate NEs to respond to receipt of an incoming test message from an upstream NE with transmission of a reply message to the network controller and with transmission along the network path of an outgoing test message from that intermediate NE, wherein the set of intermediate NEs is downstream of the ingress NE and upstream of the egress NE;

responsive to sending the incoming test message to the ingress NE, receiving a from each of the set of intermediate NEs a reply message that includes one or more timestamps, the one or more timestamps including a received timestamp indicating when that intermediate NE received its incoming test message and a sent timestamp indicating the time that intermediate NE sent the reply message; and

calculating an indication of a delay between a first of the plurality of NEs and a second of the plurality of NEs based on the difference between one of the one or more timestamps indicated in the reply message of the first NE and one of the one or more timestamps indicated in the reply message of the second NE, wherein the first and second NEs are NEs in a set of the plurality of NEs that have sent reply messages to the network controller.

19. The non-transitory computer-readable storage medium of claim 18, wherein each one of the set of intermediate NEs transmits its outgoing test message to a downstream NE that is along the network path and that is pre-selected by the network controller.

20. The non-transitory computer-readable storage medium of claim 18, wherein the network controller further calculates a jitter indication along the network path by comparing one or more variations in a plurality of indications of delay between the NEs along the network path.

21. The non-transitory computer-readable storage medium of claim 17, wherein the destination NE is the egress NE.

22. The non-transitory computer-readable storage medium of claim 17, wherein the first control message further causes the ingress NE to set a destination address indicator of the outgoing test message received by the ingress NE to include a destination address of the destination NE before transmission of the outgoing test message by the ingress NE to the destination NE.

23. The non-transitory computer-readable storage medium of claim 17, wherein a sender address indicator of the outgoing test message received by the ingress NE is an address of the network controller, and wherein the first reply message is sent to the network controller based on the address of the network controller in the sender address indicator.

24. The non-transitory computer-readable storage medium of claim 17, wherein the test and reply messages are Two-Way Active Measurement Protocol (TWAMP) Test messages and the control messages are TWAMP Control messages.