Finding latency through a physical network in a virtualized network

• US 9,094,308 B2
• Filed: 03/15/2013
• Issued: 07/28/2015
• Est. Priority Date: 06/06/2012
• Status: Active Grant

• Current Assignee: Juniper Networks Incorporated
• Original Assignee: Juniper Networks Incorporated
• Inventors: Ghose, Tirthankar, Nakil, Harshad Bhaskar, Ramesh, N D
• Primary Examiner(s): Mui, Gary
• Application Number:
  US13/840,657
• Publication Number:
  US 20130329584A1
• Time in Patent Office: 865 Days
• Field of Search: 370/252
• US Class Current: 1/1
• CPC Class Codes: H04L 41/12 Discovery or management of network topologies
• CPC Class Codes: H04L 43/028 by filtering
• CPC Class Codes: H04L 43/0852 Delays
• CPC Class Codes: H04L 43/106 using time related information in packets, e.g. by adding timestamps
• CPC Class Codes: H04L 45/586 of virtual routers
• CPC Class Codes: H04L 49/254 Centralised controller, i.e. arbitration or scheduling
• CPC Class Codes: H04L 49/356 for storage area networks
• CPC Class Codes: H04L 49/70 Virtual switches
• CPC Class Codes: H04L 69/22 Parsing or analysis of headers

Abstract

Techniques are described for determining latency in a physical network that includes a number of network devices over which packets travel. A virtual network controller receives a plurality of messages from a plurality of network devices in a network, each of the messages including a packet signature comprising a hash of an invariant portion of an original packet that uniquely identifies the original packet, an identifier of one of the plurality of network devices from which the respective message was received, and a timestamp indicating a time an original packet was processed by the network device from which the respective message was received. The virtual network controller determines a latency of a physical network path in the network based on analysis of contents of the identified messages having a common packet signature.

Claims

1. A method for determining latency of a physical network path in a network, the method comprising:

receiving, by a virtual network controller, a plurality of messages from a plurality of network devices in a network, wherein each of the messages includes (1) a packet signature comprising a hash of an invariant portion of an original packet that uniquely identifies the original packet, (2) an identifier of one of the plurality of network devices from which the respective message was received, and (3) a timestamp indicating a time an original packet was processed by the network device from which the respective message was received;

identifying, by the virtual network controller, two or more of the plurality of messages having a common packet signature;

identifying distinct flows associated with the common packet signature;

generating a path map for one of the identified flows comprising a list of physical network devices that a packet in the flows traversed based on a known physical topology of the network;

generating a hash on the path map;

for each path map hash, determining a time that a packet took in traversing a physical network path from a source to a destination in the known physical topology of the network; and

determining, by the virtual network controller, a latency of a physical network path in the network based the determined time the packet took in traversing the physical network path.

2. The method of claim 1, wherein the plurality of network devices comprise a plurality of virtual network agents executing on a plurality of server devices in the network, wherein the identifier of the network device comprises an identifier of a virtual switch associated with a virtual network agent.

3. The method of claim 2, wherein different ones of the plurality of server devices receive the same original packet at different times.

4. The method of claim 1,

wherein the identifying comprises identifying, by a plurality of distributed analytics virtual machines executing on the virtual network controller, the two or more of the plurality of messages having the common packet signature, and

wherein the determining comprises determining at least in part by the plurality of distributed analytics virtual machines analyzing contents of the plurality of messages to determine the latency.

5. The method of claim 1, further comprising prior to receiving the plurality of messages, sending, by the virtual network controller, one or more commands to the plurality of network device indicating characteristics of packets to be analyzed and a time range in which to collect packets matching the characteristics,

wherein receiving the plurality of messages comprises receiving the plurality of messages responsive to sending the one or more commands.

6. The method of claim 1, further comprising:

by the virtual network controller;

sorting contents of the plurality of messages by packet signature;

obtaining for each packet signature, a list of network device identifiers and timestamps; and

sorting the list for each packet signature by timestamp.

7. The method of claim 6, further comprising:

by the virtual network controller;

for a given signature, constructing a virtual network topology map that the original packet traversed based on the list of list of virtual network device identifiers and timestamps associated with that signature; and

matching the virtual network topology map to the known physical topology of the network.

8. The method of claim 1, further comprising:

computing a statistical measure of the latency of the physical network path.

9. A non-transitory computer-readable storage medium comprising instructions for causing a programmable processor to:

receive a plurality of messages from a plurality of network devices in a network, wherein each of the messages includes (1) a packet signature comprising a hash of an invariant portion of an original packet that uniquely identifies the original packet, (2) an identifier of one of the plurality of network devices from which the respective message was received, and (3) a timestamp indicating a time an original packet was processed by the network device from which the respective message was received;

identify two or more of the plurality of messages having a common packet signature;

identify distinct flows associated with the common packet signature;

generate a path map for one of the identified flows comprising a list of physical network devices that a packet in the flows traversed based on a known physical topology of the network;

generate a hash on the path map;

for each path map hash, determine a time that a packet took in traversing a physical network path from a source to a destination in the known physical topology of the network; and

determine a latency of a physical network path in the network based on the determined time the packet took in traversing the physical network path.

10. A virtual network controller comprising:

one or more processors;

a plurality of virtual machines executed by the processors to receive a plurality of messages from a plurality of network devices in a network, wherein each of the messages includes (1) a packet signature comprising a hash of an invariant portion of an original packet that uniquely identifies the original packet, (2) an identifier of one of the plurality of network devices from which the respective message was received, and (3) a timestamp indicating a time an original packet was processed by the network device from which the respective message was received; and

a plurality of analytics virtual machines, wherein the plurality of virtual machines identify two or more of the plurality of messages having a common packet signature, identify distinct flows associated with the common packet signature, generate a path map for one of the identified flows comprising a list of physical network devices that a packet in the flows traversed based on a known physical topology of the network, generate a hash on the path map, for each path map hash, determine a time that a packet took in traversing a physical network path from a source to a destination in the known physical topology of the network, and determine a latency of a physical network path in the network based on the determined time the packet took in traversing the physical network path.

11. The virtual network controller of claim 10, wherein the plurality of analytics virtual machines sort contents of the plurality of messages by signature, obtain for each signature, a list of network device identifiers and timestamps, and sort the list for each signature by timestamp.

12. The virtual network controller of claim 11, wherein the plurality of analytics virtual machines, for a given signature, construct a virtual network topology map that the original packet traversed based on the list of list of virtual network device identifiers and timestamps associated with that signature, and match the virtual network topology map to the known physical topology of the network.

13. The virtual network controller of claim 10, wherein the plurality of analytics virtual machines compute a statistical measure of the latency of the physical network path.

14. A system comprising:

a virtual network controller comprising;

one or more processors;

a plurality of virtual machines executed by the processors; and

a plurality of network devices comprising one or more processors, wherein the plurality of network devices receive from the virtual network controller, information specifying packet characteristics of packets to be analyzed receiving a packet,

wherein the plurality of virtual machines receive a plurality of messages from the plurality of network devices, wherein each of the messages includes (1) a packet signature comprising a hash of an invariant portion of an original packet that uniquely identifies the original packet, (2) an identifier of one of the plurality of network devices from which the respective message was received, and (3) a timestamp indicating a time an original packet was processed by the network device from which the respective message was received;

wherein the virtual network controller further comprises a plurality of analytics virtual machines that identify two or more of the plurality of messages having a common packet signature, identify distinct flows associated with the common packet signature, generate a path map for one of the identified flows comprising a list of physical network devices that a packet in the flows traversed based on a known physical topology of the network, generate a hash on the path map, for each path map hash, determine a time that a packet took in traversing a physical network path from a source to a destination in the known physical topology of the network, and determine a latency of a physical network path in the network based on the determined time the packet took in traversing the physical network path;

wherein the plurality of network devices comprise a virtual network agent executing on the processors that, responsive to determining that the packet matches the specified characteristics, determining a hash of an invariant portion of the packet that uniquely identifies the packet to obtain a packet signature, and forward, to the virtual network controller, a message that specifies;

(1) the packet signature, (2) an identifier of the network device, and (3) a timestamp indicating a time the packet was processed by the network device.

15. The system of claim 14, wherein plurality of network devices comprise a plurality of server devices each comprising a respective virtual switch and a respective virtual network agent, and wherein the identifier specified by the message comprises an identifier of a virtual switch associated with a virtual network agent.