Software control plane for switches and routers

• US 8,442,030 B2
• Filed: 02/29/2008
• Issued: 05/14/2013
• Est. Priority Date: 03/01/2007
• Status: Active Grant

• Current Assignee: Extreme Networks, Inc.
• Original Assignee: Extreme Networks, Inc.
• Inventors: Dennison, Larry R.
• Primary Examiner(s): Hamza, Faruk
• Assistant Examiner(s): Decker, Cassandra
• Application Number:
  US12/074,268
• Publication Number:
  US 20080219268A1
• Time in Patent Office: 1,901 Days
• Field of Search: None
• US Class Current: 370/351
• CPC Class Codes: H04L 12/4625 Single bridge functionality, e.g. connection of two networks over a single bridge
• CPC Class Codes: H04L 12/4633 Interconnection of networks using encapsulation techniques, e.g. tunneling
• CPC Class Codes: H04L 41/06 Management of faults, events, alarms or notifications
• CPC Class Codes: H04L 41/5003 Managing SLA; Interaction between SLA and QoS
• CPC Class Codes: H04L 43/0811 by checking connectivity
• CPC Class Codes: H04L 43/0852 Delays
• CPC Class Codes: H04L 45/00 Routing or path finding of packets in data switching networks routing or path finding in wireless networks H04W40/00
• CPC Class Codes: H04L 45/04 Interdomain routing, e.g. hierarchical routing
• CPC Class Codes: H04L 45/22 Alternate routing
• CPC Class Codes: H04L 45/28 using route fault recovery
• CPC Class Codes: H04L 45/308 Route determination based on user's profile, e.g. premium users
• CPC Class Codes: H04L 45/42 Centralised routing
• CPC Class Codes: H04L 45/50 using label swapping, e.g. multi-protocol label switch [MPLS]
• CPC Class Codes: H04L 45/56 Routing software
• CPC Class Codes: H04L 45/64 using an overlay routing layer
• CPC Class Codes: H04L 45/655 Interaction between route computation entities and forwarding entities, e.g. for route determination or for flow table update
• CPC Class Codes: H04L 45/76 Routing in software-defined topologies, e.g. routing between virtual machines
• CPC Class Codes: H04L 47/2425 for supporting services specification, e.g. SLA

Abstract

A Provider Network Controller (PNC) addresses the challenges in building services across Next Generation Network (NGN) architectures and creates an abstraction layer as a bridge, or glue, between the network transport and applications running over it. The PNC is a multi-layer, multi-vendor dynamic control plane that implements service activation and Layer 0-2 management tools for multiple transport technologies including Carrier Ethernet, Provider Backbone Transport (PBT), Multi-protocol Label Switching (MPLS), Transport MPLS (T-MPLS), optical and integrated networking platforms. Decoupling transport controls and services from the network equipment simplifies service creation and provides options for carriers to choose best-in-class equipment that leverages the PNC to enable rapid creation and management of transports and services. The PNC provides Service-Oriented Architecture (SOA) interfaces to abstract transport objects expressly designed to support both wholesale and retail services, and supports service offerings with varied bandwidth and Quality of Service (QoS) requirements, thus achieving enterprise Ethernet economics.

Claims

1. A method comprising:

executing a software control plane control system on a processor;

storing, by means of the executing software control plane control system, information about hardware endpoints and communication connections in a communication network, traffic engineering rules, and network policies governing the communication network;

defining services, by means of the executing software control plane control system, to be implemented on the communication network;

computing communication paths, by means of the executing software control plane control system, according to the stored information to implement the services,

wherein at least one communication path computed includes two or more communication tunnels, each of the two or more communication tunnels having a respective underlying communication protocol, the two or more communication tunnels to transfer data between hardware endpoints of the two or more communication tunnels;

programming, by means of the executing software control plane control system, the hardware endpoints of the two or more communication tunnels comprising the at least one communication path to establish the at least one communication path in the communication network,

wherein the programming includes configuring a hardware endpoint to emulate a second communication protocol of a second communication tunnel of the two or more communication tunnels, if a first communication protocol of a first communication tunnel of the two or more communication tunnels is different from the second communication protocol;

monitoring, by means of the executing software control plane control system, the programmed hardware endpoints and the communication connections along the at least one communication path and updating the stored information;

recomputing, by means of the executing software control plane control system, the at least one communication path and reprogramming the hardware endpoints along the recomputed at least one communication path to adapt the at least one communication path according to changes in the stored information and the services to ensure implementation of the services; and

migrating the services from the at least one communication path to the recomputed at least one communication path.

2. The method of claim 1, wherein the communication network is a heterogeneous communication network and is one of a multi-layer, multi-service, multi-vendor or multi-carrier communication network.

3. The method of claim 1, wherein the hardware endpoints include switches, routers, or a combination of both.

4. The method of claim 1, wherein the information about the hardware endpoints and the communication connections in the communication network includes capacity, utilization and performance metrics.

5. The method of claim 1, wherein the services are defined by attributes, the method further comprising:

storing attributes defining the services to be implemented on the communication network; and

computing the communication paths according to the attributes to implement the defined services.

6. The method of claim 5, wherein the attributes defining the services include service performance attributes including frame latency, delay variation, loss ratio, and bandwidth profile.

7. The method of claim 5 further comprising recomputing the at least one communication path and reprogramming the hardware endpoints along the recomputed at least one communication path to adapt the at least one communication path according to changes in the attributes of the services to ensure the implementation of the services.

8. The method of claim 1, wherein computing the at least one communication path further comprises optimizing the hardware endpoints and the communication connections in the communication network according to a quality of service and per-class bandwidth constraints.

9. The method of claim 1, wherein computing the at least one communications path includes computing at least one backup communication path that is fully redundant from the at least one communication path.

10. The method of claim 1, wherein programming the hardware endpoints along the at least one communication path includes overriding normal behaviors of the hardware endpoints.

11. The method of claim 1, wherein monitoring the programmed hardware endpoints and the communication connections along the at least one communication path further comprises monitoring for network faults, overloads or path optimization.

12. The method of claim 1, wherein recomputing the at least one communication path and reprogramming the hardware endpoints along the recomputed at least one communication path restores the at least one communication path in the communication network in an event of a failure of at least one of the communication connections in the at least one communication path.

13. The method of claim 1, wherein recomputing the at least one communication path and reprogramming the hardware endpoints along the recomputed at least one communication path optimizes the at least one communication path for at least one service in the communication network according to the stored information.

14. The method of claim 1, wherein recomputing the at least one communication path includes dynamically adjusting associated restoration time constants of the at least one communication path according to the respective restoration time constants of the communication connections of the recomputed at least one communication path.

15. The method of claim 1, wherein recomputing the at least one communication path includes recomputing according to an economic or social value associated with the at least one communication path.

16. The method of claim 1, wherein migrating the services from the at least one communication path to the recomputed at least one communication path allows maintenance of the hardware endpoints and the communication connections in the communication network without disruption to the services.

17. The method of claim 1 further comprises:

detecting failures in the hardware endpoints and the communication connections along the two or more communication tunnels; and

allocating new communication tunnels and reprogramming the hardware endpoints along the new communication tunnels to restore the two or more communication tunnels.

18. The method of claim 17, wherein allocating the new communication tunnels and reprogramming the hardware endpoints along the new communication tunnels optimizes the two or more communication tunnels according to the stored information.

19. The method of claim 17 further comprising migrating the services from the two or more communication tunnels to the new communication tunnels.

20. The method of claim 1 further comprising restoring communication tunnels in the communication network by:

allocating new communication tunnels, in an event of failure of at least one of the two or more communication tunnels, based on the stored information, each communication tunnel of the new communication tunnels having hardware endpoints; and

connecting the new communication tunnels by programming the hardware endpoints of the new communication tunnels.

21. The method of claim 1, wherein configuring the hardware endpoint to emulate the second communication tunnel in the communication network comprises:

allocating a communication tunnel having an underlying first communication protocol and hardware endpoints; and

connecting the communication tunnel to other communication tunnels having an underlying second communication protocol, different from the first communication protocol.

22. The method of claim 1, wherein computing the at least one communication path includes computing a primary path and a redundant path for communicating during a failure event of any hardware endpoint in the primary path.

23. The method of claim 1 further comprising decoupling the software control plane control system from forwarding plane hardware.

24. The method of claim 1, wherein the first and second communication tunnels are associated with a single Internet Service Provider (ISP).

25. The method of claim 1, wherein the first and second communication tunnels are associated with different Internet Service Providers.

26. The method of claim 1, wherein the first and second communication protocols are different protocols and wherein one of the first and second communication protocols is a MPLS protocol and the other of the first and second communication protocols is a PBT protocol.

27. The method of claim 1, wherein the second communication tunnel is a multicast tree, and wherein the first communication tunnel is a point to point tunnel coupled to the second communication tunnel.

28. The method of claim 1 further comprising:

tracking a percentage of misrouted paths over time; and

providing network planning information based on the tracked percentage of misrouted paths.

29. A software control plane network controller configured to control services in a communication network, the services defined to be implemented on the communication network, the software control plane network controller comprising:

a database configured to store information about hardware endpoints and communication connections in the communication network, and traffic engineering rules and network policies governing the communication network; and

a path computation module, executing on a computer, configured to;

compute at least one communication path according to the stored information to implement the services, the at least one communication path including two or more communication tunnels, each of the two or more communication tunnels having a respective underlying communication protocol, the two or more communication tunnels to transfer data between hardware endpoints of the two or more communication tunnels,

program the hardware endpoints of the two or more communication tunnels comprising the at least one communication path to establish the at least one communication path in the communication network, wherein at least one programmed hardware endpoint emulates a second communication protocol of a second communication tunnel of the two or more communication tunnels, if a first communication protocol of a first communication tunnel of the two or more communication tunnels is different from the second communication protocol,

monitor the programmed hardware endpoints and the communication connections along the at least one communication path and update the stored information,

recompute the at least one communication path and reprogram the hardware endpoints along the recomputed at least one communication path to adapt the at least one communication path according to changes in the stored information and the services to ensure implementation of the services, and

migrate the services from the at least one communication path to the recomputed at least one communication path.

30. The software control plane network controller of claim 29, wherein the communication network is a heterogeneous communication network and is one of a multi-layer, multi-service, multi-vendor or multi-carrier communication network.

31. The software control plane network controller of claim 29, wherein the hardware endpoints include switches, routers, or a combination of both.

32. The software control plane network controller of claim 29, wherein the information about the hardware endpoints and the communication connections in the communication network includes capacity, utilization and performance metrics.

33. The software control plane network controller of claim 29, wherein the path computation module is further configured to compute the at least one communication path according to attributes stored in the database, the attributes defining the services to be implemented on the network.

34. The software control plane network controller of claim 33, wherein the attributes defining the services include service performance attributes including frame latency, delay variation, loss ratio, and bandwidth profile.

35. The software control plane network controller of claim 33, wherein the path computation module is further configured to recompute the at least one communication path and reprogram the hardware endpoints along the recomputed at least one communication path to adapt the at least one communication path according to changes in the attributes of the services to ensure the implementation of the services.

36. The software control plane network controller of claim 29, wherein the path computation module is further configured to optimize the hardware endpoints and the communication connections in the communication network according to quality of service and per-class bandwidth constraints.

37. The software control plane network controller of claim 29, wherein the path computation module is further configured to compute backup communication paths that are fully redundant from the at least one communication path.

38. The software control plane network controller of claim 29, wherein the path computation module is further configured to program the hardware endpoints along the at least one communication path by overriding normal behaviors of the hardware endpoints.

39. The software control plane network controller of claim 29, wherein the path computation module is further configured to monitor the programmed hardware endpoints and the communication connections along the at least one communication path for network faults, overloads or path optimization.

40. The software control plane network controller of claim 29, wherein the path computation module is further configured to recompute the at least one communication path and reprogram the hardware endpoints along the recomputed at least one communication path to restore the at least one communication path in the communication network in an event of a failure of at least one of the communication connections in the at least one communication path.

41. The software control plane network controller of claim 29, wherein the path computation module is further configured to recompute the at least one communication path and reprogram the hardware endpoints along the recomputed at least one communication path to optimize the at least one communication path for at least one service in the communication network according to the stored information.

42. The software control plane network controller of claim 29, wherein the path computation module is further configured to dynamically adjust associated restoration time constants of the at least one communication path according to the respective restoration time constants of the communication connections of the recomputed at least one communication path.

43. The software control plane network controller of claim 29, wherein the path computation module is further configured to recompute the at least one communication path according to an economic or social value associated with the at least one communication path.

44. The software control plane network controller of claim 29, wherein the software control plane network controller is further configured to migrate the services to allow maintenance of the hardware endpoints and the communication connections in the communication network without disruption to the services.

45. The software control plane network controller of claim 29, wherein the path computation module is configured to:

detect failures in the hardware endpoints and the communication connections along the two or more communication tunnels, and

allocate new communication tunnels and reprogram the hardware endpoints along the new communication tunnels to restore the two or more communication tunnels.

46. The software control plane network controller of claim 45, wherein the path computation module is further configured to allocate the new communication tunnels and reprogram the hardware endpoints along the new communication tunnels to optimize the two or more communication tunnels according to the stored information.

47. The software control plane network controller of claim 45, wherein the software control plane network controller is further configured to migrate services from the two or more communication tunnels to the new communication tunnels.

48. The software control plane network of claim 29, wherein the path computation module is configured to compute the at least one communication path by computing a primary path and a redundant path for communicating during a failure event of any hardware endpoint in the primary path.

49. The software control plane network of claim 29, wherein the software control plane control system is decoupled from forwarding plane hardware.

50. The software control plane network of claim 29, wherein the first and second communication tunnels are associated with a single Internet Service Provider (ISP).

51. The software control plane network of claim 29, wherein the first and second communication tunnels are associated with different Internet Service Providers.

52. The software control plane network of claim 29, wherein the first and second communication protocols are different protocols and wherein one of the first and second communication protocols is a MPLS protocol and the other of the first and second communication protocols is a PBT protocol.

53. The software control plane network of claim 29, wherein the second communication tunnel is a multicast tree, and wherein the first communication tunnel is a point to point tunnel coupled to the second communication tunnel.

54. The software control plane network of claim 29, wherein the path computation module is configured to:

track a percentage of misrouted paths over time; and

provide network planning information based on the tracked percentage of misrouted paths.