Methods and apparatus for virtualizing switch control plane engine

• US 9,509,637 B1
• Filed: 02/13/2015
• Issued: 11/29/2016
• Est. Priority Date: 03/30/2012
• Status: Active Grant

• Current Assignee: Juniper Networks Incorporated
• Original Assignee: Juniper Networks Incorporated
• Inventors: Shekhar, Ravi, Vohra, Quaizar, O'Gorman, Michael, Ratkovic, Aleksandar, Frailong, Jean-Marc, Sreenivasamurthy, Shesha
• Primary Examiner(s): Yeung, Mang
• Assistant Examiner(s): PASCUAL PEGUERO, NATALI
• Application Number:
  US14/621,878
• Time in Patent Office: 655 Days
• Field of Search: 370/254, 370/384, 370/386, 709/223, 709/226
• US Class Current: 1/1
• CPC Class Codes: G06F 2009/4557 Distribution of virtual machine instances; Migration and load balancing
• CPC Class Codes: G06F 2009/45595 Network integration; Enabling network access in virtual machine instances
• CPC Class Codes: G06F 9/45558 Hypervisor-specific management and integration aspects
• CPC Class Codes: H04L 12/4641 Virtual LANs, VLANs, e.g. virtual private networks [VPN] LAN interconnection over a bridge based backbone H04L12/462; encapsulation techniques H04L12/4633; routing of packets H04L45/00; packet switches H04L49/00; virtual private networks for security H04L63/0272
• CPC Class Codes: H04L 12/50 Circuit switching systems, i.e. systems in which the path is physically permanent during the communication
• CPC Class Codes: H04L 41/0896 Bandwidth or capacity management, i.e. automatically increasing or decreasing capacities flow or congestion control using dynamic resource allocation, e.g. in-call renegotiation, H04L47/76
• CPC Class Codes: H04L 41/40 using virtualisation of network functions or resources, e.g. SDN or NFV entities
• CPC Class Codes: H04L 49/25 Routing or path finding in a switch fabric

Abstract

In some embodiments, an apparatus includes a scheduler disposed at a control device of a switch fabric system. The scheduler is configured to receive a control plane request associated with the switch fabric system having a data plane and a control plane separate from the data plane. The scheduler is configured to designate a control plane entity based on the control plane request and state information of each control plane entity from a set of control plane entities associated with the control plane and instantiated as a virtual machine. The scheduler is configured to send a signal to a compute device of the switch fabric system in response to the control plane request such that the control plane entity is instantiated as a virtual machine at the compute device.

Claims

1. An apparatus, comprising:

a control device of a switch fabric system including;

a hardware processor; and

a scheduler implemented by the hardware processor and configured to be included in a plurality of schedulers, the scheduler configured to receive a control plane request associated with the switch fabric system having a data plane and a control plane separate from the data plane;

the scheduler configured to designate a first control plane entity based on the control plane request and state information of each control plane entity from a plurality of control plane entities associated with the control plane and instantiated as a virtual machine, the state information associating the first control plane entity with a second control plane entity from the plurality of control plane entities and instantiated as a first virtual machine at a compute device, the state information including a first set of values indicating a proximity preference that the first control plane entity is executed at the compute device, the state information including a second set of values indicating a proximity preference that the first control plane entity is executed at a redundant compute device different from the compute device; and

the scheduler configured to send a signal to the compute device of the switch fabric system, in response to the control plane request and when a subset of the first set of values that is associated with the first control plane entity and the second control plane entity is larger than a subset of the second set of values that is associated with the first control plane entity and the second control plane entity, such that the first control plane entity is instantiated as a second virtual machine at the compute device.

2. The apparatus of claim 1, wherein:

the scheduler configured to designate the first control plane entity such that the first control plane entity is associated with a priority attribute value, the second control plane entity is associated with a priority attribute value; and

one of the priority attribute value of the first control plane entity or the priority attribute value of the second plane entity is a primary value and the remaining priority attribute value of the first control plane entity or the priority attribute value of the second control plane entity is a secondary value.

3. The apparatus of claim 1, wherein:

the compute device is a first compute device;

the plurality of control plane entities includes a third control plane entity having a priority attribute value and a fourth control plane entity having a priority attribute value lower than the priority attribute value of the third control plane entity;

the scheduler configured to receive a signal indicating that a second compute device associated with the third control plane entity is not operative; and

the scheduler configured to modify the priority attribute value of the fourth control plane entity in response to the signal indicating that the second compute device associated with the third control plane entity is not operative.

4. The apparatus of claim 1, wherein:

the compute device is a first compute device;

the plurality of control plane entities includes (1) a third control plane entity having a priority attribute value, (2) a fourth control plane entity having a priority attribute value lower than the priority attribute value of the third control plane entity and (3) a fifth control plane entity having a priority attribute value lower than the priority attribute value of the fourth control plane entity;

the scheduler configured to receive a signal indicating that a second compute device associated with the third control plane entity is not operative; and

the scheduler configured to increase the priority attribute value of the fourth control plane entity and increase the priority attribute value of the fifth control plane entity in response to the signal indicating that the second compute device associated with the third control plane entity is not operative.

5. The apparatus of claim 1, wherein:

the compute device is a first compute device, the signal is a first signal;

the plurality of control plane entities includes a third control plane entity, the third virtual machine instantiated for the third control plane entity is located at a second compute device of the switch fabric system before the scheduler receives the control plane request; and

the scheduler configured to send a second signal to the second compute device of the switch fabric system in response to the control plane request and based on the state information such that the third virtual machine instantiated for the third control plane entity is moved to a third compute device of the switch fabric system.

6. The apparatus of claim 1, wherein:

the signal is a first signal;

each control plane entity from the plurality of control plane entities being associated with a plurality of attribute values before the scheduler receives the control plane request; and

the scheduler configured to modify at least one attribute value for a third control plane entity from the plurality of control plane entities in response to the control plane request and based on the state information.

7. An apparatus, comprising:

a compute device of a switch fabric system having a data plane and a control plane separate from the data plane, the compute device including;

a hardware processor; and

a scheduler agent implemented by the hardware processor and configured to receive a signal designating a first control plane entity associated with the control plane, the scheduler agent configured to be included in a plurality of scheduler agents;

the first control plane entity having been designated based on a control plane request for the switch fabric system and state information of each control plane entity from a plurality of control plane entities associated with the control plane, the state information associating the first control plane entity with a second control plane entity from the plurality of control plane entities associated with the control plane, the state information including a first set of values indicating a proximity preference that the second control plane entity is executed at the compute device, the state information including a second set of values indicating a proximity preference that the second control plane entity is executed at a redundant compute device different from the compute device; and

the scheduler agent configured to configure a virtual machine corresponding to the first control plane entity on the compute device in response to the signal, the scheduler agent configured to configure a virtual machine corresponding to the second control plane entity on the compute device when a subset of the first set of values that is associated with the first control plane entity and the second control plane entity is larger than a subset of the second set of values that is associated with the first control plane entity and the second control plane entity.

8. The apparatus of claim 7, wherein:

the compute device is a first compute device, a second compute device configured to configure a virtual machine associated with a third control plane entity;

the first control plane entity is associated with an affinity attribute value and an anti-affinity attribute value, the third control plane entity is associated with an affinity attribute value and an anti-affinity attribute value; and

at least one of (1) the affinity attribute value of the first control plane entity corresponds to the affinity attribute value of the third control plane entity, or (2) the anti-affinity attribute value of the first control plane entity does not correspond to the anti-affinity attribute value of the third control plane value.

9. The apparatus of claim 7, wherein:

the compute device is a first compute device, the first control plane entity having a priority attribute value different than a priority attribute value of a third control plane entity associated with a virtual machine instantiated at a second compute device.

10. The apparatus of claim 7, wherein:

the compute device is a first compute device;

the first control plane entity has a priority attribute value lower than a priority attribute value of a third control plane entity at a first time associated with a virtual machine instantiated at a second compute device when the second compute device is operative; and

the priority attribute value of the first control plane entity at a second time is higher than the priority attribute value of the third control plane entity at the first time when the second compute device is not operative.

11. The apparatus of claim 7, wherein:

the plurality of control plane entities includes (1) a third control plane entity having a priority attribute value, (2) a fourth control plane entity having a priority attribute value lower than the priority attribute value of the third control plane entity and (3) a fifth control plane entity having a priority attribute value lower than the priority attribute value of the fourth control plane entity; and

the scheduler agent configured to send a signal indicating that the compute device associated with the third control plane entity is not operative such that the priority attribute value of the fourth control plane entity and the priority attribute value of the fifth control plane entity are increased in response to the signal indicating that the compute device associated with the third control plane entity is not operative.

12. The apparatus of claim 7, wherein:

the compute device is a first compute device; and

the scheduler agent configured to send a signal indicating a status of the virtual machine on the first compute device, the scheduler agent configured to receive a signal to un-instantiate the virtual machine on the first compute device after the signal is sent, the virtual machine for the first control plane entity being configured at a second compute device after the signal is sent from the scheduler agent.

13. The apparatus of claim 7, wherein:

the scheduler agent is configured to receive the signal designating the first control plane entity from a scheduler at a control device;

the compute device is a first compute device; and

the scheduler agent configured to send, to the scheduler at the control device, an update of state information of the first control plane entity when the state information of the first control plane entity changes.

14. A method, comprising:

receiving a control plane request associated with a switch fabric system having a data plane and a control plane separate from the data plane;

designating a first control plane entity based on the control plane request and state information of each control plane entity from a plurality of control plane entities associated with the control plane and instantiated as a virtual machine, the state information associating the first control plane entity with a second control plane entity from the plurality of control plane entities and instantiated as a first virtual machine at a compute device of the switch fabric system, the state information including a first set of values indicating a proximity preference that the first control plane entity is executed at the compute device, the state information including a second set of values indicating a proximity preference that the first control plane entity is executed at a redundant compute device different from the compute device; and

sending a signal to the compute device of the switch fabric system, in response to the control plane request and when a subset of the first set of values that is associated with the first control plane entity and the second control plane entity is larger than a subset of the second set of values that is associated with the first control plane entity and the second control plane entity, such that the first control plane entity is instantiated as a second virtual machine at the compute device by a scheduler included in a plurality of schedulers.

15. The method of claim 14, wherein:

the compute device is from a plurality of compute devices;

the first set of values is a set of affinity attribute values, the second set of values is a set of anti-affinity attribute values;

each control plane entity from the plurality of control plane entities is associated with an affinity attribute value from the first set of values and an anti-affinity attribute value from the second set of values;

the designating the first control plane entity including designating the first control plane entity such that the first control plane entity is associated with an affinity attribute value from the first set of values and an anti-affinity attribute value from the second set of values;

the subset of the first set of values including the affinity attribute value associated with the first control plane entity, the subset of the second set of values including the anti-affinity attribute value associated with the first control plane entity.

16. The method of claim 14, wherein:

the designating the first control plane entity including designating the first control plane entity such that the first control plane entity is associated with a priority attribute value;

the second control plane entity is associated with a priority attribute value; and

one of the priority attribute value of the first control plane entity or the priority attribute value of the second plane entity is a primary value and the remaining attribute value of the first control plane entity or the priority attribute value of the second control plane entity is a secondary value.

17. The method of claim 14, wherein:

the compute device is a first compute device;

the plurality of control plane entities includes a third control plane entity having a priority attribute value and a fourth control plane entity having a priority attribute value lower than the priority attribute value of the third control plane entity;

the method further comprising;

receiving a signal indicating that a second compute device associated with the third control plane entity is not operative; and

modifying the priority attribute value of the fourth control plane entity in response to the signal indicating that the second compute device associated with the third control plane entity is not operative.

18. The method of claim 14, wherein:

the compute device is a first compute device;

the plurality of control plane entities includes (1) a third control plane entity having a priority attribute value, (2) a fourth control plane entity having a priority attribute value lower than the priority attribute value of the third control plane entity and (3) a fifth control plane entity having a priority attribute value lower than the priority attribute value of the fourth plane entity;

the method further comprising;

receiving a signal indicating that a second compute device associated with the third control plane entity is not operative; and

increasing the priority attribute value of the fourth control plane entity and increasing the priority attribute value of the fifth control plane entity in response to the signal indicating that the second compute device associated with the third control plane entity is not operative.

19. The method of claim 14, the method further comprising:

modifying, after the sending, at least one attribute value for the second control plane entity in response to the control plane request and based on the state information.