Elastically managing a service node group

• US 9,755,898 B2
• Filed: 12/12/2014
• Issued: 09/05/2017
• Est. Priority Date: 09/30/2014
• Status: Active Grant

• Current Assignee: Nicira Incorporated (Broadcom, Inc.)
• Original Assignee: Nicira Incorporated (Broadcom, Inc.)
• Inventors: Jain, Jayant, Sengupta, Anirban, Parthasarathy, Mohan
• Primary Examiner(s): Pham, Chi H
• Assistant Examiner(s): HYUN, SOON D
• Application Number:
  US14/569,452
• Publication Number:
  US 20160094389A1
• Time in Patent Office: 998 Days
• Field of Search: None
• CPC Class Codes: H04L 41/0813 characterised by the conditions triggering a change of settings
• CPC Class Codes: H04L 41/0895 Configuration of virtualised networks or elements, e.g. virtualised network function or OpenFlow elements
• CPC Class Codes: H04L 41/40 using virtualisation of network functions or resources, e.g. SDN or NFV entities
• CPC Class Codes: H04L 41/5054 Automatic deployment of services triggered by the service manager, e.g. service implementation by automatic configuration of network components
• CPC Class Codes: H04L 43/0817 by checking functioning
• CPC Class Codes: H04L 43/16 Threshold monitoring
• CPC Class Codes: H04L 45/7453 using hashing
• CPC Class Codes: H04L 47/125 by balancing the load, e.g. traffic engineering
• CPC Class Codes: H04L 47/6225 Fixed service order, e.g. Round Robin
• CPC Class Codes: H04L 63/02 for separating internal from external traffic, e.g. firewalls
• CPC Class Codes: H04L 67/1008 based on parameters of servers, e.g. available memory or workload monitoring of computer activity G06F11/30
• CPC Class Codes: H04L 67/1027 Persistence of sessions during load balancing
• CPC Class Codes: H04L 67/1031 Controlling of the operation of servers by a load balancer, e.g. adding or removing servers that serve requests
• CPC Class Codes: H04L 69/22 Parsing or analysis of headers

Abstract

Some embodiments provide an elastic architecture for providing a service in a computing system. To perform a service on the data messages, the service architecture uses a service node (SN) group that includes one primary service node (PSN) and zero or more secondary service nodes (SSNs). The service can be performed on a data message by either the PSN or one of the SSN. However, in addition to performing the service, the PSN also performs a load balancing operation that assesses the load on each service node (i.e., on the PSN or each SSN), and based on this assessment, has the data messages distributed to the service node(s) in its SN group. Based on the assessed load, the PSN in some embodiments also has one or more SSNs added to or removed from its SN group. To add or remove an SSN to or from the service node group, the PSN in some embodiments directs a set of controllers to add (e.g., instantiate or allocate) or remove the SSN to or from the SN group. Also, to assess the load on the service nodes, the PSN in some embodiments receives message load data from the controller set, which collects such data from each service node. In other embodiments, the PSN receives such load data directly from the SSNs.

Claims

1. A non-transitory machine readable medium storing a primary service node (PSN) for execution on a host computer, the PSN comprising a program for managing a service node (SN) group that performs a service on data messages, the SN group comprising a plurality of service nodes, wherein one of the service nodes is the PSN and each other service node is a secondary service node (SSN), the program comprising sets of instructions for:

receiving, at the PSN, all data messages for the SN group and identifying, for an incoming data message, an SN in the group of SNs to perform the service on data messages of a data message flow to which the incoming data message belongs;

if the identified SN is one of the SSNs, forwarding the data message to the identified SSN; and

if the identified SN is the PSN, performing the service on the data message at the PSN

analyzing message traffic data relating to data messages that each service node in the SN group processes; and

based on the analysis, adding a service node to the SN group.

2. The non-transitory machine readable medium of claim 1,

wherein the set of instructions for adding a service node comprises a set of instructions for determining that a data message load on at least a first subset of service nodes has exceeded a first threshold value;

wherein the service node is added to the SN group to alleviate the data message load on the service nodes in the group.

3. The non-transitory machine readable medium of claim 2, wherein the first subset of service nodes includes just one service node.

4. The non-transitory machine readable medium of claim 2, wherein the first subset of service nodes includes more than one service node.

5. The non-transitory machine readable medium of claim 2, wherein the program further comprises sets of instructions for:

after adding the service node to the SN group, analyzing new message traffic data relating to data messages that each service node in the SN group processes and determining that a data message load on a second subset of service nodes has dropped below a second threshold;

based on the determination, removing a service node from the SN group.

6. The non-transitory machine readable medium of claim 5, wherein the first and second thresholds are different.

7. The non-transitory machine readable medium of claim 5, wherein the second subset of service nodes includes just one service node.

8. The non-transitory machine readable medium of claim 5, wherein the second subset of service nodes includes more than one service node.

9. The non-transitory machine readable medium of claim 1, wherein the set of instructions for adding a service node to the SN group comprises a set of instructions for directing a controller set to add the service node to the SN group.

10. The non-transitory machine readable medium of claim 9, wherein the program further comprises a set of instructions for informing each SSN of the addition of the new service node to the SN group.

11. The non-transitory machine readable medium of claim 9, wherein the program further comprises a set of instructions for providing notification of the addition of the service node to a set of load balancers that direct data message flows to the service nodes in the SN group.

12. The non-transitory machine readable medium of claim 9, wherein the controller set informs each service node of the addition of the new service node to the SN group.

13. The non-transitory machine readable medium of claim 9, wherein the program further comprises sets of instructions for:

after adding the service node to the SN group, analyzing new message traffic data relating to data messages that each service node in the SN group processes and determining that the data message load on a subset of service nodes has dropped below a threshold;

based on the determination, directing each SSN to remove a service node from the SN group.

14. The non-transitory machine readable medium of claim 13, wherein the program further comprises a set of instructions for directing the controller set to remove the service node from the SN group after receiving confirmation that the service nodes no longer use a service node.

15. The non-transitory machine readable medium of claim 9, wherein the program further comprises a set of instructions for receiving message traffic data from each SSN in the SN group.

16. The non-transitory machine readable medium of claim 9, wherein the program further comprises a set of instructions for receiving message traffic data from the controller set, wherein the controller set receives message traffic data from each of the service nodes, aggregates the message traffic data and distributes the message traffic data to the PSN.

17. The non-transitory machine readable medium of claim 16, wherein the controller set comprises:

a first subset of controllers for collecting message load data from all service nodes, aggregating the message load data and distributing the load data to the PSN; and

a second subset of controllers for modifying the SN group membership by adding or removing service nodes to the group.

18. A non-transitory machine readable medium of storing a program for managing service nodes that perform a service on data messages, the program comprising sets of instructions for:

defining a service node (SN) group comprising plurality of service nodes, each service node including a service virtual machine (SVM);

analyzing message traffic data relating to data messages that each service node in the SN group processes;

based on the analysis, adding a service node to the SN group by directing a controller set to add the service node to the SN group, wherein the controller set adds a service node by instantiating a new SVM and adding the SVM to the SN group.

19. The non-transitory machine readable medium of claim 18,

wherein the set of instructions for adding a service node comprises a set of instructions for determining that a data message load on at least a first subset of service nodes has exceeded a first threshold value;

wherein the service node is added to the SN group to alleviate the data message load on the service nodes in the group.

20. The non-transitory machine readable medium of claim 19, wherein the program further comprises sets of instructions for:

after adding the service node to the SN group, analyzing new message traffic data relating to data messages that each service node in the SN group processes and determining that a data message load on a second subset of service nodes has dropped below a second threshold;

based on the determination, removing a service node from the SN group.

21. A non-transitory machine readable medium of storing a program for managing service nodes that perform a service on data messages, the program comprising sets of instructions for:

defining a service node (SN) group comprising plurality of service nodes, each service node including a service virtual machine (SVM);

analyzing message traffic data relating to data messages that each service node in the SN group processes;

based on the analysis, adding a service node to the SN group by directing a controller set to add the service node to the SN group, wherein the controller set adds a service node by allocating a previously instantiated SVM to the SN group.

22. The non-transitory machine readable medium of claim 21,

wherein the set of instructions for adding a service node comprises a set of instructions for determining that a data message load on at least a first subset of service nodes has exceeded a first threshold value;

wherein the service node is added to the SN group to alleviate the data message load on the service nodes in the group.

23. The non-transitory machine readable medium of claim 22, wherein the program further comprises sets of instructions for:

after adding the service node to the SN group, analyzing new message traffic data relating to data messages that each service node in the SN group processes and determining that a data message load on a second subset of service nodes has dropped below a second threshold;

based on the determination, removing a service node from the SN group.