Stateful services on stateless clustered edge

• US 9,866,473 B2
• Filed: 11/14/2014
• Issued: 01/09/2018
• Est. Priority Date: 11/14/2014
• Status: Active Grant

• Current Assignee: Nicira Incorporated (Broadcom, Inc.)
• Original Assignee: Nicira Incorporated (Broadcom, Inc.)
• Inventors: Parsa, Mike, Jain, Jayant, Hong, Xinhua, Sengupta, Anirban, Fan, Kai-Wei
• Primary Examiner(s): Zhao, Wei
• Application Number:
  US14/541,517
• Publication Number:
  US 20160142296A1
• Time in Patent Office: 1,152 Days
• CPC Class Codes: G06F 21/85 interconnection devices, e.g. bus-connected or in-line devices
• CPC Class Codes: H04L 45/38 Flow based routing
• CPC Class Codes: H04L 45/46 Cluster building
• CPC Class Codes: H04L 45/7453 using hashing
• CPC Class Codes: H04L 61/2503 Translation of Internet protocol [IP] addresses
• CPC Class Codes: H04L 63/0218 Distributed architectures, e.g. distributed firewalls
• CPC Class Codes: H04L 67/02 based on web technology, e.g. hypertext transfer protocol [HTTP]
• CPC Class Codes: H04L 67/06 specially adapted for file transfer, e.g. file transfer protocol [FTP]
• CPC Class Codes: H04L 67/1001 for accessing one among a plurality of replicated servers

Abstract

In order to enable dynamic scaling of network services at the edge, novel systems and methods are provided to enable addition of add new nodes or removal of existing nodes while retaining the affinity of the flows through the stateful services. The methods provide a cluster of network nodes that can be dynamically resized to handle and process network traffic that utilizes stateful network services. The existing traffic flows through the edge continue to function during and after the changes to membership of the cluster. All nodes in the cluster operate in active-active mode, i.e., they are receiving and processing traffic flows, thereby maximizing the utilization of the available processing power.

Claims

1. A method of performing stateful services on a first flow and a second flow different from the first flow but related to the first flow, the method comprising:

performing a stateful service for the first flow at a first node in a plurality of nodes that each performs the stateful service, wherein state information of the first flow is maintained by the first node;

receiving, at the first node, packets belonging to the second flow from a second node in the plurality of nodes, wherein a consistent hash function is used to initially assign particular flows to particular nodes in the plurality of nodes to perform the stateful service, wherein the consistent hash function assigns the first flow to the first node and the second flow to the second node, wherein the second node receives the packets belonging to the second flow based on the initial assignment of the consistent hash and forwards the second flow'"'"'s packets to the first node because the second flow is related to the first flow; and

performing the stateful service on the received packets of the second flow at the first node by using the state information of the first flow, wherein the stateful service for the second flow requires the state information of the first flow.

2. The method of claim 1, wherein the first flow is a control flow and the second flow is a data flow.

3. The method of claim 1, wherein the first flow is a control flow and the second flow is a data flow of a same file transfer protocol (FTP) session.

4. The method of claim 1, wherein the second node comprises an indirection table having an entry for forwarding packets of the second flow from the second node to the first node.

5. The method of claim 4, wherein the first node comprises a pinned flow table having an entry for keeping and processing packets of the second flow at the first node.

6. The method of claim 1, wherein the consistent hash function is based on flow identifiers in packets.

7. The method of claim 1, wherein the plurality of nodes is an edge service cluster providing stateful services.

8. A method of performing stateful services on a first flow and a second flow different from the first flow but related to the first flow, the method comprising:

performing a stateful service for the first flow at a first node in a plurality of nodes that each performs the stateful service, wherein state information of the first flow is maintained by the first node;

identifying a second node in the plurality of nodes for performing the stateful service for a second flow, wherein the second flow requires the state information of the first flow; and

forwarding the state information of the first flow from the first node to the second node based on the identification, for the second node to perform the stateful service on the second flow that is related to the first flow but is a different flow than the first flow.

9. The method of claim 8, wherein the first flow is a control flow and the second flow is a data flow.

10. The method of claim 8, wherein the first flow is a control flow and the second flow is a data flow of a same file transfer protocol (FTP) session.

11. The method of claim 8, wherein identifying the second node comprises identifying the second node based on information received from a network manager.

12. The method of claim 8, wherein identifying the second node comprises identifying the second node based on information received from a particular node in the plurality of nodes.

13. The method of claim 8, wherein a hash of flow identifiers of a flow initially identifies an owner node of the flow, wherein the first node is the owner node of the first flow and the second node is the owner node of the second flow.

14. A non-transitory machine readable medium storing sets of instructions for performing stateful services on a first flow and a second flow different from the first flow but related to the first flow, the sets of instructions for execution by a set of processing units, the sets of instructions comprising sets of instructions for:

performing a stateful service for the first flow at a first node in a plurality of nodes that each performs the stateful service, wherein state information of the first flow is maintained by the first node;

receiving, at the first node, packets belonging to the second flow from a second node in the plurality of nodes, wherein a consistent hash function is used to initially assign particular flows to particular nodes in the plurality of nodes to perform the stateful service, wherein the consistent hash function assigns the first flow to the first node and the second flow to the second node, wherein the second node receives the packets belonging to the second flow based on the initial assignment of the consistent hash and forwards the second flow'"'"'s packets to the first node because the second flow is related to the first flow; and

performing the stateful service on the received packets of the second flow at the first node by using the state information of the first flow, wherein the stateful service for the second flow requires the state information of the first flow.

15. The non-transitory machine readable medium of claim 14, wherein the first flow is a control flow and the second flow is a data flow.

16. The non-transitory machine readable medium of claim 14, wherein the second node comprises an indirection table having an entry for forwarding packets of the second flow from the second node to the first node.

17. The non-transitory machine readable medium of claim 16, wherein the first node comprises a pinned flow table having an entry for keeping and processing packets of the second flow at the first node.

18. A non-transitory machine readable medium storing sets of instructions for performing stateful services on a first flow and a second flow different from the first flow but related to the first flow, the sets of instructions for execution by a set of processing units, the sets of instructions comprising sets of instructions for:

performing a stateful service for the first flow at a first node in a plurality of nodes that each performs the stateful service, wherein state information of the first flow is maintained by the first node;

identifying a second node in the plurality of nodes for performing the stateful service for a second flow, wherein the second flow requires the state information of the first flow; and

forwarding the state information of the first flow from the first node to the second node based on the identification, for the second node to perform the stateful service on the second flow that is related to the first flow but is a different flow than the first flow.

19. The non-transitory machine readable medium of claim 18, wherein the set of instructions for identifying the second node comprises a set of instructions for identifying the second node based on information received from a network manager.

20. The non-transitory machine readable medium of claim 18, wherein the set of instructions for identifying the second node comprises a set of instructions for identifying the second node based on information received from a particular node in the plurality of nodes.