Method and apparatus for efficient TCP connection handoff

• US 7,877,490 B1
• Filed: 12/28/2007
• Issued: 01/25/2011
• Est. Priority Date: 12/28/2007
• Status: Active Grant

• Current Assignee: Innovations In Memory LLC
• Original Assignee: Violin Memory Incorporated
• Inventors: Huang, Qing, Patterson, Martin, Talagala, Nisha, Chitta, Rama
• Primary Examiner(s): ISMAIL, SHAWKI SAIF
• Application Number:
  US11/966,811
• Time in Patent Office: 1,124 Days
• Field of Search: 709/203, 709227-228, 709/238
• US Class Current: 709/227
• CPC Class Codes: H04L 67/1097 for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
• CPC Class Codes: H04L 67/148 Migration or transfer of sessions
• CPC Class Codes: H04L 69/163 In-band adaptation of TCP data exchange; In-band control procedures
• CPC Class Codes: H04L 69/28 Timers or timing mechanisms used in protocols

Abstract

A method for efficient communications with a cluster-based architecture preserves various aspects of integrity throughout one or more connections with a client, even in the midst of connection migration between nodes in the cluster. According to one aspect, the invention provides a mechanism for preventing the loss of packets arising from a TCP connection migration within the cluster. According to another aspect, the invention provides a mechanism for uniquely identifying conflicting TCP connections migrated to a common node. According to a still further aspect, the invention provides a distributed TCP timestamp mechanism so that the sender and receiver will have a consistent view of the timestamp even when each node has different local clock values and regardless of how many times the socket has been migrated.

Claims

1. A method comprising:

receiving a first network connection to a client at a first node of a storage cluster;

first migrating the first connection to a second node of the storage cluster;

receiving a second network connection to the client at a third node of the storage cluster;

second migrating the second connection to the second node of the storage cluster while the first connection is also migrated to the second node;

ensuring jointly at the first, second, and third nodes;

that timestamps associated with the connection continue to monotonically increase after the migrations;

that packets associated with the connection are not dropped within the storage cluster after the second migration;

that packets associated with the network connection do not conflict with other packets associated with a different network connection after the first migration, and after a concurrent third migration of the different network connection to the second node,

wherein the client uses a virtual IP address for connection with the storage cluster, and wherein the migration occurs transparently to the client.

2. The method of claim 1, wherein the connections are TCP connections.

3. The method of claim 1, wherein the ensuring step includes:

maintaining a plurality of received packets associated with the connection at the first node after the first migration; and

sending the maintained plurality of received packets to the third node after the second migration.

4. The method of claim 1, wherein the ensuring step includes:

overwriting header values in the first and second packets at the first and third nodes, respectively, wherein the overwriting step includes;

obtaining different unique identifiers associated with the first and second connections, respectively; and

adjusting a port number in the first and second packets using the different unique identifiers, respectively.

5. A storage apparatus comprising:

a first node that receives a network connection to a client;

second and third different nodes capable of handling the network connection;

a handoff mechanism that causes the network connection to the client to be first migrated from the first node to the second node, and if necessary, second migrated from the second node to the third node; and

an application running in the first, second and third nodes that jointly ensures;

that timestamps associated with the connection continue to monotonically increase after the migrations,

that packets associated with the connection are not dropped within the storage cluster after the second migration, and

that packets associated with the network connection do not conflict with other packets associated with a different network connection after the first migration, and after a concurrent third migration of the different network connection to the second node,

wherein the client uses a virtual IP address for the network connection with the nodes, and

wherein the first and second migrations occur transparently to the client.

6. The apparatus of claim 5, wherein the connections are TCP connections.