Internet protocol data mirroring

• US 7,386,610 B1
• Filed: 09/18/2000
• Issued: 06/10/2008
• Est. Priority Date: 09/18/2000
• Status: Expired due to Term

• Current Assignee: Hewlett Packard Enterprise Development LP (Hewlett-Packard Enterprise Company)
• Original Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Inventors: Vekiarides, Nicos A.
• Primary Examiner(s): Etienne; Ario
• Assistant Examiner(s): EL CHANTI, HUSSEIN A
• Application Number:
  US09/664,499
• Time in Patent Office: 2,822 Days
• Field of Search: 709/206, 709/212, 709/213, 709216-219, 709/227, 709/223, 709/224, 709/249
• US Class Current: 709/224
• CPC Class Codes: G06F 11/2071 using a plurality of controllers
• CPC Class Codes: G06F 11/2079 Bidirectional techniques
• CPC Class Codes: H04L 67/1095 Replication or mirroring of data, e.g. scheduling or transport for data synchronisation between network nodes
• CPC Class Codes: H04L 67/1097 for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
• CPC Class Codes: H04L 69/16 Implementation or adaptation of Internet protocol [IP], of transmission control protocol [TCP] or of user datagram protocol [UDP]
• CPC Class Codes: H04L 69/162 involving adaptations of sockets based mechanisms secure socket layer H04L63/168
• CPC Class Codes: H04L 69/163 In-band adaptation of TCP data exchange; In-band control procedures
• CPC Class Codes: H04L 69/164 Adaptation or special uses of UDP protocol

Abstract

A method, system, and computer program product for mirroring data in a computer network is described. At least one connection is established between a local storage server and a mirror storage server. A primary storage request is received from a network host at the local storage server. A mirror storage request is sent across the established at least one connection from the local storage server, wherein the mirror storage request corresponds to the received primary storage request. The mirror storage request is processed at the mirror storage server. A first heartbeat signal is sent from the local storage server to the mirror storage server. A second heartbeat signal is sent from the mirror storage server to the local storage server. Data of the received mirror storage request is stored in a mirror storage device corresponding to a primary storage device. A response is sent across the established at least one connection from the mirror storage server, wherein the response indicates whether the storing of data of the received mirror storage request step was successful. An interruption may be detected in the second heartbeat signal at the local storage server. The established at least one connection is closed. Mirror storage requests are queued. The second heartbeat signal is received at the local storage server after the detected interruption of the second heartbeat signal. The closed at least one connection is re-established. The queued mirror storage requests are sent across the re-established at least one connection after the re-establishing step.

Claims

1. A method of mirroring data in a computer network, comprising the steps of:

establishing at least one connection between a local storage server and a mirror storage server;

receiving a primary storage request from a network host at the local storage server;

sending a mirror storage request across the established at least one connection from the local storage server to the mirror storage server, wherein the mirror storage request corresponds to the received primary storage request;

processing the mirror storage request at the mirror storage server;

sending a first heartbeat signal at regular first intervals from the local storage server to the mirror storage server;

sending a second heartbeat signal at regular second intervals from the mirror storage server to the local storage server;

monitoring reception of the first heartbeat signal and the second heartbeat signal for interruption in the regular receipt thereof respectively;

detecting an interruption in the second heartbeat signal at the local storage server; and

closing the established at least one connection.

2. The method of claim 1, further comprising the step of:

queuing mirror storage requests that result from primary storage requests that are received during the detected interruption.

3. The method of claim 2, further comprising the steps of:

receiving the second heartbeat signal at the local storage server after the detected interruption of the second heartbeat signal; and

re-establishing the closed at least one connection between the local storage server and the mirror storage server.

4. The method of claim 3, wherein said mirror storage request sending step comprises the step of:

sending the queued mirror storage requests across the re-established at least one connection after said re-establishing step.

5. The method of claim 4, wherein said detecting step comprises the step of:

detecting an interruption in the second heartbeat signal at the local storage server that has a duration longer than a first predetermined amount of time.

6. The method of claim 3, wherein said re-establishing step comprises the steps of:

monitoring the second heartbeat signal for a probationary interval of time; and

re-establishing the closed at least one connection between the local storage server and the mirror storage server only if no interruptions in the second heartbeat signal are detected during said monitoring step.

7. The method of claim 1, wherein said processing step comprises:

storing data of the received mirror storage request in a mirror storage device corresponding to a primary storage device.

8. The method of claim 7, further comprising the step of:

sending a response across the established at least one connection from the mirror storage server to the local storage server, wherein the response indicates whether said storing data step was successful.

9. The method of claim 5, wherein said establishing step comprises the steps of:

establishing n connections between the local storage server and the mirror storage server, wherein each of the n connections is between one of n worker threads in the local storage server and one of n connection threads in the mirror storage server, wherein n≧

1;

storing a local connection array of n elements on the local storage server, wherein each element of the local connection array corresponds to one of the n local worker thread that operates on the local storage server; and

storing a mirror connection array of n elements on the mirror storage server, wherein each element of the mirror connection array corresponds to one of the n connection threads on the mirror storage server.

10. The method of claim 9, wherein said local connection array storing step comprises the step of:

storing a local connection array of n elements, wherein each element comprises a socket and a timestamp; and

wherein said mirror connection array storing step comprises the step of;

storing a mirror connection array of n elements, wherein each element comprises a socket parameter and a timestamp parameter.

11. The method of claim 10, wherein said establishing step further comprises the step of:

establishing each of the n connections according to the socket parameter stored in the corresponding one of the n elements of the stored local connection array.

12. The method of claim 11, further comprising the steps of:

establishing a mirror heartbeat sender thread and a mirror heartbeat receiver thread in the mirror storage server; and

establishing a local heartbeat sender thread and a local heartbeat receiver thread in the local storage server.

13. The method of claim 12, wherein the first heartbeat signal sending step and said second heartbeat signal sending step each further comprise the step of:

sending a message at time intervals of a second predetermined amount of time.

14. The method of claim 13, wherein said first heartbeat signal sending step further comprises the step of:

updating the timestamp parameter of each of the n elements of the mirror connection array whenever the message on the first heartbeat signal is received by the mirror heartbeat receiver thread; and

wherein said second heartbeat signal sending step further comprises the step of;

updating the timestamp parameter of each of the n elements of the local connection array whenever the message on the second heartbeat signal is received by the local heartbeat receiver thread.

15. The method of claim 14, wherein said detecting step further comprises the step of:

indicating in one of the n elements of the mirror connection array that the corresponding one of the established n connections is closed if the timestamp parameter of the one of the n elements is older than the first predetermined amount of time.

16. The method of claim 15, wherein said closing step comprises the steps of:

timing out one of the n connection threads on the mirror storage server if a request on the corresponding one of the established n connections has not arrived in a third predetermined amount of time; and

closing and exiting the timed out connection thread if the corresponding one of the n elements in the mirror connection array is indicated to be closed.

17. The method of claim 16, further comprising the steps of:

receiving a first message on the first heartbeat signal after an interruption of the first heartbeat signal; and

re-establishing the n connections between the local storage server and the corresponding connection threads on the mirror storage server.

18. The method of claim 17, wherein said second heartbeat signal receiving step comprises the step of:

receiving a first message on the second heartbeat signal after an interruption of the second heartbeat signal.

19. The method of claim 1, wherein the local storage server is operating in an asynchronous mirror mode, the method further comprising:

processing the primary storage request; and

sending the results of the processed primary storage request to the network host.

20. The method of claim 1, wherein the local storage server is operating in a synchronous mirror mode, the method further comprising:

processing the primary storage request;

waiting for a response corresponding to the sent mirror storage request from the mirror storage server; and

sending the results of the processed primary storage request to the network host after the response is received from the mirror storage server.

21. The method of claim 1, the method further comprising:

determining whether a LUN related to the received primary storage request is designated to be mirrored.

22. The method of claim 1, wherein the established at least one connection is a TCP connection.

23. The method of claim 13, wherein said sending a message steps each comprise the step of:

sending a user datagram protocol message at time intervals of the second predetermined amount of time.

24. The method of claim 1, wherein at least one of the step of sending a first heartbeat signal and the step of sending a second heartbeat signal includes:

periodically sending a User Datagram Protocol (UDP) message.

26. The method of claim 24, further comprising the steps of:

receiving at least a second local storage request at the local storage server; and

queuing at least a second local mirror storage request at the local storage server, wherein the at least a second local mirror storage request corresponds to the received at least a second local storage request.

27. The method of claim 26 further comprising the steps of:

receiving the second heartbeat signal at the local storage server after the detected interruption of the second heartbeat signal; and

re-establishing the closed first connection between the local storage server and the mirror storage server.

28. The method of claim 27, further comprising the step of:

sending the queued at least a second local mirror storage request across the re-established first connection after said re-establishing step.

29. The method of claim 24, further comprising:

receiving at least a second remote storage request at the remote storage server; and

queuing the at least a second remote mirror storage request at the remote storage server, wherein the at least a second remote mirror storage request corresponds to the received at least a second remote storage request.

30. The method of claim 29, further comprising the steps of:

receiving the first heartbeat signal at the remote storage server after the detected interruption of the first heartbeat signal; and

re-establishing the closed second connection between the local storage server and the mirror storage server.

31. The method of claim 30, further comprising the step of:

sending the queued at least a second remote mirror storage request across the re-established second connection after said re-establishing step.

25. A method of bi-directional mirroring of data in computer networks, comprising the steps of:

establishing a first connection between a local storage server and a remote storage server;

establishing a second connection between the local storage server and the remote storage server;

receiving a first local storage request from a first network host at the local storage server;

sending a first local mirror storage request from the local storage server across the first connection, wherein the first local mirror storage request corresponds to the first received local storage request;

receiving the first local mirror storage request at the remote storage server;

storing data received in the first local mirror storage request in at least one remote storage device coupled to the remote storage server;

receiving a first remote storage request from a second network host at the remote storage server;

sending a first remote mirror storage request from the remote storage server across the second connection, wherein the first remote mirror storage request corresponds to the received first remote storage request;

receiving the first remote mirror storage request at the local storage server;

storing data received in the first remote mirror storage request in at least one local storage device coupled to the local storage server;

sending a first heartbeat signal from the local storage server to the mirror storage server;

sending a second heartbeat signal from the remote storage server to the local storage server;

monitoring reception of the first heartbeat signal and the second heartbeat signal for interruption in the regular receipt thereof, respectively;

detecting an interruption in the second heartbeat signal at the local storage server; and

closing the first connection.

32. The method of claim 25, wherein at least one of the step of sending a first heartbeat signal and the step of sending a second heartbeat signal includes:

periodically sending a User Datagram Protocol (UDP) message.

33. A system for mirroring data in a computer network, comprising:

a local storage server; and

a mirror storage server;

wherein the local storage server receives a storage request, outputs a mirror storage request, and outputs a first heartbeat signal at regular first intervals to the mirror storage server; and

wherein the mirror storage server receives and processes said mirror storage request, outputs a response corresponding to said mirror storage request to said local storage server, outputs a second heartbeat signal at regular second intervals to said local storage server, and monitors reception of said first heartbeat signal for interruption in the regular receipt thereof;

wherein at least one of said local storage server and said mirror storage server establishes at least one connection therebetween;

wherein said local storage server monitors reception of said second heartbeat signal and detects an interruption in the regular receipt thereof; and

wherein at least one of said local storage server and said mirror storage server closes the established at least one connection.

34. The system of claim 33, wherein said local storage server comprises:

a local work thread generator module that generates n local worker threads; and

a local connection array that includes n elements; and

wherein said a mirror storage server comprises;

a mirror connection array that comprises n elements; and

a mirror connection thread generator module that generates n mirror connection threads.

35. The system of claim 34, wherein each of said n mirror connection threads are connected to a corresponding one of said n local worker threads using a corresponding socket parameter stored in each of said n elements of said mirror connection array to form n corresponding connections.

36. The system of claim 35, wherein said local storage server comprises:

a local heartbeat thread generator module that generates a local heartbeat sender thread and a local heartbeat receiver thread; and

wherein said mirror storage server comprises;

a mirror heartbeat thread generator module that generates a mirror heartbeat sender thread and a mirror heartbeat receiver thread;

wherein said local heartbeat sender thread sends said first heartbeat signal to said mirror heartbeat receiver thread, and said mirror heartbeat sender thread sends said second heartbeat signal to said local heartbeat receiver thread.

37. The system of claim 36, wherein each of n elements of said local connection array comprises a timestamp parameter, wherein said local heartbeat receiver thread updates each said timestamp parameter in said local connection array when a message is received on said second heartbeat signal.

38. The system of claim 37, wherein said local heartbeat sender thread indicates in at least one of the n elements of the mirror connection array that the corresponding at least one of the established n connections is closed if the corresponding timestamp parameter is older than the first predetermined amount of time.

39. The system of claim 37, wherein one of said n mirror connection threads times out if a corresponding mirror storage request is not received from said local storage server for a second predetermined amount of time, wherein after said time out said one of said n mirror connection threads checks the timestamp of the corresponding one of the n elements and exits if said corresponding timestamp is older than a second predetermined amount of time.

40. The system of claim 33, wherein at least one of the local storage server and the mirror storage server is operable to send the first and second heartbeat signals, respectively, by

periodically sending a User Datagram Protocol (UDP) message.

41. A computer program product comprising a computer useable medium storing a computer program thereon for enabling at least one processor to mirror data in a computer network, said computer program product comprising:

means for enabling the processor to establish at least one connection between a local storage server and a mirror storage server;

means for enabling the processor to receive a primary storage request from a network host at the local storage server;

means for enabling the processor to send a mirror storage request across the established at least one connection from the local storage server to the mirror storage server, wherein the mirror storage request corresponds to the received primary storage request;

means for enabling the processor to send a first heartbeat signal at regular first intervals from the local storage server to the mirror storage server;

means for enabling the processor to send a second heartbeat signal at regular second intervals from the mirror storage server to the local storage server;

means for monitoring reception of the first heartbeat signal and the second heartbeat signal for interruption in the regular receipt thereof, respectively;

means for enabling the processor to detect an interruption in the second heartbeat signal at the local storage server; and

means for enabling the processor to close the established at least one connection.

42. The computer program product of claim 41, further comprising:

means for enabling the processor to queue mirror storage requests that result from primary storage requests that are received during the detected interruption.

43. The computer program product of claim 42, further comprising:

means for enabling the processor to receive the second heartbeat signal at the local storage server after the detected interruption of the second heartbeat signal; and

means for enabling the processor to re-establish the closed at least one connection between the local storage server and the mirror storage server.

44. The computer program product of claim 43, further comprising:

means for enabling the processor to send the queued mirror storage requests across the re-established at least one connection.

45. The method of claim 41, further comprising:

means for enabling the processor to receive a response across the established at least one connection from the mirror storage server, wherein the response indicates whether data in said sent mirror storage request was successfully stored in a mirror storage device.

46. The computer program product of claim 41, wherein at least one of the means for enabling the processor to send a first heartbeat signal and the means for enabling the processor to send a second heartbeat signal includes:

means for periodically sending a User Datagram Protocol (UDP) message.

47. A method of mirroring data in a computer network, comprising the steps of:

establishing at least one connection between a local storage server and a mirror storage server;

receiving a primary storage request from a network host at the local storage server;

sending a mirror storage request across the established at least one connection from the local storage server to the mirror storage server, wherein the mirror storage request corresponds to the received primary storage request;

processing the mirror storage request at the mirror storage server;

sending a first heartbeat signal at regular first intervals from the local storage server to the mirror storage server;

sending a second heartbeat signal, independent of the first heartbeat signal, at regular second intervals from the mirror storage server to the local storage server; and

monitoring reception of at least one the first heartbeat signal and the second heartbeat signal for interruption in the regular receipt thereof respectively;

detecting an interruption in the second heartbeat signal at the local storage server; and

closing the established at least one connection.

48. A method of mirroring data in a computer network, comprising the steps of:

establishing at least one connection between a local storage server and a mirror storage server;

receiving a primary storage request from a network host at the local storage server;

sending a mirror storage request across the established at least one connection from the local storage server to the mirror storage server, wherein the mirror storage request corresponds to the received primary storage request;

processing the mirror storage request at the mirror storage server;

sending a first heartbeat signal using a connectionless protocol at regular first intervals from the local storage server to the mirror storage server;

sending a second heartbeat signal using a connectionless protocol at regular second intervals from the mirror storage server to the local storage server; and

monitoring reception of at least one the first heartbeat signal and the second heartbeat signal for interruption in the regular receipt thereof, respectively;

detecting an interruption in the second heartbeat signal at the local storage server; and

closing the established at least one connection.