System and a method for asynchronous replication for storage area networks

• US 20020133737A1
• Filed: 03/04/2002
• Published: 09/19/2002
• Est. Priority Date: 03/05/2001
• Status: Active Grant

• Current Assignee: Topio (NetApp, Inc.)
• Original Assignee: Sanpro Systems Incorporated
• Inventors: Novick, Yoram
• Granted Patent: US 7,096,382 B2
• Time in Patent Office: Days
• US Class Current: 714/5
• CPC Class Codes: G06F 11/1451 by selection of backup contents
• CPC Class Codes: G06F 11/1464 for networked environments
• CPC Class Codes: G06F 11/1469 Backup restoration techniques
• CPC Class Codes: G06F 11/1471 involving logging of persistent data for recovery
• CPC Class Codes: G06F 2201/82 Solving problems relating to consistency ensuring consistency in mirrored systems G06F11/2064
• CPC Class Codes: G06F 2201/835 Timestamp

Abstract

A data backup and recovery system for use with at least one server interconnected with at least one storage device, including at least one data recovery device, at least one associated data recovery storage device, controlled by the data recovery device, and at least one data communication monitor. A method for data backup and recovery is also disclosed.

Claims

1. A data backup and recovery system for use with at least one server interconnected with at least one storage device, said data backup and recovery system comprising:

at least one data recovery device;

at least one data recovery storage device associated with and controlled by said at least one data recovery device; and

at least one data communication monitor for providing to said at least one data recovery device at least control information bearing an order stamp regarding data communications between corresponding ones of said at least one server and said at least one storage device,

said at least one data recovery device being responsive to at least said control information bearing an order stamp for storing data on said at least one data recovery storage device in a manner which enables reconstruction of a representation of said data communications at a given earlier time but does not require that the data be sent to said at least one data recovery device in a given order or stored on said at least one data recovery storage device in a given order.

2. A data backup and recovery system according to claim 1 and wherein said data communication monitors are located other than only at said at least one storage device.

3. A data backup and recovery system according to claim 1 and wherein said data communication monitors also provide at least part of said data communications to said at least one data recovery device.

4. A data backup and recovery system according to claim 2 and wherein said data communication monitors also provide at least part of said data communications to said at least one data recovery device.

5. A data backup and recovery system according to claim 1 and wherein said at least one data recovery device is operative to receive said at least control information and to store data on said at least one data recovery storage device in parallel.

6. A data backup and recovery system according to claim 1 and wherein said data communications comprise data updates.

7. A data backup and recovery system according to claim 1 and wherein said reconstruction of a representation of said data communications at a given earlier time guarantees that if the order stamp of a first update is smaller than the order stamp of a second update, the second update is not stored on said at least one data recovery storage device unless the first update is stored on said at least one data recovery storage device.

8. A data backup and recovery system according to claim 1 and wherein said data communication monitors are associated with individual ones of said at least one server.

9. A data backup and recovery system according to claim 1 and wherein said data communication monitors are associated with network elements of a storage area network.

10. A data backup and recovery system according to claim 1 and wherein at least one of said control information and said data communications is communicated from said data communication monitors to said data recovery device via a network.

11. A data backup and recovery system according to claim 10 and wherein said network is a private network.

12. A data backup and recovery system according to claim 10 and wherein said network is a public network.

13. A data backup and recovery system according to claim 1 and wherein at least one of said control information and said data communications is communicated from said data communication monitors to said data recovery device via a storage area network.

14. A data backup and recovery system according to claim 1 and wherein said data communication monitors provide at least part of said data communications to said at least one data recovery storage device other than via said at least one data recovery device.

15. A data backup and recovery system according to claim 1 and also comprising at least one LOG storage device wherein said at least one LOG storage device comprise at least control information bearing a time mark regarding data communications between corresponding ones of said first plurality of servers and said plurality of storage devices via said storage area network.

16. A data backup and recovery system according to claim 15 and wherein said data communication monitors also store at least part of said data communications to said at least one LOG storage device.

17. A data backup and recovery system according to claim 16 and wherein said data communications stored to said at least one LOG storage device comprises data updates sent by said first plurality of servers to said second plurality of storage devices.

18. A data backup and recovery system according to claim 17 having said at least one storage device LOG such that if either said control information or said data communications or both are prematurely erased from said at least one data recovery device due to a failure or other event, said at least one data recovery device restores either said control information or said data communications or both from said at least one storage device LOG.

19. A data backup and recovery system according to claim 18 and wherein said at least one data recovery device resumes its activities with said restored data from said at least one storage device LOG.

20. A data backup and recovery system according to claim 17 and wherein said at least one data recovery device retrieves said at least part of said data communications from at least one storage device LOG for the purpose of storing said data to at least one data recovery storage device associated therewith in said time ordered manner.

21. A data backup and recovery system according to claim 18 and wherein said at least part of said data communications is communicated from said data communication monitors to said at least one storage device LOG via a network.

22. A data backup and recovery system according to claim 21 and wherein said network is a private network.

23. A data backup and recovery system according to claim 21 and wherein said network is a public network.

24. A data backup and recovery system according to claim 18 and wherein at least part of said data communications is communicated from said data communication monitors to said at least one storage device LOG via said storage area network.

25. A data backup and recovery system according to claim 17 wherein said at least one data recovery device retrieves both said control information and said at least part of said data communications from at least one storage device LOG for the purpose of storing said data to at least one data recovery storage device associated therewith in said time ordered manner.

26. A data backup and recovery system according to claim 25 and wherein both said control information and said at least part of said data communications are communicated from said data communication monitors to said at least one storage device LOG via a network.

27. A data backup and recovery system according to claim 26 and wherein said network is a private network.

28. A data backup and recovery system according to claim 26 and wherein said network is a public network.

29. A data backup and recovery system according to claim 25 and wherein both said control information and said at least part of said data communications are communicated from said data communication monitors to said at least one storage device LOG via said storage area network.

59. A data backup and recovery system according to claim 1 and wherein said reconstruction comprises sending said data communications from said at least one data recovery storage device to said at least one storage device.

60. A data backup and recovery system according to claim 1 and wherein said reconstruction comprises employing said at least one data backup and recovery system as at least one of said at least one server and said at least one storage device.

61. A data backup and recovery system according to claim 1 and wherein said at least one server and said at least one storage device are interconnected via a local area network (LAN).

62. A data backup and recovery system according to claim 1 and wherein said at least one server and said at least one storage device are interconnected via a storage area network (SAN).

63. A data backup and recovery system according to claim 1 and wherein said at least one storage device is a network attached storage (NAS) device.

64. A data backup and recovery system according to claim 61 and wherein said at least one data communication monitor monitors data communications between said at least one server and said at least one storage device over said LAN.

65. A data backup and recovery system according to claim 62 and wherein said at least one data communication monitor monitors data communications between said at least one server and said at least one storage device over said SAN.

66. A data backup and recovery system according to claim 1 and wherein said at least one server comprises said at least one data communication monitor.

67. A data backup and recovery system according to claim 1 and wherein said at least one storage device comprises said at least one data communication monitor.

68. A data backup and recovery system according to claim 62 and wherein said SAN comprises said at least one data communication monitor.

70. A method for data backup and recovery according to claim 69 and wherein said data communication monitors are provided other than only at said at least one storage device.

71. A method for data backup and recovery according to claim 69 and wherein said data communication monitors also provide at least part of said data communications to said at least one data recovery device.

72. A method for data backup and recovery according to claim 70 and wherein said data communication monitors also provide at least part of said data communications to said at least one data recovery device.

73. A method for data backup and recovery according to claim 69 and wherein said at least one data recovery device is operative to receive said at least control information and to store data on said at least one data recovery storage device in parallel.

74. A method for data backup and recovery according to claim 69 and wherein said data communications comprise data updates.

75. A method for data backup and recovery according to claim 69 and wherein said reconstruction of a representation of said data communications at a given earlier time guarantees that if the order stamp of a first update is smaller than the order stamp of a second update, the second update is not stored on said at least one data recovery storage device unless the first update is stored on said at least one data recovery storage device

76. A method for data backup and recovery according to claim 69 and wherein said data communication monitors are associated with individual ones of said at least one server.

77. A method for data backup and recovery according to claim 69 and wherein said data communication monitors are associated with network elements of a storage area network.

78. A method for data backup and recovery according to claim 69 and wherein at least one of said control information and said data communications is communicated from said data communication monitors to said data recovery device via a network.

79. A method for data backup and recovery according to claim 78 and wherein said network is a private network.

80. A method for data backup and recovery according to claim 78 and wherein said network is a public network.

81. A method for data backup and recovery according to claim 69 and wherein at least one of said control information and said data communications is communicated from said data communication monitors to said data recovery device via a storage area network.

82. A method for data backup and recovery according to claim 69 wherein said data communication monitors provide at least part of said data communications to said at least one data recovery storage device other than via said at least one data recovery device.

83. A method for data backup and recovery according to claim 69 and also comprising at least one LOG storage device wherein said at least one LOG storage device comprise at least control information bearing a time mark regarding data communications between corresponding ones of said first plurality of servers and said plurality of storage devices via said storage area network.

84. A method for data backup and recovery according to claim 83 and wherein said data communication monitors also store at least part of said data communications to said at least one LOG storage device.

85. A method for data backup and recovery according to claim 84 and wherein said data communications stored to said at least one LOG storage device comprises data updates sent by said first plurality of servers to said second plurality of storage devices.

86. A method for data backup and recovery according to claim 85 such that if either said control information or said data communications or both are prematurely erased from said at least one data recovery device due to a failure or other event, said at least one data recovery device restores either said control information or said data communications or both from said at least one storage device LOG.

87. A method for data backup and recovery according to claim 86 wherein said at least one data recovery device resumes its activities with said restored data from said at least one storage device LOG.

88. A method for data backup and recovery according to claim 85 wherein said at least one data recovery device retrieves said at least part of said data communications from at least one storage device LOG for the purpose of storing said data to at least one data recovery storage device associated therewith in said time ordered manner.

89. A method for data backup and recovery according to claim 86 and wherein said at least part of said data communications is communicated from said data communication monitors to said at least one storage device LOG via a network.

90. A method for data backup and recovery according to claim 89 and wherein said network is a private network.

91. A method for data backup and recovery according to claim 89 and wherein said network is a public network.

92. A method for data backup and recovery according to claim 86 and wherein at least part of said data communications is communicated from said data communication monitors to said at least one storage device LOG via said storage area network.

93. A method for data backup and recovery according to claim 85 wherein said at least one data recovery device retrieves both said control information and said at least part of said data communications from at least one storage device LOG for the purpose of storing said data to at least one data recovery storage device associated therewith in said time ordered manner.

94. A method for data backup and recovery according to claim 93 and wherein both said control information and said at least part of said data communications are communicated from said data communication monitors to said at least one storage device LOG via a network.

95. A method for data backup and recovery according to claim 94 and wherein said network is a private network.

96. A method for data backup and recovery according to claim 94 and wherein said network is a public network.

97. A method for data backup and recovery according to claim 93 and wherein both said control information and said at least part of said data communications are communicated from said data communication monitors to said at least one storage device LOG via said storage area network.

127. A method for data backup and recovery according to claim 69 and wherein said reconstruction comprises sending said data communications from said at least one data recovery storage device to said at least one storage device.

128. A method for data backup and recovery according to claim 69 and wherein said reconstruction comprises employing said at least one data backup and recovery system as at least one of said at least one server and said at least one storage device.

129. A method for data backup and recovery according to claim 69 and wherein said at least one server and said at least one storage device are interconnected via a local area network (LAN).

130. A method for data backup and recovery according to claim 69 and wherein said at least one server and said at least one storage device are interconnected via a storage area network (SAN).

131. A method for data backup and recovery according to claim 69 and wherein said at least one storage device is a network attached storage (NAS) device.

134. A method for data backup and recovery according to claim 69 and wherein said at least one server comprises said at least one data communication monitor.

135. A method for data backup and recovery according to claim 69 and wherein said at least one storage device comprises said at least one data communication monitor.

30. A data backup and recovery system for use with at least one server interconnected with at least one storage device, said data backup and recovery system comprising:

at least one data recovery device;

at least one data recovery storage device associated with and controlled by said at least one data recovery device; and

data communication monitors for providing to said at least one data recovery device at least control information bearing an order stamp regarding data communications between corresponding ones of said at least one server and said at least one storage device,

said at least one data recovery device being operative to receive said at least control information and to store data on said at least one data recovery storage device in parallel and not requiring that the data be received by said at least one data recovery device in a given order.

31. A data backup and recovery system according to claim 30 and wherein said data communication monitors are located other than only at said at least one storage device.

32. A data backup and recovery system according to claim 30 and wherein said data communication monitors also provide at least part of said data communications to said at least one data recovery device.

33. A data backup and recovery system according to claim 31 and wherein said data communication monitors also provide at least part of said data communications to said at least one data recovery device.

34. A data backup and recovery system according to claim 30 and wherein said at least one data recovery device is operative to receive said at least control information and to store data on said at least one data recovery storage device in parallel.

35. A data backup and recovery system according to claim 30 and wherein said data communications comprise data updates.

36. A data backup and recovery system according to claim 30 and wherein said reconstruction of a representation of said data communications at a given earlier time guarantees that if the order stamp of a first update is smaller than the order stamp of a second update, the second update is not stored on said at least one data recovery storage device unless the first update is stored on said at least one data recovery storage device.

37. A data backup and recovery system according to claim 30 and wherein said data communication monitors are associated with individual ones of said at least one server.

38. A data backup and recovery system according to claim 30 and wherein said data communication monitors are associated with network elements of a storage area network.

39. A data backup and recovery system according to claim 30 and wherein at least one of said control information and said data communications is communicated from said data communication monitors to said data recovery device via a network.

40. A data backup and recovery system according to claim 39 and wherein said network is a private network.

41. A data backup and recovery system according to claim 39 and wherein said network is a public network.

42. A data backup and recovery system according to claim 30 and wherein at least one of said control information and said data communications is communicated from said data communication monitors to said data recovery device via a storage area network.

43. A data backup and recovery system according to claim 30 wherein said data communication monitors provide at least part of said data communications to said at least one data recovery storage device other than via said at least one data recovery device.

44. A data backup and recovery system according to claim 30 and also comprising at least one LOG storage device wherein said at least one LOG storage device comprise at least control information bearing a time mark regarding data communications between corresponding ones of said first plurality of servers and said plurality of storage devices via said storage area network.

45. A data backup and recovery system according to claim 44 and wherein said data communication monitors also store at least part of said data communications to said at least one LOG storage device.

46. A data backup and recovery system according to claim 45 and wherein said data communications stored to said at least one LOG storage device comprises data updates sent by said first plurality of servers to said second plurality of storage devices.

47. A data backup and recovery system according to claim 44 having said at least one storage device LOG such that if either said control information or said data communications or both are prematurely erased from said at least one data recovery device due to a failure or other event, said at least one data recovery device restores either said control information or said data communications or both from said at least one storage device LOG.

48. A data backup and recovery system according to claim 47 wherein said at least one data recovery device resumes its activities with said restored data from said at least one storage device LOG.

49. A data backup and recovery system according to claim 46 wherein said at least one data recovery device retrieves said at least part of said data communications from at least one storage device LOG for the purpose of storing said data to at least one data recovery storage device associated therewith in said time ordered manner.

50. A data backup and recovery system according to claim 47 and wherein said at least part of said data communications is communicated from said data communication monitors to said at least one storage device LOG via a network.

51. A data backup and recovery system according to claim 50 and wherein said network is a private network.

52. A data backup and recovery system according to claim 50 and wherein said network is a public network.

53. A data backup and recovery system according to claim 47 and wherein at least part of said data communications is communicated from said data communication monitors to said at least one storage device LOG via said storage area network.

54. A data backup and recovery system according to claim 46 wherein said at least one data recovery device retrieves both said control information and said at least part of said data communications from at least one storage device LOG for the purpose of storing said data to at least one data recovery storage device associated therewith in said time ordered manner.

55. A data backup and recovery system according to claim 54 and wherein both said control information and said at least part of said data communications are communicated from said data communication monitors to said at least one storage device LOG via a network.

56. A data backup and recovery system according to claim 55 and wherein said network is a private network.

57. A data backup and recovery system according to claim 55 and wherein said network is a public network.

58. A data backup and recovery system according to claim 54 and wherein both said control information and said at least part of said data communications are communicated from said data communication monitors to said at least one storage device LOG via said storage area network.

69. A method for data backup and recovery for use with at least one server interconnected with at least one storage device, the method comprising:

providing at least one data recovery device;

providing at least one data recovery storage device associated with and controlled by said at least one data recovery device; and

providing at least one data communication monitor operative to perform;

monitoring the data communication between said at least one server and said at least one storage device;

creating at least control information bearing an order stamp regarding said data communications between corresponding ones of said at least one server and said at least one storage device; and

sending said monitored data communications and said control information to said at least one data recovery device,

said at least one data recovery device responding to said at least said control information in a manner which enables reconstruction of a representation of said data communications at a given earlier time but not requiring that said sending said monitored data communications and said control information to said at least one data recovery device be in a given order or stored on said at least one data recovery storage device in a given order.

98. A method for data backup and recovery for use with at least one server interconnected with at least one storage device, said method comprising:

providing at least one data recovery device;

providing at least one data recovery storage device associated with and controlled by said at least one data recovery device;

providing at least one data communication monitor operative to perform;

monitoring the data communication between said at least one server and said at least one storage device;

creating at least control information bearing an order stamp regarding said data communications between corresponding ones of said at least one server and said at least one storage device; and

sending said monitored data communications and said control information to said at least one data recovery device,

receiving said at least control information by said at least one data recovery device; and

storing said data on said at least one data recovery storage device in parallel and without requiring that the data be received by said at least one data recovery device in a given order.

99. A method for data backup and recovery according to claim 98 and wherein said data communication monitors are located other than only at said at least one storage device.

100. A method for data backup and recovery according to claim 98 and wherein said data communication monitors also provide at least part of said data communications to said at least one data recovery device.

101. A method for data backup and recovery according to claim 99 and wherein said data communication monitors also provide at least part of said data communications to said at least one data recovery device.

102. A method for data backup and recovery according to claim 98 and wherein said at least one data recovery device is operative to receive said at least control information and to store data on said at least one data recovery storage device in parallel.

103. A method for data backup and recovery according to claim 98 and wherein said data communications comprise data updates.

104. A method for data backup and recovery according to claim 98 and wherein said reconstruction of a representation of said data communications at a given earlier time guarantees that if the order stamp of a first update is smaller than the order stamp of a second update, the second update is not stored on said at least one data recovery storage device unless the first update is stored on said at least one data recovery storage device.

105. A method for data backup and recovery according to claim 98 and wherein said data communication monitors are associated with individual ones of said at least one server.

106. A method for data backup and recovery according to claim 98 and wherein said data communication monitors are associated with network elements of a storage area network.

107. A method for data backup and recovery according to claim 98 and wherein at least one of said control information and said data communications is communicated from said data communication monitors to said data recovery device via a network.

108. A method for data backup and recovery according to claim 107 and wherein said network is a private network.

109. A method for data backup and recovery according to claim 107 and wherein said network is a public network.

110. A method for data backup and recovery according to claim 98 and wherein at least one of said control information and said data communications is communicated from said data communication monitors to said data recovery device via a storage area network.

111. A method for data backup and recovery according to claim 98 wherein said data communication monitors provide at least part of said data communications to said at least one data recovery storage device other than via said at least one data recovery device.

112. A method for data backup and recovery according to claim 98 and also comprising at least one LOG storage device wherein said at least one LOG storage device comprise at least control information bearing a time mark regarding data communications between corresponding ones of said first plurality of servers and said plurality of storage devices via said storage area network.

113. A method for data backup and recovery according to claim 112 and wherein said data communication monitors also store at least part of said data communications to said at least one LOG storage device.

114. A method for data backup and recovery according to claim 113 and wherein said data communications stored to said at least one LOG storage device comprises data updates sent by said first plurality of servers to said second plurality of storage devices.

115. A method for data backup and recovery according to claim 114 having said at least one storage device LOG such that if either said control information or said data communications or both are prematurely erased from said at least one data recovery device due to a failure or other event, said at least one data recovery device restores either said control information or said data communications or both from said at least one storage device LOG.

116. A method for data backup and recovery according to claim 115 wherein said at least one data recovery device resumes its activities with said restored data from said at least one storage device LOG.

117. A method for data backup and recovery according to claim 114 wherein said at least one data recovery device retrieves said at least part of said data communications from at least one storage device LOG for the purpose of storing said data to at least one data recovery storage device associated therewith in said time ordered manner.

118. A method for data backup and recovery according to claim 115 and wherein said at least part of said data communications is communicated from said data communication monitors to said at least one storage device LOG via a network.

119. A method for data backup and recovery according to claim 118 and wherein said network is a private network.

120. A method for data backup and recovery according to claim 118 and wherein said network is a public network .

121. A method for data backup and recovery according to claim 115 and wherein at least part of said data communications is communicated from said data communication monitors to said at least one storage device LOG via said storage area network.

122. A method for data backup and recovery according to claim 114 wherein said at least one data recovery device retrieves both said control information and said at least part of said data communications from at least one storage device LOG for the purpose of storing said data to at least one data recovery storage device associated therewith in said time ordered manner.

123. A method for data backup and recovery according to claim 122 and wherein both said control information and said at least part of said data communications are communicated from said data communication monitors to said at least one storage device LOG via a network.

124. A method for data backup and recovery according to claim 123 and wherein said network is a private network.

125. A method for data backup and recovery according to claim 123 and wherein said network is a public network.

126. A method for data backup and recovery according to claim 122 and wherein both said control information and said at least part of said data communications are communicated from said data communication monitors to said at least one storage device LOG via said storage area network.

132. A method for data backup and recovery according to claim 129 and wherein said at least one data communication monitor monitors data communications between said at least one server and said at least one storage device over said LAN.

133. A method for data backup and recovery according to claim 130 and wherein said at least one data communication monitor monitors data communications between said at least one server and said at least one storage device over said SAN.

136. A method for data backup and recovery according to claim 130 and wherein said SAN comprises said at least one data communication monitor.