Ordered writes for SRDF assist

• US 7,237,018 B1
• Filed: 09/28/2001
• Issued: 06/26/2007
• Est. Priority Date: 08/28/2001
• Status: Expired due to Term

• Current Assignee: Emc IP Holding Company LLC (Dell Technologies Inc.)
• Original Assignee: EMC Corporation (Dell Technologies Inc.)
• Inventors: Kamvysselis, Peter
• Primary Examiner(s): Dharia; Rupal
• Assistant Examiner(s): Shingles; Kristie D.
• Application Number:
  US09/965,897
• Time in Patent Office: 2,097 Days
• Field of Search: 709/207, 709/232, 709/237, 709/201, 709/217, 709/223, 707/204, 707/1, 707/7, 370/392, 711/167, 711/170
• US Class Current: 709/223
• CPC Class Codes: H04L 63/0428 wherein the data content is protected, e.g. by encrypting or encapsulating the payload
• CPC Class Codes: H04L 67/06 specially adapted for file transfer, e.g. file transfer protocol [FTP]
• CPC Class Codes: H04L 69/16 Implementation or adaptation of Internet protocol [IP], of transmission control protocol [TCP] or of user datagram protocol [UDP]
• CPC Class Codes: H04L 69/163 In-band adaptation of TCP data exchange; In-band control procedures
• CPC Class Codes: H04L 69/329 in the application layer [OSI layer 7]
• CPC Class Codes: H04L 9/40 Network security protocols
• CPC Class Codes: Y10S 707/99938 Concurrency, e.g. lock management in shared database
• CPC Class Codes: Y10S 707/99952 Coherency, e.g. same view to multiple users

Abstract

Transmitting data from a source to a destination, includes receiving the data from the source and providing the data to the destination using a network, where the data is acknowledged to the source as being successfully received at the destination prior to all of the data being provided to the network. The source may be a primary storage device. The destination may be a secondary storage device. The data may be provided from the source in a first format and may be provided to the network in a second format that is different from the first format where the first format may be RDF and the second format may be TCP/IP or UDP. The destination may receive the data in a first format different from a second format used to transmit the data over the network. The first format may be RDF and the second format may be TCP/IP or UDP.

Claims

1. A method of sending data, comprising:

obtaining a first predetermined value for a sequence number;

obtaining blocks of data, wherein each of the blocks of data corresponds to a packet of data;

assigning the first predetermined value as the sequence number to each of the packets of data, wherein at least two packets of data are assigned the same sequence number before the at least two packets of data are sent to a destination;

incrementing the sequence number periodically, according to an amount of time between a first block of data being provided and a second block of data being provided, wherein the second block of data being provided depends upon the first block of data being provided; and

in response to the sequence number becoming equal to a second predetermined value different from the first predetermined value, acknowledging receipt of the blocks of data corresponding to the packets of data that are assigned the first predetermined value as the sequence number and sending the packets of data that are assigned the first predetermined value as the sequence number to the destination, wherein packets of data associated with the same sequence number are sent to the destination in an order that is independent of an order in which the packets are obtained.

2. The method of claim 1, the method further comprising:

prior to acknowledging, indicating to a first storage device a transfer ready signal; and

sending said blocks of data to a second storage device.

3. The method of claim 2, wherein said acknowledging is performed prior to providing said blocks of data to said second storage device.

4. The method of claim 1, wherein the second predetermined value is a number that is one greater than the first predetermined value.

5. The method of claim 1, further comprising:

in response to the sequence number becoming equal to the second predetermined value, providing a value to each of the packets corresponding to a total number of packets of data that are assigned the first predetermined value as the sequence number.

6. The method of claim 1, further comprising:

prior to sending the packets of data, storing the data in a journal.

7. A method of receiving data, comprising:

accumulating received packets of data having a sequence number equal to a first predetermined value, wherein at least two packets of data have the same sequence number, the sequence number being assigned before the at least two packets of data are transferred to a receiving device;

incrementing the sequence number periodically, according to an amount of time between a first packet of data being provided and a second block of data being provided, wherein the second packet of data being provided depends upon the first packet of data being provided;

obtaining a first indication that the sequence number equals the first predetermined value;

obtaining a second indication that the sequence number equals a second predetermined value different from the first predetermined value; and

in response to obtaining the second indication, transferring data corresponding to packets of data having the sequence number equal to the first predetermined value to the receiving device, wherein packets of data associated with the same sequence number are transferred to the receiving device in an order that is independent of an order in which the packets are accumulated.

8. The method of claim 7, further comprising:

following obtaining the first indication, initiating a transfer command to the receiving device.

9. The method of claim 8, wherein data is not transferred to the receiving device until the receiving device acknowledges initiation of data transfer in response to the transfer command being initiated.

10. The method of claim 9, further comprising:

acknowledging completion of sending said data to said receiving device prior to all said data actually being transferred to said receiving device.

11. The method of claim 10, wherein acknowledging is performed in response to a sending storage device receiving the transfer command.

12. The method of claim 7, wherein the second predetermined value is a number that is one greater than the first predetermined value.

13. The method of claim 7, further comprising:

prior to transferring the data, storing the data in a journal.

14. A method of transferring data, comprising:

obtaining a first predetermined value for a first sequence number;

obtaining blocks of data, wherein each of the blocks of data corresponds to a packet of data;

assigning the first predetermined value as the first sequence number to each of the packets of data, wherein at least two packets of data are assigned the same sequence number before the at least two packets of data are sent to a destination;

in response to the first sequence number becoming equal to a second predetermined value different from the first predetermined value, acknowledging receipt of the blocks of data corresponding to the packets of data that are assigned the first predetermined value as the sequence number and sending the packets of data that are assigned the first predetermined value as the sequence number to the destination, wherein packets of data associated with the same sequence number are sent to the destination in an order that is independent of an order in which the packets are obtained;

accumulating received packets of data having a sequence number equal to said first predetermined value;

obtaining a first indication that the sequence number equals the first predetermined value;

obtaining a second indication that the sequence number equals a second predetermined value different from the first predetermined value; and

in response to obtaining the second indication, transferring data corresponding to packets of data having the sequence number equal to the first predetermined value to a receiving device, wherein packets of data associated with the same sequence number are transferred to the receiving device in an order that is independent of an order in which the packets are accumulated.

15. A computer system comprising:

a host performing a data operation for transferring blocks of data from a first device to a second device;

a first WAN blade connected to said first device;

a second WAN blade connected to said first WAN blade by a network, said second device being connected to said second WAN blade;

wherein said first WAN blade includes machine executable code that receives said blocks of data from said first storage device, each of said blocks corresponding to a packet of data, assigns a first predetermined value to each of said packets of data, wherein at least two packets of data are assigned the same sequence number before the at least two packets are sent to the second device, and, in response to receiving a second predetermined value different than said first predetermined value, acknowledges receipt of said blocks of data associated with said first predetermined value and sending the packets of data that are assigned the first predetermined value as a sequence number to said second device, wherein packets of data associated with the same sequence number are sent to the destination in an order that is independent of an order in which the packets are received; and

said second WAN blade includes machine executable code that receives said packets of data associated with said first predetermined value, obtains an indication of said first predetermined value as a sequence number, obtains a second indication that the sequence number equals a second predetermined value different from the first predetermined value, and in response to obtaining the second indication, transfers data corresponding to packets of data having the sequence number equal to the first predetermined value to said second device, wherein packets of data associated with the same sequence number are transferred to the second device in an order that is independent of an order in which the packets are received.

16. The computer system of claim 15, wherein said first WAN blade is one of a first set of WAN blades, said second WAN blade is one of second set of WAN blades, said first device is included in a first consistency group of a plurality of storage devices, and said second device is included in a second consistency group of a plurality of storage devices.

17. The computer system of claim 16, wherein said first device is a primary storage device of the first consistency group, and said host computer is a first host computer coupled to said first device.

18. The computer system of claim 17, wherein said second device is a primary storage device of said second consistency group, and the computer system further includes a second host computer coupled to said second device.

19. The computer system of claim 18, wherein other devices included in said first and second consistency groups are secondary storage devices.

20. A computer program product, implemented in a computer-readable medium, for sending data, comprising:

machine executable code that obtains a first predetermined value for a sequence number;

machine executable code that obtains blocks of data, wherein each of the blocks of data corresponds to a packet of data;

machine executable code that assigns the first predetermined value as the sequence number to each of the packets of data, wherein at least two packets of data are assigned the same sequence number before the at least two packets are sent to a destination;

machine readable code that increments the sequence number periodically, according to an amount of time between a first block of data being provided and a second block of data being provided, wherein the second block of data being provided depends upon the first block of data being provided; and

machine executable code that, in response to the sequence number becoming equal to a second predetermined value different from the first predetermined value, acknowledges receipt of the blocks of data corresponding to the packets of data that are assigned the first predetermined value as the sequence number and sending the packets of data that are assigned the first predetermined value as the sequence number to the destination, wherein packets of data associated with the same sequence number are sent to the destination in an order that is independent of an order in which the packets are obtained.

21. The computer program product of claim 20, further comprising:

machine executable code that, prior to said acknowledging, indicates to a first storage device a transfer ready signal; and

machine executable code that sends said blocks of data to a second storage device.

22. The computer program product of claim 21, wherein said machine executable code that acknowledges is executed prior to providing said blocks of data to said second storage device.

23. The computer program product of claim 20, wherein the second predetermined value is a number that is one greater than the first predetermined value.

24. The computer program product of claim 20, further comprising:

machine executable code that, in response to the sequence number becoming equal to the second predetermined value, provides a value to each of the packets corresponding to a total number of packets of data that are assigned the first predetermined value as the sequence number.

25. The computer program product of claim 20, further comprising:

machine executable code that, prior to sending the packets of data, stores the data in a journal.

26. A computer program product, implemented in a computer-readable medium, for receiving data, comprising:

machine executable code that accumulates received packets of data having a sequence number equal to a first predetermined value, wherein at least two packets of data have the same sequence number, the sequence number being assigned before the at least two packets are transferred to a receiving device;

machine readable code that increments the sequence number periodically, according to an amount of time between a first packet of data being provided and a second block of data being provided, wherein the second packet of data being provided depends upon the first packet of data being provided;

machine executable code that obtains a first indication that the sequence number equals the first predetermined value;

machine executable code that obtains a second indication that the sequence number equals a second predetermined value different from the first predetermined value; and

machine executable code that, in response to obtaining the second indication, transfers data corresponding to packets of data having the sequence number equal to the first predetermined value to the receiving device, wherein packets of data associated with the same sequence number are transferred to the receiving device in an order that is independent of an order in which the packets are accumulated.

27. The computer program product of claim 26, further comprising:

machine executable code that, following obtaining the first indication, initiates a transfer command to the receiving device.

28. The computer program product of claim 27, wherein data is not transferred to the receiving device until the receiving device acknowledges initiation of data transfer in response to the transfer command being initiated.

29. The computer program product of claim 28, further comprising:

machine executable code that acknowledges completion of sending said data to said receiving device prior to all said data actually being transferred to said receiving device.

30. The computer program product of claim 29, wherein said machine executable code that acknowledges is executed in response to a sending storage device receiving the transfer command.

31. The computer program product of claim 26, wherein the second predetermined value is a number that is one greater than the first predetermined value.

32. The computer program product of claim 26, further comprising:

machine executable code that, prior to transferring the data, stores the data in a journal.

33. A computer program product, implemented in a computer-readable medium, for transferring data, comprising:

machine executable code that obtains a first predetermined value for a first sequence number;

machine executable code that obtains blocks of data, wherein each of the blocks of data corresponds to a packet of data;

machine executable code that assigns the first predetermined value as the first sequence number to each of the packets of data, wherein at least two packets of data are assigned the same sequence number before the at least two packets are sent to a destination;

machine executable code that, in response to the first sequence number becoming equal to a second predetermined value different from the first predetermined value, acknowledges receipt of the blocks of data corresponding to the packets of data that are assigned the first predetermined value as the sequence number and sending the packets of data that are assigned the first predetermined value as the sequence number to the destination, wherein packets of data associated with the same sequence number are sent to the destination in an order that is independent of an order in which the packets are obtained;

machine executable code that accumulates received packets of data having a sequence number equal to the first predetermined value;

machine executable code that obtains a first indication that the sequence number equals the first predetermined value;

machine executable code that obtains a second indication that the sequence number equals a second predetermined value different from the first predetermined value; and

machine executable code that, in response to obtaining the second indication, transfers data corresponding to packets of data having the sequence number equal to the first predetermined value to a receiving device, wherein packets of data associated with the same sequence number are transferred to the receiving device in an order that is independent of an order in which the packets are accumulated.