Data Replication

• US 20080168157A1
• Filed: 10/28/2007
• Published: 07/10/2008
• Est. Priority Date: 05/23/2002
• Status: Active Grant

• Current Assignee: eXludus Technologies, Inc.
• Original Assignee: eXludus Technologies, Inc.
• Inventors: Marchand, Benoit
• Granted Patent: US 7,707,457 B2
• Time in Patent Office: Days
• US Class Current: 709/219
• CPC Class Codes: H04L 12/1863 comprising mechanisms for improved reliability, e.g. status reports arrangements for detecting or preventing errors by carrying supervisory signal the return channel H04L1/16
• CPC Class Codes: H04L 12/1868 Measures taken after transmission, e.g. acknowledgments
• CPC Class Codes: H04L 12/1881 with schedule organisation, e.g. priority, sequence management
• CPC Class Codes: H04L 67/06 specially adapted for file transfer, e.g. file transfer protocol [FTP]
• CPC Class Codes: H04L 67/1095 Replication or mirroring of data, e.g. scheduling or transport for data synchronisation between network nodes
• CPC Class Codes: H04L 67/14 Session management for real-time applications in data packet communications networks H04L65/1066
• CPC Class Codes: H04L 69/329 in the application layer [OSI layer 7]
• CPC Class Codes: H04L 9/40 Network security protocols

Abstract

Apparatus and method to improve the speed, scalability, robustness and dynamism of multicast data transfers to remote computers. Many Grid Computing applications, such as Genomics, Proteomics, Seismic, Risk Management, etc., require a priori transfer of sets of files or other data to remote computers prior to processing taking place. Existing multicast and data transfer protocols are static and can not guarantee that all nodes will contain a copy of the replicated data or files. The fully distributed data transfer and data replication protocol of the invention permits transfers which minimize processing requirements on master transfer nodes by spreading work across the network. The result is higher scalability than current centralized protocols, more dynamism and allows fault-tolerance by distribution of functionality. The ability to distribute the protocol is simplified through our innovative symmetric-connectionless data transfer protocol.

Claims

1-9. -9. (canceled)

10. A method for completing an interrupted data replication operation, the method comprising:

commencing a data replication operation amongst a plurality of networked computing devices;

identifying an interruption of the data replication operation at one of the computing devices from the plurality of networked computing devices; and

receiving data transferred as a part of the data replication operation subsequent to the interruption of the data replication operation at the one of the computing devices from any of the other plurality of networked computing devices, wherein the data received subsequent to the interruption of the data replication operation is transferred using a connectionless transfer protocol, the transfer being asynchronous and autonomous relative to the data replication operation.

12. The method of claim 10, wherein the data transferred as a part of the data replication operation subsequent to the interruption of the data replication operation at the one of the computing devices includes data never initially received as a result of the interruption of the data replication operation.

13. The method of claim 10, wherein the data includes a complete file.

14. The method of claim 10, wherein the data includes a portion of a complete file.

15. The method of claim 10, wherein the data includes a series of packets.

16. The method of claim 10, wherein the data received subsequent to the interruption of the data replication operation is received from a single computing device from the plurality of other networked computing devices.

17. The method of claim 10, wherein the data received subsequent to the interruption of the data replication operation is received from multiple computing devices from the plurality of other networked computing devices.

18. The method of claim 10, further comprising removing data from the one of the computing devices, wherein the data is removed as a part of the asynchronous and autonomous transfer of data.

19. The method of claim 18, wherein the removed data is expired data.

20. The method of claim 18, wherein the removed data is data originally transferred as a part of the data replication operation and having been modified subsequent to the interruption of the data replication operation.

21. The method of claim 10, further comprising identifying data to be updated subsequent to the interruption of the data replication operation.

22. The method of claim 21, wherein data is identified using a log of deltas.

23. The method of claim 21, further comprising updating data at the one of the computing devices subsequent to the interruption of the data replication operation, wherein the data updated is data identified as to be updated.

24. The method of claim 10, wherein the data replication operation includes a plurality of operations.

25. The method of claim 10, wherein the plurality of networked computing devices are a part of a peer-to-peer network.

26. The method of claim 10, wherein the asynchronous and autonomous transfer of data may be controlled to prevent network saturation.

11. The method of claim 11, wherein the data transferred as a part of the data replication operation subsequent to the interruption of the data replication operation at the one of the computing devices includes data corrupted by the interruption of the data replication operation.

27. A computing device, comprising:

a processor; and

memory storing a program, the program being executable by the processor for performing a method for completing an interrupted data replication operation, the method comprising;

commencing a data replication operation with a plurality of other computing devices in a network;

identifying an interruption of the data replication operation; and

receiving data transferred as a part of the data replication operation subsequent to the interruption of the data replication operation from any of the plurality of other networked computing devices, wherein the data received subsequent to the interruption of the data replication operation is transferred using a connectionless transfer protocol, the transfer being asynchronous and autonomous relative to the data replication operation.

28. A computer-readable storage medium having embodied thereon a program, the program being executable by a processor to perform a method for completing an interrupted data replication operation, the method comprising:

commencing a data replication operation with a plurality of other computing devices in a network;

identifying an interruption of the data replication operation; and

receiving data transferred as a part of the data replication operation subsequent to the interruption of the data replication operation from any of the plurality of other networked computing devices, wherein the data received subsequent to the interruption of the data replication operation is transferred using a connectionless transfer protocol, the transfer being asynchronous and autonomous relative to the data replication operation.