Method and system for file transfer over a messaging infrastructure

• US 9,860,299 B2
• Filed: 09/12/2016
• Issued: 01/02/2018
• Est. Priority Date: 09/13/2007
• Status: Expired due to Fees

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Broadhurst, Peter Andrew
• Primary Examiner(s): Conaway, James
• Application Number:
  US15/263,344
• Publication Number:
  US 20170070558A1
• Time in Patent Office: 477 Days
• Field of Search: 709246, 714 48- 57, 711216, 713181
• CPC Class Codes: G06F 16/10 File systems; File servers
• CPC Class Codes: H04L 63/00 Network architectures or network communication protocols for network security cryptographic mechanisms or cryptographic arrangements for secret or secure communication H04L9/00; network architectures or network communication protocols for wireless network security H04W12/00; security arrangements for protecting computers or computer systems against unauthorised activity G06F21/00
• CPC Class Codes: H04L 63/12 Applying verification of the received information cryptographic mechanisms or cryptographic arrangements for data integrity or data verification H04L9/32
• CPC Class Codes: H04L 63/123 received data contents, e.g. message integrity
• CPC Class Codes: H04L 67/06 specially adapted for file transfer, e.g. file transfer protocol [FTP]
• CPC Class Codes: H04L 69/22 Parsing or analysis of headers

Abstract

A method and system for file transfer over a messaging infrastructure are provided. The method includes dividing a file into multiple portions. The method includes generating for a current portion of a file, except for the first portion in a file, a first hash summarizing the state of the file up to, but not including, the current portion and a second hash summarizing the state of the file up to and including the current portion. The method includes sending the first and second hashes with the file portion. The second hash may be used at a target for comparing to a first hash of a subsequent file portion, for example, by recreating the second hash from the current state of the received file on the target.

Claims

1. A method for file transfer over a messaging infrastructure, comprising:

dividing a file into multiple portions including a first portion and at least one subsequent portion;

creating a message including a multiplicity of headers and payloads with an individual one of the headers and an individual one of the payloads for each of the multiple portions of the file, each of the payloads including a corresponding one of the multiple portions and being associated with a corresponding one of the message headers, wherein the one of the headers of a message for the first portion includes a hash for the first portion included in the message for the first portion, and the one of the headers of a message for any subsequent portion includes two different hashes;

a first hash summarizing a first state of the file up to, but not including, a current one of the portions included in the message for the subsequent portion, the first state indicating a state of the file that is required in order to add the current one of the portions to the file when recreating the file at a target computing device;

a second hash summarizing a second state of the file up to and including the current one of the portions included in the message for the subsequent portion, the second state indicating a state of a recreated file after having added the current portion to the file at the target computing device; and

sending each created message to the target computing device by way of a message queue,

wherein each of the payloads is filled from an end of free space available in the message so that space allocated for each of the headers is able to grow at a head of the message, while file data grows from a tail of the message, wherein a single fixed size buffer is used to store the message without moving data within the message as file portions are added.

2. The method as claimed in claim 1, including comparing the second hash to a first hash of a subsequent file portion at a target.

3. The method as claimed in claim 2, including recreating the second hash from stored file data at the target.

4. The method as claimed in claim 1, including:

generating a message including a header section and a payload section, wherein the payload section includes one or more file portions; and

sending the first and second hashes in the header section of the message.

5. The method as claimed in claim 4, wherein a message includes file portions for different files.

6. The method as claimed in claim 4, wherein the message includes the file name, the size of the file part and where it is located in the message, and the amount of data sent previously for a given file.

7. The method as claimed in claim 1, wherein dividing the file into multiple portions, divides the file into portions to fit in the payload section of the message once the size of the header section has been determined.

8. The method as claimed in claim 1, including:

sending the size of the file with the file portion.

9. The method as claimed in claim 1, including:

receiving a file portion in a message; and

determining if a file portion belongs to a given file by determining if the first hash matches the second hash of the previous file portion.

10. The method as claimed in claim 1, wherein generating the first and second hashes uses a hashing algorithm which performs operations against contiguous portions of a file in order, and which finalizes the calculations of a hash for a complete file without referring to previously stored portions of a file.

11. The method as claimed in claim 10, wherein the hashing algorithm is the MD5 algorithm.

12. The method as claimed in claim 1, wherein for a first portion of a file, the method includes generating a hash of the first portion of the file and sending the hash with the first portion.