Dispersal and retrieval of data fragments in a peer-to-peer data backup and archival network

• US 9,307,020 B2
• Filed: 10/02/2008
• Issued: 04/05/2016
• Est. Priority Date: 10/02/2008
• Status: Expired due to Fees

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Buller, Steven J., Garrett, Richard C., Hutzler, Richard
• Primary Examiner(s): Leroux, Etienne
• Assistant Examiner(s): BIBBEE, JARED M
• Application Number:
  US12/244,767
• Publication Number:
  US 20100088269A1
• Time in Patent Office: 2,742 Days
• Field of Search: 707/622, 707/652, 707/661
• US Class Current: 1/1
• CPC Class Codes: G06F 16/1837 Management specially adapted to peer-to-peer storage networks topology management mechanisms of peer-to-peer networks H04L67/1042
• CPC Class Codes: H04L 63/0428 wherein the data content is protected, e.g. by encrypting or encapsulating the payload
• CPC Class Codes: H04L 67/104 Peer-to-peer [P2P] networks
• CPC Class Codes: H04L 67/1063 Discovery through centralising entities
• CPC Class Codes: H04L 67/1068 Discovery involving direct consultation or announcement among potential requesting and potential source peers
• CPC Class Codes: H04L 67/1076 Resource dissemination mechanisms or network resource keeping policies for optimal resource availability in the overlay network
• CPC Class Codes: H04L 67/108 characterised by resources being split in blocks or fragments

Abstract

Embodiments of the present invention address deficiencies of the art in respect to data backup and archival tools and provide a method, system and computer program product for the dispersal and retrieval of fragments in a peer-to-peer data backup and archival network. In an embodiment of the invention, a method for the dispersal and retrieval of fragments in a peer-to-peer data backup and archival network can include partitioning a file into multiple, different fragments for storage in a peer-to-peer data backup and archival network, selecting different peer hosts in the peer-to-peer data backup and archival network to store different ones of the fragments, and storing each of the fragments in at least one of the selected different peer hosts. Optionally, the fragments can be encrypted before storage in the different peer hosts.

Claims

1. A method for the dispersal and retrieval of fragments in a peer-to-peer data backup and archival network, the method comprising:

partitioning a file into multiple, different fragments for storage in a peer-to-peer data backup and archival network;

selecting different peer hosts in the peer-to-peer data backup and archival network to store different ones of the fragments;

storing each of the fragments in at least one of the selected different peer hosts; and

,

broadcasting, at a periodic interval, a request to confirm an integrity of the fragments stored in the different peer hosts, the request being broadcast to the selected different peer hosts that have been selected to store different ones of the fragments, from an unselected one of the different peer hosts that has not been selected to store different ones of the fragments.

2. The method of claim 1, further comprising encrypting the fragments before storage in the different peer hosts.

3. The method of claim 2, wherein encrypting the fragments before storage in the different peer hosts, comprises encrypting the fragments before storage in the different peer hosts using an encryption method associated with a file type for the file.

4. The method of claim 1, wherein partitioning a file into multiple, different fragments for storage in a peer-to-peer data backup and archival network, comprises partitioning a file into multiple multi-byte sized fragments for storage in a peer-to-peer data backup and archival network.

5. The method of claim 1, wherein storing each of the fragments in at least one of the selected different peer hosts, further comprises recording a location of the fragments in a master index for the file.

6. The method of claim 1, wherein storing each of the fragments in at least one of the selected different peer hosts, comprises storing each of the fragments in at least one of the selected different peer hosts in a community of peer hosts associated with a requestor requesting backup of the file.

7. The method of claim 1, further comprising distributing credentials to a third party sufficient for the third party to broadcast a request to the selected different peer hosts to retrieve the fragments stored in the selected different peer hosts.

8. A peer-to-peer data backup and archival network configured for the dispersal and retrieval of fragments, the network comprising:

a data backup and archival tool providing an interface for providing a file to be stored in the peer-to-peer backup and archival network;

a multiplicity of peer hosts coupled to the tool; and

,

peer-to-peer fragment dispersal and retrieval logic coupled to each of the multiplicity of different peer hosts, the logic comprising program code enabled to respond to a request to store a fragment for the file by storing the fragment and reporting a location of the fragment to the tool and by broadcasting at a periodic interval from one of the different peer hosts not selected to store the fragment to another of the different peer hosts that has been selected to store the fragment, a request to the selected different peer hosts at a periodic interval to confirm an integrity of the fragments stored in the another of the different peer hosts.

9. The network of claim 8, wherein the fragments are encrypted bytes of the file.

10. The network of claim 8, wherein the peer hosts are arranged hierarchically in a hierarchy of nodes, each node corresponding to a host, each node comprising a node selected from the group consisting of a root node, an intermediate node and a leaf node, the root node issuing requests to store fragments of a file in other nodes, the intermediate node both issuing requests to store fragments of a file in other nodes and also store fragments of a file on request by other nodes, and the leaf node storing fragments of a file on request by other nodes, but not requesting storage of fragments of a file in other nodes.

11. A computer program product comprising a non-transitory computer usable storage medium storing computer usable program code for the dispersal and retrieval of fragments in a peer-to-peer data backup and archival network, the computer program product comprising:

computer usable program code for partitioning a file into multiple, different fragments for storage in a peer-to-peer data backup and archival network;

computer usable program code for selecting different peer hosts in the peer-to-peer data backup and archival network to store different ones of the fragments;

computer usable program code for storing each of the fragments in at least one of the selected different peer hosts; and

,

computer usable program code for broadcasting, at a periodic interval, a request to confirm an integrity of the fragments stored in the different peer hosts, the request being broadcast to the selected different peer hosts that have been selected to store different ones of the fragments, from an unselected one of the different peer hosts that has not been selected to store different ones of the fragments.

12. The computer program product of claim 11, further comprising computer usable program code for encrypting the fragments before storage in the different peer hosts.

13. The computer program product of claim 11, wherein the computer usable program code for encrypting the fragments before storage in the different peer hosts, comprises computer usable program code for encrypting the fragments before storage in the different peer hosts using an encryption method associated with a file type for the file.

14. The computer program product of claim 11, wherein the computer usable program code for partitioning a file into multiple multi-byte sized fragments for storage in a peer-to-peer data backup and archival network, comprises computer usable program code for partitioning a file into multiple, different byte sized fragments for storage in a peer-to-peer data backup and archival network.

15. The computer program product of claim 11, wherein the computer usable program code for storing each of the fragments in at least one of the selected different peer hosts, further comprises computer usable program code for recording a location of the fragments in a master index for the file.

16. The computer program product of claim 11, wherein the computer usable program code for storing each of the fragments in at least one of the selected different peer hosts, comprises computer usable program code for storing each of the fragments in at least one of the selected different peer hosts in a community of peer hosts associated with a requestor requesting backup of the file.

17. The computer program product of claim 11, further comprising computer usable program code for distributing credentials to a third party sufficient for the third party to broadcast a request to the selected different peer hosts to retrieve the fragments stored in the selected different peer hosts.