System and method for efficiently replicating a file among a plurality of recipients

• US 20040143575A1
• Filed: 01/16/2003
• Published: 07/22/2004
• Est. Priority Date: 01/16/2003
• Status: Active Grant

• Current Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Original Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Inventors: Cherkasova, Ludmila
• Granted Patent: US 7,174,334 B2
• Time in Patent Office: Days
• US Class Current: 707/10
• CPC Class Codes: G06F 16/184 implemented as replicated file system
• CPC Class Codes: Y10S 707/99953 Recoverability

Abstract

A system and method for distributing a file from a first node to a plurality of recipient nodes are provided. The method comprises partitioning a file into a plurality of subfiles, and distributing the plurality of subfiles from a first node to a first group comprising a plurality of recipient nodes, wherein at least one subfile is distributed from the first node to each recipient node of the first group but not all of the plurality of subfiles are distributed from the first node to any of the recipient nodes of the first group. The method further comprises the plurality of recipient nodes of the first group exchanging their respective subfiles such that each recipient node of the first group obtains all of the plurality of subfiles.

Claims

1. A method of distributing a file from a first node to a plurality of recipient nodes, the method comprising:

partitioning a file into a plurality of subfiles;

distributing the plurality of subfiles from a first node to a first group comprising a plurality of recipient nodes, wherein at least one subfile is distributed from the first node to each recipient node of said first group but not all of said plurality of subfiles are distributed from the first node to any of the recipient nodes of said first group; and

said plurality of recipient nodes of said first group exchanging their respective subfiles such that each recipient node of said first group obtains all of said plurality of subfiles.

2. The method of claim 1 wherein said distributing comprising:

distributing a different subfile to each of said recipient nodes of said first group.

3. The method of claim 1 wherein said partitioning comprises:

partitioning said file into said plurality of subfiles corresponding in number to a number of said recipient nodes in said first group.

4. The method of claim 1 wherein said partitioning further comprises:

partitioning said file into said plurality of subfiles that are each approximately equal in size.

5. The method of claim 1 further comprising:

determining a number of said subfiles to partition said file into.

6. The method of claim 5 wherein said determining comprises:

determining a suitable number of concurrent communication connections that can be used for communication of information between one of the nodes and a plurality of the other nodes; and

determining said number of subfiles as corresponding in number to said number of concurrent communication connections.

7. The method of claim 1 further comprising:

determining a number of said recipient nodes to include in said first group.

8. The method of claim 7 wherein said determining comprises:

determining a suitable number of concurrent communication connections that can be used for communication of information between one of the nodes and a plurality of the other nodes; and

determining said number of recipient nodes to include in said first group as corresponding in number to said number of concurrent communication connections.

9. The method of claim 1 wherein said distributing comprises:

distributing the plurality of subfiles to said plurality of recipient nodes of said first group concurrently.

10. The method of claim 1 wherein said distributing comprises:

distributing the plurality of subfiles via a communication network to which said first node and said plurality of recipient nodes of said first group are communicatively coupled.

11. The method of claim 10 wherein said distributing comprises:

distributing the plurality of subfiles to said plurality of recipient nodes of said first group via concurrent communication connections of said first node to said communication network.

12. The method of claim 1 wherein said plurality of recipient nodes of said first group exchanging their respective subfiles further comprises:

each of said plurality of recipient nodes establishing concurrent communication connections to every other recipient node of said first group.

13. The method of claim 1 wherein said first node and said plurality of recipient nodes of said first group each comprise a server computer.

14. The method of claim 13 wherein said first node and said plurality of recipient nodes are distributed server computers in a Content Distribution Network (CDN).

15. The method of claim 1 further comprising:

said first group of recipient nodes communicating said file to a second group comprising a plurality of recipient nodes.

16. The method of claim 15 further comprising:

each recipient node of said first group communicating a subfile to every recipient node of said second group such that said recipient nodes of said second group each receive all of said plurality of subfiles.

17. The method of claim 15 further comprising:

each recipient node of said first group communicating the subfile that it received from said first node to every node of the second group.

18. The method of claim 17 wherein each recipient node of said first group communicates the subfile that it received from said first node to every node of the second group concurrently.

19. A system comprising:

means for partitioning a file into a plurality of subfiles;

an origin node comprising means for distributing all of said plurality of subfiles from said origin node to a first group comprising a plurality of recipient nodes, wherein at least one subfile is distributed from the origin node to each recipient node of said first group but not all of said plurality of subfiles are distributed from the origin node to any of the recipient nodes of said first group; and

said recipient nodes of said first group each comprising means for exchanging their respective subfiles received from said origin node such that each recipient node of said first group obtains all of said plurality of subfiles.

20. The system of claim 19 wherein said means for distributing distributes a different subfile from said origin node to each of said recipient nodes of said first group.

21. The system of claim 19 wherein said means for partitioning partitions said file into said plurality of subfiles that are each approximately equal in size.

22. The system of claim 19 further comprising:

means for determining a suitable number of concurrent communication connections that can be used for communication of information between one of the nodes and a plurality of the other nodes; and

means for determining a number of subfiles into which said partitioning means is to partition said file as corresponding in number to said determined number of concurrent communication connections.

23. The system of claim 19 further comprising:

means for determining a suitable number of concurrent communication connections that can be used for communication of information between one of the nodes and a plurality of the other nodes; and

means for determining a number of recipient nodes to include in said first group as corresponding in number to said number of concurrent communication connections.

24. The system of claim 19 wherein said means for distributing distributes the plurality of subfiles to said plurality of recipient nodes of said first group concurrently.

25. The system of claim 19 wherein said means for exchanging of each of said plurality of recipient nodes establishes concurrent communication connections to every other recipient node of said first group.

26. The system of claim 19 further comprising:

means for communicating said file from said first group of recipient nodes to a second group comprising a plurality of recipient nodes.

27. The system of claim 26 wherein each recipient node of said first group comprises means for communicating a subfile to every recipient node of said second group such that said recipient nodes of said second group each receive all of said plurality of subfiles.

28. The system of claim 26 wherein each recipient node of said first group comprises means for communicating the subfile that it received from said origin node to every node of the second group concurrently.

29. A system comprising:

an origin node operable to partition a file into a plurality of sub files, wherein said plurality of subfiles correspond in number to a number of recipient nodes in a first group to which said file is to be distributed;

said origin node operable to distribute all of said plurality of subfiles to said recipient nodes, wherein a different subfile is distributed from said origin node to each of said recipient nodes; and

said recipient nodes operable to exchange their respective subfiles received from said origin node such that each recipient node obtains all of said plurality of subfiles.

30. The system of claim 29 wherein said plurality of subfiles are each approximately equal in size.

31. The system of claim 29 wherein said origin node is operable to determine a suitable number of concurrent communication connections that can be used for communication of information between one of the nodes and a plurality of the other nodes, and said origin node is operable to determine a number of said subfiles into which said file is to be partitioned as corresponding in number to said determined number of concurrent communication connections.

32. The system of claim 29 wherein said origin node is operable to determine a suitable number of concurrent communication connections that can be used for communication of information between one of the nodes and a plurality of the other nodes, and said origin node is operable to determine a number of recipient nodes to include in said first group as corresponding in number to said number of concurrent communication connections.

33. The system of claim 29 wherein said origin node is operable to distribute the plurality of subfiles to said plurality of recipient nodes of said first group concurrently.

34. The system of claim 29 wherein each of said recipient nodes is operable to communicate the subfile that it received from said origin node to every other recipient node of said first group concurrently.