System and method for efficient replication of files

• US 8,626,944 B2
• Filed: 05/05/2003
• Issued: 01/07/2014
• Est. Priority Date: 05/05/2003
• Status: Active Grant

• Current Assignee: Hewlett Packard Enterprise Development LP (Hewlett-Packard Enterprise Company)
• Original Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Inventors: Cherkasova, Ludmila
• Primary Examiner(s): TODD, GREGORY G
• Application Number:
  US10/429,797
• Publication Number:
  US 20040225723A1
• Time in Patent Office: 3,900 Days
• Field of Search: 709/201, 709/203, 709/219, 709/231, 709/246, 709/236, 709/248, 709/252, 709/238, 707/10, 707/101, 707/104.1
• US Class Current: 709/236
• CPC Class Codes: H04L 65/1101 Session protocols
• CPC Class Codes: H04L 65/80 Responding to QoS
• CPC Class Codes: H04L 67/06 specially adapted for file transfer, e.g. file transfer protocol [FTP]
• CPC Class Codes: H04L 69/329 in the application layer [OSI layer 7]
• CPC Class Codes: H04L 9/40 Network security protocols

Abstract

A method comprises distributing a plurality of descriptors of file encoded with comprising a plurality of recipient nodes, wherein at least one descriptor is distributed from the first node to each recipient node of the at least a portion of the first group. The at least a portion of the first group communicate their respective descriptors received from the first node to other nodes of the first group. A system comprises an origin node operable to distribute all of a plurality of descriptors of a MDC file to a first group of recipient nodes, wherein the origin node does not attempt to communicate all of the plurality of descriptors to all of the recipient nodes of the first group. The recipient nodes of the first group are each operable to communicate a descriptor that it receives from the origin node to other nodes of the first group.

Claims

1. A method of distributing from a first node to a plurality of recipient nodes a file encoded with multiple description coding, the method comprising:

distributing a plurality of descriptors of a file encoded with multiple description coding (MDC) from a first node to a plurality of nodes of a first group of a plurality of different groups, the plurality of different groups comprising different nodes in different groups;

wherein at least one descriptor is distributed from the first node directly to each of the plurality of nodes of said first group but not all of said plurality of descriptors are distributed from the first node directly to any of the plurality of nodes of said first group;

said plurality of nodes of said first group exchanging their respective descriptors such that each of the plurality of nodes of said first group obtains all of said plurality of descriptors;

said plurality of nodes of the first group communicating said plurality of descriptors to a plurality of nodes of a second group, of the plurality of groups, comprising a different plurality of recipient nodes;

determining the number of descriptors of said file; and

determining the number of said plurality of nodes to include in said first group as corresponding to the number of descriptors of said file.

2. The method of claim 1 wherein said distributing comprising:

distributing a different descriptor to each of said plurality of nodes of said first group.

3. The method of claim 1 further comprising:

determining a number of said plurality of nodes to include in said first group.

4. The method of claim 1 wherein said distributing comprises:

distributing the plurality of descriptors to said plurality of nodes of said first group concurrently.

5. The method of claim 1 wherein said distributing comprises:

distributing the plurality of descriptors via a communication network to which said first node and said plurality of nodes of said first group are communicatively coupled.

6. The method of claim 5 wherein said distributing comprises:

distributing the plurality of descriptors to said plurality of nodes of said first group via concurrent communication connections of said first node to said communication network.

7. The method of claim 1 wherein said plurality of nodes of said first group exchanging their respective descriptors further comprises:

each of said plurality of nodes establishing concurrent communication connections to every other node of said first group.

8. The method of claim 1 wherein each of said first node and said plurality of nodes of said first group comprise a server computer.

9. The method of claim 8 wherein said first node and said plurality of nodes of said first group are distributed server computers in a Content Distribution Network (CDN).

10. The method of claim 1 further comprising:

each of the plurality of nodes of said first group communicating a descriptor of said file to each of the plurality of nodes of said second group such that said plurality of nodes of said second group each receive all of said plurality of descriptors of said file.

11. The method of claim 1 further comprising:

each of the plurality of nodes of said first group communicating the descriptor that it received from said first node to every node of the second group.

12. The method of claim 11 wherein each of the plurality of nodes of said first group communicates the descriptor that it received from said first node to every node of the second group concurrently.

13. The method of claim 1 wherein said plurality of nodes of the first group communicating said plurality of descriptors to the plurality of nodes of said second group further comprises:

communicating the plurality of descriptors of said file from at least one node of said first group to the plurality of nodes of said second group, wherein at least one descriptor is communicated from the at least one node to each of the plurality of nodes of said second group but not all of said plurality of descriptors are distributed from the at least one node to any of the plurality of nodes of said second group; and

said plurality of nodes of said second group exchanging their respective descriptors such that each of the plurality of nodes of said second group obtains all of said plurality of descriptors.

14. The method of claim 13 wherein said communicating the plurality of descriptors from said at least one node of said first group to the plurality of nodes of said second group comprises:

communicating the plurality of descriptors to the plurality of nodes of said second group concurrently.

15. A method of distributing from a first node to a plurality of recipient nodes a file encoded with multiple description coding, the method comprising:

distributing a plurality of descriptors of a file encoded with multiple description coding (MDC) from a first node to at least a portion of a plurality of nodes of a first group of a plurality of different groups, the plurality of different groups comprising different nodes in different groups;

wherein at least one descriptor is distributed from the first node directly to each recipient node of said at least a portion of said first group;

said at least a portion of said first group communicating their respective descriptors received directly from said first node directly to other nodes of said first group;

said recipient nodes of the first group communicating said plurality of descriptors to a plurality of nodes of a second group, of the plurality of groups, comprising a different plurality of recipient nodes;

determining the number of descriptors of said file; and

determining the number of said recipient nodes to include in said sub-group as corresponding to the number of descriptors of said file.

16. The method of claim 15 wherein not all of said plurality of descriptors are distributed from the first node to any of the recipient nodes of said first group.

17. The method of claim 15 wherein said distributing comprises:

distributing a different descriptor to each of said at least a portion of said first group of recipient nodes.

18. The method of claim 15 wherein said at least a portion of said first group of recipient nodes comprises a sub-group of said first group of recipient nodes, said sub-group comprising multiple ones of said plurality of recipient nodes of said first group.

19. The method of claim 18 further comprising:

determining a number of said recipient nodes to include in said sub-group.

20. The method of claim 18 wherein said distributing comprises:

distributing the plurality of descriptors to said multiple recipient nodes of said sub-group concurrently.

21. The method of claim 18 wherein said at least a portion of said first group communicating their respective descriptors received from said first node to other nodes of said first group comprises:

each of said multiple recipient nodes of said sub-group establishing concurrent communication connections to every other recipient node of said first group.

22. A system comprising:

an origin node comprising a processor, wherein the origin node distributes all of a plurality of descriptors of a file encoded with multiple description coding (MDC) from said origin node to a plurality of nodes of a first group of a plurality of different groups, the plurality of different groups comprising different nodes in different groups;

wherein at least one descriptor is distributed from the origin node directly to each recipient node of said first group but not all of said plurality of descriptors are distributed from the origin node directly to any of the recipient nodes of said first group;

wherein said recipient nodes of said first group communicate their respective descriptors received from the origin node directly with the recipient nodes of said first group such that each recipient node of said first group obtains all of said plurality of descriptors;

a second group of different recipient nodes, wherein each of said recipient nodes of said first group communicates its respective descriptors received from the origin node with the recipient nodes of said second group;

wherein said origin node

determines the number of descriptors of said MDC file; and

determines a number of recipient nodes to include in said first group as corresponding in number to the number of descriptors of the MDC file.

23. The system of claim 22 wherein said first group of recipient nodes comprise a number of recipient nodes equal to the number of descriptors of the MDC file.

24. The system of claim 22 wherein the origin node distributes a different descriptor to each of said recipient nodes of said first group.

25. The system of claim 22 wherein the origin node concurrently distributes one of the plurality of descriptors to each of said plurality of recipient nodes of said first group.

26. The system of claim 22 comprising:

a communication network to which said origin node and said plurality of recipient nodes of said first group are communicatively coupled.

27. The system of claim 26 wherein the origin node establishes concurrent communication connections from said origin node to said plurality of recipient nodes of said first group.

28. The system of claim 22 wherein said first group establishes concurrent communication connections from the recipient node to every other recipient node of said first group.

29. A system comprising:

an origin node comprising a processor, operable to distribute all of a plurality of descriptors of a file encoded with multiple description coding (MDC) to a plurality of nodes in a first group of a plurality of different groups, the plurality of different groups comprising different nodes in different groups;

wherein said origin node does not attempt to communicate all of said plurality of descriptors to all of said recipient nodes of said first group; and

wherein said recipient nodes of said first group are each operable to communicate a descriptor that it directly receives from said origin node directly to other nodes of said first group; and

a second group of different recipient nodes, wherein each of said recipient nodes of said first group communicates its respective descriptors received from the origin node with the recipient nodes of said second group;

wherein said origin node is operable to logically group a number of said recipient nodes of said first group into a sub-group, wherein said number of said recipient nodes of said sub-group corresponds to the number of descriptors of the MDC file.

30. The system of claim 29 wherein said origin node is operable to distribute said plurality of descriptors to a sub-group of said first group of recipient nodes, and wherein said sub-group of recipient nodes are operable to communicate the plurality of descriptors to the nodes of said first group that are not included in said sub-group.

31. The system of claim 29 wherein said origin node is operable to concurrently distribute one of the plurality of descriptors to each of the recipient nodes of said sub-group.

32. The system of claim 31 wherein said origin node is operable to concurrently distribute a different one of said plurality of descriptors to each of said recipient nodes of said sub-group.

33. The system of claim 29 wherein said origin node is operable to distribute a different one of said plurality of descriptors to each of said recipient nodes of said sub-group.

34. The system of claim 33 wherein each of said recipient nodes of said sub-group is operable to communicate its respective descriptor received from said origin node to each of the other recipient nodes of said sub-group.

35. The system of claim 33 wherein each of said recipient nodes of said sub-group is operable to communicate a respective descriptor received from said origin node to each of the other recipient nodes of said first group.

36. A system comprising:

an origin node comprising a processor, to distribute all of a plurality of descriptors of a file encoded with multiple description coding (MDC) from said origin node to at least a sub-group of a first group of a plurality of groups, the sub-group having more than one node, the plurality of different groups comprising different nodes in different groups;

wherein at least one descriptor is distributed from the origin node directly to each recipient node of said sub-group of said first group; and

the recipient nodes of said sub-group each to communicate its respective descriptors received from said origin node directly to other nodes of said first group; and

a second group of different recipient nodes, wherein each of said recipient nodes of said sub-group communicate its respective descriptors received from the origin node with the recipient nodes of said second group;

wherein said origin node

determines the number of descriptors of said MDC file; and

determines a number of recipient nodes to include in said sub-group as corresponding in number to the number of descriptors of the MDC file.

37. The system of claim 36 wherein said recipient nodes of said sub-group each exchange its respective descriptors received from said origin node such that each recipient node of said sub-group obtains all of said plurality of descriptors of said file.

38. The system of claim 36 wherein said origin node:

concurrently distributes one of said plurality of descriptors to each of said sub-group of recipient nodes.