Distributed multicast caching technique

• US 7,240,105 B2
• Filed: 01/26/2001
• Issued: 07/03/2007
• Est. Priority Date: 01/26/2001
• Status: Expired due to Fees

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Satran, Julian, Gershinsky, Gidon
• Primary Examiner(s): Wiley; David
• Assistant Examiner(s): NEURAUTER, GEORGE C
• Application Number:
  US09/770,558
• Publication Number:
  US 20020103972A1
• Time in Patent Office: 2,349 Days
• Field of Search: 709/201, 709/222, 370/390, 370/422
• US Class Current: 709/222
• CPC Class Codes: H04L 12/185 with management of multicast group membership
• CPC Class Codes: H04L 12/1859 adapted to provide push services, e.g. data channels
• CPC Class Codes: H04L 67/2885 Hierarchically arranged intermediate devices, e.g. for hierarchical caching
• CPC Class Codes: H04L 67/568 Storing data temporarily at an intermediate stage, e.g. caching
• CPC Class Codes: H04L 69/329 in the application layer [OSI layer 7]

Abstract

A caching arrangement for the content of multicast transmission across a data network utilizes a first cache which receives content from one or more content providers. Using the REMADE protocol, the first cache constructs a group directory. The first cache forms the root of a multilevel hierarchical tree. In accordance with configuration parameters, the first cache transmits the group directory to a plurality of subsidiary caches. The subsidiary caches may reorganize the group directory, and relay it to a lower level of subsidiary caches. The process is recursive, until a multicast group of end-user clients is reached. Requests for content by the end-user clients are received by the lowest level cache, and forwarded as necessary to higher levels in the hierarchy. The content is then returned to the requesters. Various levels of caches retain the group directory and content according to configuration options, which can be adaptive to changing conditions such as demand, loading, and the like. The behavior of the caches may optionally be modified by the policies of the content providers.

Claims

1. A method of transmitting data over a communications network, comprising:

receiving content from a content provider in a first cache;

responsively to receipt of said content establishing a first group directory in said first cache;

multicasting said first group directory from said first cache over said communications network to a plurality of subsidiary caches, while flagging said content so as to require said subsidiary caches to begin receiving said content immediately without waiting for transmission requests from clients, and without using a return link from the subsidiary caches to the first cache;

establishing second group directories in said subsidiary caches, said second group directories being derived from said first group directory; and

transmitting said second group directories from said subsidiary caches to a multicast group of receivers.

2. The method according to claim 1, wherein multicasting said first group directory comprises periodically retransmitting said first group directory, so as to enable said subsidiary caches to recover from errors in transmission without returning messages to said first cache.

3. The method according to claim 1, wherein said step of transmitting said first group directory is performed using a REMADE protocol, wherein said first group directory and said second group directories comprise data items that are divided into blocks that include a block sequence number, a data item identifier, and a timestamp indicating an age of a respective data item.

4. The method according to claim 1, wherein said step of transmitting said first group directory is performed by periodic transmission thereof.

5. The method according to claim 1, wherein said step of transmitting said first group directory is performed according to a policy of said content provider.

6. The method according to claim 1, wherein said step of transmitting said second group directory is performed by periodic transmission thereof.

7. The method according to claim 1, wherein said step of transmitting said second group directory is performed using a REMADE protocol, wherein said first group directory and said second group directories comprise data items that are divided into blocks that include a block sequence number, a data item identifier, and a timestamp indicating an age of a respective data item.

8. The method according to claim 1, wherein said step of transmitting said second group directories is performed according to a policy of said content provider.

9. The method according to claim 1, wherein said content provider comprises a plurality of content providers.

10. The method according to claim 1, wherein said first cache and said subsidiary caches are linked together as a hierarchical tree, said first cache forming a root of said hierarchical tree.

11. The method according to claim 1, wherein said first group directory comprises a root directory hierarchically linked to a plurality of subdirectories, said subdirectories carrying a list of data items, a subtree of said first group directory being defined by one of said subdirectories and at least one linked subdirectory thereunder.

12. The method according to claim 1, wherein said second group directories comprises a root directory hierarchically linked to a plurality of subdirectories, said subdirectories carrying a list of data items, a subtree of said second group directory being defined by one of said subdirectories and at least one linked subdirectory thereunder.

13. The method according to claim 1, wherein said step of transmitting said first group directory is performed without receiving communications from any receivers of said content.

14. A computer software product, comprising a computer-readable medium in which computer program instructions are stored, which instructions, when read by at least one computer, causes said at least one computer to execute a method of transmitting data over a communications network, comprising the steps of:

receiving content from a content provider in a first cache;

responsively to receipt of said content establishing a first group directory in said first cache;

multicasting said first group directory from said first cache over said communications network to a plurality of subsidiary caches, while flagging said content so as to require said subsidiary caches to begin receiving said content immediately without waiting for transmission requests from clients, and without using a return link from the subsidiary caches to the first cache;

establishing second group directories in said subsidiary caches, said second group directories being derived from said first group directory; and

transmitting said second group directories from said subsidiary caches to a multicast group of receivers.

15. The computer software product according to claim 14, wherein multicasting said first group directory comprises periodically retransmitting said first group directory, so as to enable said subsidiary caches to recover from errors in transmission without returning messages to said first cache.

16. The computer software product according to claim 14, wherein said step of transmitting said first group directory is performed using a REMADE protocol, wherein said first group directory and said second group directories comprise data items that are divided into blocks that include a block sequence number, a data item identifier, and a timestamp indicating an age of a respective data item.

17. The computer software product according to claim 14, wherein said step of transmitting said first group directory is performed by periodic transmission thereof.

18. The computer software product according to claim 14, wherein said step of transmitting said first group directory is performed according to a policy of said content provider.

19. The computer software product according to claim 14, wherein said step of transmitting said second group directories is performed by periodic transmission thereof.

20. The computer software product according to claim 14, wherein said step of transmitting said second group directory is performed using a REMADE protocol, wherein said first group directory and said second group directories comprise data items that are divided into blocks that include a block sequence number, a data item identifier, and a timestamp indicating an age of a respective data item.

21. The computer software product according to claim 14, wherein said step of transmitting said second group directories is performed according to a policy of said content provider.

22. The computer software product according to claim 14, wherein said content provider comprises a plurality of content providers.

23. The computer software product according to claim 14, wherein said cache and said subsidiary caches are linked together as a hierarchical tree, said cache forming a root of said hierarchical tree.

24. The computer software product according to claim 14, wherein said first group directory comprises a root directory hierarchically linked to a plurality of subdirectories, said subdirectories carrying a list of data items, a subtree of said first group directory being defined by one of said subdirectories and at least one linked subdirectory thereunder.

25. The computer software product according to claim 14, wherein said second group directories comprises a root directory hierarchically linked to a plurality of subdirectories, said subdirectories carrying a list of data items, a subtree of said second group directory being defined by one of said subdirectories and at least one linked subdirectory thereunder.

26. The computer software product according to claim 14, wherein said step of transmitting said first group directory is performed without receiving communications from any receivers of said content.

27. A system for transmitting data over a communications network, comprising:

a first server, having a cache therein, receiving content from a content provider, wherein responsive to said content a first group directory is established in said cache by said first server; and

a plurality of second servers, having respective subsidiary caches therein,

wherein said first server is arranged to multicast said first group directory from said first cache over said communications network to said subsidiary caches, while flagging said content so as to require said subsidiary caches to begin receiving said content immediately without waiting for transmission requests from clients, and without using a return link from the subsidiary caches to the first cache, and

wherein responsive to said first group directory, second group directories are established in said subsidiary caches by said second servers, and said second group directories are transmitted by said second servers from said subsidiary caches to a multicast group of receivers.

28. The system according to claim 27, wherein said first server is arranged to periodically retransmit said first group directory, so as to enable said subsidiary caches to recover from errors in transmission without returning messages to said first cache.

29. The system according to claim 27, wherein said first group directory is transmitted using a REMADE protocol, wherein said first group directory and said second group directories comprise data items that are divided into blocks that include a block sequence number, a data item identifier, and a timestamp indicating an age of a respective data item.

30. The system according to claim 27, wherein said first group directory is transmitted periodically.

31. The system according to claim 27, wherein said first group directory is transmitted according to a policy of said content provider.

32. The system according to claim 27, wherein said second group directories are transmitted periodically.

33. The system according to claim 27, wherein said second group directory is transmitted using a REMADE protocol, wherein said first group directory and said second group directories comprise data items that are divided into blocks that include a block sequence number, a data item identifier, and a timestamp indicating an age of a respective data item.

34. The system according to claim 27, wherein said second group directories are transmitted according to a policy of said content provider.

35. The system according to claim 27, wherein said content provider comprises a plurality of content providers.

36. The system according to claim 27, wherein said cache and said subsidiary caches are linked together as a hierarchical tree, said cache forming a root of said hierarchical tree.

37. The system according to claim 27, wherein said first group directory comprises a root directory hierarchically linked to a plurality of subdirectories, said subdirectories carrying a list of data items, a subtree of said first group directory being defined by one of said subdirectories and at least one linked subdirectory thereunder.

38. The system according to claim 27, wherein said second group directories comprises a root directory hierarchically linked to a plurality of subdirectories, said subdirectories carrying a list of data items, a subtree of said second group directory being defined by one of said subdirectories and at least one linked subdirectory thereunder.

39. The system according to claim 27, wherein said first server is operative to transmit said first group directory to said subsidiary cache without receiving communications from any receivers of said content.