Content addressable information encapsulation, representation, and transfer

• US 20050044417A1
• Filed: 07/19/2004
• Published: 02/24/2005
• Est. Priority Date: 01/23/1998
• Status: Active Grant

• Current Assignee: Jan F. Van Riel, Paul R. Carpentier, Tom Teugels
• Original Assignee: Jan F. Van Riel, Paul R. Carpentier, Tom Teugels
• Inventors: Teugels, Tom, Carpentier, Paul R., Riel, Jan F. Van
• Granted Patent: US 7,398,391 B2
• Time in Patent Office: Days
• US Class Current: 726/4
• CPC Class Codes: G06F 11/1451 by selection of backup contents
• CPC Class Codes: G06F 11/1453 using de-duplication of the data
• CPC Class Codes: G06F 11/1464 for networked environments
• CPC Class Codes: G06F 16/137 Hash-based content-based indexing of textual data G06F16/31
• CPC Class Codes: H04L 12/1854 with non-centralised forwarding system, e.g. chaincast
• CPC Class Codes: H04L 63/0428 wherein the data content is protected, e.g. by encrypting or encapsulating the payload
• CPC Class Codes: H04L 63/065 for group communications cryptographic mechanisms or cryptographic arrangements for key management involving conference or group key H04L9/0833
• CPC Class Codes: H04L 63/12 Applying verification of the received information cryptographic mechanisms or cryptographic arrangements for data integrity or data verification H04L9/32
• CPC Class Codes: H04L 67/104 Peer-to-peer [P2P] networks
• CPC Class Codes: H04L 67/1068 Discovery involving direct consultation or announcement among potential requesting and potential source peers
• CPC Class Codes: H04L 67/108 characterised by resources being split in blocks or fragments
• CPC Class Codes: H04L 67/56 Provisioning of proxy services store-and-forward switching systems in data switching networks H04L12/54
• CPC Class Codes: H04L 67/566 Grouping or aggregating service requests, e.g. for unified processing
• CPC Class Codes: H04L 67/568 Storing data temporarily at an intermediate stage, e.g. caching

Abstract

Representing a number of assets on an originating computer begins with selecting the assets to be represented. Cryptographic hash asset identifiers are generated; each of the asset identifiers is computed using the contents of a particular asset. The asset identifier is a content-based or content-addressable asset name for the asset and is location independent. An asset list is generated that includes the asset identifiers computed from the assets. A cryptographic hash asset list identifier is generated that is computed from the asset list. The asset list identifier is stored for later retrieval. The assets selected are also stored for safekeeping either locally or on a computer network. In the event of loss of the files from the originating computer, the asset list identifier is retrieved. Using the asset list identifier, the original asset list is found and retrieved from its safe location. The asset identifiers from the retrieved asset list are used to find and retrieve the individual assets from their backup locations. The assets are verified by recomputing the cryptographic hash asset identifier for each asset retrieved and comparing it to the asset identifier from the asset list. The MD5 algorithm is used for the cryptographic hash function. Assets are retrieved using a multicast protocol. A series of importer programs searches for assets to retrieve in progressively more remote locations. Assets are retrieved whole or in segments.

Claims

1. A method of managing the storing of a digital asset by a first computer in a computer system that comprises a second computer, the method comprising acts, performed by the first computer, of:

(A) receiving, at the first computer, a communication including the digital asset;

(B) determining whether the digital asset has been stored by the first computer; and

(C) when it is determined that the digital asset is not stored by the first computer, storing a copy of the digital asset.

2. The method of claim 1, further comprising an act, performed by the first computer, of:

(D) when it is determined that the digital asset has been stored by the first computer, refraining from having the first computer store a duplicative of the digital asset in response to the receipt of the communication in the act (A).

3. The method of claim 1, wherein the first computer is coupled to the second computer by a network, and wherein the act (A) comprises an act of monitoring the network for a communication including the digital asset.

4. The method of claim 1, wherein the first computer provides content addressable storage.

5. The method of claim 4, wherein the communication comprises an asset identifier for the digital asset that is based, at least in part, upon the content of the digital asset, and wherein the act (B) comprises an act of comparing the asset identifier with a set of asset identifiers that identify a set of digital assets stored by the first computer.

6. The method of claim 1, wherein the first computer is a silo.

7. The method of claim 1, wherein the first computer is coupled to the second computer, and wherein the act (A) comprises an act of receiving the communication from the second computer.

8. The method of claim 1, wherein the first computer is a file server.

9. The method of claim 1, wherein the first computer is a storage system.

10. The method of claim 1, wherein the computer system comprises a plurality of computers in addition to the first and second computers and wherein the plurality of computers are interconnected by at least one network, and wherein each of the plurality of computers manages storage of one or more digital assets.

11. The method of claim 1, wherein the first and second computers are peer computers coupled by at least one network.

12. The method of claim 1, wherein the act (C) comprises an act of storing the digital asset on the first computer.

13. The method of claim 1, wherein the act (C) comprises an act of storing the digital asset on a storage device managed by the first computer.

14. At least one computer readable medium encoded with instructions that, when executed on a computer system comprising a first computer and a second computer, perform a method of managing the storing of a digital asset by the first computer, the method comprising acts of:

(A) receiving, at the first computer, a communication including the digital asset;

(B) determining whether the digital asset has been stored by the first computer; and

(C) when it is determined that the digital asset is not stored by the first computer, storing a copy of the digital asset.

15. The at least one computer readable medium of claim 14, wherein the method further comprises an act of:

(D) when it is determined that the digital asset has been stored by the first computer, refraining from having the first computer store a duplicative of the digital asset in response to the receipt of the communication in the act (A).

16. The at least one computer readable medium of claim 14, wherein the first computer is coupled to the second computer by a network, and wherein the act (A) comprises an act of monitoring the network for a communication including the digital asset.

17. The at least one computer readable medium of claim 14, wherein the first computer provides content addressable storage.

18. The at least one computer readable medium of claim 17, wherein the communication comprises an asset identifier for the digital asset that is based, at least in part, upon the content of the digital asset, and wherein the act (B) comprises an act of comparing the asset identifier with a set of asset identifiers that identify a set of digital assets stored by the first computer.

19. The at least one computer readable medium of claim 14, wherein the first computer is a silo.

20. The at least one computer readable medium of claim 14, wherein the first computer is coupled to the second computer, and wherein the act (A) comprises an act of receiving the communication from the second computer.

21. The at least one computer readable medium of claim 14, wherein the first computer is a file server.

22. The at least one computer readable medium of claim 14, wherein the first computer is a storage system.

23. The method of claim 14, wherein the computer system comprises a plurality of computers in addition to the first and second computers and wherein the plurality of computers are interconnected by at least one network, and wherein each of the plurality of computers manages storage of one or more digital assets.

24. The at least one computer readable medium of claim 14, wherein the first and second computers are peer computers coupled by at least one network.

25. The at least one computer readable medium of claim 14, wherein the act (C) comprises an act of storing the digital asset on the first computer.

26. The at least one computer readable medium of claim 14, wherein the act (C) comprises an act of storing the digital asset on a storage device managed by the first computer.

27. A first computer that manages storage of a digital asset for use in a computer system, wherein the computer system comprises the first computer and a second computer, the first computer comprising:

at least one storage device; and

at least one controller, coupled to the at least one storage device, that;

receives a communication including the digital asset;

determines whether the digital asset has been stored on the at least one storage device; and

when it is determined that the digital asset is not stored on the at least one storage device, stores a copy of the digital asset.

28. The first computer of claim 27, wherein the at least one controller, when it is determined that the digital asset has been stored on the at least one storage device, refrains from storing a duplicative of the digital asset in response to the receipt of the communication including the digital asset.

29. The first computer of claim 27, wherein the first computer is to be coupled to the second computer by a network, and wherein the at least one controller is adapted to monitor the network for a communication including the digital asset.

30. The first computer of claim 27, wherein the first computer provides content addressable storage.

31. The first computer of claim 30, wherein the communication comprises an asset identifier for the digital asset that is based, at least in part, upon the content of the digital asset, and wherein the at least one controller compares the asset identifier with a set of asset identifiers that identify a set of digital assets stored on the at least one storage device.

32. The first computer of claim 27, wherein the first computer is a silo.

33. The first computer of claim 27, wherein the first computer is coupled to the second computer, and wherein the at least one controller receives the communication from the second computer.

34. The first computer of claim 27, wherein the first computer is a file server.

35. The first computer of claim 27, wherein the first computer is a storage system.

36. The first computer of claim 27, wherein the computer system comprises a plurality of computers in addition to the first and second computers and wherein the plurality of computers are interconnected by at least one network, and wherein each of the plurality of computers manages storage of one or more digital assets.

37. The first computer of claim 27, wherein the first and second computers are peer computers coupled by at least one network.

38. The first computer of claim 27, wherein the at least one controller stores the digital asset on the at least one storage device.