DATA SHARING AND RECOVERY WITHIN A NETWORK OF UNTRUSTED STORAGE DEVICES USING DATA OBJECT FINGERPRINTING

• US 20110099200A1
• Filed: 10/28/2009
• Published: 04/28/2011
• Est. Priority Date: 10/28/2009
• Status: Active Grant

• Current Assignee: Oracle America, Inc. (Oracle Corporation)
• Original Assignee: Sun Microsystems Incorporated (Oracle Corporation)
• Inventors: BINFORD, CHARLES, BLOUNT, JOSEPH, MAYDEW, STACY LEE
• Granted Patent: US 8,121,993 B2
• Time in Patent Office: Days
• US Class Current: 707/770
• CPC Class Codes: G06F 16/152 using file content signatures, e.g. hash values
• CPC Class Codes: G06F 21/16 Program or content traceability, e.g. by watermarking
• CPC Class Codes: G06F 21/32 using biometric data, e.g. fingerprints, iris scans or voiceprints
• CPC Class Codes: G06F 2221/2145 Inheriting rights or properties, e.g., propagation of permissions or restrictions within a hierarchy
• CPC Class Codes: H04L 1/0061 Error detection codes
• CPC Class Codes: H04L 63/123 received data contents, e.g. message integrity

Abstract

A data sharing method using fingerprinted data objects for sharing data among untrusted network devices. Each peer device is adapted for storing a plurality of data objects, and a fingerprint generator is used to generate a fingerprint for each stored data object available for sharing or for recovery. The fingerprints are stored in a local data store, and a data manager running on one of the computer devices retrieves from another of the computer devices a copy of one of its data objects through the use of the associated fingerprints. The fingerprints include a hash value output from a strong hashing algorithm. The retrieving includes transmitting query messages with the fingerprints of the needed data objects to the networked, peer devices and then verifying the integrity of received data objects by generating a fingerprint of the received data objects that can be compared with the ones provided in the queries.

Claims

1. A data sharing method, comprising:

communicatively linking a plurality of computer devices via a communications network, wherein each of the computer devices includes data storage storing a plurality of data objects;

providing a fingerprint generation module on each of the computer devices;

with each of the computer devices, processing at least a portion of the data objects in the data storage with the fingerprint generation module to generate a fingerprint for the portion of the data objects, wherein the fingerprints are stored in a searchable manner in a data store; and

with a data manager on one of the computer devices, retrieving from another one of the computer devices a copy of one of the data objects in the data storage associated with the one of the computer devices using the fingerprint generated for the one of the data objects.

2. The method of claim 1, wherein each of the fingerprints comprises a hash value output from a hashing algorithm run on an associated one of the data objects.

3. The method of claim 2, wherein the fingerprint generation module parses the hash value into a plurality of sub-stings to provide a first component of each of the fingerprints.

4. The method of claim 3, wherein each of the fingerprints for the data objects further comprises a second component generated by performing a cyclic redundancy check (CRC) function on the data object.

5. The method of claim 1, wherein the retrieving of one of the data objects comprises transmitting a query providing the fingerprint to the computer devices over the communications network.

6. The method of claim 5, wherein the retrieving of one of the data objects further comprises receiving a message from a particular one of the computer devices indicating the provided fingerprint matches one of the fingerprints generated by the particular one of the computer devices and, in response, sending a retrieve message with the fingerprint for the one of the data objects to the particular one of the computer devices.

7. The method of claim 6, wherein the retrieving of one of the data objects further comprises receiving a data object from the particular one of the computer devices and verifying integrity of the received data object by using the fingerprint generation module to generate a new fingerprint and comparing the new fingerprint with the fingerprint provided to the particular one of the computer devices.

8. The method of claim 1, wherein each of the fingerprints comprises a location component generated based on an output of a hashing algorithm applied to an associated one of the data objects and wherein the hashing algorithm is parsed to divide it into a number of segments.

9. A data recovery method, comprising:

with at least one microprocessor, executing at least one fingerprint generation module to process a plurality of data objects to define a fingerprint for each of the data objects, wherein each of the fingerprints comprises a hash value and a CRC for an associated one of the data objects;

storing the data objects in a distributed manner in data storage devices of a plurality of peer devices linked to a network, wherein each of the data storage devices stores a subset of the data objects with at least some of the subsets storing differing ones of the data objects; and

storing the fingerprints associated with each of the subsets of the data objects in memory accessible by one of the peer devices associated with the data storage device storing the subset of the data objects.

10. The method of claim 9, further comprising operating a data manager at one of the peer devices to recover one of the subsets of the data objects by transmitting query messages to the peer devices, wherein each of the query messages includes one of the fingerprints of one of the data objects of the subset of the data objects being recovered.

11. The method of claim 10, wherein each of the peer devices receiving the query messages responds by comparing the fingerprints in the query messages with the fingerprints stored in the memory of the peer device and providing a responsive message indicating located ones of the data objects.

12. The method of claim 11, further comprising operating the data manager, for each of the data objects being recovered, directing a retrieve message with one of the fingerprints of the data objects being recovered to one of the peer devices providing the responsive messages.

13. The method of claim 12, further comprising with the data manager, receiving the data objects being recovered from the peer devices and, prior to storing the received data objects, verifying integrity by using one of the fingerprint generation modules to generate a fingerprint for each received data object and comparing the generated fingerprints with the fingerprints stored in the memory.

14. The process of claim 9, wherein the fingerprint generation module comprises a strong hashing algorithm producing the hash value.

15. A data sharing and recovery system comprising:

a communications network; and

a plurality of peer systems each including a processor providing a data manager with a fingerprint generation module, wherein each of the peer systems is linked to the communications network for communicating with other ones of the peer systems;

wherein each of the peer systems includes a repository storing a number of data objects; and

wherein each of the peer systems includes a data store storing a fingerprint generated by the fingerprint generation module for each of the data objects in the peer system repository.

16. The system of claim 15, wherein the fingerprint generation modules each utilize a substantially identical hash function to provide a first component of each of the fingerprints comprising an output string of the hash function run on each the data objects.

17. The system of claim 15, wherein the data objects stored differs for at least some of the peer systems.

18. The system of claim 15, wherein at least one of the data managers operates to initiate data sharing by transmitting a query over the communications network to other ones of the peer systems, the query comprising the fingerprint of one of the data objects in the peer systems repository associated with the one of the data managers.

19. The system of claim 15, wherein the one of the data managers further operates to poll one of the peer systems with the fingerprint of the one of the data objects to retrieve a copy of one of the data objects.

20. The system of claim 19, wherein the one of the data managers further operates to operate the fingerprint generation module to generate a fingerprint of the received copy of the one of the data objects and further operates to verify integrity by comparing the fingerprint of the received copy with the fingerprint used in the polling step.