History preservation in a computer storage system

• US 7,912,855 B2
• Filed: 01/07/2004
• Issued: 03/22/2011
• Est. Priority Date: 02/26/2003
• Status: Expired due to Term

• Current Assignee: Red Hat, Inc. (International Business Machines Corporation)
• Original Assignee: Permabit Technology Corporation (International Business Machines Corporation)
• Inventors: Margolus, Norman H.
• Primary Examiner(s): Harper; Eliyah S
• Application Number:
  US10/752,848
• Publication Number:
  US 20040167913A1
• Time in Patent Office: 2,631 Days
• Field of Search: 707/104.1, 707/100, 707/3, 707/705, 707/758, 707/781, 707/783, 707/802, 707/999.001, 707/999.009
• US Class Current: 707/781
• CPC Class Codes: G06F 16/122 using management policies backup systems G06F11/1446; file migration policies for HSM systems G06F16/185
• CPC Class Codes: G06F 16/125 characterised by the use of retention policies retention policies for HSM systems G06F16/185
• CPC Class Codes: G06F 16/2358 Change logging, detection, and notification replication G06F16/27
• CPC Class Codes: Y10S 707/99931 Database or file accessing
• CPC Class Codes: Y10S 707/99936 Pattern matching access
• CPC Class Codes: Y10S 707/99937 Sorting
• CPC Class Codes: Y10S 707/99939 Privileged access
• CPC Class Codes: Y10S 707/99942 Manipulating data structure, e.g. compression, compaction, compilation
• CPC Class Codes: Y10S 707/99952 Coherency, e.g. same view to multiple users
• CPC Class Codes: Y10S 707/99953 Recoverability

Abstract

A method by which a disk-based distributed data storage system is organized for protecting historical records of stored data entities. The method comprises recording distinct states of an entity, corresponding to different moments of time, as separate entity versions coexisting within the distributed data storage system, and assigning expiration times to the entity versions independently within each of a plurality of storage sites according to a shared set of rules, before which times deletion is prohibited.

Claims

1. A method by which a plurality of client programs connected to a network are allowed to deposit data items identical to ones already stored in a data repository connected to the network without transmitting the full data items but are prevented from depositing data items they do not possess, the method comprising:

depositing a plurality of data items over the network into the data repository, in response to requests from the plurality of client programs;

depositing some of the plurality of data items that are identical to data items already stored in the data repository without transmitting the full data items, using digital fingerprints to identify identical data items;

requiring clients depositing data items without transmitting the full data items to respond to challenges designed to prevent clients from depositing data items they do not possess;

determining a digital fingerprint of a data item;

testing for whether a copy of the data item is already stored in the data repository by comparing the digital fingerprint of the data item to the digital fingerprints of data items already in storage in the data repository;

challenging a client that is attempting to deposit the data item without transmitting the full data item to the data repository; and

assigning an expiration time to the data item, before which time both modification and deletion are prohibited;

wherein depositing the data item comprises ensuring that a copy of the data item is stored in the data repository and arranging for the client to have future access to read the copy;

wherein the testing step reveals that a copy of the data item is already stored in the data repository;

wherein challenging comprises requiring of the client that it supply additional information representative of the content of the data item other than the digital fingerprint;

wherein the additional information representative of the content of the data item is not sufficient to reconstruct the entire data item;

wherein challenging comprises requiring that the client provide correct answers to questions about the content of portions of the data item, or questions that require knowledge of this content; and

wherein the challenging step prevents clients that possess the digital fingerprint of the data item but not the entire data item from successfully depositing the data item and being granted future access to the copy of the data item stored in the data repository.

2. The method of claim 1 in which rules governing expiration and deletion are distributed among a plurality of storage sites that constitute the data repository.

3. The method of claim 1 in which the expiration time assigned to the data item depends upon expiration times assigned by the client programs.

4. The method of claim 1 in which the digital fingerprint of the data item is a cryptographic hash of the data item.

5. The method of claim 1 in which the testing determines whether or not the data item is already stored in the data repository without comparing the entire contents of the data item to the entire contents of a data item already stored.

6. The method of claim 1 in which, before the expiration time has passed, no action taken by the client can change the expiration time to be sooner than it was at the time of the action.

7. The method of claim 6 in which, before the expiration time has passed, the client causes the expiration time assigned to the data item to be changed to a later time.

8. The method of claim 6 in which the client causes a value to be assigned to the expiration time.

9. The method of claim 6 in which no action taken before the expiration time by any client program that only communicates with the data repository over a wide area network can cause the expiration time to be made sooner than it was at the time of the action or cause the data item to be deleted.

10. The method of claim 1 in which the additional information representative of the content of the data item is not substantially larger than the digital fingerprint of the data item.

11. The method of claim 1 in which the questions are communicated from the data repository to the client.

12. The method of claim 1 in which the questions are determined by the client without communicating with the data repository.