Method and apparatus for automatically archiving a file system

• US 7,155,465 B2
• Filed: 04/18/2003
• Issued: 12/26/2006
• Est. Priority Date: 04/18/2003
• Status: Active Grant

• Current Assignee: Digital Cache, LLC (Oso IP, LLC)
• Original Assignee: Benjamin F. Cutler, Howard F. Lee
• Inventors: Lee, Howard F., Cutler, Benjamin F.
• Primary Examiner(s): Rimell, Sam
• Assistant Examiner(s): Kim, Paul
• Application Number:
  US10/420,113
• Publication Number:
  US 20040210608A1
• Time in Patent Office: 1,348 Days
• Field of Search: 707/204, 707/206, 707/200, 707/201, 707/1
• US Class Current: 1/1
• CPC Class Codes: G06F 11/1448 Management of the data involved in backup or backup restore
• CPC Class Codes: G06F 11/1451 by selection of backup contents
• CPC Class Codes: Y10S 707/99953 Recoverability
• CPC Class Codes: Y10S 707/99955 Archiving or backup

Abstract

In a digital data processing system having an on-line file system component, a method and apparatus for archiving the contents of a selected client volume stored on the file system. The archiving is performed automatically, beginning with an initial duplication of the existing contents of the client volume into an archive volume, then continuing as changes, including additions, deletions and modifications, are made to the files comprising the client volume. Older, previously-archived versions of modified files are gracefully discarded so as to moderate the rate of growth of the archive volume. The archive volume may be used to restore the client volume, either selectively or in whole, in the event of inadvertent damage to, or loss of, files in the client volume.

Claims

1. In a digital data processing system having a first file storage system adapted to store a first file, a method for archiving said stored file, comprising:

providing a second file storage system adapted to store files;

storing in said second file storage system a first copy of said first file;

storing in a first record the time said first copy is stored in said second file storage system;

selectively applying a predetermined graceful degradation filter to said first record, the filter comprising at least;

a first age interval criterion adapted to select said first copy for retention if said first copy is the most recent copy of said first file stored in said second file storage system; and

a second age interval criterion adapted to select said first copy for retention if said first copy is the only copy of said first file stored in said second file storage system; and

if said first copy is not selected for retention by said filter, deleting said first copy from said second file storage system.

2. The method of claim 1 further comprising:

if said first file is thereafter modified;

storing in said second file storage system a second copy of said modified first file; and

storing in a second record said state of said selected condition existent as of the time said second copy is stored in said second file storage system; and

wherein said filter criteria are selectively applied to said first and second records.

3. The method of claim 2 further comprising:

if said modified first file is thereafter deleted, storing in a third record said state of said selected condition existent as of the time said modified first file is deleted from said first file storage system; and

wherein said filter criteria are selectively applied to said first, second and third records.

4. The method of claim 1 further comprising:

if said first file is thereafter deleted, storing in a third record said state of said selected condition existent as of the time said first file is deleted from said first file storage system; and

wherein said filter criteria are selectively applied to said first and third records.

5. The method of claim 1 wherein said filter is a selected one of:

a linear filter;

with infrequent changes;

with frequent changes;

crafted;

lazy;

Fibonacci; and

Base-2.

6. The method of claim 1 wherein said filter is specially adapted to permanently retain in said second file system said first copy of said first file if, after said first copy of said first file is initially stored in said second file system, said first file is never thereafter modified in or deleted from said first file system.

7. The method of claim 1 wherein said filter is specially adapted to permanently retain in said second file system said first copy of said first file even if, after said first copy of said first file is initially stored in said second file system, said first file is thereafter deleted from said first file system.

8. The method of claim 1 wherein said filter is specially adapted to selectively retain permanently in said second file system said first copy of said first file.

9. The method of claim 1 wherein said first file system is contained within a first enclosure and said second file system is contained within a second enclosure independent of said first enclosure.

10. The method of claim 1 wherein said first file system and said second file system are both contained within a single first enclosure.

11. A digital data processing system having a first file storage system adapted to store a first file, the system comprising:

a second file storage system adapted to store files;

a storage agent adapted to;

store in said second file storage system a first copy of said first file;

store in a first record a state of a selected condition existent as of the time said first copy is stored in said second file storage system;

selectively apply a predetermined graceful degradation filter to said first record, the filter comprising at least;

a first age interval criterion adapted to select said first copy for retention if said first copy is the most recent copy of said first file stored in said second file storage system; and

a second age interval criterion adapted to select said first copy for retention if said first copy is the only copy of said first file stored in said second file storage system; and

if said first copy is not selected for retention by said filter, delete said first copy from said second file storage system.

12. The system of claim 11 further comprising:

if said first file is thereafter modified, the storage agent;

stores in said second file storage system a second copy of said modified first file; and

stores in a second record said state of said selected condition existent as of the time said second copy is stored in said second file storage system; and

wherein said filter criteria are selectively applied to said first and second records.

13. The system of claim 12 further comprising:

if said modified first file is thereafter deleted, the storage agent stores in a third record said state of said selected condition existent as of the time said modified first file is deleted from said first file storage system; and

wherein said filter criteria are selectively applied to said first, second and third records.

14. The system of claim 11 further comprising:

if said first file is thereafter deleted, the storage agent stores in a third record said state of said selected condition existent as of the time said first file is deleted from said first file storage system; and

wherein said filter criteria are selectively applied to said first and third records.

15. The system of claim 11 wherein said filter is a selected one of:

a linear filter;

with infrequent changes;

with frequent changes;

crafted;

lazy;

Fibonacci; and

Base-2.

16. The system of claim 11 wherein said filter is specially adapted to permanently retain in said second file system said first copy of said first file if, after said first copy of said first file is initially stored in said second file system, said first file is never thereafter modified in or deleted from said first file system.

17. The system of claim 11 wherein said filter is specially adapted to permanently retain in said second file system said first copy of said first file even if, after said first copy of said first file is initially stored in said second file system, said first file is thereafter deleted from said first file system.

18. The system of claim 11 wherein said filter is specially adapted to selectively retain permanently in said second file system said first copy of said first file.

19. The system of claim 11 wherein said first file system is contained within a first enclosure and said second file system is contained within a second enclosure independent of said first enclosure.

20. The system of claim 11 wherein said first file system and said second file system are both contained within a single first enclosure.

21. A storage agent for use in a digital data processing system having a first file storage system adapted to store a first file, the storage agent comprising:

a second file storage system adapted to store files;

wherein the storage agent is adapted to;

store in said second file storage system a first copy of said first file;

store in a first record a state of a selected condition existent as of the time said first copy is stored in said second file storage system;

selectively apply a predetermined graceful degradation filter to said first record, the filter comprising at least;

a first age interval criterion adapted to select said first copy for retention if said first copy is the most recent copy of said first file stored in said second file storage system; and

a second age interval criterion adapted to select said first copy for retention if said first copy is the only copy of said first file stored in said second file storage system; and

if said stored state of said selected condition satisfies said criteria, delete said first copy from said second file storage system.

22. The storage agent of claim 21 further comprising:

if said first file is thereafter modified, the storage agent;

stores in said second file storage system a second copy of said modified first file; and

stores in a second record said state of said selected condition existent as of the time said second copy is stored in said second file storage system; and

wherein said filter criteria are selectively applied to said first and second records.

23. The storage agent of claim 22 further comprising:

if said modified first file is thereafter deleted, the storage agent stores in a third record said state of said selected condition existent as of the time said modified first file is deleted from said second file storage system; and

wherein said filter criteria are selectively applied to said first, second and third records.

24. The storage agent of claim 21 further comprising:

if said first file is thereafter deleted, the storage agent stores in a third record said state of said selected condition existent as of the time said first file is deleted from said first file storage system; and

wherein said filter criteria are selectively applied to said first and third records.

25. The storage agent of claim 21 wherein said filter is a selected one of:

a linear filter;

with infrequent changes;

with frequent changes;

crafted;

lazy;

Fibonacci; and

Base-2.

26. The storage agent of claim 21 wherein said filter is specially adapted to permanently retain in said second file system said first copy of said first file if, after said first copy of said first file is initially stored in said second file system, said first file is never thereafter modified in or deleted from said first file system.

27. The storage agent of claim 21 wherein said filter is specially adapted to permanently retain in said second file system said first copy of said first file even if, after said first copy of said first file is initially stored in said second file system, said first file is thereafter deleted from said first file system.

28. The storage agent of claim 21 wherein said filter is specially adapted to selectively retain permanently in said second file system said first copy of said first file.

29. The storage agent of claim 21 wherein said first file system is contained within a first enclosure and said second file system is contained within a second enclosure independent of said first enclosure.

30. The storage agent of claim 21 wherein said first file system and said second file system are both contained within a single first enclosure.

31. In a digital data processing system having a file system adapted to store at least two versions of a file, a method for managing a file archive, comprising:

selectively storing in said file archive a copy of each of said versions of said file;

selectively applying a predetermined graceful degradation filter to said file archive, the filter comprising at least;

a first criterion adapted to select for retention in said file archive the copy of the most recent version of said file; and

a second criterion adapted to select for retention in said file archive the copy of at least a selected one of the versions of said first file; and

if a copy is not selected for retention by said filter, deleting said copy from said file archive.

32. The method of claim 31 wherein said filter further comprises:

a third criterion adapted to select for retention in said file archive, from among all copies of versions of said first file stored in said file system during a first age interval, at least the copy of that version stored in said file system earliest in said first age interval.

33. The method of claim 31 wherein said filter further comprises:

a third criterion adapted to select for retention in said file archive, from among all copies of versions of said first file stored in said file system during a first age interval, all copies of those versions stored in said file system during said first age interval.

34. The method of claim 31 wherein said filter further comprises:

a third criterion adapted to select for retention in said file archive, from among all copies of versions of said first file stored in said file system during a first age interval, a selected subset of all copies of those versions stored in said file system during said first age interval.