Scan-free archiving

• US 8,880,478 B2
• Filed: 12/28/2006
• Issued: 11/04/2014
• Est. Priority Date: 12/28/2006
• Status: Expired due to Fees

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Chen, Ying, Liu, Chao, Mbogo, Lesley
• Primary Examiner(s): Bhatia, Ajay
• Assistant Examiner(s): MUELLER, KURT A
• Application Number:
  US11/617,465
• Publication Number:
  US 20080162601A1
• Time in Patent Office: 2,868 Days
• Field of Search: 707/665
• US Class Current: 707/665
• CPC Class Codes: G06F 16/113 Details of archiving lifecycle management in storage systems G06F3/0649; backup systems G06F11/1446
• CPC Class Codes: G06F 16/1734 Details of monitoring file system events, e.g. by the use of hooks, filter drivers, logs

Abstract

A method is disclosed for archiving data in a storage server using a runtime monitoring system. The method includes providing a plurality of data files and creating access logs according to a specified format, which may include an append only access log, from the plurality of data files. At least one of the access logs from the plurality of data files is examined and a file will be archived from the examination of the access logs. An archive procedure is initiated for a file when the file has not been accessed for a specified period of time. If the file will be archived includes ascertaining if the file has a duplicate entry in the access log, and archiving the file when the file does not have the duplicate entry in the access log.

Claims

1. A method for archiving data in a storage server using a runtime monitoring system, comprising:

providing a plurality of data files stored on a computer readable data storage device, the data storage device communicating with a computer;

reading file accesses using a module on the computer readable data storage device using the computer;

creating a plurality of access logs, each having a predetermined and individual time period;

defining a specified format for the plurality of access logs, the specified format comprising at least a last file access time (atime);

logging, using an appending update archiving method, read accesses of the plurality of data files in the plurality of access logs using the specified format for the access logs using the computer, the logging creating an access log record in one of the plurality of access logs having the predetermined time period corresponding to the atime of the read access;

examining the plurality of access logs from the plurality of data files using the computer;

determining if an accessed file will be archived from the examination of the plurality of access logs using the computer by;

ascertaining if the accessed file has more than one access log record in the plurality of access logs by examining the plurality of access logs; and

archiving the accessed file when the accessed file does not have more than one access log record in the plurality of access logs using the computer; and

initiating an archive procedure using the computer for the accessed file when the accessed file has not been accessed for a specified period of time.

2. The method of claim 1, wherein the plurality of data files are tracked as the data files are created by using the computer.

3. The method of claim 2, wherein the tracking of the plurality of data files occurs when the data files first enter a data storage system.

4. The method of claim 3, wherein the data storage system includes a plurality of computer data storage elements.

5. The method of claim 1, further including the steps of:

determining when the plurality of access logs are available and when the plurality of access logs are not available using the computer;

scanning the plurality of data files using the computer;

determining if the accessed file will be archived using the computer; and

initiating the archive procedure for the accessed file when the accessed file has not been accessed for the specified period of time using the computer.

7. The method of claim 1, further comprising:

separating the plurality of access logs into specified access log files using the computer; and

identifying the plurality of access logs in each of the specified access log files using the computer.

10. The method of claim 1, further comprising:

reading an access log into memory;

filtering out duplicate file entries; and

archiving remaining file entries.

11. The method of claim 10, further comprising:

dividing one or more of the plurality of access logs into pieces; and

sequentially filtering out duplicate file entries for each of the pieces of the one or more access logs.

12. The method of claim 1, further comprising:

converting filenames of the plurality of data files into hash values.

13. The method of claim 1, further comprising:

creating a log deliminator for the plurality of access logs for separating a log from one day from another day'"'"'s log.

6. A runtime monitoring system for archiving data in a storage server, which comprises:

a plurality of data files stored on a computer readable data storage device, the data storage device communicating with a computer;

an access monitoring device having a module on the computer readable data storage device and using the computer for monitoring a user'"'"'s access of the data files, the module creating a plurality of access logs, each having a predetermined and individual time period, defining a specified format of a plurality of access logs, the specified format comprising at least a last file access time (atime), and the module using an appending update archiving method to log read accesses of the plurality of data files in the plurality of access logs, the logging creating an access log record in one of the plurality of access logs having the predetermined time period corresponding to the atime of the read access; and

a monitoring daemon stored in the data storage device and communicating with the computer, the monitoring daemon for;

examining the plurality of access logs from the plurality of data files; and

determining if an accessed file will be archived from the examination of the plurality of access logs by;

ascertaining if the accessed file has more than one access log record in the plurality of access logs by examining the plurality of access logs; and

archiving the accessed file when the accessed file does not have more than one access log record in the plurality of access logs; and

initiating an archive procedure using the computer for the accessed file when the access file has not been access for a specified period of time.

8. The system of claim 6, wherein the specified format includes an append access log using an appending update archiving method, the appending update archiving method logically removes log records from the logs when a more recent log record is in the access log.

9. The system of claim 6, wherein the monitoring daemon reads an access log into memory to filter out duplicate file entries and archive remaining file entries.