Data storage management for network interconnected processors using transferrable placeholders

• US 5,873,103 A
• Filed: 08/27/1997
• Issued: 02/16/1999
• Est. Priority Date: 02/25/1994
• Status: Expired due to Term

• Current Assignee: Clouding Corporation (Marathon Patent Group, Inc.)
• Original Assignee: Kodak Limited (Eastman Kodak Company)
• Inventors: Lotz, Michael Glen, Trede, Brian Eldred
• Primary Examiner(s): Lintz, Paul R.
• Application Number:
  US08/920,344
• Time in Patent Office: 538 Days
• Field of Search: 707/204, 707/10, 395/858
• US Class Current: 1/1
• CPC Class Codes: G06F 12/08 in hierarchically structured memory systems, e.g. virtual memory systems
• CPC Class Codes: G06F 16/1744 using compression, e.g. sparse files
• CPC Class Codes: G06F 3/0617 in relation to availability
• CPC Class Codes: G06F 3/0647 Migration mechanisms
• CPC Class Codes: G06F 3/067 Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
• CPC Class Codes: Y10S 707/99955 Archiving or backup

Abstract

The data storage management system provides the capability to move and/or copy the placeholder files from one file server volume to another file server volume, even if the destination file server volume resides on a different file server. This is accomplished by the use of unique and immutable migration keys which are included in the placeholder entries to identify the location of the associated data file with absolute certainty. In addition, a duplicate copy of the placeholder catalog file is maintained in the system to prevent loss of file system integrity in the event that the active placeholder catalog file is corrupted. This placeholder data is maintained in a placeholder volume catalog which provides users with a file-system-like view of the placeholder files which reside on the selected volume.

Claims

1. A data storage management system for a data network which functions to interconnect a plurality of file servers, each of which stores data files in a plurality of file server volumes, said data storage management system comprising:

directory means, located in each of said plurality of file servers, for identifying a storage location in said plurality of file server volumes of each data file stored on said file server;

secondary storage means for storing data files migrated from said plurality of file servers;

storage server means connected to said network for automatically managing transfer of data files between said plurality of file servers and said secondary storage means, comprising;

means for migrating selected data files from said plurality of file servers to said secondary storage means,

means for writing in said directory means at a file server volume directory location for each of said migrated selected data files, placeholder data indicating that said migrated selected data file has been migrated to said secondary storage means, and

means, responsive to a one of said migrated selected data files being transferred from a first of said plurality of file server volumes on a selected file server to a second of said plurality of file server volumes on a one of said plurality of file servers, for transferring said placeholder data, written in said directory means at a file server volume directory location for said migrated selected data file on said selected file server, to a said directory means at a file server volume directory location for said migrated selected data file on a one of said plurality of file servers associated with said second of said plurality of file server volumes.

2. The system of claim 1 wherein said storage server means further comprises:

means for storing data indicative of a physical data storage location that identifies a locus in said secondary storage means of each of said selected data files migrated to said secondary storage means.

3. The system of claim 2 further comprising:

means, located in each of said plurality of file servers, for intercepting a call at a selected file server to a data file that has been stored in said file server;

means, responsive to said placeholder data written in said directory means, for recalling said requested data file from said secondary storage means to said file server, comprising;

means for reading said placeholder data stored in said directory means to identify a physical data storage location in said storing means that contains data which identifies a locus in said secondary storage means of said requested migrated data file,

means for retrieving said data stored in said identified physical storage location in said storing means, and

means, responsive to said retrieved data, for transmitting said requested migrated data file from said locus in said secondary storage means to said selected file server.

4. The system of claim 1 wherein said placeholder data, written by said writing means in said directory means, is stored as part of the data file attributes.

5. The system of claim 1 wherein said storage server means further comprises:

means, responsive to said means for writing said placeholder data, for writing a copy of said placeholder data into a volume catalog for all data files migrated from said file server volume to said secondary storage means.

6. The system of claim 5 further comprising:

means for enabling a user to recall said placeholder data stored in said volume catalog.

7. The system of claim 2 wherein said secondary storage means comprises:

a multi-layer hierarchical memory, wherein said layers in said hierarchical memory comprise media of differing characteristics.

8. The system of claim 7 wherein said storage server means further comprises:

means for collecting a plurality of data files, that are transmitted to said secondary storage means, into a transfer unit;

means for storing said transfer unit on a first layer of said hierarchy.

9. The system of claim 8 wherein said means for storing data comprises:

media object directory means for storing data indicative of a correspondence between a transfer unit and a media on which said transfer unit is located.