Clustered hierarchical file services

• US 7,627,617 B2
• Filed: 02/10/2005
• Issued: 12/01/2009
• Est. Priority Date: 02/11/2004
• Status: Active Grant

• Current Assignee: Oracle America, Inc. (Oracle Corporation)
• Original Assignee: Storage Technology Corp (Oracle Corporation)
• Inventors: Hughes, James P., Eichel, Dale R., Kavuri, Ravi K., Holdman, Jon M., Hewitt, Randall K.
• Primary Examiner(s): Breene; John E
• Assistant Examiner(s): Jami; Hares
• Application Number:
  US11/055,523
• Publication Number:
  US 20050195660A1
• Time in Patent Office: 1,755 Days
• Field of Search: 707/103, 707/1, 707/100, 707/201, 707/204, 709/217, 711/113
• US Class Current: 1/1
• CPC Class Codes: G06F 11/1458 Management of the backup or restore process
• CPC Class Codes: G06F 11/1461 Backup scheduling policy
• CPC Class Codes: G06F 16/122 using management policies backup systems G06F11/1446; file migration policies for HSM systems G06F16/185
• CPC Class Codes: G06F 3/0605 by facilitating the interaction with a user or administrator
• CPC Class Codes: G06F 3/0607 by facilitating the process of upgrading existing storage systems, e.g. for improving compatibility between host and storage device
• CPC Class Codes: G06F 3/0631 by allocating resources to storage systems
• CPC Class Codes: G06F 3/0649 Lifecycle management
• CPC Class Codes: G06F 3/0664 at device level, e.g. emulation of a storage device or system
• CPC Class Codes: G06F 3/0685 Hybrid storage combining heterogeneous device types, e.g. hierarchical storage, hybrid arrays
• CPC Class Codes: Y10S 707/99931 Database or file accessing
• CPC Class Codes: Y10S 707/99943 Generating database or data structure, e.g. via user interface
• CPC Class Codes: Y10S 707/99944 Object-oriented database structure
• CPC Class Codes: Y10S 707/99952 Coherency, e.g. same view to multiple users
• CPC Class Codes: Y10S 707/99953 Recoverability
• CPC Class Codes: Y10S 707/99955 Archiving or backup

Abstract

A system for object-based archival data storage includes an object-based storage subsystem having respective data storage devices, at least one file presentation interface that interfaces to client platforms, an administration interface having graphical user interface (GUI) and a command line interface (CLI), a meta data subsystem for storing meta data about files, and includes a virtual file subsystem having a virtual file server (VFS), a policy subsystem, and a scalable interconnect to couple the object-based storage subsystem, the at least one file presentation interface, the administration interface, the meta data subsystem, and the policy subsystem, wherein the policy subsystem provides system rules predetermined by a user for at least one of hash based integrity checking, read-only/write-ability/erase-ability control, and duplicate data treatment corresponding to files and file objects.

Claims

1. A system for object-based archival data storage, the system comprising:

an administration interface subsystem having a graphical user interface (GUI) and a command line interface (CLI), the administration interface subsystem allowing an administrator to interface with;

a policy subsystem that provides system rules for at least one of hash based integrity checking, read-only/write-ability/erase-ability control, and duplicate data treatment corresponding to files and file objects;

an object-based storage subsystem connected to respective data storage devices, the object-based storage subsystem including a meta data subsystem for maintaining information about the data storage devices used by a virtual library system to store data, and the object-based storage subsystem further including an Input-Output (IO) subsystem for providing routines for reading and writing stored objects;

the meta data subsystem further being configured to store meta data about files, the meta data subsystem further categorizing data into classes and mapping the classed data into policies, the meta data subsystem transmitting the policies to the policy subsystem, and the policy subsystem generating system rules in response to the policies received from the meta data subsystem; and

an audit subsystem that captures and stores audit information about at least one class of data, wherein the audit subsystem captures and stores the audit information in response to a policy received from the administration interface subsystem;

at least one file presentation interface that interfaces a client platform to a Virtual File System (VFS) of the meta data subsystem; and

a scalable interconnect to couple the object-based storage subsystem, the administration interface subsystem, the meta data subsystem, the policy subsystem, and the at least one file presentation interface.

2. The system according to claim 1 further comprising an indexer that creates searchable, content based indices, and is externally accessible via the file presentation interface.

3. The system according to claim 1 wherein the policy subsystem further comprises a policy control interface that interfaces with the administration interface subsystem to collect class and policy definitions, maintain and process class and policy definitions, extract data management rules, and maintain the hierarchy of functions to be performed.

4. The system according to claim 1 wherein the duplicate data treatment includes at least one of keeping all original and duplicated data copies, keeping only original data and deleting duplicate data, and replacing original data with new duplicate data, and detection of duplicate data is recorded in an audit log.

5. The system according to claim 1 wherein the policy subsystem further provides controls for policy modifications, and absolute time based controls.

6. The system according to claim 1 wherein the object-based storage subsystem stores data onto physical storage and manages free space in response to the policy subsystem rules.

7. The system according to claim 1 further comprising a security subsystem coupled to the administration interface subsystem, and that creates roles for each user, and assigns credentials, creates resources and resource groups and assigns role based enforcement criterion, maintains pluggable security modules for validation, interfaces with a key management system for symmetric key management, and provides rules for client authentication for physical resources including disks and tapes.

8. The system according to claim 1 wherein the object-based storage subsystem provides at least one of mirrored writes to disk, optimization for small objects, data security erase via expungement of obsolete data, and direct support for media change libraries.

9. A method of object-based archival data storage, the method comprising:

interfacing an administration interface subsystem having graphical user interface (GUI) and a command line interface (CLI) with;

a policy subsystem that provides system rules for at least one of hash based integrity checking, read-only/write-ability/erase-ability control, and duplicate data treatment corresponding to files and file objects;

an object-based storage subsystem connected to respective data storage devices, the object-based storage subsystem including a meta-data subsystem for maintaining information about the data storage devices used by a virtual library system to store data, and the object-based storage subsystem further including an Input-Output (IO) subsystem for providing routines for reading and writing stored objects;

the meta data subsystem further being configured to store meta data about files, the meta data subsystem further categorizing data into classes and mapping the classed data into policies, the meta data subsystem transmitting the policies to the policy subsystem, and the policy subsystem generating system rules in response to the policies received from the meta data subsystem; and

an audit subsystem that captures and stores audit information about at least one class of data, wherein the audit subsystem captures and stores the audit information in response to a policy received from the administration interface subsystem;

at least one file presentation interface that interfaces a client platform to a Virtual File System (VFS) of the meta data subsystem; and

a scalable interconnect to couple the object-based storage subsystem, the administration interface subsystem, the meta data subsystem, the policy subsystem, and the at least one file presentation interface.

10. The method according to claim 9 wherein the duplicate data treatment includes at least one of keeping all original and duplicated data copies, keeping only original data and deleting duplicate data, and replacing original data with new duplicate data, and detection of duplicate data is recorded in an audit log.

11. The method according to claim 9 wherein the policy subsystem further provides controls for policy modifications, and absolute time based controls.

12. The method according to claim 9 wherein the object-based storage subsystem stores data onto physical storage and manages free space in response to the policy subsystem rules, and provides at least one of mirrored writes to disk, optimization for small objects, data security erase via expungement of obsolete data, and direct support for media change libraries.

13. The method according to claim 9 further comprising coupling an indexer to the file presentation interface, wherein the indexer creates searchable, content based indices, and is externally accessible via the file presentation interface.

14. The method according to claim 13 wherein the policy subsystem further comprises a policy control interface that interfaces with the administration interface subsystem to collect class and policy definitions, maintain and process class and policy definitions, extract data management rules, and maintain the hierarchy of functions to be performed.

15. The method according to claim 9 further comprising a security subsystem coupled to the administration interface subsystem, and that creates roles for each user, and assigns credentials, creates resources and resource groups and assigns role based enforcement criterion, maintains pluggable security modules for validation, interfaces with a key management system for symmetric key management, and provides rules for client authentication for physical resources including disks and tapes.