Fixed content storage within a partitioned content platform, with disposition service

• US 20110106771A1
• Filed: 10/30/2009
• Published: 05/05/2011
• Est. Priority Date: 10/30/2009
• Status: Active Grant

• Current Assignee: Hitachi Vantara, LLC (Hitachi, Ltd.)
• Original Assignee: Hitachi Data Systems Corporation (Hitachi, Ltd.)
• Inventors: Lacasse, Christopher S., Zolotusky, Vitaly, Rogers, Richard E., McDonald, Matthew M.
• Granted Patent: US 8,533,161 B2
• Time in Patent Office: Days
• US Class Current: 707/663
• CPC Class Codes: G06F 16/182 Distributed file systems

Abstract

A content platform (or “cluster”) that comprises a redundant array of independent nodes is logically partitioned. Using a web-based interface, an administrator defines one or more “tenants” within the cluster, wherein a tenant has a set of attributes: namespaces, administrative accounts, data access accounts, and a permission mask. A namespace is a logical partition of the cluster that serves as a collection of objects typically associated with at least one defined application. Each namespace has a private file system with respect to other namespaces. This approach enables a user to segregate cluster data into logical partitions. Using the administrative interface, a namespace associated with a given tenant is selectively configured without affecting a configuration of at least one other namespace in the set of namespaces. One configuration option is a “disposition service” that, once enabled for a namespace, automatically deletes objects that were once under retention and whose retention time has expired. Preferably, the disposition service deletes objects that do not have a “retention hold” associated therewith. The service enables the content platform to automatically reclaim cluster capacity while minimizing external involvement and archive load.

Claims

1. A method of operating a physical archive cluster instance, the cluster instance comprising a redundant array of independent nodes, wherein each node comprises a processor, a data store coupled to the processor, and a local file system, and an application instance stored in the data store and executed by the processor, the method comprising:

logically partitioning the archive cluster into a set of one or more namespaces, wherein a namespace comprises a collection of data objects;

enabling disposition with respect to a given namespace of the set of one or more namespaces;

for the given namespace, and for a data object under retention, determining whether a retention time associated with the data object has reached a predetermined time; and

if the retention time associated with the data object has reached a predetermined time, automatically deleting the data object from the namespace.

2. The method as described in claim 1 wherein the namespace is a logical partition of the physical archive cluster instance and the collection of objects is associated with a particular application.

3. The method as described in claim 1 further including overriding disposition with respect to at least one data object in the namespace that is under a retention hold.

4. The method as described in claim 1 further including overriding disposition with respect to at least one data object if a replication transaction associated with the at least one data object is pending.

5. The method as described in claim 1 wherein the data object under retention is one of multiple versions of the data object in the namespace, and wherein the data object deleted is a current version of the data object.

6. The method as described in claim 1 wherein the determining step is performed periodically.

7. A method of operating a physical archive cluster instance, the cluster instance comprising a redundant array of independent nodes, wherein each node comprises a processor, a data store coupled to the processor, and a local file system, and an application instance stored in the data store and executed by the processor, the method comprising:

logically partitioning the archive cluster into a set of namespaces, wherein each namespace of the set of namespaces comprises a set of data objects, and each namespace is managed independently with respect to any other namespace in the set of namespaces; and

configuring a disposition service to execute with respect to a given namespace, the disposition service automatically deleting data objects within the given namespace whose retention has expired and that do not have a retention hold parameter associated therewith.

8. The method as described in claim 7 wherein the namespace is a logical partition of the physical archive cluster instance and the collection of objects is associated with a particular application.

9. The method as described in claim 7 further including overriding the disposition service with respect to at least one data object in the given namespace if a replication transaction associated with the at least one data object is pending.

10. The method as described in claim 7 wherein a data object in the given namespace is one of multiple versions of the data object in the given namespace, and wherein the data object deleted is a current version of the data object.

11. The method as described in claim 7 wherein the disposition service executes periodically.

12. Apparatus for use in a redundant array of independent nodes networked together as an archive cluster, wherein each node executes an instance of an application that provides fixed content-based object storage, comprising:

a processor;

computer memory holding computer program instructions that, when executed by the processor, perform a method comprising;

logically partitioning the archive cluster into a set of one or more namespaces, wherein a namespace comprises a collection of data objects;

enabling disposition with respect to a given namespace of the set of one or more namespaces;

for the given namespace, and for a data object under retention, determining whether a retention time associated with the data object has reached a predetermined time; and

if the retention time associated with the data object has reached a predetermined time, automatically deleting the data object from the namespace.

13. The apparatus as described in claim 12 wherein the method further includes overriding disposition with respect to at least one data object in the namespace that is under a retention hold.

14. The apparatus as described in claim 13 wherein the method further includes overriding disposition with respect to at least one data object if a replication transaction associated with the at least one data object is pending.

15. The apparatus as described in claim 12 wherein the data object under retention is one of multiple versions of the data object in the namespace, and wherein the data object deleted is a current version of the data object.

16. The apparatus as described in claim 12 wherein the determining step is executed periodically.

17. The apparatus as described in claim 12 further including a Web-based interface that exports one or more display interfaces through which a disposition service is provisioned.

18. The apparatus as described in claim 17 wherein a display interface provides information about storage space reclaimed as a result of running the disposition service.