System and method for integrating namespace management and storage management in a storage system environment

• US 9,118,697 B1
• Filed: 03/20/2006
• Issued: 08/25/2015
• Est. Priority Date: 03/20/2006
• Status: Active Grant

• Current Assignee: NetApp, Inc.
• Original Assignee: NetApp, Inc.
• Inventors: Balasubramanian, Shankar, Roussos, Konstantinos, Hackworth, Brian M., Kishore, K. Uday
• Primary Examiner(s): Mai, Kevin
• Application Number:
  US11/384,711
• Time in Patent Office: 3,445 Days
• Field of Search: 707/10, 707/100, 707200-206, 709/223, 709/229
• US Class Current: 1/1
• CPC Class Codes: G06F 16/1827 Management specifically adapted to NAS management of storage area networks [SAN] G06F3/067
• CPC Class Codes: H04L 67/1097 for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]

Abstract

A system and method integrates namespace management and storage management in a storage system environment. According to the invention, an integrated management framework provides an underlying infrastructure that supports various heterogenous storage access protocols within a single, logical namespace service. The logical namespace service is based on extensions to underlying storage management processes that cooperate to create the integrated management framework. Notably, these extensions are embodied as novel library functionality.

Claims

1. A system configured to integrate namespace management and storage management in a storage system environment, the system comprising:

a namespace and storage management (NSM) console including a user interface;

a remote agent installed on a host machine including units of storage;

a NSM server cooperating with the NSM console and remote agent to create an integrated management framework that provides an underlying infrastructure that supports various heterogeneous storage access protocols within a logical namespace service provided by the NSM server, the logical namespace service further enabling integration of the storage management with the namespace management through the NSM server to thereby improve the performance and availability of the service;

the integrated management framework configured to extract pathnames from namespaces exported by heterogeneous namespace services and to configure the extracted pathnames to be accessible in the logical namespace service via at least one of the various heterogeneous storage access protocols, the integrated management framework executing a discovery daemon configured to execute a discovery function to determine namespace and link point information associated with the units of storage discovered on the host machine, the discovery daemon further configured to populate a database of the integrated management framework with the namespace and link point information associated with the discovered units of storage;

a policy architecture configured to integrate the storage management with the namespace management utilizing a policy, a task, and a job, wherein the policy is a first static entity including rules for performing a specific action, wherein the task is a second static entity that includes parameters needed to execute the policy, wherein the job is an executable entity of the task configured to implement the rules of the policy, and the policy architecture is further configured to change a policy by only modifying the task or the job without creation of a new policy, where a plurality of management objects sharing one or more characteristics is grouped together to form a group of managed objects, and the policy architecture is further configured to apply a particular policy to the group of managed objects, wherein the policy architecture includes an offline template at the NSM console coupled to the NSM server, the offline template utilized to create and define the policy; and

an application program interface (API) server configured to cooperate with an NSM library of the integrated management framework to translate function calls received from the NSM console after creation of the particular policy into an API that stores details associated with the particular policy applied to the group of managed objects in the database of the integrated management framework.

2. The system of claim 1 wherein the storage management comprises a function of managing individual storage objects.

3. The system of claim 1 wherein the namespace management comprises a function of managing individual namespace objects.

4. The system of claim 1 wherein the integrated management framework facilitates configuration and management of pathnames in a logical namespace.

5. The system of claim 4 wherein the integrated management framework presents to a client a notion of the logical namespace that is accessible via a storage access protocol of the various heterogonous storage access protocols.

6. The system of claim 1 wherein the extracted pathnames are configured to be stored in the database, and wherein the extracted pathnames are accessible in the logical namespace via a storage access protocol of the various heterogonous storage access protocols.

7. The system of claim 1 wherein the logical namespace service is based on extensions to storage management processes embodied as library functionality directed to the namespace and remote agent management.

8. The system of claim 7 wherein the storage management processes are further extended to provide the policy architecture directed to integrating the namespace management and the storage management in the logical namespace.

9. The system of claim 8 wherein the specific action is configuration of the extracted pathnames in the logical namespace.

10. The system of claim 1 wherein each entity of the policy architecture is independent of the other, thereby allowing flexibility and efficiency among tasks and jobs.

11. The system of claim 1 further comprising a plug-in module installed in the remote agent, the plug-in module allowing remote access and management of data by the NSM server.

12. The system of claim 11 wherein the plug-in module provides an interface from an architecture of the integrated management framework to an architecture of the host machine.

13. The system of claim 12 wherein the plug-in module is a namespace plugin module.

14. A method for integrating namespace management and storage management in a storage system environment, the method comprising:

creating an integrated management framework, on a processor of a computer system, that provides an underlying infrastructure that supports various heterogeneous storage access protocols within a logical namespace;

extracting pathnames from namespaces exported by heterogeneous namespace services;

storing the pathnames on a namespace and storage management (NSM) server;

configuring the pathnames so that they are accessible in the logical namespace via a storage access protocol of the various heterogeneous storage access protocols;

extending storage management processes through the NSM server to provide a policy architecture directed to an ability to integrate namespace management and storage management in the logical namespace through the NSM server, wherein the policy architecture includes a policy, a task, and a job, wherein the policy is a first static entity including rules for performing a specific action, wherein the task is a second static entity that includes parameters and a schedule needed to execute the policy, wherein the job is an executable entity of the task configured to implement the rules of the policy according to the schedule, and the policy architecture is further configured to change a policy by only modifying the task or the job without creation of a new policy, wherein the policy architecture includes an offline template at the NSM console coupled to the NSM server, the offline template utilized to create and define the particular policy;

grouping a plurality of managed objects together to form a group of managed objects, wherein the group of managed objects share one or more characteristics;

utilizing the policy architecture to apply a particular policy to the group of managed objects;

cooperating between an application program interface (API) server and a NSM library of the integrated management framework to translate function calls received from a NSM console after creation of the particular policy into an API that stores details associated with the particular policy in a database of the integrated management framework; and

executing, by the integrated management framework, a discovery daemon that implements a discovery function to determine namespace and link point information associated with units of storage discovered on a host machine coupled to the integrated management framework, the discovery daemon populating the database with the namespace and link point information associated with the discovered units of storage.

15. The method of claim 14 wherein the extended storage management processes include library functionality directed to namespace management to thereby create the integrated management framework.

16. The method of claim 14 wherein the group of managed objects include one of remote agents, shares, namespaces and namespace servers.

21. The method of claim 14 further comprising:

in response to storing the details, generating a unique identifier associated with the particular policy;

utilizing the unique identifier to query the database to access the policy.

17. Apparatus configured to integrate namespace management and storage management in a storage system environment, the apparatus comprising:

means for creating an integrated management framework that provides an underlying infrastructure that supports various heterogeneous storage access protocols within a logical namespace;

means for extracting pathnames from namespaces exported by heterogeneous namespace services;

means for storing the pathnames on a namespace and storage management (NSM) server including one or more processors and one or more memories;

means for configuring the pathnames so that they are accessible in the logical namespace via the storage access protocol of the various heterogeneous storage access protocols;

means for extending storage management processes through the NSM server to provide a policy architecture directed to an ability to integrate the namespace management and the storage management in the logical namespace through the NSM server, wherein the policy architecture includes a policy, a task, and a job, wherein the policy is a first static entity including rules for performing a specific action, wherein the task is a second static entity that includes parameters needed to execute the policy, wherein the job is an executable entity of the task configured to implement the rules of the policy, and the policy architecture is further configured to change a policy by only modifying the task or the job without creation of a new policy, where a plurality of management objects sharing one or more characteristics are grouped together to form a group of managed objects and the policy architecture applies a particular policy to the group of managed objects, wherein the policy architecture includes an offline template at the NSM console coupled to the NSM server, the offline template utilized to create and define the particular policy;

cooperating, between an application program interface (API) server and an NSM library of the integrated management framework to translate function calls received from a NSM console after creation of the particular policy into an API that stores details associated with the particular policy applied to the group of managed objects in a database of the integrated management framework; and

means for executing a discovery daemon that implements a discovery function to determine namespace and link point information associated with units of storage discovered on a host machine coupled to the integrated management framework, the discovery daemon populating the database with the namespace and link point information associated with the discovered units of storage.

18. The apparatus of claim 17 further comprising means for extending storage management processes executing on the NSM server to include library functionality directed to namespace management to thereby create the integrated management framework.

19. A computer readable medium containing executable program instructions executed by a processor, comprising:

program instructions that create an integrated management framework that provides an underlying infrastructure that supports various heterogeneous storage access protocols within a logical namespace;

program instructions that extract pathnames from namespaces exported by heterogeneous namespace services;

program instructions that store the pathnames on a namespace and storage management (NSM) server including one or more processors and one or more memories;

program instructions that configure the pathnames so that they are accessible in the logical namespace via a storage access protocol of the various heterogeneous storage access protocols;

program instructions that extend storage management processes through the NSM is server to provide a policy architecture directed to an ability to integrate namespace management and storage management in the logical namespace through the NSM server, wherein the policy architecture includes a policy, a task, and a job, wherein the policy is first a static entity including rules for performing a specific action, wherein the task is a second static entity that includes parameters needed to execute the policy, wherein the job is an executable entity of the task configured to implement the rules of the policy, and the policy architecture is further configured to change a policy by only modifying the task or the job without creation of a new policy, where a plurality of management objects sharing one or more characteristics are grouped together to form a group of managed objects and the policy architecture is further configured to apply a particular policy to the group of managed objects, wherein the policy architecture includes an offline template at the NSM console coupled to the NSM server, the offline template utilized to create and define the particular policy;

program instructions that facilitate cooperation between an application program interface (API) server and an NSM library of the integrated management framework to translate function calls received from a NSM console after creation of the particular policy into an API that stores details associated with the particular policy applied to the group of managed objects in a database of the integrated management framework; and

program instructions that execute a discovery daemon that implements a discovery function to determine namespace and link point information associated with units of storage discovered on a host machine coupled to the integrated management framework, the discovery daemon populating the database with the namespace and link point information associated with the discovered units of storage.

20. The computer readable medium of claim 19 further comprising one or more program instructions for extending storage management processes executing on the NSM server to include library functionality directed to namespace management to thereby provide the integrated management framework.