Method, system, and program for a policy based storage manager

• US 7,269,612 B2
• Filed: 05/31/2002
• Issued: 09/11/2007
• Est. Priority Date: 05/31/2002
• Status: Expired due to Fees

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Devarakonda, Murthy V., Saha, Avijit, Strickland, Jimmy Paul, Gelb, Jack P.
• Primary Examiner(s): Rodriguez; Paul
• Assistant Examiner(s): OSBORNE, LUKE R
• Application Number:
  US10/159,494
• Publication Number:
  US 20030225801A1
• Time in Patent Office: 1,929 Days
• Field of Search: 707/205, 707/200, 707/204
• US Class Current: 707/694
• CPC Class Codes: G06F 16/221 Column-oriented storage; Management thereof
• CPC Class Codes: Y10S 707/99956 File allocation

Abstract

Provided are data structures for use in storing data. A plurality of data structures are defined in a computer readable medium, wherein each data structure indicates a plurality of attributes and at least one function of a storage resource to store data. Policies are defined in the computer readable medium that associate data characteristics to data structures based on a correspondence of data characteristics and the attributes defined in the data structures, wherein each defined data structure is adapted to provide requirements to determine a storage resource to store associated data, and wherein the defined data structure is adapted to provide the storage resource with requirements for storing the data.

Claims

1. A computer implemented method for generating containers for use in storing data, comprising:

defining a plurality of containers in a computer readable medium, wherein a first level of containers indicates first level attributes providing capabilities for a computational resource and a second level of storage containers indicates a plurality of storage attributes providing storage capabilities of a storage resource and storage management capabilities in addition to the storage capabilities of the storage resource and at least one function to manage the storage resource to store data according to the provided storage resource and storage management capabilities indicated in the storage attributes;

defining first level policies in the computer readable medium that map data attributes of the data to the first level containers;

defining storage policies in the computer readable medium that associate data attributes of data concerned with management of the data to storage containers by enabling operations to be performed, the operations comprising;

determining storage attributes corresponding to data attributes of the data;

determining one of the storage containers using information on the determined storage attributes and the first level container to which the data attributes of the data map, wherein each defined storage container is adapted to provide requirements to determine a storage resource to store the data having the data attributes, and wherein the defined storage container is adapted to provide the storage resource with at least one function for storing the data; and

using the at least one function indicated by the determined storage container to store the data in a manner that satisfies the storage attributes defined by the determined storage container.

2. The method of claim 1, wherein the first level containers comprise application containers and wherein the first level policies comprise application policies concerning application requirements with respect to data, further comprising:

defining an application policy manager in the computer readable medium that processes application containers to determine the application container having application attributes corresponding to the determined data attributes.

3. The method of claim 2, wherein the application policies further comprise enterprise specific attributes for data associated with an application level element.

4. The method of claim 1, further comprising:

data policies including criteria for management of the data life cycle, recoverability, and security; and

generating a data policy manager that processes data containers to determine the data container having data attributes corresponding to determined characteristics of the associated data.

5. The method of claim 4, wherein the data policies are adapted to operate as middleware.

6. The method of claim 1, wherein storage vendors provide storage policies, storage policy managers, and the storage containers to associate storage policies with their storage resources.

7. The method of claim 1, wherein the storage policy manager determines the storage resource associated with the determined storage container and transmits the data to the determined storage resource.

8. The method of claim 1, wherein the storage management capabilities include hierarchical data storage management capabilities and wherein the at least one function implementing the storage management capabilities comprises software.

9. A computer readable medium including:

a first level of containers indicating first level attributes providing capabilities for a computational resource;

a second level of storage containers indicating a plurality of storage attributes providing storage capabilities of a storage resource and storage management capabilities in addition to the storage capabilities of the storage resource and at least one function to manage the storage resource to store data according to the provided storage resource and storage management capabilities indicated in the storage attributes, wherein each defined storage container is adapted to provide requirements to determine a storage resource to store data having the data attributes, and herein the defined storage container is adapted to provide the storage resource with at least one function for storing the data;

first level policies that map data attributes of the data to the first level containers;

storage policies enabled to associate data attributes of the data concerned with the management of the data to storage containers by enabling operation to be performed, the operation comprising;

determining storage attributes corresponding to data attributes of the data;

determining one of the storage containers using information on the determined storage attributes and the first level container to which the data attributes of the data map; and

using the at least one function indicated by the determined storage container to store the data in a manner that satisfies the storage attributes defined by the determined storage container.

10. The computer readable medium of claim 9, wherein the first level policies comprise application policies concerning application requirements with respect to data, wherein an application policy manager processes application containers to determine the application containers having attributes corresponding to the determined data attributes.

11. The computer readable medium of claim 10, wherein different application vendors provide application policies and storage containers to associate storage policies with data generated by their applications.

12. The computer readable medium of claim 9, further comprising data policies including criteria for management of the data life cycle, recoverability, and security, and wherein a data policy manager processes the data containers to determine the data container having data attributes corresponding to determined characteristics of the data.

13. The computer readable medium of claim 12, wherein middleware vendors provide data policies, data policy managers, and storage policies to associate storage policies with data generated by their middleware.

14. The computer readable medium of claim 9, wherein storage vendors provide storage policies, storage policy managers, and the storage containers to associate storage policies with their storage resources.

15. The computer readable medium of claim 9, wherein the storage management capabilities include hierarchical data storage management capabilities and wherein the at least one function implementing the storage management capabilities comprises software.

16. A method of processing data to be stored, comprising:

associating an application attribute with data characteristics of data based on an application policy, wherein the application attribute provides application capabilities concerned with properties and characteristics related to requirements demanded by a client application for data the client application generates or uses;

determining an application attribute in a predetermined application container that corresponds to the data characteristics of the data, wherein the predetermined application container is adapted to be received by a data level policy manager and by a storage level policy manager to provide the storage resource with functions for storing the data having the data characteristics according to the provided application capabilities indicated in the application attribute; and

using the functions indicated by the predetermined application container to store the data in a manner that satisfies the application attribute defined by the predetermined application container.

17. An article of manufacture comprising at least one of logic implemented in a hardware device and code stored in a computer readable storage medium, wherein the at least one of the logic and code when executed cause article of manufacture causes operations to be performed, the operations comprising:

associating an application attribute with data characteristics of data based on an application policy, wherein the application attribute provides application capabilities concerned with properties and characteristics related to requirements demanded by a client application for data the client application generates or uses;

determining an application attribute in a predetermined application container that corresponds to the data characteristics of the data, wherein the predetermined application container is adapted to be received by a data level policy manager and by a storage level policy manager and to provide the storage resource with functions for storing the data having the data characteristics according to the provided application capabilities indicated in the application attribute; and

using the functions indicated by the predetermined application container to store the data in a manner that satisfies the application attribute defined by the predetermined application container.

18. A computer implemented method for storing data, comprising:

determining attributes corresponding to data characteristics of the data;

processing a plurality of first level containers in a computer readable medium to determine one first level container having first level attributes corresponding to the determined characteristics of the data;

processing a plurality of second level containers in the computer readable medium to determine one second level container using information on the second level attributes corresponding to the determined characteristics of the data and the determined first level container, wherein each second level container indicates a plurality of second level attributes and at least one function, wherein the second level attributes include capabilities in addition to storage capabilities of a storage resource to store the data, wherein the storage resource is associated with the determined second level container; and

using the at least one function indicated by the determined second level container to store the data in the storage resource in a manner that satisfies the attributes indicated by the determined second level container, including second level attributes providing capabilities in addition to the storage capabilities of the storage resource.

19. The method of claim 18, wherein the first level containers comprise application containers and wherein the first level attributes comprise application attributes, wherein an application policy maps the application attributes and at least one function to the application containers, wherein the application policy concerns an application requirements with respect to data, and wherein an application policy manager processes the application containers to determine the application container having application attributes corresponding to the determined characteristics of the data.

20. The method of claim 19, wherein different application vendors provide application policies and application policy managers to associate application policies with data generated by their applications.

21. The method of claim 18, wherein the first level containers comprise data containers and wherein the first level attributes comprise data attributes, wherein a data policy maps the data attributes and at least one function to the data containers, wherein the data policy concerns criteria for management of the data life cycle, recoverability, and security, and wherein a data policy manager processes the data containers to determine the data containers having data attributes corresponding to the determined characteristics of the data.

22. The method of claim 21, wherein middleware vendors provide data policies and data policy managers to associate storage policies with data generated by their middleware.

23. The method of claim 18, wherein the second level containers comprise storage containers and wherein the second level attributes comprise storage attributes, wherein a storage policy maps the storage attributes and at least one function to the storage containers, wherein the storage policy concerns management and configuration of a storage space for data, and wherein a storage policy manager processes the storage containers to determine the storage containers having storage attributes corresponding to the determined characteristics of the data.

24. The method of claim 23, wherein storage vendors provide storage policies and storage policy managers to associate storage policies with their storage resources.

25. The method of claim 23, wherein the storage policy manager determines the storage resource associated with the determined storage container and transmits the data to the determined storage resource.

26. The method of claim 18, wherein the at least one function is executed by programs in the determined storage resource.

27. The method of claim 18, wherein the determined data characteristics concern properties of a file including the data and characteristics of an application creating the data.

28. The method of claim 18, wherein the first level containers comprise data containers, wherein the first level attributes in the data containers comprise data attributes concerning properties related to data usage and retention requirements, and wherein the functions indicated in the data containers indicate data management operations to implement the data attributes indicated in the data containers.

29. The method of claim 28, wherein the data attributes include at least one member of a set of data attributes comprising:

performance and availability of the data, life cycle management and recoverability.

30. The method of claim 28, wherein the second level containers comprise storage containers and the second level attributes in the storage containers comprise storage attributes concerning properties related to storage capabilities, and wherein the functions indicated in the storage containers indicate storage management operations to implement the storage attributes indicated in the storage containers.

31. The method of claim 30, wherein the storage attributes include at least one member of a set of storage attributes comprising:

storage capacity, bandwidth, Input/Output (I/O) rates, reliability/error rates, number of paths to storage resource, physical location, and security.

32. The method of claim 18, wherein the second level containers comprise storage containers and the second level attributes in the storage containers comprise storage attributes concerning properties related to storage capabilities, and wherein the determined storage resource associated with the determined storage container satisfies the storage attributes indicated in the determined storage container.

33. The method of claim 32, wherein there are a plurality of storage resources, wherein storage vendor attributes are provided with each storage resource, and wherein determining one storage resource associated with the determined storage container further comprises:

determining the storage resource having storage vendor attributes that satisfy the storage attributes indicated in the determined storage container.

34. The method of claim 33, wherein the storage resources are provided from different storage vendors.

35. The method of claim 18, wherein processing the containers further comprises:

determining one third level container corresponding to the determined first level container, wherein the determined second level container corresponds to the determined third level container.

36. The method of claim 35, wherein the first level attributes in the first level containers comprise application attributes related to application usage of the data, wherein third level attributes in the third level containers comprise data attributes concerning properties related to data usage and retention requirements.

37. A system for storing data, comprising:

means for determining attributes corresponding to data characteristics of the data;

a computer readable medium including first level containers having first level attributes corresponding to the determined data characteristics and second level containers having second level, attributes and at least one function, wherein the second level attributes include capabilities in addition to storage capabilities of a storage resource to store the data;

means for processing a plurality of first level containers to determine one first level container having first level attributes and at least one function corresponding to the determined characteristics of the data;

means for processing the second level containers to determine one second level container using information on the second level attributes corresponding to the determined characteristics of the data and the determined first level container, wherein the storage resource is associated with the determined second level container, and wherein the storage resource associated with the determined second level container implements the second level attributes and the at least one function indicated in the second level container; and

means for using the at least one function indicated by the determined second level container to store the data in the storage resource in a manner that satisfies the second level attributes indicated by the determined second level container, including attributes providing capabilities in addition to the storage capabilities of the storage resource.

38. The system of claim 37, wherein the first level containers comprise application containers and wherein the first level attributes comprise application attributes, further comprising an application policy that maps the application attributes and at least one function to the application containers, wherein the application policy concerns application requirements with respect to data, and wherein an application policy manager processes the application containers to determine the application container having attributes corresponding to the determined characteristics of the data.

39. The system of claim 37, wherein the first level containers comprise data containers and wherein the first level attributes comprise data attributes, further comprising a data policy that maps the data attributes and at least one function to the data containers, wherein the data policy concerns criteria for management of the data life cycle, recoverability, and security, and wherein a data policy manager processes the data containers to determine the data container having attributes corresponding to the determined characteristics of the data.

40. The system of claim 37, wherein the second level containers comprise storage containers and wherein the second level attributes comprise storage attributes, further comprising a storage policy that maps the storage attributes and at least one function to the storage containers, wherein the storage policy concerns management and configuration of a storage space for data, and wherein a storage policy manager processes the storage containers to determine the storage container having attributes corresponding to the determined characteristics of the data.

41. The system of claim 39, wherein the means for processing the containers further performs:

determining one of a plurality of third level containers corresponding to the determined first level container, wherein the determined second level container corresponds to the determined third level container.

42. An article of manufacture comprising at least one of logic implemented in a hardware device and code stored in a computer readable storage medium, wherein the at least one of the logic and code when executed communicate with a computer readable medium and cause operations, the operations comprising:

determining attributes corresponding to data characteristics of the data;

processing a plurality of first level containers in the computer readable medium to determine one first level container having first level attributes corresponding to the determined characteristics of the data;

processing a plurality of second level containers to determine one second level container using information on the second level attributes corresponding to the determined characteristics of the data and the determined first level container, wherein each second level container indicates a plurality of second level attributes and at least one function, wherein the second level attributes include capabilities in addition to storage capabilities of a storage resource to store the data, wherein the storage resource is associated with the determined second level container; and

using the at least one function indicated by the determined second level container to store the data in the storage resource in a manner that satisfies the second level attributes indicated by the determined second level container, including second level attributes providing capabilities in addition to the storage capabilities of the storage resource.

43. The article of manufacture of claim 42, wherein the first level containers comprise application containers and wherein the first level attributes comprise application attributes, wherein an application policy maps the application attributes and at least one function data to the application containers, wherein the application policy concerns application requirements with respect to data, and wherein an application policy manager processes the application containers to determine the application container having application attributes corresponding to the determined characteristics of the data.

44. The article of manufacture of claim 42, wherein the first level containers comprise data containers and wherein the first level attributes comprise data attributes, wherein a data policy maps the data attributes and at least one function to the data containers, wherein the data policy concerns criteria for management of the data life cycle, recoverability, and security, and wherein a data policy manager processes the data containers to determine the data container having data attributes corresponding to the determined characteristics of the data.

45. The article of manufacture of claim 42, wherein the second level containers comprise storage containers and wherein the first level attributes comprise storage attributes, wherein a storage policy maps the storage attributes and at least one function to the storage containers, wherein the storage policy concerns management and configuration of a storage space for data, and wherein a storage policy manager processes the storage containers to determine the storage container having storage attributes corresponding to the determine characteristics of the data.

46. The article of manufacture of claim 45, wherein the first level containers comprise data containers and the first level attributes comprise data attributes concerning properties related to data usage and retention requirements, and wherein the functions indicated in the data containers indicate data management operations to implement the data attributes indicated in the data containers.

47. The article of manufacture of claim 42, wherein processing the containers further comprises:

determining one third level container corresponding to the determined first level container.