Methods and apparatus for structured partitioning of management information

• US 7,899,780 B1
• Filed: 03/30/2006
• Issued: 03/01/2011
• Est. Priority Date: 03/30/2006
• Status: Active Grant

• Current Assignee: Emc IP Holding Company LLC (Dell Technologies Inc.)
• Original Assignee: EMC Corporation (Dell Technologies Inc.)
• Inventors: Shmuylovich, Samuil, Ninan, Anoop George, Farizon, Boris
• Primary Examiner(s): Abel-Jalil; Neveen
• Assistant Examiner(s): Hoffler; Raheem
• Application Number:
  US11/393,111
• Time in Patent Office: 1,797 Days
• Field of Search: None
• US Class Current: 707/610
• CPC Class Codes: G06F 16/217 Database tuning G06F16/2282 takes precedence; database performance monitoring G06F11/3409

Abstract

A SAN management agent performs hierarchical based partitioning. Partitions expressed as a hierarchy of related manageable entities allow partitioning based on the relations in the hierarchy. Related manageable entities often trigger updates to database elements common to both of the related manageable entities. The related manageable entities often take the form of a hierarchy (tree) indicative of these relations. Grouping the updates affecting related manageable entities together in the same partition allows the database elements affected by the related updates to occur from a single retrieval of the common database element. By partitioning updates of related manageable entities together, the common database elements are more likely to be paged or cached in memory at the time the update processing updates the common database element. Accordingly, tree-based partitioning identifies relations between manageable entities, and designates related manageable entities by traversing the relations.

Claims

1. A computer implemented method of organizing updates to management information in a storage area network comprising:

identifying update information including a set of updates to management information, the update information pertaining to manageable entities in a storage area network (SAN), each update in the set of updates corresponding to at least one manageable entity from a plurality of independent top level managed objects;

identifying groups of manageable entities corresponding to the set of updates;

grouping the set of updates, to storage objects from the plurality of independent top level managed objects, into partitions corresponding to the identified groups of manageable entities, each partition including updates affecting database elements corresponding to the manageable entities in a respective identified group, grouping including grouping updates in the set of updates into a partition of related updates, the related updates having changes in common with other updates in the partition such that the related updates result in writes to common database elements, wherein the partition includes entries of SAN manageable entities in the same hierarchy according to tree based partitioning and wherein grouping identifies relations between manageable entities and wherein updates resulting in a database modification corresponding to a particular manageable entity result in an update to a related manageable entity, as defined by the relations, the update affecting a common database element, the updates to the related manageable entity operable to be affected in the same database update;

transmitting each of the partitions independently of the other partitions according to a hierarchy of relations between the manageable entities; and

updating a SAN managed object database (MODB) using at least one group of partitioned updates.

2. The method of claim 1 wherein the relations corresponding to a likelihood of corresponding updates between the manageable entities included in the relations.

3. The method of claim 2 wherein identifying the groups of manageable entities further comprises determining relations between manageable entities, related manageable entities having a common database element.

4. The method of claim 3 wherein updating related manageable entities includes:

performing updates corresponding to a first manageable entity, the update affecting a database element, the first manageable entity having relations to a second manageable entity and a third manageable entity;

performing updates corresponding to the second manageable entity; and

performing updates to the third manageable entity without refetching the database element corresponding to the first manageable entity; and

minimizing fetches of common database elements by updating common database elements in the same fetch.

5. The method of claim 3 wherein the relations define a hierarchy of related manageable entities, the hierarchy defining relations in a parent/child format, grouping into partitions further comprising:

identifying child manageable entities of a particular parent manageable entity for inclusion in a particular partition; and

including each of the child manageable entities with the parent manageable entity in the particular partition.

6. The method of claim 5 wherein identifying groups of manageable entities further comprises:

identifying a top level manageable entity, the top level manageable entity operable to include other manageable entities and independent of others of top level manageable entities; and

traversing relations between the identified top level manageable entity and included manageable entities, relations indicative of managed objects likely to incur updates from updates to the top level manageable entity.

7. The method of claim 6 wherein the plurality of top level managed objects define a set of storage devices in a storage array.

8. The method of claim 5 wherein identifying the partitions further comprises a depth-first traversal of the hierarchy defined by the relations.

18. The method of claim 1 wherein the grouping is performed at a level of the hierarchy as defined by relations such that the same fetch retrieves entries corresponding to both manageable entities of a relation.

9. A computer program product having a computer readable storage medium operable to store computer program logic embodied in computer program code encoded thereon for an agent for organizing updates to management information in a storage area network comprising:

computer program code for an interface to a manageable entity operable to identify update information including a set of updates to management information, the update information pertaining to manageable entities in a storage area network, each update in the set of updates corresponding to at least one manageable entity;

computer program code for a hierarchical set of relations operable to identifying groups of manageable entities corresponding to the set of updates;

computer program code for a partitioner operable to group the set of updates into partitions corresponding to the identified groups of manageable entities, each partition including updates affecting database elements, grouping including grouping updates in the set of updates into a partition of related updates, the related updates having changes in common with other updates in the partition such that the related updates result in writes to common database elements;

corresponding to the manageable entities in a respective identified group wherein the partition includes entries of SAN manageable entities in the same hierarchy according to tree based partitioning and wherein grouping identifies relations between manageable entities and wherein updates resulting in a database modification corresponding to a particular manageable entity result in an update to a related manageable entity, as defined by the relations, the update affecting a common database element, the updates to the related manageable entity operable to be affected in the same database update;

computer program code for transmitting each of the partitions independently of the other partitions according to a hierarchy of relations between the manageable entities; and

computer program code for updating a SAN managed object database (MODB) using at least one group of partitioned updates.

10. The product of claim 9 wherein the partitioner is further operable to group updates in the set of updates into a partition of related updates, related updates having modifications in common with other updates in the partition such that the related updates result in writes to common database elements.

11. The product of claim 10 wherein the partitioner is operable to identify the relations between manageable entities, the relations corresponding to a likelihood of corresponding updates between the manageable entities included in the relations, wherein related manageable entities have a common database element.

12. The product of claim 11 further comprising an interface to a management application, the management application operable to update database elements pertaining to related manageable entities by:

performing updates corresponding to a first manageable entity, the update affecting a database element, the first manageable entity having relations to a second manageable entity and a third manageable entity;

performing updates corresponding to the second manageable entity; and

performing updates to the third manageable entity without refetching the database element corresponding to the first manageable entity.

13. The product of claim 9 wherein the relations define a hierarchy of related manageable entities, the hierarchy defining relations in a parent/child format, the partitioner further operable to group into partitions further comprising:

identifying child manageable entities of a particular parent manageable entity for inclusion in a particular partition; and

including each of the child manageable entities with the parent manageable entity in the particular partition.

17. The product of claim 9 wherein the agent examines the management information to determine whether the management information is to be grouped into partitions by the partitioner.

14. A method of processing updates to management information in a SAN comprising:

identifying a set of updates indicative of update information in a storage array, the storage array including a plurality of storage objects;

identifying a set of at least one storage object to which at least one of the updates pertain;

determining updates in the set of updates which pertain to storage objects in the identified set;

grouping the determined updates as a partition of updates operable for transmission and update, grouping including grouping updates in the set of updates into a partition of related updates, the related updates having changes in common with other updates in the partition such that the related updates result in writes to common database elements wherein the partition includes entries of SAN manageable entities in the same hierarchy according to tree based partitioning and wherein grouping identifies relations between manageable entities and wherein updates resulting in a database modification corresponding to a particular manageable entity result in an update to a related manageable entity, as defined by the relations, the update affecting a common database element, the updates to the related manageable entity operable to be affected in the same database update;

transmitting each of the partitions independently of the other partitions according to a hierarchy of relations between the manageable entities; and

updating a SAN managed object database (MODB) using at least one group of partitioned updates.

15. The method of claim 14 further comprising:

determining if the updates are within a set of storage objects defined by one of the identified groups; and

grouping updates together according to the relations, related manageable entities causing updates to common database elements, the related updates determined according to a san hierarchy of manageable entities, such that the SAN hierarchy includes mappings of FE adaptors to storage devices, the number of storage devices substantially larger than the number of FE adaptors and common database elements records pertaining to a particular manageable entity.

16. A computer program product having a computer readable storage medium operable to store computer program logic embodied in computer program code encoded thereon that, when executed cause the computer to perform a method for partitioning data in a storage area network (SAN) comprising:

computer program code for identifying update information including a set of updates to management information, the update information pertaining to manageable entities in a storage area network, each update in the set of updates corresponding to at least one manageable entity;

computer program code for identifying groups of manageable entities corresponding to the set of updates;

computer program code for grouping the set of updates into partitions corresponding to the identified groups of manageable entities, each partition including updates affecting database elements corresponding to the manageable entities in a respective identified group, including grouping updates in the set of updates into a partition of related updates, the related updates having changes in common with other updates in the partition such that the related updates result in writes to common database elements wherein the partition includes entries of SAN manageable entities in the same hierarchy according to tree based partitioning and wherein grouping identifies relations between manageable entities and wherein updates resulting in a database modification corresponding to a particular manageable entity result in an update to a related manageable entity, as defined by the relations, the update affecting a common database element, the updates to the related manageable entity operable to be affected in the same database update;

computer program code for transmitting each of the partitions independently of the other partitions according to a hierarchy of relations between the manageable entities; and

computer program code for updating related manageable entities in a SAN managed object database (MODB) using at least one group of partitioned updates, further including;

computer program code for performing updates corresponding to a first manageable entity, the update affecting a database element, the first manageable entity having relations to a second manageable entity and a third manageable entity;

computer program code for performing updates corresponding to the second manageable entity; and

computer program code for performing updates to the third manageable entity without refetching the database element corresponding to the first manageable entity.