Systems and methods for comparative load analysis in storage networks

• US 9,042,263 B1
• Filed: 04/07/2008
• Issued: 05/26/2015
• Est. Priority Date: 04/06/2007
• Status: Active Grant

• Current Assignee: NetApp, Inc.
• Original Assignee: NetApp, Inc.
• Inventors: Yahalom, Raphael, Levy, Assaf
• Primary Examiner(s): Jensen, Nicholas
• Assistant Examiner(s): BELETE, BERHANU D
• Application Number:
  US12/080,946
• Time in Patent Office: 2,605 Days
• Field of Search: 370241-256
• US Class Current: 370/253
• CPC Class Codes: G06F 3/0653 Monitoring storage devices or systems
• CPC Class Codes: G06F 3/067 Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
• CPC Class Codes: H04L 41/142 using statistical or mathematical methods
• CPC Class Codes: H04L 43/0882 Utilisation of link capacity
• CPC Class Codes: H04L 47/10 Flow control; Congestion control
• CPC Class Codes: H04L 67/1097 for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]

Abstract

Methods and systems for collecting, analyzing, and presenting traffic loads in each part of a storage area network are described. These methods and systems account for various resource types, logical access paths, and relationships among different storage environment components. Data traffic flow is managed in terms of resource planning and consumption. The aggregated information is stored, and may be used to estimate future data traffic loads or determine deviations between projected and actual traffic load status from which adjustments may be made to better predict and manage future data traffic load.

Claims

1. A method for analyzing data traffic loads associated with applications in a storage network, comprising:

identifying, by a storage management computing device, a plurality of logical access paths propagating data between a first end node and a second end node in a network;

computing, by the storage management computing device, absolute data traffic load comprising total data traffic load between the first end node and the second end node and relative data traffic load comprising data traffic load between the first end node and the second end node relative to total data traffic load in the network, wherein the absolute data traffic load and the relative data traffic load are based on current state configuration information and current data traffic flow information of the identified plurality of logical access paths in the network over a pre-selected period of time;

comparing, by the storage management computing device, the computed absolute data traffic load and the computed relative data traffic load over the pre-selected period of time to an expected absolute data traffic load and an expected relative data traffic load for each of the identified plurality of logical access paths in the network;

detecting, by the storage management computing device, when at least one of the computed absolute data traffic load and the computed relative data traffic load comprising a data traffic load relative to a total data traffic load, associated with a particular logical access path deviates from the corresponding expected absolute data traffic load or the expected relative data traffic load by at least one pre-selected range, wherein the particular logical access path has no data flow during the at least one pre-selected period of time; and

providing, by the storage management computing device, a notification message when a variance of the computed absolute data traffic load and the computed relative data traffic load associated with the identified plurality of logical access paths deviates from the corresponding expected data traffic loads by the at least one pre-selected range.

2. The method of claim 1, further comprising:

standardizing, by the storage management computing device, formats of the current state configuration information, the current data traffic flow information, and reconciling conflicts.

3. The method of claim 1, further comprising:

computing, by the storage management computing device, the absolute data traffic load and the relative data traffic load through each port of a first network component over a second pre-selected period of time;

comparing, by the storage management computing device, the computed absolute data traffic load and the computed relative data traffic load over the second pre-selected period of time to an expected absolute data traffic load and an expected relative data traffic load through each port of the first network component;

detecting, by the storage management computing device, when at least one of the computed absolute data traffic load or the computed relative data traffic load over the second pre-selected period of time deviates from the corresponding expected absolute data traffic load or the expected relative data traffic load by a second pre-selected range; and

providing, by the storage management computing device, a notification message of the detected deviation by the second pre-selected range.

4. The method of claim 1, further comprising:

computing, by the storage management computing device, an absolute data traffic load and a relative data traffic load between the first network component and the second network component in the network over a third pre-selected period of time;

comparing, by the storage management computing device, the computed absolute data traffic load and the computed relative data traffic load over the third pre-selected period of time to an expected absolute data traffic load and an expected relative data traffic load between the first network component and the second network component;

detecting, by the storage management computing device, when at least one of the computed absolute data traffic load or the computed relative data traffic load over the third pre-selected period of time deviates from the corresponding expected absolute data traffic load or the expected relative data traffic load by a third pre-selected range; and

providing, by the storage management computing device, a notification message of the detected deviation by the third pre-selected range.

5. The method of claim 1, further comprising:

computing, by the storage management computing device, an absolute data traffic load and a relative data traffic load between a group of associated network components over the fourth pre-selected range; and

comparing, by the storage management computing device, the computed absolute data traffic load and the computed relative data traffic load over the fourth pre-selected period of time to an expected absolute data traffic load and an expected relative data traffic load between the group of associated network components;

detecting, by the storage management computing device, when at least one of the computed absolute data traffic load or the computed relative data traffic load over the fourth pre-selected period of time deviates from the corresponding expected absolute data traffic load or the expected relative data traffic load by a fourth pre-selected range; and

providing, by the storage management computing device, a notification message of the detected deviation by the fourth pre-selected range.

6. The method as set forth in claim 1 further comprising:

storing, by the storage management computing device, the expected absolute data traffic load and the expected relative data traffic load between the first end node and second end node on the identified plurality of logical access paths in the network over the pre-selected period of time.

7. The method as set forth in claim 1 further comprising:

collecting and storing, by the storage management computing device, the current state configuration information and the current data traffic flow information from a plurality of sources in the network; and

determining, by the storage management computing device, when the particular logical access path is configured for data flow using the current state configuration information.

8. The method of claim 7, wherein the collecting the current data traffic flow information further comprises collecting information associated with all data traffic loads for a plurality of host applications in the network.

9. A non-transitory computer readable medium having stored thereon instructions for analyzing data traffic loads associated with applications in a storage network comprising executable code which when executed by a processor, causes the processor to perform steps comprising:

identifying a plurality of logical access paths propagating data between a first end node and a second end node in a network;

computing absolute data traffic load comprising total data traffic load between the first end node and the second end node and relative data traffic load comprising data traffic between the first end node and the second end node relative to total data traffic load in the network, wherein the absolute data traffic load and the relative data traffic load are based on current state configuration information and current data traffic flow information of the identified plurality of logical access paths in the network over a pre-selected period of time;

comparing the computed absolute data traffic load and the computed relative data traffic load over the pre-selected period of time to an expected absolute data traffic load and an expected relative data traffic load comprising a data traffic load relative to a total data traffic load, for each of the identified plurality of logical access paths in the network;

detecting when at least one of the computed absolute data traffic load and the computed relative data traffic load associated with a particular logical access path deviates from the corresponding expected absolute data traffic load or the expected relative data traffic load by at least one pre-selected range, wherein the particular logical access path has no data flow during the at least one pre-selected period of time; and

providing a notification message when a variance of the computed absolute data traffic load and the computed relative data traffic load associated with the identified plurality of logical access paths deviates from the corresponding expected data traffic loads by the at least one pre-selected range.

10. The non-transitory computer readable medium as set forth in claim 9 further having stored thereon instructions that when executed by the processor cause the processor to perform steps further comprising:

standardizing formats of the current state configuration information, the current data traffic flow information and reconciling conflicts.

11. The non-transitory computer readable medium as set forth in claim 9 further having stored thereon instructions that when executed by the processor cause the processor to perform steps further comprising:

computing the absolute data traffic load and the relative data traffic load through each port of a first network component over a second pre-selected period of time;

comparing the computed absolute data traffic load and the computed relative data traffic load over the second pre-selected period of time to an expected absolute data traffic load and an expected relative data traffic load through each port of the first network component;

detecting when at least one of the computed absolute data traffic load or the computed relative data traffic load over the second pre-selected period of time deviates from the corresponding expected absolute data traffic load or the expected relative data traffic load by a second pre-selected range; and

providing a notification message of the detected deviation by the second pre-selected range.

12. The non-transitory computer readable medium as set forth in claim 9 further having stored thereon instructions that when executed by the processor cause the processor to perform steps further comprising:

computing an absolute data traffic load and a relative data traffic load between the first network component and the second network component in the network over a third pre-selected period of time;

comparing the computed absolute data traffic load and the computed relative data traffic load over the third pre-selected period of time to an expected absolute data traffic load and an expected relative data traffic load between the first network component and the second network component;

detecting when at least one of the computed absolute data traffic load or the computed relative data traffic load over the third pre-selected period of time deviates from the corresponding expected absolute data traffic load or the expected relative data traffic load by a third pre-selected range; and

providing a notification message of the detected deviation by the third pre-selected range.

13. The non-transitory computer readable medium as set forth in claim 9 further having stored thereon instructions that when executed by the processor cause the processor to perform steps further comprising:

computing an absolute data traffic load and a relative data traffic load between a group of associated network components over the fourth pre-selected range; and

comparing the computed absolute data traffic load and the computed relative data traffic load over the fourth pre-selected period of time to an expected absolute data traffic load and an expected relative data traffic load between the group of associated network components;

detecting when at least one of the computed absolute data traffic load or the computed relative data traffic load over the fourth pre-selected period of time deviates from the corresponding expected absolute data traffic load or the expected relative data traffic load by a fourth pre-selected range; and

providing a notification message of the detected deviation by the fourth pre-selected range.

14. The non-transitory computer readable medium as set forth in claim 9 further having stored thereon instructions that when executed by the processor cause the processor to perform steps further comprising:

storing the expected absolute data traffic load and the expected relative data traffic load between the first end node and second end node on the identified plurality of logical access paths in the network over the pre-selected period of time.

15. The non-transitory computer readable medium as set forth in claim 9 further having stored thereon instructions that when executed by the processor cause the processor to perform steps further comprising:

collecting and storing the current state configuration information and the current data traffic flow information from a plurality of sources in the network; and

determining when the particular logical access path is configured for data flow using the current state configuration information.

16. The non-transitory computer readable medium as set forth in claim 15 wherein the collecting the current data traffic flow information further comprises collecting information associated with all data traffic loads for a plurality of host applications in the network.

17. A storage management computing device comprising:

a processor;

a memory coupled to the processor and configured to be capable of executing programmed instructions comprising and stored in the memory to;

identify a plurality of logical access paths propagating data between a first end node and a second end node in a network;

compute absolute data traffic load comprising total data traffic load between the first end node and the second end node and relative data traffic load comprising data traffic load between the first end node and the second end node relative to total data traffic load in the network, wherein the absolute data traffic load and the relative data traffic load are based on current state configuration information and current data traffic flow information of the identified plurality of logical access paths in the network over a pre-selected period of time;

compare the computed absolute data traffic load and the computed relative data traffic load over the pre-selected period of time to an expected absolute data traffic load and an expected relative data traffic load comprising a data traffic load relative to a total data traffic load, for each of the identified plurality of logical access paths in the network;

detect when at least one of the computed absolute data traffic load and the computed relative data traffic load associated with a particular logical access path deviates from the corresponding expected absolute data traffic load or the expected relative data traffic load by at least one pre-selected range, wherein the particular logical access path has no data flow during the at least one pre-selected period of time; and

provide a notification message when a variance of the computed absolute data traffic load and the computed relative data traffic load associated with the identified plurality of logical access paths deviates from the corresponding expected data traffic loads by the at least one pre-selected range.

18. The device as set forth in claim 17 wherein the processor is further configured to be capable of executing programmed instructions comprising and stored in the memory to:

standardize formats of the current state configuration information, the current data traffic flow information and reconciling conflicts.

19. The device as set forth in claim 17 wherein the processor is further configured to be capable of executing programmed instructions comprising and stored in the memory to:

compute the absolute data traffic load and the relative data traffic load through each port of a first network component over a second pre-selected period of time;

compare the computed absolute data traffic load and the computed relative data traffic load over the second pre-selected period of time to an expected absolute data traffic load and an expected relative data traffic load through each port of the first network component;

detect when at least one of the computed absolute data traffic load or the computed relative data traffic load over the second pre-selected period of time deviates from the corresponding expected absolute data traffic load or the expected relative data traffic load by a second pre-selected range; and

provide a notification message of the detected deviation by the second pre-selected range.

20. The device as set forth in claim 17 wherein the processor is further configured to be capable of executing programmed instructions comprising and stored in the memory to:

compute an absolute data traffic load and a relative data traffic load between the first network component and the second network component in the network over a third pre-selected period of time;

compare the computed absolute data traffic load and the computed relative data traffic load over the third pre-selected period of time to an expected absolute data traffic load and an expected relative data traffic load between the first network component and the second network component;

detect when at least one of the computed absolute data traffic load or the computed relative data traffic load over the third pre-selected period of time deviates from the corresponding expected absolute data traffic load or the expected relative data traffic load by a third pre-selected range; and

provide a notification message of the detected deviation by the third pre-selected range.

21. The device as set forth in claim 17 wherein the processor is further configured to be capable of executing programmed instructions comprising and stored in the memory to:

compute an absolute data traffic load and a relative data traffic load between a group of associated network components over the fourth pre-selected range; and

compare the computed absolute data traffic load and the computed relative data traffic load over the fourth pre-selected period of time to an expected absolute data traffic load and an expected relative data traffic load between the group of associated network components;

detect when at least one of the computed absolute data traffic load or the computed relative data traffic load over the fourth pre-selected period of time deviates from the corresponding expected absolute data traffic load or the expected relative data traffic load by a fourth pre-selected range; and

provide a notification message of the detected deviation by the fourth pre-selected range.

22. The device as set forth in claim 17 wherein the processor is further configured to be capable of executing programmed instructions comprising and stored in the memory to:

store the expected absolute data traffic load and the expected relative data traffic load between the first end node and second end node on the identified plurality of logical access paths in the network over the pre-selected period of time.

23. The device as set forth in claim 17 wherein the processor is further configured to be capable of executing programmed instructions comprising and stored in the memory to:

collect and store the current state configuration information and the current data traffic flow information from a plurality of sources in the network; and

determine when the particular logical access path is configured for data flow using the current state configuration information.

24. The device as set forth in claim 23 wherein the collecting the current data traffic flow information further comprises collecting information associated with all data traffic loads for a plurality of host applications in the network.