Time-based monitoring of service level agreements

• US 7,082,463 B1
• Filed: 11/30/2000
• Issued: 07/25/2006
• Est. Priority Date: 06/07/2000
• Status: Active Grant

• Current Assignee: Cisco Technology, Inc. (Cisco Systems, Inc.)
• Original Assignee: Cisco Technology, Inc. (Cisco Systems, Inc.)
• Inventors: Lemler, Christian, Patel, Amrit C., Bradley, Karen Ann, Lau, Ray Mein
• Primary Examiner(s): Follansbee, John
• Assistant Examiner(s): LIN, KENNY S
• Application Number:
  US09/727,567
• Time in Patent Office: 2,063 Days
• Field of Search: 709/224, 709/200, 709/223, 370/230, 715/500, 715/513, 714/4, 707/104.1
• US Class Current: 709/223
• CPC Class Codes: H04L 41/046 comprising network management agents or mobile agents therefor
• CPC Class Codes: H04L 41/5003 Managing SLA; Interaction between SLA and QoS
• CPC Class Codes: H04L 41/5009 Determining service level performance parameters or violations of service level contracts, e.g. violations of agreed response time or mean time between failures [MTBF]
• CPC Class Codes: H04L 41/5067 Customer-centric QoS measurements
• CPC Class Codes: H04L 41/5087 wherein the managed service relates to voice services management of VoIP services H04M7/0081
• CPC Class Codes: H04L 43/067 using time frame reporting
• CPC Class Codes: H04L 43/0829 Packet loss
• CPC Class Codes: H04L 43/0852 Delays
• CPC Class Codes: H04L 43/0864 Round trip delays
• CPC Class Codes: H04L 43/087 Jitter
• CPC Class Codes: H04L 43/10 Active monitoring, e.g. heartbeat, ping or trace-route
• CPC Class Codes: H04L 43/16 Threshold monitoring
• CPC Class Codes: H04L 43/55 Testing of service level quality, e.g. simulating service usage

Abstract

A Time-Based Service Monitoring mechanism for monitoring Service Level Agreements (SLAs) over specific time intervals is described. To provide for the time-based monitoring of service, data is received for defining one or more tests for monitoring the level of network service that is being provided to a particular customer. Based on the received data, information is created and stored that defines a specific time range for when the one or more tests are to be enforced. The one or more tests are distributed to one or more agents that are configured to communicate with devices that are associated with the network. The devices are then configured to perform the one or more tests within the specific time range. Based on the results, the customer is provided information indicating whether they are receiving the level of service that has been guaranteed by the service provider over the specific time intervals.

Claims

1. A network device configured for monitoring a level of network service provided by a service provider, comprising:

a network interface;

a processor coupled to the network interface and receiving information from the network interface;

a computer-readable medium accessible by the processor and comprising one or more sequences of instructions which, when executed by the processor, cause the processor to carry out the steps of;

receiving a schema that provides a configuration for monitoring a service level contract between the service provider and a particular customer, wherein the schema comprises;

data defining one or more metric tests for monitoring the level of network service being provided to the particular customer by the service provider, each said metric test measuring a level of service of a particular type of network operation, and including a set of one or more threshold values that define one or more particular performance metrics for the particular type of network operation, and

information defining a specific time range for when the one or more metric tests are to be performed; and

distributing the one or more metric tests to one or more agents, wherein the one or more agents configure devices associated with the network to perform the one or more metric tests during the specific time range and receive result information from the devices performing the one or more metric tests, wherein each of the one or more metric tests is selected from the group consisting of ICMP metric test, UDP metric test, DNS metric test, HTTP metric test and VoIP metric test.

2. The network device recited in claim 1, wherein the sequence of instructions further comprises instructions that cause the one or more processors to:

for each metric test defined in the schema, determine whether result information for that metric test is within the range of acceptable values defined by the set of one or more threshold values included with that metric test; and

create and store reporting information that indicates whether the customer is actually receiving, during the specific time range, the level of network service offered by the service provider in the service level contract, said reporting information based on said determinations.

3. The network device recited in claim 1,

said schema being based on Extensible Markup Language (XML), and wherein the schema models the service level contract.

4. The network device recited in claim 1, wherein the sequence of instructions further comprises the steps of:

generating, at a server, interface data for defining the schema for monitoring the service level contract; and

communicating the interface data to a client that is remote from said server, wherein the interface data allows users to configure specific times for monitoring the level of service that is being provided by the service provider, and to configure the set of one or more threshold values associated with each metric test.

5. The network device recited in claim 1, wherein:

the one or more agents configure the devices to perform the one or more metric tests only within the specific time range.

6. A method for monitoring a level of network service provided by a service provider, the method comprising the computer-implemented steps of:

receiving a schema that provides a configuration for monitoring a service level contract between the service provider and a particular customer, wherein the schema comprises;

data defining one or more metric tests for monitoring the level of network service being provided to the particular customer by the service provider, each said metric test measuring a level of service of a particular type of network operation, and including a set of one or more threshold values that correspond to one or more particular performance metrics for the particular type of network operation, and

information defining a specific time range for when the one or more metric tests are to be performed; and

distributing the one or more metric tests to one or more agents, wherein the one or more agents configure devices associated with the network to automatically perform the one or more metric tests during the specific time range, and receive result information from the devices performing the one or more metric tests, wherein each of the one or more metric tests is selected from the group consisting of ICMP metric test, UDP metric test, DNS metric test, HTTP metric test and VoIP metric test.

7. The method recited in claim 6, further including the steps of:

for each metric test defined in the schema, determining whether result information for that metric test is within the set of one or more threshold values included in that metric test; and

creating and storing reporting information that indicates whether the customer is actually receiving, during the specific time range, the level of network service offered by the service provider in the service level contract, said reporting information based on said determinations.

8. The method recited in claim 6,

said schema being based on Extensible Markup Language (XML), and wherein the schema models the service level contract.

9. The method recited in claim 6, further comprising the steps of:

generating, at a server, interface data for defining the schema for monitoring the service level contract; and

communicating the interface data to a client that is remote from said server, wherein the interface data allows users to configure specific times for monitoring the level of service that is being provided by the service provider, and to configure the set of one or more threshold values included with each metric test.

10. The method recited in claim 6, wherein:

the one or more agents configure the devices to perform the one or more metric tests only within the specific time range.

18. The method recited in claim 6, wherein the range of threshold values included with a particular metric test is configured according to a level of performance specified in a service level agreement for the type of network operation measured by the particular metric test.

11. A computer readable storage medium carrying sequences of instructions for monitoring a level of network service provided by a service provider, the sequences of instructions including instructions for performing the steps of:

receiving a schema that provides a configuration for monitoring a service level contract between the service provider and a particular customer, wherein the schema comprises;

data defining one or more metric tests for monitoring the level of network service being provided to the particular customer by the service provider, each said metric test measuring a level of service of a particular type of network operation, and including a set of one or more threshold values that define one or more particular performance metrics for the particular type of network operation, and

information defining a specific time range for when the one or more metric tests are to be performed; and

distributing the one or more metric tests to one or more agents, wherein the one or more agents configure devices associated with the network to perform the one or more metric tests during the specific time range and receive result information from the devices performing the one or more metric tests, wherein each of the one or more metric tests is selected from the group consisting of ICMP metric test, UDP metric test, DNS metric test, HTTP metric test and VoIP metric test.

12. The computer readable storage medium recited in claim 11, further comprising instructions for performing the steps of:

for each metric test defined in the schema, determining whether result information for that metric test is within the range of acceptable values defined by the set of one or more threshold values included with that metric test; and

creating and storing reporting information that indicates whether the customer is actually receiving, during the specific time range, the level of network service offered by the service provider in the service level contract, said reporting information based on said determinations.

13. The computer readable storage medium recited in claim 11, said schema being based on Extensible Markup Language (XML), and wherein the schema models the service level contract.

14. The computer readable storage medium recited in claim 11, further comprising instructions for performing the steps of:

generating, at a server, interface data for defining the schema for monitoring the service level contract; and

communicating the interface data to a client that is remote from said server, wherein the interface data allows users to configure specific times for monitoring the level of service that is being provided by the service provider, and to configure the set of one or more threshold values associated with each metric test.

15. The computer readable storage medium recited in claim 11, wherein:

the one or more agents configure the devices to perform the one or more metric tests only within the specific time range.

16. A network device configured for monitoring a level of network service provided by a service provider, comprising:

means for receiving a schema that provides a configuration for monitoring a service level contract between the service provider and a particular customer, wherein the schema comprises;

data defining one or more metric tests for monitoring the level of network service being provided to the particular customer by the service provider, each said metric test measuring a level of service of a particular type of network operations, and including a set of one or more threshold values that define one or more particular performance metrics for the particular type of network operation, and

information defining a specific time range for when the one or more metric tests are to be performed; and

means for distributing the one or more metric tests to one or more agents, wherein the one or more agents configure devices associated with the network to perform the one or more metric tests during the specific time range and receive result information from the devices performing the one or more metric tests, wherein each of the one or more metric tests is selected from the group consisting of ICMP metric test, UDP metric test, DNS metric test, HTTP metric test and VoIP metric test.

17. The network device recited in claim 16, further including:

for each metric test defined in the schema, means for determining whether result information for that metric test is within the range of acceptable values defined by the set of one or more threshold values included with that metric test; and

means for creating and storing reporting information that indicates whether the customer is actually receiving, during the specific time range, the level of network service offered by the service provider in the service level contract, said reporting information based on said determinations.