Systems and methods for monitoring and evaluating a connectivity device

• US 20060034185A1
• Filed: 07/07/2005
• Published: 02/16/2006
• Est. Priority Date: 07/08/2004
• Status: Abandoned Application

• Current Assignee: Internetwork, Inc.
• Original Assignee: Internetwork, Inc.
• Inventors: Wesemann, Darren Leroy, Patzschke, Till Immanuel
• Application Number:
  US11/176,838
• Publication Number:
  US 20060034185A1
• Time in Patent Office: Days
• US Class Current: 370/252
• CPC Class Codes: H04L 41/046 comprising network management agents or mobile agents therefor
• CPC Class Codes: H04L 43/0811 by checking connectivity
• CPC Class Codes: H04L 43/50 Testing arrangements
• CPC Class Codes: H04L 51/00 User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail

Abstract

The end-to-end services provided to an end-user by a service provider in a communications network can be tested by a system including a testing agent embedded within a connectivity device and a receiving server for receiving and analyzing test data from the connectivity device. The testing agent performs one or more tests to simulate a user'"'"'s activities and obtain data regarding the simulated activities, for example simulating a user'"'"'s activities by proactively consuming and measuring the end-to-end performance of services provided by the service provider. The receiving server may include a data storage device configured for receiving and storing test data from the testing agent and an expert engine configured for analyzing the test data and providing a predictive analysis.

Claims

1. In a communications network in which a service is provided to a plurality of users, a method for testing the quality of service provided to a user, the method comprising:

providing an agent on a connectivity device of a user;

causing the agent to perform one or more tests involving the connectivity between a network device and the connectivity device;

collecting data from the one or more tests, wherein the data is indicative of an aspect of a user experience; and

transmitting the collected data to a receiving server using at least one scalable protocol.

2. A method as define in claim 1, further comprising the act of transmitting to the connectivity device a profile for use by the agent, wherein the profile comprises one or more tests to be performed by the agent.

3. A method as define in claim 1, further comprising the act of causing the agent to generate from the test data a high level metric indicative of a predicted user quality of experience.

4. A method as define in claim 1, wherein the one or more tests are performed when the connectivity device is not being used by a user.

5. A method as define in claim 1, wherein the one or more tests involve establishing a communications link between the connectivity device and the network device and simulating a user action on the communication link.

6. A method as define in claim 1, wherein the connectivity device comprises a cellular telephone, a set-top box, a modem, a VoIP phone, a wirelessly connected computer, or a computer.

7. A method as define in claim 1, further comprising, at the receiving server, an act of processing a plurality of collected data with an expert engine to determine a high level metric indicative of a predicted user quality of experience.

8. A method as define in claim 1, wherein the scalable protocol comprises SMTP.

9. A system for testing the services provided to an end-user by a service provider in a communications network, comprising:

a testing agent embedded within a connectivity device associated with a user, wherein the connectivity device is in communication with a network and the testing agent performs one or more tests in order to simulate a user'"'"'s activities and obtain data regarding the simulated activities; and

a receiving server in communication with the network, the receiving server comprising a data storage device configured for receiving and storing test data from the testing agent.

10. A method as define in claim 9, wherein the test data is sent from the testing agent to the receiving server as an SMTP packet.

11. A system as defined in claim 9, wherein the network is administered by a service provider that provides communication services to the connectivity device.

12. A system as defined in claim 9, wherein the receiving server further comprises an expert engine configured for analyzing the test data and providing a predictive analysis.

13. A method as define in claim 9, wherein the test data comprise low level metrics representing specific test results and the testing agent further comprises an expert module that generates, using a plurality of low level metrics, a high level metric indicative of a predicted user quality of experience.

14. A system as defined in claim 9, wherein the receiving server further comprises a user interface for receiving user input to provide analysis controls to the expert engine.

15. A system as defined in claim 9, wherein the testing agent can receive, via the network, profiles having one or more tests to be performed by the testing agent.

16. A system as defined in claim 9, wherein the testing agent performs one or more tests in order to simulate a user'"'"'s activities by proactively consuming and measuring the end-to-end performance of services provided by the service provider.

17. A system as defined in claim 9, wherein the connectivity device comprises a cellular telephone and the network is administered by a cellular telephone service provider.

18. A system as defined in claim 9, wherein the connectivity device comprises at least one of a set-top box, a modem, a VoIP phone, a wirelessly connected computer, or a computer.

19. A system as defined in claim 9, wherein the one or more tests are performed when the connectivity device is not being used by a user.

20. A method as define in claim 9, wherein the simulated activities comprise the operation of an application on the connectivity device.

21. A system for testing the services provided to an end-user by a service provider in a communications network, comprising:

a testing agent embedded within a connectivity device associated with a user, wherein the connectivity device is in communication with a network and the testing agent performs one or more tests in order to simulate a user'"'"'s activities by proactively consuming and measuring the end-to-end performance of services provided by a service provider; and

a receiving server in communication with the network, the receiving server comprising;

a data storage device configured for receiving and storing test data from the testing agent; and

an expert engine configured for analyzing the test data and providing a predictive analysis.

22. A method as define in claim 21, wherein the test data comprise low level metrics representing specific test results and high level metrics indicative of a predicted user quality of experience, wherein the testing agent further comprises an expert module that generates, using a plurality of low level metrics determined from at least one of the one or more tests, a high level metric.

23. A system as defined in claim 21, wherein the receiving server further comprises a user interface for receiving user input to provide analysis controls to the expert engine.

24. A system as defined in claim 21, wherein the testing agent can receive, via the network, profiles having one or more tests to be performed by the testing agent.

25. A system as defined in claim 21, wherein the connectivity device comprises a cellular telephone and the network is administered by a cellular telephone service provider.

26. A system as defined in claim 21, wherein the connectivity device comprises at least one of a set-top box, a modem, a VoIP phone, a wirelessly connected computer, or a computer.

27. A method as define in claim 21, wherein the test data is sent from the testing agent to the receiving server as an SMTP packet.

28. A system as defined in claim 21, wherein the network is administered by the service provider.