Method and software for testing and performance monitoring

• US 6,874,099 B1
• Filed: 05/31/2001
• Issued: 03/29/2005
• Est. Priority Date: 05/31/2001
• Status: Expired due to Term

• Current Assignee: T-Mobile Innovations LLC (Deutsche Telekom AG)
• Original Assignee: Sprint Communications Company LP (Deutsche Telekom AG)
• Inventors: Jivani, Nadirshah, Balasubramanian, Balagurunathan, Ma, Lih-jong
• Primary Examiner(s): Beausoliel, Robert
• Assistant Examiner(s): PUENTE, EMERSON C
• Application Number:
  US09/871,304
• Time in Patent Office: 1,398 Days
• Field of Search: 714/4, 714/47, 709/223, 709/224
• US Class Current: 714/4.1
• CPC Class Codes: G06F 11/3419 by assessing time
• CPC Class Codes: G06F 11/3495 for systems
• CPC Class Codes: G06F 2201/86 Event-based monitoring
• CPC Class Codes: G06F 2201/87 Monitoring of transactions
• CPC Class Codes: G06F 2201/875 Monitoring of systems including the internet

Abstract

One embodiment of the present invention provides a method for testing and monitoring software applications such as naming services, messaging services, publish/subscribe services, authentication/authorization services, transaction services, and the like. The method involves testing multiple elements of the application so as to ease trouble-shooting in the event of failure of some element of the application. A preferred embodiment also gathers performance statistics which can prove useful in analyzing loads and efficiencies of various applications and processes or elements within an application.

Claims

1. A computer-implemented method for testing and monitoring applications, the method comprising:

(a) sending a first test signal to elicit a response from a first element of an authentication and authorization system;

(b) monitoring the authentication and authorization system for the response to the first test signal;

(c) checking the response to the first test signal;

(d) sending a second test signal to elicit a response from a second element of the authentication and authorization system, wherein the second element is independent and distinct from the first element;

(e) monitoring the authentication and authorization system for the response to the second test signal;

(f) checking the response to the second test signal; and

(g) reporting the results of checking the responses to the first and second test signal;

wherein one of the first and second elements is an access server and wherein the other of the first and second elements is a register server.

2. The computer implemented method of claim 1, wherein the application is monitored in b) and e) by a monitoring program;

wherein monitoring in b) and e) further comprises monitoring the time at which the test signal is sent and monitoring a response time from the sending of the test signal to the receiving of the response from that test signal;

wherein the results comprise the response time from the sending of one of the test signals to the receiving of the response to that test signal by the monitoring program and the time at which that test signal was sent.

3. The computer-implemented method of claim 1, wherein reporting the results comprises sending notification based on the presence of predefined results.

4. The computer-implemented method of claim 3, wherein sending notification comprises sending a page.

5. The computer-implemented method of claim 3, wherein sending notification comprises sending an e-mail.

6. The computer-implemented method of claim 1, wherein reporting the results comprises the results in a datastore.

7. The computer-implemented method of claim 6, wherein recording the results in a datastore comprises storing the results in a text file.

8. The computer-implemented method of claim 6, wherein recording the results in a datastore comprises storing the results in a relational database.

9. The computer implemented method of claim 1, wherein reporting the results comprises:

sending notification based on the presence of predefined results; and

recording the results in a datastore.

10. A computer-implemented method for testing and monitoring applications, the method comprising:

(a) sending a first test signal to elicit a response via a first channel of a messaging service;

(b) monitoring the messaging service for the response to the first test signal;

(c) checking the response to the first test signal;

(d) sending a second test signal to elicit a response via a second channel of the messaging service, wherein the second channel is independent and distinct from the first channel;

(e) monitoring the messaging service for the response to the second test signal;

(f) checking the response to the second test signal; and

(g) reporting the results of checking the responses to the first and second test signals;

wherein one of the first and second channels is a send channel, and wherein the other of the first and second channels is a receive channel.

11. A computer-implemented method for testing and monitoring applications, the method comprising:

(a) sending a first test signal to elicit a response via a first channel of a publish/subscribe service;

(b) monitoring the publish/subscribe service for the response to the first test signal;

(c) checking the response to the first test signal;

(d) sending a second test signal to elicit a response via a second channel of the publish/subscribe service, wherein the second channel is independent and distinct from the first channel;

(e) monitoring the publish/subscribe service for the response to the second test signal;

(f) checking the response to the second test signal; and

(g) reporting the results of checking the responses to the first and second test signals;

wherein one of the first and second channels is a publish channel, and wherein the other of the first and second channels is a subscribe channel.

12. A computer-implemented method for testing and monitoring applications, the method comprising:

(a) sending a first test signal to elicit a response from a first object of a CORBA-compliant transaction service;

(b) monitoring the CORBA-compliant transaction service for the response to the first test signal;

(c) checking the response to the first test signal;

(d) sending a second test signal to elicit a response from a second object of the COBRA-compliant transaction service, wherein the second object is independent and distinct from the first object;

(e) monitoring the COBRA-compliant transaction service for the response of the second test signal;

(f) checking the response to the second test signal; and

(g) reporting the results of checking the responses to the first and second test signal;

wherein the first object is an OTS daemon and wherein the second object is a completion daemon.

13. The computer-implemented method of claim 12, further comprising:

(a) sending a third test signal to elicit a response from a recovery daemon;

(b) monitoring the COBRA-compliant transaction service for the response to the first test signal;

(c) checking the response to the third test signal;

(d) sending a fourth test signal to elicit a response from a transaction daemon;

(e) monitoring the COBRA-compliant transaction service for the response to the fourth test signal;

(f) checking the response to the fourth test signal;

wherein reporting the results of checking the responses to the first and second test signals comprises reporting the results of checking the responses to the first, second, third, and fourth test signals; and

wherein the sending of the first through fourth test signals may occur in any order.

14. A computer-implemented method for testing and monitoring applications, the method comprising:

(a) sending a first test signal to elicit a response from a first object of a naming service;

(b) monitoring the naming service for the response to the first test signal;

(c) checking the response to the first test signal;

(d) sending a second test signal to elicit a response from a second object of the naming service, wherein the second object is independent and distinct from the first object;

(e) monitoring the naming service for the response to the second test signal;

(f) checking the response to the second test signal; and

(g) reporting the results of checking the responses to the first and second test signals;

wherein the one of the first and second objects is a register object; and

wherein the other of the first and second objects is a resolve object.

15. A computer-implemented method for testing and monitoring applications, the method comprising:

(a) sending a first test signal via a send channel of a messaging service to elicit a response;

(b) monitoring the messaging service for the response to the first test signal;

(c) checking the response to the first test signal;

(d) sending a second test signal via a receive channel of the messaging service to elicit a response;

(e) monitoring the messaging service for the response to the second test signal;

(f) checking the response to the second test signal; and

(g) reporting the results of checking the responses to the first and second test signals;

16. The computer-implemented method of claim 15, wherein the order of sending the test signals is selected from one of the group consisting of:

the first test signal is sent prior to the sending of the second test signal;

the second test signal is sent prior to the first test signal; and

the first and second test signal are sent approximately simultaneously.

17. The computer implemented method of claim 15, wherein the application is monitored in b) and e) by a monitoring program;

wherein monitoring in b) and e) further comprises monitoring the time at which the test signal is sent and monitoring a response time from the sending of the test signal to the receiving of the response from that test signal;

wherein the results comprise the response time from the sending of one of the test signals to the receiving of the response to that test signal by the monitoring program and the time at which that test signal was sent.

18. A computer-implemented method for testing and monitoring applications, the method comprising:

(a) sending a first test signal via a publish channel of a publish/subscribe service to elicit a response;

(b) monitoring the publish/subscribe service for the response to the first test signal;

(c) checking the response to the first test signal;

(d) sending a second test signal via a subscribe channel of the publish/subscribe service to elicit a response;

(e) monitoring the publish/subscribe service for the response to the second test signal;

(f) checking the response to the second test signal; and

(g) reporting the results of checking the responses to the first and second test signals.

19. The computer-implemented method of claim 18, wherein the order of sending the test signals is selected from one of the group consisting of:

the first test signal is sent prior to the sending of the second test signal;

the second test signal is sent prior to the first test signal; and

the first and second test signal are sent approximately simultaneously.

20. The computer implemented method of claim 18, wherein the application is monitored in b) and e) by a monitoring program;

wherein monitoring in b) and e) further comprises monitoring the time at which the test signal is sent and monitoring a response time from the sending of the test signal to the receiving of the response from that test signal;

wherein the results comprise the response time from the sending of one of the test signals to the receiving of the response to that test signal by the monitoring program and the time at which that test signal was sent.

21. A computer-implemented method for testing and monitoring applications, the method comprising:

(a) sending a first test signal to elicit a response from a register object of a naming service;

(b) monitoring the messaging service for the response to the first test signal;

(c) checking the response to the first test signal;

(d) sending a second test signal to elicit a response from a resolve object of the naming service;

(e) monitoring the naming service for the response to the second test signal;

(f) checking the response to the second test signal; and

(g) reporting the results of checking the responses to the first and second test signals;

22. The computer-implemented method of claim 21, wherein the order of sending the test signals is selected from one of the group consisting of:

the first test signal is sent prior to the sending of the second test signal;

the second test signal is sent prior to the first test signal; and

the first and second test signal are sent approximately simultaneously.

23. The computer-implemented method of claim 21, wherein the order of sending the test signals is selected from one of the group consisting of:

the first test signal is sent prior to the second test signal;

the second test signal is sent prior to the first test signal; and

the first and second test signal are sent approximately simultaneously.

24. The computer implemented method of claim 21, wherein the application is monitored in b) and e) by a monitoring program;

wherein monitoring in b) and e) further comprises monitoring the time at which the test signal is sent and monitoring a response time from the sending of the test signal to the receiving of the response from that test signal;

wherein the results comprise the response time from the sending of one of the test signals to the receiving of the response to that test signal by the monitoring program and the time at which that test signal was sent.

25. A computer-implemented method for testing and monitoring applications, the method comprising:

(a) sending a first test signal to elicit a response from an access server of an authentication and authorization system;

(b) monitoring the authentication and authorization system for the response to the first test signal;

(c) checking the response to the first test signal;

(d) sending a second test signal to elicit a response from a register server of the authentication and authorization system;

(e) monitoring the authentication and authorization system for the response to the second test signal;

(f) checking the response to the second test signal; and

(g) reporting the results of checking the responses to the first and second test signals;

26. The computer implemented method of claim 25, wherein the application is monitored in b) and e) by a monitoring program;

wherein monitoring in b) and e) further comprises monitoring the time at which the test signal is sent and monitoring a response time from the sending of the test signal to the receiving of the response from that test signal;

wherein the results comprise the response time from the sending of one of the test signals to the receiving of the response to that test signal by the monitoring program and the time at which that test signal was sent.

27. A computer-implemented method for testing and monitoring applications, the method comprising:

(a) sending a first test signal to elicit a response from a first object of a transaction service, wherein the first object is selected from a first member of the group consisting essentially of;

an OTS daemon, a completion daemon, a recovery daemon, and a transaction daemon;

(b) monitoring the transaction service for the response to the first test signal;

(c) checking the response to the first test signal;

(d) sending a second test signal to elicit a response from a second object of the transaction service, wherein the second object is selected from a second member of the group consisting essentially of;

an OTS daemon, a completion daemon, a recovery daemon, and a transaction daemon;

(e) monitoring the transaction service for the response to the second test signal;

(f) checking the response to the second test signal; and

(g) reporting the results of checking the responses to the first and second test signals.

28. The computer-implemented method of claim 27, further comprising:

(h) sending a third test signal to elicit a response from a third object of the transaction service, wherein the third object is selected from a third member of the group consisting essentially of;

OTS daemon, a completion daemon, a recovery daemon, and a transaction daemon;

(i) monitoring the transaction service for the response to the third test signal;

(j) checking the response to the third test signal; and

wherein reporting the results of checking the responses to the first and second test signals comprises reporting the results of checking the responses to the first, second and third test signals; and

wherein the sending of the first through third test signals may occur in any order.

29. The computer-implemented method of claim 28, further comprising:

(k) sending a fourth test signal to elicit a response from a fourth object of the transaction service, wherein the fourth object is the remaining member of the group consisting essentially of;

OTS daemon, a completion daemon, a recovery daemon, and a transaction daemon;

(l) monitoring the transaction service for the response to the fourth test signal;

(m) checking the response to the fourth test signal; and

wherein reporting the results of checking the responses to the first, second, and third test signals comprises reporting the results of checking the responses to the first, second, third, and fourth test signals; and

wherein the sending of the first through fourth test signals may occur in any order.

30. The computer-implemented method of claim 29, wherein the transaction service is a COBRA-compliant transaction service.

31. The computer implemented method of claim 27, wherein the application is monitored in b) and e) by a monitoring program;

wherein monitoring in b) and e) further comprises monitoring the time at which the test signal is sent and monitoring a response time from the sending of the test signal to the receiving of the response from that test signal;

wherein the results comprise the response time from the sending of one of the test signals to the receiving of the response to that test signal by the monitoring program and the time at which that test signal was sent.