Method and system for evaluating quality of service for transactions over a network

• US 7,392,321 B1
• Filed: 04/02/2002
• Issued: 06/24/2008
• Est. Priority Date: 05/30/2001
• Status: Active Grant

• Current Assignee: Dynatrace LLC (Dynatrace, Inc.)
• Original Assignee: Keynote Systems (Dynatrace, Inc.)
• Inventors: Asar, Adnan, Rozen, Maria, Divnich, Anastasia, Oron, Menachem Ahikam, Wolf, Ronald E.
• Primary Examiner(s): Dalencourt; Yves
• Application Number:
  US10/114,921
• Time in Patent Office: 2,275 Days
• Field of Search: 709200-204, 709217-219, 709223-225, 707/1, 707/10
• US Class Current: 709/232
• CPC Class Codes: H04L 41/5009 Determining service level performance parameters or violations of service level contracts, e.g. violations of agreed response time or mean time between failures [MTBF]

Abstract

A method of recording a transaction over a network generally includes staring a recorder, sending a request for information from a computer to an information source over the network to begin the transaction, interacting with the information source over the network to complete the transaction, and stopping the recorder. The recorded transaction is played back and feedback is provided on the recorded transaction. The recorded transaction is configured for use by a data acquisition agent operable to execute the recorded transaction with the information source and collect performance measurements for the transaction.

Claims

1. A method of recording at a computer a transaction over a network between the computer and an information source, the method comprising:

starting a recorder at the computer;

sending a request for information from the computer to the information source over the network to begin the transaction;

recording the transaction including browser operations;

stopping the recorder;

playing back the recorded transaction for review and validation of the recorded transaction by a user at the computer;

inserting comments into the recorded transaction during playback of the recorded transaction in a step mode; and

sending the recorded transaction to a collection system for distribution to a data acquisition agent;

wherein the recorded transaction is configured for use by the data acquisition agent remote from the computer and operable to execute the recorded transaction with the information source and collect performance measurements for the transaction, performance measurements comprising download time of data during execution of said recorded transaction and including browser execution time.

2. The method of claim 1 wherein playing back the recorded transaction comprises generating a summary of the transaction for the user.

3. The method of claim 1 further comprising generating an error notification if the recorded transaction is not completed during playback and identifying that the error is due to missing data within the recording.

4. The method of claim 3 wherein the error notification contains one or more keywords or timeouts.

5. The method of claim 3 wherein receiving feedback further comprises receiving notification that the playback was unsuccessful.

6. The method of claim 5 further comprising repeating the steps of:

starting the recorder;

sending a request for information from the computer to the information source over the network to begin the transaction;

interacting with the information source over the network to complete the transaction; and

stopping the recorder.

7. The method of claim 1 further comprising playing back the recorded transaction in a continuous mode.

8. The method of claim 1 wherein the information source is one or more web servers and sending a request for information comprises requesting a web page.

9. The method of claim 8 further comprising sending the recorded transaction to the agent and the agent executing the recorded transaction.

10. The method of claim 9 wherein collecting performance measurements comprises collecting download time for each web page downloaded during the transaction.

11. The method of claim 10 wherein collecting performance measurements comprises collecting download time for individual components within each of the web pages.

12. The method of claim 9 wherein executing the transaction comprises sending a query from the data acquisition agent to the information source after data is loaded on the agent.

13. The method of claim 9 wherein executing the transaction comprises submitting an order from the data acquisition agent to the information source after data is loaded on the agent.

14. The method of claim 9 wherein sending the recording comprises sending the recording to a plurality of data acquisition agents at different geographic locations within the network.

15. The method of claim 1 further comprising creating a script file and sending the script file to an operations center for test.

16. The method of claim 15 further comprising receiving the script file at the operations center and storing the script file in a database comprising a plurality of script files.

17. The method of claim 16 further comprising sending said database to an agent and executing the script files by the agent.

18. The method of claim 17 wherein executing the script files comprises passing one of said plurality of script files to a browser installed on the agent.

19. The method of claim 17 further comprising collecting measurement data during execution of the script and sending the measurement data to a measurement database located at a database server.

20. The method of claim 1 wherein said performance measurements comprises overall time to complete a transaction including time to download one or more web pages on the computer by the browser.

21. The method of claim 1 wherein playing back the recording comprises passing the recorded transaction to the browser.

22. The method of claim 1 further comprising sending the recorded transaction to a remote network element and playing back the recorded transaction a plurality of times to test the recorded transaction under different operating conditions.

23. The method of claim 1 wherein web pages are not cached for use in playing back the recorded transaction.

24. The method of claim 1 wherein the browser is modified to allow access to information within web pages during collection of performance measurements.

25. The method of claim 1 wherein said starting, stopping, playing back, and sending comprises utilizing a tool bar of a user interface.

26. The method of claim 1 wherein playing back the recorded transaction comprises interacting with the information source.

27. A computer program product for recording at a computer and measuring a transaction over a network between the computer and an information source, the computer program product comprising:

computer code that starts a recorder at the computer;

computer code that sends a request for information from a computer to an information source over the network to begin the transaction;

computer code that records the transaction including browser operations;

computer code that stops the recorder;

computer code that plays back the recorded transaction for review and validation of the recorded transaction by a user at the computer;

computer code that inserts comments into the transaction during playback of the recorded transaction in a step mode; and

computer code that sends the recording of the transaction to a node on the network in communication with a data acquisition agent remote from the computer and operable to execute the recorded transaction with the information source and collect performance measurements for the transaction, performance measurements comprising download time of data during execution of said recorded transaction and including browser execution time; and

a computer-readable storage medium for storing the codes.

28. The computer program product of claim 27 wherein the computer readable medium is selected from the group consisting of CD-ROM, floppy disk, tape, flash memory, system memory, and hard drive.

29. A system for recording a transaction between two or more computers in a computer network, the system comprising:

a recorder configured to record a transaction between a user computer and a host computer, the recorder installed at the user computer;

a playback application configured to playback the recorded transaction and insert comments into the transaction during playback of the recorded transaction in a step mode at the user computer, wherein playback of the recorded transaction comprises sending a request for a web page from a browser at the user computer to a web server and interacting with the web server to complete said transaction;

memory configured to at least temporarily store the recorded transaction at the user computer; and

a delivery device operable to send the recorded transaction to a central computer in communication with at least one data acquisition agent remote from the computer and operable to execute the recorded transaction and collect performance measurements for the transaction, wherein performance measurements comprise download time of data during execution of said recorded transaction and includes browser execution time.

30. The system of claim 29 wherein the recorder is configured to save information about HTML tags during a recording phase.

31. The system of claim 29 wherein the recorder comprises a recognition system operable to recognize HTML tags within a web page.

32. The system of claim 31 wherein the tags are recognized during playback via exact matching.

33. The system of claim 31 wherein the recognized tags include a tag selected from a group consisting of SELECT, AREA, ANCHOR, LINK, IMG, and INPUT tags.

34. The system of claim 29 wherein the transaction begins with the user computer sending a URL to the host computer.

35. The system of claim 34 wherein the transaction includes interaction between the user computer and the host computer.

36. The system of claim 29 further comprising a plurality of data acquisition agents at different geographic locations within the network, each of the data acquisition agents being in communication with the central computer.