END-TO-END PERFORMANCE TOOL AND METHOD FOR MONITORING ELECTRONIC-COMMERCE TRANSACTIONS

• US 20090006616A1
• Filed: 09/05/2008
• Published: 01/01/2009
• Est. Priority Date: 11/30/2001
• Status: Active Grant

• Current Assignee: Cisco Technology, Inc. (Cisco Systems, Inc.)
• Original Assignee: Cisco Technology, Inc. (Cisco Systems, Inc.)
• Inventors: Conley, Alan, Wilmes, Joshua, Pirouz, Mehrdad, Gore, Richard
• Granted Patent: US 7,836,176 B2
• Time in Patent Office: Days
• US Class Current: 709/224
• CPC Class Codes: H04L 41/5009 Determining service level performance parameters or violations of service level contracts, e.g. violations of agreed response time or mean time between failures [MTBF]
• CPC Class Codes: H04L 67/131 Protocols for games, networked simulations or virtual reality

Abstract

A method and apparatus for monitoring electronic commerce transactions. A network delay agent, coupled to the access point for the electronic commerce provider'"'"'s system is operable to send and receive communications to a designated customer'"'"'s site for measuring network transport latency. Application test latency is also determined. An application monitor agent that is coupled to the electronic commerce provider'"'"'s access point sends application tests that correspond to tasks performed during a typical electronic commerce transaction, to the electronic commerce provider'"'"'s system. The time required for the electronic commerce provider'"'"'s system to perform the indicated tasks and return a response to the application monitor agent is recorded as application test latency. Network transport latency and application test latency are displayed to indicate the delays that are experienced by a user in executing an electronic commerce order.

Claims

1. A method, comprising:

simulating a transaction between a customer and one or more electronic commerce servers located in an enterprise network, said simulation performed using an access device located on a perimeter of the enterprise network;

wherein said simulation using the access device measures performance of an electronic commerce application independently of network conditions outside the enterprise network;

pinging a customer network using the same access device used for said simulation;

wherein said pinging measures network transport latency between the access device and the customer network independently of latency associated with the electronic commerce application; and

outputting said application performance measurement and said network transport latency measurement.

2. The method of claim 1, further comprising:

identifying a time of day associated with the measurements;

determining a first network transport latency baseline using previously determined values of network transport latency for the identified time of day, the first network transport latency baseline indicating an expected transport latency for the identified time of day; and

determining a first application performance baseline using previously determined values of application performance measurements for the identified time of day, the first application performance baseline indicating an expected application performance for the identified time of day.

3. The method of claim 2, wherein said method further includes:

calculating a second different network transport latency baseline, said second network transport latency baseline indicating the lowest measured network transport latency during a given time period; and

displaying the network transport latency measurement and said network transport latency baselines.

4. The method of claim 3, wherein a single graph is displayed that indicates the network transport latency measurement and the network transport latency baselines.

5. The method of claim 2, wherein said method further includes:

calculating a second different application performance baseline, said second application performance baseline indicating the lowest measured application performance during a given time period; and

displaying the application performance measurement and said application performance baselines.

6. The method of claim 5, wherein a single graph is displayed that indicates said application performance measurement and the application performance baselines.

7. The method of claim 2, further comprising measuring application performance for each of a plurality of application components and wherein said application performance measurements for each of said plurality of application components is displayed.

8. The method of claim 7, wherein a first application component performance baseline is determined for each of said plurality of application components.

9. The method of claim 8, wherein a second application component latency baseline is determined for each of said plurality of application components and wherein said second application component latency baseline for each of said plurality of application components is displayed.

10. The method of claim 9, wherein a graph is generated for each application component that includes the application component'"'"'s application component performance, first application component latency performance and second application component performance baseline.

11. The method of claim 10, wherein said application components include a login component, an order component, a configure component and a help component.

12. A system, comprising:

one or more electronic commerce servers for conducting transactions with a computer located outside an enterprise network for the electronic commerce servers over a call path;

a network device located on the call path between the electronic commerce servers and the computer;

the network device configured to ping a device located in a same network as the computer to determine latency between the computer and the network device;

the network device configured to mimic a customer interaction with the electronic commerce servers to determine current performance of an electronic commerce application operating in the enterprise network;

generate test packets and send the generated test packets to the electronic commerce servers, the generated test packets simulating a customer endpoint sending requests to the electronic commerce application, the sent test packets to at least in part mimic the customer interaction;

receive back a response to the sent packets, the response representing completion of the mimicked customer transaction;

analyze the received response to determine the current performance of the electronic commerce application operating in the enterprise network; and

the network device to output the latency and performance determinations.

13. The system of claim 12, wherein the network device is an access point located on an edge of the enterprise network and the test packets generated by the network device simulate an actual customer ordering a product using the electronic commerce application.

14. The system of claim 12, wherein the electronic commerce application comprises a plurality of application components, and the mimicked customer transaction utilizes the application components.

15. The system of claim 14, wherein the application components comprise a logon component and an ordering component and the network device is further configured to:

simulate the customer endpoint logging into the electronic commerce application using the generated test packets;

simulate the customer endpoint ordering a product or a service using the generated test packets.

16. The system of claim 12, wherein outputs indicate network latency attributed to a first leg of the call path, the first leg extending from the computer'"'"'s network to the network device, and application performance based on an exchange occurring on only the second leg of the call path, the second leg extending from the network device to the electronic commerce servers.

17. A system, comprising:

means for simulating a customer transaction between one or more electronic commerce servers associated with an enterprise network and an access point that at least partially defines the enterprise network, said simulating means originating test packets that mimic a customer transaction;

wherein said simulating means measures performance of an application running on the electronic commerce servers independently of network conditions of a customer network;

means for measuring network transport latency between the access point and a customer device located in the customer network; and

means for outputting said application performance measurements and said network latency measurements.

18. The system of claim 17, wherein said application performance measurement isolates application performance from performance associated with network elements located in the customer network.

19. The system of claim 18, wherein said network transport latency measurement isolates performance of network elements located on a communication path between the access point and the customer network from performance of the application.

20. The system of claim 17, further comprising means for identifying a communication path used for exchanging packets representing an electronic commerce transaction between the electronic commerce servers and the customer network;

wherein the access point is selected for the transaction simulation according to the presence of the access point on the communication path.

21. The system of claim 17, further comprising:

means for generating a graph, the graph comparing the application performance measurement to other application performance measurements, each of the application performance measurements included in the comparison characterizing application performance during a same time segment of a daily or weekly period.

22. The system of claim 21, wherein the generated graph plots application response time versus time.

23. The system of claim 17, wherein the application performance measurement includes different performance measurements for each of a plurality of application components associated with the application.

24. An apparatus, comprising:

a bus;

a memory unit coupled to said bus, said memory unit including instructions for monitoring electronic commerce transactions

one or more processors coupled to said bus, the processors for executing said instructions, and when executing said instructions, operable to;

send first packets to one or more servers associated with a first network, the first packets representing interaction with an application associated with the servers, the first packets traveling over a first communication path extending from the servers to an access point of the first network;

identify a first latency measurement according to a response to the first packets;

send one or more second packets to a remote device located in a second different network, the second network being remote relative to the servers and the access point, the second packets traveling over a second communication path extending from the remote device to the access point;

identify a second latency measurement according to a response to the second packets; and

display the latency measurements.

25. The apparatus of claim 24, wherein the first and second communication paths are separate segments of a third communication path that communicatively couples the remote device to the servers, wherein each latency measurement corresponds to only one of the separate segments.