Web service performance index

• US 8,560,504 B2
• Filed: 11/23/2004
• Issued: 10/15/2013
• Est. Priority Date: 11/25/2003
• Status: Active Grant

• Current Assignee: CA, Inc. (d/b/a CA Technologies) (Broadcom, Inc.)
• Original Assignee: CA, Inc. (d/b/a CA Technologies) (Broadcom, Inc.)
• Inventors: Parker, Leo F., Umansky, Vlad, Caminetsky, Marc R., Tcherevik, Dmitri, Srinivas, Davanum M., Kelly, Dennis J.
• Primary Examiner(s): LE, DEBBIE M
• Application Number:
  US10/995,654
• Publication Number:
  US 20050187950A1
• Time in Patent Office: 3,248 Days
• Field of Search: None
• US Class Current: 707/688
• CPC Class Codes: G06F 16/958 Organisation or management of web site content, e.g. publishing, maintaining pages or automatic linking
• CPC Class Codes: H04L 67/02 based on web technology, e.g. hypertext transfer protocol [HTTP]
• CPC Class Codes: H04L 67/125 involving control of end-device applications over a network
• CPC Class Codes: H04L 67/535 Tracking the activity of the user network monitoring arrangements H04L43/00; recording of computer activity G06F11/34

Abstract

A system for providing a web service performance index is operable to collect service metric data from each of a plurality of web services, with at least one of the web services comprising a remote web service. A web service performance index is generated based on the collected service metric data. The web service performance index is then published to a website.

Claims

1. A method for providing one or more web service performance indices for a plurality of web services, the method comprising:

associating a plurality of web services with a server system, wherein each of the plurality of associated web services comprises at least one self-contained application, remote from the server system, that provides one or more services to one or more additional applications over a network;

generating, at the server system, a service client for each of at least one of the plurality of associated web services, wherein each service client is configured to collect service metric data from a single corresponding web service, wherein each service client includes one or more observer modules, and wherein each observer module is configured to collect service metric data from a single corresponding performance metric of a web service;

for at least one service client, scheduling, at the server system, one or more synthetic transactions for collection of service metric data from the corresponding at least one web service;

loading, at the server system, at least one service client;

initializing, at the server system, each observer module of the at least one loaded service client;

for the at least one loaded service client, executing the one or more scheduled synthetic transactions to collect, by each initialized observer module at the server system, service metric data from the corresponding at least one web service;

generating, by the server system, using the collected service metric data, a performance index for each performance metric for which service metric data was collected, wherein each performance index includes at least one indicator, other than the collected service metric data, that reflects a performance of a web service; and

publishing, by the server system, the generated at least one performance index.

2. The method of claim 1, wherein service metric data relating to a plurality of performance metrics is merged into one or more performance metric groups for comparison and ranking prior to the publishing.

3. The method of claim 1, wherein the performance metric comprises one of:

service response time;

transaction volume;

or

fault frequency.

4. The method of claim 1, further comprising:

generating at least one graphical representation for the generated at least one performance index.

5. The method of claim 4, further comprising automatically e-mailing the at least one generated graphical representation to a client.

6. The method of claim 4, wherein the graphical representation is selected from the group consisting of at least one of a chart, a table, a graph, or a log.

7. The method of claim 1, wherein collecting service metric data comprises collecting real-time performance metrics.

8. The method of claim 1, wherein the performance index includes a consistency performance index, wherein the consistency performance index is calculated using one of the following measurements:

service response time, service volume, or fault frequency, and wherein the consistency performance index is calculated using one minus the standard deviation of the average measurement over a predetermined period of time.

9. The method of claim 1, wherein publishing the generated at least one performance index further comprises:

generating a plurality of web pages for publishing to a website, the plurality of web pages including a home page and at least a first provider page associated with a first web service provider and a second provider page associated with a second web service provider; and

generating, for each of the first and the second web service provider, one or more graphical representations for at least one individual performance metric, wherein the generated one or more graphical representations represent measurements associated with the at least one individual performance metric over a pre-determined time period, and wherein the generated one or more graphical representations are included in one of the first provider page or the second provider page based on the associations of the individual performance metrics with the web services of either the first web service provider or the second service provider.

10. The method of claim 1, wherein each web service comprises at least one web service method.

11. The method of claim 9, wherein the home page comprises a link to each of the first and second provider pages.

12. The method of claim 9, further comprising:

receiving a request from a client to access the website; and

communicating at least a portion of the generated web pages to the client based on at least one client characteristic and at least partially in response to the request.

13. A computer program product comprising tangible computer-readable storage media having thereon computer-executable instructions for causing a computer to provide one or more web service performance indices for a plurality of web services, the instructions operable to configure one or more processors to:

associate a plurality of web services with a server system, wherein each of the plurality of associated web services comprises at least one self-contained application, remote from the server system, that provides one or more services to one or more additional applications over a network;

generate, at the server system, a service client for each of at least one of the plurality of associated web services, wherein each service client is configured to collect service metric data from a single corresponding web service, wherein each service client includes one or more observer modules, and wherein each observer module is configured to collect service metric data from a single corresponding performance metric of a web service;

for at least one service client, schedule, at the server system, one or more synthetic transactions for collection of service metric data from the corresponding at least one web service;

load, at the server system, at least one service client;

initializing, at the server system, each observer module of the at least one loaded service client;

for the at least one loaded service client, execute the one or more scheduled synthetic transactions to collect, by each initialized observer module at the server system, service metric data from the corresponding at least one web service;

generate, by parsing the collected service metric data, a performance index for each performance metric for which service metric data was collected, wherein each performance index includes at least one indicator, other than the collected service metric data, that reflects a performance of a web service; and

publish the generated at least one performance index.

14. The computer program product of claim 13, wherein service metric data relating to a plurality of performance metric is merged into one or more performance metric groups for comparison and ranking prior to publishing.

15. The computer program product of claim 13, wherein the performance metric comprises one of:

service response time;

transaction volume;

or

fault frequency.

16. The computer program product of claim 13, wherein the instructions are further operable to configure one or more processors to generate at least one graphical representation for the generated at least one performance index.

17. The computer program product of claim 16, further configured to automatically e-mail the at least one generated graphical representation to a client.

18. The computer program product of claim 16, wherein the graphical representation is selected from the group consisting of at least one of a chart, a table, a graph, or a log.

19. The computer program product of claim 13, wherein the computer program product configured to collect service metric data comprises a computer program product configured to collect real-time performance metrics.

20. The computer program product of claim 13, wherein the performance index includes a consistency performance index, wherein the consistency performance index is calculated using one of the following measurements:

service response time, service volume, or fault frequency, and wherein the consistency performance index is calculated using one minus the standard deviation of the average measurement over a predetermined period of time.

21. The computer program product of claim 13, wherein publication of the generated at least one performance index further includes:

generation of a plurality of web pages for publishing to a website, the plurality of web pages including a home page and at least a first provider page associated with a first web service provider and a second provider page associated with a second web service provider; and

generation of, for each of the first and second web service provider, one or more graphical representations for at least one individual performance metric, wherein the generated one or more graphical representations represent measurements associated with the at least one individual performance metric over a pre-determined time period, and wherein the generated one or more graphical representations are included in one of the first provider page or the second provider page based on the associations of individual performance metrics with the web services of either the first web service provider or the second service provider.

22. The computer program product of claim 13, wherein each web service comprises at least one web service method.

23. The computer program product of claim 21, wherein the home page comprises a link to each of the first and second provider pages.

24. The computer program product of claim 21, wherein the instructions are further operable to configure one or more processors to:

receive a request from a client to access the website; and

communicate at least a;

portion of the generated web pages to the client based on at least one client characteristic and at least partially in response to the request.

25. A server system for providing at least one web service performance index for a plurality of web service, the server system comprising:

one or more processors configured to;

associate a plurality of web services with the server system, wherein each of the plurality of associated web services comprises at least one self-contained application, remote from the server system, that provides one or more services to one or more additional applications over a network;

generate, at the server system, a service client for each of at least one of the plurality of associated web services, wherein each service client is configured to collect service metric data from a single corresponding web service, wherein each service client includes one or more observer modules, and wherein each observer module is configured to collect service metric data from a single corresponding performance metric of a web service;

for at least one service client, schedule, at the server system, one or more synthetic transactions for collection of service metric data from the corresponding at least one web service;

load, at the server system, at least one service client;

initialize, at the server system, each observer module of the at least one loaded service client;

for the at least one loaded service client, execute the one or more scheduled synthetic transactions to collect, by each initialized observer module at the server system, service metric data from the corresponding at least one web service;

generate by the server system using the collected service metric data, a performance index for each performance metric for which service metric data was gathered, wherein each performance index includes at least one indicator, other than the collected service metric data, that reflects a performance of a web service; and

publish the generated at least one performance index.

26. The server system of claim 25, wherein service metric data relating to a plurality of performance metrics is merged into one or more performance metric groups for comparison and ranking prior to publishing.

27. The server system of claim 25, wherein the performance metric comprises one of:

service response time;

transaction volume;

or

fault frequency.

28. The server system of claim 25, wherein the one or more processors are further configured to generate at least one graphical representation of the generated at least one performance index.

29. The server system of claim 28, the one or more processors further configured to automatically e-mail the at least one generated graphical representation to a client.

30. The server system of claim 28, wherein the graphical representation is selected from the group consisting of at least one of a chart, a table, a graph, or a log.

31. The server system of claim 25, wherein the one or more processors configured to collect service metric data comprises processors configured to collect real-time performance metrics.

32. The server system of claim 25, wherein the performance index includes a consistency performance index, wherein the consistency performance index is calculated using one of the following measurements:

service response time, service volume, or fault frequency, and wherein the consistency performance index is calculated using one minus the standard deviation of the average measurement over a predetermined period of time.

33. The server system of claim 25, wherein publishing the generated at least one performance index further comprises:

generation of a plurality of web pages for publishing to a website, the plurality of web pages including a home page and at least a first provider page associated with a first web service provider and a second provider page associated with a second web service provider; and

;

generate, for each of the first and second web service provider, one or more graphical representations for at least one individual performance metric, wherein the generated one or more graphical representations represent measurements associated with the at least one individual performance metric over a pre-determined time period, and wherein the generated one or more graphical representations are included in one of the first provider page or the second provider page based on the associations of individual performance metrics with the web services of either the first web service provider or the second service provider.

34. The server system of claim 25, wherein each web service comprises at least one web service method.

35. The server system of claim 33, wherein the home page comprises a link to each of the first and second provider pages.

36. The server system of claim 33, wherein the one or more processors are further configured to:

receive a request from a client to access the website; and

communicate a portion of the web service performance index based on at least one client characteristic and at least partially in response to the request.

37. The server system of claim 25, wherein each service client is associated with a Web Services Distributed Management (WSDM) interface.

38. A system for providing at least one web service performance index for a plurality of web services, the system comprising:

one or more processors configured to;

register a plurality of remote web services;

for each of the registered remote web services, load a separate service client associated with the given registered remote web service, wherein each service client includes one or more observer modules, and wherein each observer module is configured to collect service metric data from a single corresponding performance metric of a web service;

selecting a first registered remote web service of the plurality of registered remote web services using a first loaded service client that is associated with the first registered remote web service;

collect, using the one or more observer modules of the first loaded service client, first service metric data from the first registered remote web service, the first service metric data comprising one or more individual performance metrics for the first registered remote web service;

parse the collected first service metric data to generate at least one first performance index using the first service metric data, wherein the at least one first performance index indicates a performance of the first registered remote web service;

selecting a second registered remote web service of the plurality of registered remote web services using a second loaded service client that is associated with the second registered remote web service;

collect, using the one or more observer modules of the second loaded service client, second service metric data from the second registered remote web service, the second service metric data comprising one or more individual performance metrics for the second registered remote web service; and

parse the collected second service metric data to generate at least one second performance index using the second service metric data, wherein the at least one second performance index indicates a performance of the second registered remote web service.

39. The server system of claim 38, wherein the one or more processors are further configured to:

generate a home web page based at least in part on the loaded service clients;

generate a first web service page for the first registered remote web service;

embed the at least one first performance index in the first web service page, wherein the home web page is linked to the first web service page;

generate a second web service page for the second registered remote web service; and

embed the at least one second performance index in the second web service page, wherein the home web page is linked to the second web service page.

40. A system for providing at least one web service performance index for a plurality of web services, the system comprising:

at least one memory unit in a server with instructions stored thereupon;

one or more processors in the server coupled to the memory unit, the one or more processors when executing the instructions cause the server to;

register a plurality of remote web services;

for each of the registered remote web services, load a separate service client associated with the given registered remote web service, wherein each service client includes one or more observer modules, and wherein each observer module is configured to collect service metric data from a single corresponding performance metric of a web service;

schedule a collection of service metric data using the one or more observer modules of a corresponding service client from the loaded service clients;

process at the server the collected service metric data;

determine when a predetermined amount of service metric data has been collected by the server; and

when the predetermined amount of service metric data has been collected;

parse the collected service metric data into individual performance metrics;

merge the collected service metric data for each individual performance metric into one or more performance metric groups;

compare each performance metric within the one or more performance metric groups with another performance metric in the one or more performance metric groups; and

generate a ranked graphical representation for each performance metric group based upon the comparison for publishing to a website.