Data driven test automation of web sites and web services

• US 20050267976A1
• Filed: 03/11/2004
• Published: 12/01/2005
• Est. Priority Date: 03/11/2004
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Chang, Ivy A., Sannakkayala, Sudhakar S.
• Granted Patent: US 7,334,220 B2
• Time in Patent Office: Days
• US Class Current: 709/230
• CPC Class Codes: H04L 63/0815 providing single-sign-on or federations
• CPC Class Codes: H04L 67/02 based on web technology, e.g. hypertext transfer protocol [HTTP]
• CPC Class Codes: H04L 67/125 involving control of end-device applications over a network

Abstract

A system, method and data structure for testing a web location including a web site or web service. A test generator or user generates an XML test case and a driver interprets the XML test case into an http request to be sent to the web location as a test.

Claims

1. A system for testing a web location including a web site or web service comprising:

a test generator for generating an XML test case; and

a driver for interpreting the XML test case into an http request to be sent to the web location.

2. The system of claim 1 wherein said driver comprises:

a parsing engine for parsing the XML test case into a sequence of requests/response pairs; and

a runtime engine for providing to the web location the http request corresponding to the sequence of requests/response pairs.

3. The system of claim 2 wherein said runtime engine receives from the web location an http response corresponding to the http request and retrieves, validates, and stores data in the http response, said retrieved, validated, and stored data being indicative of an operational status of the web location.

4. The system of claim 3 wherein the parsing engine comprises:

instructions for identifying components in the XML test case received from the test generator or created by a user;

instructions for identifying the configuration data of the components; and

instructions for replacing the identified configuration data in the request to be sent to the web location to be tested.

5. The system of claim 3 wherein the parsing engine comprises:

instructions for identifying any sequence of request/response pairs in the XML test case received from the test generator or user input;

instructions for determining if each identified request is a simple request or a composite of other requests and for reducing a composite request to a plurality of simple requests;

for each simple request/response pair, instructions for identifying a data structure of the simple request/response pair;

instructions for identifying aspects of the request data structure which include configuration data; and

instructions for replacing the identified configuration data in the request to be sent to the web location to be tested and outputting the resulting sequence of request/response pairs.

6. The system of claim 5 wherein the data structure includes the elements of an http request including the following:

a URL, a path, query string parameters, post data, and a verb.

7. The system of claim 5 wherein the runtime engine comprises:

instructions for identifying dynamic data in the request/response pairs received from the parsing engine;

instructions for replacing the identified dynamic data to generate a replaced request;

instructions for creating an http request from the data in the replaced request;

instructions for instantiating the http engine; and

instructions for sending the http request to the web location.

8. The system of claim 7 further comprising:

instructions for receiving from the web location an http response to the corresponding http request;

instructions for identifying the location and data to be retrieved from the http response regarding the operability of the web location; and

instructions for retrieving, validating, and storing the identified location and data.

9. The system of claim 2 wherein the runtime engine comprises:

instructions for identifying dynamic data in the request/response pairs received from the parsing engine;

instructions for replacing the identified dynamic data to generate a replaced request;

instructions for creating an http request from the data in the replaced request;

instructions for instantiating an http engine; and

instructions for sending the http request to the web location.

10. The system of claim 9 further comprising:

instructions for receiving from the web location an http response to the corresponding http request;

instructions for identifying the location and data to be retrieved from the http response regarding the operability of the web location; and

instructions for retrieving, validating, and storing the identified location and data.

11. The system of claim 1 wherein the test case includes at least one of the following tags:

dynamic user names, parameters specific to the test case and retrieved from a configuration file corresponding to the web location, and optional tags.

12. The system of claim 1 further comprising instructions for at least one of the following:

handling cookies, manipulating data, supporting XML parameters, sending hidden fields, inserting random parameters, and using use case attributes.

13. The system of claim 1 wherein the XML test case has a data structure comprising elements of an http request including the following:

a URL, a path, query string parameters, post data, and a verb.

14. A method of testing a web location including a web site or web service comprising:

generating a test case in XML format; and

interpreting the XML test case into a http request to be sent to the web location.

15. The method of claim 14 further comprising:

parsing the XML test case into a sequence of request/response pairs; and

providing to the web location the http request corresponding to the sequence of request/response pairs.

16. The method of claim 15 wherein the parsing comprises:

identifying components in the XML test case received from the test generator or created by a user;

identifying the configuration data of the components; and

replacing the identified configuration data in the request to be sent to the web location to be tested.

17. The method of claim 15 wherein the parsing comprises:

identifying any sequence of request/response pairs in the XML test case received from the test generator or user input;

determining if each identified request is a simple request or a composite of other requests and for reducing a composite request to a plurality of simple requests;

for each simple request/response pair, identifying a data structure of the simple request/response pair;

identifying aspects of the request data structure which include configuration data; and

replacing the identified configuration data in the request to be sent to the web location to be tested and outputting the resulting sequence of request/response pairs.

18. The method of claim 17 wherein the data structure includes the elements of an http request including the following:

a URL, a path, query string parameters, post data, and a verb.

19. The method of claim 18 wherein providing to the web location the http request comprises:

identifying dynamic data in the request/response pairs received from the parsing engine;

replacing the identified dynamic data to generate a replaced request;

creating an http request from the data in the replaced request;

instantiating the http engine; and

sending the http request to the web location.

20. The method of claim 19 further comprising:

receiving from the web location an http response to the corresponding http request;

identifying the location and data to be retrieved from the http response regarding the operability of the web location; and

retrieving, validating, and storing the identified location and data.

21. The method of claim 15 wherein providing to the web location the http request comprises:

identifying dynamic data in the request/response pairs received from the parsing engine;

replacing the identified dynamic data to generate a replaced request;

creating an http request from the data in the replaced request;

instantiating an http engine; and

sending the http request to the web location.

22. The method of claim 21 further comprising:

receiving from the web location an http response to the corresponding http request;

identifying the location and data to be retrieved from the http response regarding the operability of the web location; and

retrieving, validating, and storing the identified location and data.

23. The method of claim 14 further comprising receiving from the web location an http response corresponding to the http request and retrieving, validating and storing data from the http response wherein said retrieved, validated and stored data is indicative of an operational status of the web location.

24. The method of claim 14 wherein the test case includes at least one of the following tags:

dynamic user names, parameters specific to the test case and retrieved from a configuration file corresponding to the test case, and optional tags.

25. The method of claim 14 further comprising at least of the following in conjunction with the generating of the XML test case:

handling cookies, manipulating data, supporting XML parameter, sending hidden fields, inserting random parameters, and using use case attributes.

26. A data structure for an XML test case for use by a driver for interpreting the XML test case into an http request to be sent to a web location including a web site or a web service, said data structure comprising elements of an http request including the following:

a URL, a path, query string parameters, post data, and a verb.

27. A method of testing a plurality of web locations connected by a multi-site user authentication system according to an XML test case comprising:

generating a specific XML test case associated with the web locations;

parsing the XML test case into a sequence of request/response pairs; and

sending each of the http requests to the corresponding web locations.

28. The method of claim 27 further comprising receiving from each of the web locations an http response corresponding to the http request sent to the location and retrieving, validating, and storing data from the http response wherein said retrieved, validated, and stored data is indicative of an operational status of the web location.

29. The method of claim 27 wherein parsing the XML test case comprises:

identifying components in the XML test case received from the test generator or created by a user;

identifying the configuration data of the components; and

replacing the identified configuration data in the request to be sent to the web location to be tested.

30. The method of claim 27 wherein parsing the XML test case comprises:

identifying any sequence of request/response pairs in the XML test case received from the test generator or user input;

determining if each identified request is a simple request or a composite of other requests and for reducing a composite request to a plurality of simple requests;

for each simple request/response pair, identifying a data structure of the simple request/response pair;

identifying aspects of the request data structure which include configuration data; and

replacing the identified configuration data in the request to be sent to the web location to be tested and outputting the resulting sequence of request/response pairs.

31. The method of claim 30 wherein the data structure includes the elements of an http request including the following:

a URL, a path, query string parameters, post data, and a verb.

32. The method of claim 27 wherein sending each of the http requests comprises:

identifying dynamic data in the request/response pairs received from the parsing engine;

replacing the identified dynamic data to generate a replaced request;

creating an http request from the data in the replaced request;

instantiating the http engine; and

sending the http request to the web location.

33. The method of claim 32 further comprising:

instructions for receiving from the web location an http response to the corresponding http request;

instructions for identifying the location and data to be retrieved from the http response regarding the operability of the web location; and

instructions for retrieving, validating, and storing the identified location and data.

34. The method of claim 27 wherein sending each of the http requests comprises:

identifying dynamic data in the request/response pairs received from the parsing engine;

replacing the identified dynamic data to generate a replaced request;

creating an http request from the data in the replaced request;

instantiating an http engine; and

sending the http request to the web location.

35. The method of claim 34 further comprising:

receiving from the web location an http response to the corresponding http request;

identifying the location and data to be retrieved from the http response regarding the operability of the web location; and

retrieving, validating, and storing the identified location and data.

36. A computer readable medium (CRM) having instructions for testing a web location including a web site or web service comprising instructions for generating an XML test case and instructions for interpreting the XML test case into an http request to be sent to the web location.

37. The CRM of claim 36 further comprising:

instructions for parsing the XML test case into a sequence of request/response pairs; and

instructions for providing to the web location the http request corresponding to the sequence of requests/response pairs.

38. The CRM of claim 36 further comprising instructions for receiving from the web location an http response corresponding to the http request and instructions for retrieving, validating, and storing data from the http response wherein said retrieved, validated, and stored data is indicative of an operational status of the web location.

39. The CRM of claim 36 wherein the test case includes at least one of the following tags:

dynamic user names, parameters specific to the test case and retrieved from a configuration file corresponding to the test case, and optional tags.

40. The CRM of claim 36 further comprising at least one of the following in conjunction with the instructions for generating of the XML test case:

instructions for handling cookies, instructions for manipulating data, instructions for supporting XML parameter, instructions for sending hidden fields, instructions for inserting random parameters, and instructions for using use case attributes.