Analytics driven development

• US 9,075,914 B2
• Filed: 10/01/2012
• Issued: 07/07/2015
• Est. Priority Date: 09/29/2011
• Status: Active Grant

• Current Assignee: Sauce Labs, Inc.
• Original Assignee: Sauce Labs, Inc.
• Inventors: Huggins, Jason
• Primary Examiner(s): DAO, THUY CHAN
• Application Number:
  US13/633,080
• Publication Number:
  US 20130086554A1
• Time in Patent Office: 1,009 Days
• US Class Current: 1/1
• CPC Class Codes: G06F 11/3664 Environments for testing or debugging software
• CPC Class Codes: G06F 11/3684 for test design, e.g. generating new test cases
• CPC Class Codes: G06F 8/34 Graphical or visual programming
• CPC Class Codes: G06F 9/44526 Plug-ins; Add-ons

Abstract

Analytics of the recorded user interface operations at clients accessing a web application at a server are used to develop a test routine for testing the web application at a cloud service. A code module, which is either at the server or attached to the browser in each of the clients, records and correlates each of the user interface operations at each client to each action taken in the web application as it is being navigated. The module then transmits the correlated user interface operations to the test service. At the test service, analytics are performed on the correlated user interface operations to develop data from the user interface operations, from which data the test routine is constructed.

Claims

1. An analytics driven development method to develop a test routine wherein the test routine upon being developed is stored at a test service for subsequent utilization in the testing of a web application which is stored at a server, the method comprising steps of:

navigating the web application from a plurality of user clients wherein each of the user clients includes a browser to effect navigation of the web application;

storing a code module selectively at the server or at each one of the user clients, the code module recording user interface operations which interact with the web application as the web application is being navigated by the browser at each of the user clients;

correlating each of the user interface operations with a respective one of actions occurring in the web application in response thereto;

transmitting the correlated user interface operations to the test service;

performing analytics at the test service on the recorded user interface operations to generate data from which the test routine is developed, wherein the performing step identifies the most frequented paths taken through the web application be the user clients and wherein the test routine is a Selenium test constructed at the test service which replicates the most frequented paths; and

accessing the test routine from a developer client which interacts with the test service to implement the routine as a navigation commands to the web application.

2. An analytics driven development method as set forth in claim 1 wherein the user interface operations include selected ones of keystrokes, touch gestures, mouse clicks and mouse movements at each of the user clients.

3. An analytics driven development method as set forth in claim 1 further comprising the step of downloading a module to one of the user clients from the server upon first access of the same one of the user clients to the web application, the module upon being downloaded becoming operational in association with the browser to perform each of the recording, correlating and transmitting steps.

4. An analytics driven development method as set forth in claim 3 wherein the module is attached as a plug in to the browser.

5. An analytics driven development method to develop a test routine wherein the test routine upon being developed is stored at a test service for subsequent utilization in the testing of a web application which is stored at a server, the method comprising steps of:

recording user interface operations which interact with the web application as the web application is being navigated by a browser at the user client;

correlating each of the user interface operations with a respective one of actions occurring in the web application in response thereto;

transmitting the correlated user interface operations to the test service;

performing analytics at the test service on the recorded user interface operations to develop data;

constructing the test routine from the data;

wherein the recording step includes recording user interface operations at a further user client which interact with the web application as the web application is being navigated by a browser at the further user client, wherein the step includes correlating each of the user interface operations at the further user client with a respective one of actions occurring in the web application in response thereto, wherein the transmitting step includes transmitting the correlated user interface operations of the further user client to the test service, and wherein the performing step includes performing analytics at the test service on the recorded user interface operations of each of the user client and the further user client to develop data; and

downloading a module to the user client and to the further user client from the server upon first access respectively of each of the user client and the further user client to the web application, the module upon being downloaded becoming operational in association with the browser at each respective one of the user client and the further user client to perform each of the recording, correlating and transmitting steps.

6. An analytics driven development method as set forth in claim 5 wherein the module is attached as a plug in to the browser at the further user client.

7. An analytics driven development system to develop a test routine wherein the test routine upon being developed is electronically stored for subsequent use at a test service for the testing of a web application which is stored at a server, the system comprising:

a plurality of user clients, each of the user clients including a browser stored in a memory through which the web application can be viewed at and navigated through from each of the user clients; and

a code module associated with the web application, the code module being selectively stored at the server or at each one of the user clients, the code module recording user interface operations which interact with the web application as the web application is being navigated from each one of the user clients, correlating each of the user interface operations with a respective one of actions occurring in the web application in response thereto and transmitting the correlated user interface operations to the test service, the test service in response to receipt of the correlated user interface operations performing analytics thereon to generate data from which the test routine is developed, wherein the data is an identification of the most frequented paths taken through the web application by the user clients and wherein the test routine is a Selenium test constructed at the test service which replicates the most frequented paths; and

a developer client which upon connection to the test service accesses the test routine and interacts with the test service so that the test routine is implemented as navigation commands to the web application.

8. An analytics driven development system as set forth in claim 7 wherein the user interface operations include selected ones of keystrokes, touch gestures, mouse clicks and mouse movements at each of the user clients.

9. An analytics driven development system as set forth in claim 7 wherein the module is stored in association with the web application at the server and downloaded to one of the user clients upon first access of the same one of the user clients to the web application, the module upon being downloaded becoming operational in association with the browser.

10. An analytics driven development system as set forth in claim 9 wherein the module attaches as a plug in to the browser.

11. An analytics driven development system as set forth in claim 7 wherein the module is operational at the server.

12. An analytics driven development system as set forth in claim 7 wherein the developer client manages execution of the test routine.

13. An analytics driven development system as set forth in claim 12 wherein metadata related to the test routine is transmitted to the developer client from which metadata the test routine is accessible at the test service.

14. An analytics driven development system to develop a test routine wherein the test routine upon being developed is utilizable at a test service for the testing of a web application which is stored at a server, the system comprising:

a user client including a browser stored in a memory through which the web application can be viewed at and navigated through from the user client;

a code module operative to record user interface operations which interact with the web application as the web application is being navigated and correlate each of the user interface operations with a respective one of actions occurring in the web application in response thereto and further operative to transmit the correlated user interface operations to the test service, the test service in response to receipt of the correlated user interface operations being operative to perform analytics thereon to develop data from which the test routine is constructed;

at least one further user client including a browser stored in a memory through which the web application can be viewed at and navigated through from the further user client; and

a code module associated with the browser of the further user client and operative to record user interface operations at the further user client which interact with the web application as the web application is being navigated and correlate each of the user interface operations of the further user client with a respective one of actions occurring in the web application in response thereto and further operative to transmit the correlated user interface operations of the further user client to the test service, the test service in response to receipt of the correlated user interface operations of the further user client being operative to perform analytics on the correlated user interface operations from each of the user client and the further user client to develop data from which the test routine is constructed;

wherein the module is stored in association with the web application at the server and downloaded to each of the user client and the further user client upon first access respectively of each of the user client and the further user client to the web application, the module upon being downloaded to each of the user client and the further user client becoming operational in association with the browser at the respective one of each of the user client and the further user client.

15. An analytics driven development system as set forth in claim 14 wherein the test service includes a database in which a log file is maintained for the user interface operations at each of the user clients.