Automated HTTP user flows simulator

• US 10,282,282 B2
• Filed: 06/29/2017
• Issued: 05/07/2019
• Est. Priority Date: 06/29/2016
• Status: Active Grant

• Current Assignee: Software Integrity Group Incorporated
• Original Assignee: Synopsys Incorporated
• Inventors: Shavro, Tamir, Tamir, Eran, Blochet, Lilian
• Primary Examiner(s): Bui, Hanh Thi-Minh
• Application Number:
  US15/636,721
• Publication Number:
  US 20180004640A1
• Time in Patent Office: 677 Days
• CPC Class Codes: G06F 11/3664 Environments for testing or debugging software
• CPC Class Codes: G06F 11/3672 Test management
• CPC Class Codes: G06F 11/3692 for test results analysis
• CPC Class Codes: G06F 16/95 Retrieval from the web
• CPC Class Codes: G06F 16/958 Organisation or management of web site content, e.g. publishing, maintaining pages or automatic linking
• CPC Class Codes: G06F 16/986 Document structures and storage, e.g. HTML extensions

Abstract

A testing method and system for automatic Hypertext Transfer Protocol (HTTP) testing, the system including a memory configured to store sequences of user requests, a program store storing code for emulating a sequence of user requests, and at least one processor coupled to the program store and to the memory for executing the stored code, the code including instructions for generating an emulated request based on a request from a user sequence of requests, transmitting the emulated request to an application, receiving a response to the emulated request from the application, calculating an adapted emulated sequence based on validity of the received response, and instructing transmission of the adapted emulated sequence.

Claims

1. A system for automatic testing of web service, the system comprising:

a memory configured to store a sequence of requests;

a program store storing code; and

at least one processor coupled to the program store and to the memory for executing the stored code, the stored code comprising instructions that, when executed, cause the processor to perform operations comprising;

generating an emulated request based on a first stored request of the sequence of requests stored in the memory,

transmitting the emulated request to an application coupled to the system,

receiving a received response to the emulated request from the application,

detecting a dependency between the first stored request and a second stored request of the sequence of requests stored in the memory, based on whether the received response to the emulated request is valid;

calculating an adapted emulated request sequence based on the dependency, wherein the adapted emulated request sequence is a result of an adaptation process executed by the processor using a machine learning (ML) based adaptation mechanism; and

transmitting the adapted emulated request sequence to the application; and

adapting, by the processor, a dependent emulated request that depends on a previous request of the sequence of requests by inserting, into the dependent emulated request, information from a response to the previous request on which the dependent emulated request depends.

2. The system of claim 1, the operations further comprising:

comparing the received response to a corresponding pre-recorded response;

determining a similarity measure between the received response and the corresponding pre-recorded response; and

deciding based on the similarity measure whether the received response is valid.

3. The system of claim 1, wherein the application is in an application server, and wherein the operations further comprise sending the adapted emulated request sequence to the application server.

4. The system of claim 1, wherein the operations further comprise adapting the dependent emulated request corresponding to a particular request by inserting information from a previous response to the previous request into the dependent emulated request.

5. The system of claim 1, wherein the operations further comprise:

identifying, in the sequence, a previous response to the previous request, wherein the previous response produced at least one dynamic data item;

executing the previous request;

extracting at least one dynamic data item from the previous response; and

inserting the at least one dynamic data item into the emulated request.

6. The system of claim 5, wherein the operations further comprise replacing specified information in the emulated request with the dynamic data item, wherein the specified information was copied from a corresponding pre-recorded request.

7. The system of claim 1, wherein the system further comprises a token-instances repository, and wherein the operations further comprise:

monitoring one or more monitored responses received from an application server in response to the emulated requests;

detecting a one-time token value in a given monitored response;

storing the one-time token value in the token-instances repository; and

replacing a recorded token value in the emulated request with the one-time token value.

8. The system of claim 1, wherein the code further comprises client-side instructions to generate a one-time token value, and wherein the client-side instructions comprise instructions to insert the generated token value into the emulated request instead of a recorded token value.

9. The system of claim 1, wherein the operations further comprise:

producing a testing agent; and

planting the testing agent in an application server.

10. The system of claim 9, wherein the testing agent is configured to:

monitor an activity item in the tested application;

associate the activity item with an accessed application page;

store the activity item in correlation with the accessed application page and corresponding requests; and

identify, based on the correlation, a dependent application page.

11. The system of claim 1, wherein the operations further comprise:

generating an emulated sequence comprising a plurality of sequential requests;

determining a target outcome;

identifying a dependent request in the emulated sequence; and

producing a reduced emulated sequence by;

executing the emulated sequence without an independent request of the emulated sequence to produce a reduced response;

determining the validity of the reduced response, by comparing the reduced response to the target outcome; and

removing the independent request from the emulated sequence when the reduced response is valid.

12. A method comprising:

generating, by a processor, an emulated request based on a first stored request of a sequence stored in a memory;

transmitting, by the processor, the emulated request to an application server;

receiving, by the processor, a received response to the emulated request from the application server;

detecting, by the processor, a dependency between the first stored request and a second stored request of the sequence of requests stored in the memory, based on whether the received response to the emulated request is valid;

calculating, by the processor, an adapted emulated request sequence based on the dependency, wherein the adapted emulated request sequence is a result of an adaptation process executed by the processor using a machine learning (ML) based adaptation mechanism;

transmitting, by the processor, the adapted emulated request sequence to the application server; and

adapting, by the processor, a dependent emulated request that depends on a previous request of the sequence of requests by inserting, by the processor, into the dependent emulated request, information from a response to the previous request on which the dependent emulated request depends.

13. The method of claim 12, further comprising:

comparing, by the processor, the received response to a corresponding pre-recorded response;

determining, by the processor, a similarity measure between the received response and the corresponding pre-recorded response; and

deciding, by the processor, based on the similarity measure whether the received response is valid.

14. The method of claim 12, further comprising:

adapting, by the processor, the dependent emulated request corresponding to a particular request by inserting information from a previous response to the previous request into the dependent emulated request.

15. The method of claim 12, further comprising:

identifying, by the processor, in the sequence, a previous response to the previous request, wherein the previous response produced a dynamic data item;

executing, by the processor, the previous request;

extracting, by the processor, the dynamic data item from the previous response; and

inserting, by the processor, the dynamic data item into the emulated request.

16. The method of claim 15, further comprising:

replacing specified information in the emulated request with the dynamic data item, wherein the specified information was copied from a corresponding pre-recorded request.

17. The method of claim 12, further comprising:

monitoring, by the processor, one or more monitored responses received from the application server in response to the emulated request;

detecting, by the processor, a one-time token value in a given monitored response;

storing, by the processor, the one-time token value in a token-instances repository; and

replacing, by the processor, a recorded token value in the emulated request with the one-time token value.

18. The method of claim 12, further comprising:

instructing, by the processor, a client-side device to generate a one-time token value and insert the generated token value into the emulated request instead of a recorded token value.

19. The method of claim 12, further comprising:

producing, by the processor, a testing agent; and

planting, by the processor, the testing agent in the application server, wherein the testing agent is configured to;

monitor an activity item in the tested application;

associate the activity item with an accessed application page;

store the activity item in correlation with the accessed application page and corresponding requests; and

identify, based on the correlation, a dependent application page.

20. The method of claim 12, further comprising:

generating, by the processor, an emulated sequence comprising a plurality of sequential requests;

determining, by the processor, a target outcome;

identifying, by the processor, a dependent request in the emulated sequence; and

producing, by the processor, a reduced emulated sequence by;

executing, by the processor, the emulated sequence without an independent request of the emulated sequence to produce a reduced response;

determining, by the processor, a validity of the reduced response by comparing the reduced response to the target outcome; and

removing, by the processor, the independent request from the emulated sequence when the reduced response is valid.

21. A testing server comprising:

a memory configured to store a sequence of requests;

a processor configured to implement a testing engine, wherein the testing engine is configured to;

generate an emulated request based on a first stored request from the sequence of requests stored in the memory;

transmit the emulated request to an application server coupled to the testing server;

receive, from the application server, a response to the emulated request;

detect a dependency between the first stored request and a second stored request of the sequence of requests stored in the memory, based on whether the received response to the emulated request is valid;

calculate an adapted emulated request sequence based on the dependency, wherein the adapted emulated request sequence is a result of an adaptation process executed by the processor using a machine learning (ML) based adaptation mechanism; and

transmit the adapted emulated request sequence to the application server;

wherein the testing engine is further configured to adapt a dependent emulated request that depends on a previous request of the sequence of requests by inserting, into the dependent emulated request, information from a response to the previous request on which the dependent emulated request depends.