System testing from production transactions

• US 10,474,563 B1
• Filed: 12/28/2016
• Issued: 11/12/2019
• Est. Priority Date: 12/28/2016
• Status: Active Grant

• Current Assignee: Wells Fargo Bank NA (Wells Fargo & Company)
• Original Assignee: Wells Fargo Bank NA (Wells Fargo & Company)
• Inventors: Rai, Sunil, Howarth, Jonathan, Rao, Shashikanth
• Primary Examiner(s): Lyons, Andrew M.
• Application Number:
  US15/392,884
• Time in Patent Office: 1,049 Days
• Field of Search: 717124-135
• CPC Class Codes: G06F 11/3664 Environments for testing or debugging software
• CPC Class Codes: G06F 11/3672 Test management
• CPC Class Codes: G06F 11/3684 for test design, e.g. generating new test cases
• CPC Class Codes: G06F 11/3688 for test execution, e.g. scheduling of test suites
• CPC Class Codes: G06F 11/3692 for test results analysis
• CPC Class Codes: G06F 16/22 Indexing; Data structures therefor; Storage structures
• CPC Class Codes: G06F 8/60 Software deployment
• CPC Class Codes: H04L 67/02 based on web technology, e.g. hypertext transfer protocol [HTTP]
• CPC Class Codes: H04L 67/101 based on network conditions

Abstract

A system comprising at least one processor; and at least one storage device. The storage device(s) store instructions that, when executed, cause the at least one processor to: determine an initial state of a production processing system, store the initial state, capture information about a plurality of transactions executing within the production processing system, configure, based on the initial state of a production processing system, a test processing system, deploy, within the test processing system, source code not included in the production processing system, generate, based on the information about the plurality of transactions, a replay test script, wherein the replay test script comprises a replay of the plurality of transactions, and wherein the replay test script further comprises transactions based on a new use case for the source code not included in the production processing system, and execute, within the test processing system, the replay test script.

Claims

1. A method comprising:

determining, by a computing system, an initial state of a production processing system comprising a load balancing system that distributes a transaction load across a plurality of application servers, wherein determining the initial state includes the computing system communicating, over a network, with the production processing system;

storing, by the computing system and in storage included within the computing system, the initial state of the production processing system;

capturing, by the computing system and based on network traffic monitored between a firewall and the load balancing system, information about a plurality of transactions executing across the plurality of application servers within the production processing system, wherein the information about the plurality of transactions includes information identifying hypertext transfer protocol requests and responses involving one or more of the plurality of application servers, and wherein capturing includes generating, based on the network traffic monitored between the firewall and the load balancing system, extract files organized into hypertext transfer protocol (http) requests and responses across the plurality of application servers;

storing, by the computing system, the extract files in the storage included within the computing system;

configuring, by the computing system and based on the initial state of the production processing system, a test processing system comprising a test load balancing system that distributes a test transaction load across a plurality of test application servers, wherein configuring the test processing system includes communicating, over the network, with the test processing system;

deploying, by the computing system and within the test processing system, source code not included in the production processing system, wherein deploying the source code includes communicating, over the network, with the test processing system;

generating, by the computing system and based on the information about the plurality of transactions executing across the plurality of application servers within the production processing system, a replay test script, wherein the replay test script comprises a replay of the plurality of transactions;

merging, by the computing system and into the replay test script, a new set of transactions not included within the plurality of transactions, wherein the new set of transactions are based on a new use case for the source code not included in the production processing system;

configuring, by the computing system, the test processing system to execute the replay test script, wherein configuring the test processing system to execute the replay test script includes communicating, over the network, with the test processing system; and

enabling the test processing system to execute the replay test script.

2. The method of claim 1, further comprising:

evaluating, by the computing system, the operation of the source code not included in the production processing system by observing operations performed by the test processing system.

3. The method of claim 1, further comprising:

after capturing the information about the plurality of transactions executing within the production processing system, determining, by the computing system, an updated state of the production processing system; and

storing the updated state.

4. The method of claim 3, further comprising:

evaluating, by the computing system, the operation of the source code not included in the production processing system by comparing the state of the test processing system after executing the replay test script with the updated state of the production processing system.

5. The method of claim 1, wherein configuring the test processing system comprises:

updating at least some data stored within the test processing system to match data associated with the initial state of the production processing system.

6. The method of claim 1, wherein the plurality of transactions executing within the production processing system are executed at a production rate, and wherein executing the replay test script comprises:

replaying transactions within the replay test script at a faster rate than the production rate.

7. The method of claim 1,

wherein generating the replay test script comprises updating at least some of the extract files to include information pertinent to a testing scenario, and disregarding at least some of the extract files not pertinent to the testing scenario.

8. A system comprising:

a production processing system;

a test processing system; and

a computing system having access to the production processing system and the test processing system over a network, wherein the computing system comprises at least one processor and at least one storage device that stores instructions that, when executed, configure the at least one processor to;

determine an initial state of the production processing system comprising a load balancing system that distributes a transaction load across a plurality of application servers, and wherein to determine the initial state, the instructions configure the at least one processor to communicate, over the network, with the production processing system,

store the initial state of the production processing system in the at least one storage device,

capture, based on network traffic monitored between a firewall and the load balancing system, information about a plurality of transactions executing across the plurality of application servers within the production processing system, wherein the information about the plurality of transactions includes information identifying hypertext transfer protocol requests and responses involving one or more of the plurality of application servers, and wherein to capture information, the instructions configure the at least one processor to generate, based on the network traffic monitored between the firewall and the load balancing system, extract files organized into hypertext transfer protocol (http) requests and responses across the plurality of application servers,

store the extract files in the at least one storage device,

configure, based on the initial state of a production processing system, the test processing system comprising a test load balancing system that distributes a test transaction load across a plurality of test application servers, and wherein to configure the test processing system, the instructions configure the at least one processor to communicate, over the network, with the test processing system,

deploy, within the test processing system, source code not included in the production processing system,

generate, based on the information included within the stored extract files about the plurality of transactions executing across the plurality of application servers within the production processing system, a replay test script, wherein the replay test script comprises a replay of the plurality of transactions, and wherein to generate the replay test script the instructions configure the at least one processor to update, without requiring input from a user, at least some of the extract files to include information pertinent to a testing scenario and to disregard at least some of the extract files not pertinent to the testing scenario,

merge, into the replay test script, a new set of transactions not included within the plurality of transactions, wherein the new set of transactions are based on a new use case for the source code not included in the production processing system, and

configure the test processing system to execute the replay test script.

9. The system of claim 8, wherein the instructions, when executed, further configure the at least one processor to:

evaluate the operation of the source code not included in the production processing system by observing operations performed by the test processing system.

10. The system of claim 8, wherein the instructions, when executed, further configure the at least one processor to:

after capturing the information about the plurality of transactions executing within the production processing system, determine an updated state of the production processing system; and

store the updated state.

11. The system of claim 10, wherein the instructions, when executed, further configure the at least one processor to:

evaluate the operation of the source code not included in the production processing system by comparing the state of the test processing system after executing the replay test script with the updated state of the production processing system.

12. The system of claim 8, wherein, to configure the test processing system, the instructions, when executed, further configure the at least one processor to:

update at least some data stored within the test processing system to match data associated with the initial state of the production processing system.

13. The system of claim 8, wherein the plurality of transactions executing within the production processing system are executed at a production rate, and wherein, to execute the replay test script, the instructions, when executed, further configure the at least one processor to:

replay transactions within the replay test script at a faster rate than the production rate.

14. A non-transitory computer-readable storage medium comprising instructions that, when executed, configure at least one processor of a system to:

determine an initial state of a production processing system comprising a load balancing system that distributes a transaction load across a plurality of application servers, wherein to determine the initial state, the instructions configure the at least one processor to communicate, over a network, with the production processing system;

store the initial state of the production processing system in storage included within the system;

capture, based on network traffic monitored between a firewall and the load balancing system, information about a plurality of transactions executing across the plurality of application servers within the production processing system, wherein the information about the plurality of transactions includes information identifying hypertext transfer protocol requests and responses involving one or more of the plurality of application servers, and wherein to capture information, the instructions configure the at least one processor to generate, based on the network traffic monitored between the firewall and the load balancing system, extract files organized into hypertext transfer protocol (http) requests and responses across the plurality of application servers;

store the extract files in the storage included within the system;

configure, based on the initial state of a production processing system, a test processing system comprising a test load balancing system that distributes a test transaction load across a plurality of test application servers, and wherein to configure test processing system, the instructions configure the at least one processor to communicate, over the network, with the test processing system;

deploy, within the test processing system, source code not included in the production processing system, wherein to deploy the source code, the instructions configure the at least one processor to communicate, over the network, with the test processing system;

generate, based on the information about the plurality of transactions executing across the plurality of application servers within the production processing system, a replay test script, wherein the replay test script comprises a replay of the plurality of transactions;

merge, into the replay test script, a new set of transactions not included within the plurality of transactions, wherein the new set of transactions are based on a new use case for the source code not included in the production processing system; and

configure the test processing system to execute the replay test script.

15. The non-transitory computer-readable storage medium of claim 14, wherein the instructions, when executed, further configure the at least one processor to:

evaluate the operation of the source code by observing operations performed by the test processing system.

16. The non-transitory computer-readable storage medium of claim 14, wherein the instructions, when executed, further configure the at least one processor to:

after capturing the information about the plurality of transactions executing within the production processing system, determine an updated state of the production processing system; and

store the updated state.

17. The non-transitory computer-readable storage medium of claim 16, wherein the instructions, when executed, further configure the at least one processor to:

evaluate the operation of the source code by comparing the state of the test processing system after executing the replay test script with the updated state of the production processing system.

18. The non-transitory computer-readable storage medium of claim 14, wherein the instructions, when executed, further configure the at least one processor to:

update at least some data stored within the test processing system to match data associated with the initial state of the production processing system.

19. The non-transitory computer-readable storage medium of claim 14, wherein the plurality of transactions executing within the production processing system are executed at a production rate, and wherein the instructions, when executed, further configure the at least one processor to:

replay transactions within the replay test script at a faster rate than the production rate.