Testing software code in a production environment

• US 9,983,982 B1
• Filed: 01/04/2017
• Issued: 05/29/2018
• Est. Priority Date: 01/04/2017
• Status: Active Grant

• Current Assignee: Visa International Service Association (Visa, Inc.)
• Original Assignee: Visa International Service Association (Visa, Inc.)
• Inventors: Kumar, Surjeet, John, Aloysius, Abraham, Biju, Nair, Soorej, Nanduri, Priya
• Primary Examiner(s): Bodden, Evral E
• Application Number:
  US15/398,579
• Time in Patent Office: 510 Days
• Field of Search: 717124
• CPC Class Codes: G06F 11/3664 Environments for testing or debugging software
• CPC Class Codes: G06F 11/368 for test version control, e.g. updating test cases to a new software version
• CPC Class Codes: G06F 11/3688 for test execution, e.g. scheduling of test suites
• CPC Class Codes: G06F 8/71 Version control security arrangements therefor G06F21/57; Configuration management
• CPC Class Codes: H04L 43/50 Testing arrangements

Abstract

Embodiments of the invention are directed to techniques for redirecting data streams from a production environment to validate non-production software code. In some embodiments, a front-end computer executing a first version of software can receive a request message from a requesting computer, generate a request payload using the request message, transmit the request payload to a processor computer, receive a response payload from the processor computer, generate a reply message using the response payload, and provide, to a validation computer that is executing a second version of the software, the request message, the request payload, and the response payload. The validation computer can generate a modified request payload using the request message and a modified reply message using the response payload. To detect potential errors in the second version, the modified request payload is compared with the request payload and the modified reply message is compare with the reply message.

Claims

1. A method comprising performing, by a computer system:

receiving, from a requesting server computer over a first network, a request message at a front-end computing device, the front-end computing device executing a first version of a software code;

generating, by the front-end computing device, a request payload using the request message, the request payload having a plurality of request-payload fields;

transmitting, by the front-end computing device, the request payload to a processor computer over a second network;

receiving, by the front-end computing device, from the processor computer over the second network, a response payload;

generating, by the front-end computing device, a reply message using the response payload for sending to the requesting server computer, the reply message having a plurality of reply-message fields;

providing, by the front-end computing device to a validation computing device executing in coordination with the front-end computing device, the request message, the request payload, and the response payload, the validation computing device executing a second version of the software code;

generating, by the validation computing device, a modified request payload using the request message, the modified request payload having a plurality of modified request-payload fields;

comparing the plurality of modified request-payload fields of the modified request payload with the plurality of request-payload fields of the request payload to identify discrepancies between the modified request payload and the request payload corresponding to potential errors in the second version of the software code;

generating, by the validation computing device, a modified reply message using the response payload, the modified reply message having a plurality of modified reply-message fields; and

comparing the plurality of modified reply-message fields with the plurality of reply-message fields to identify discrepancies between the modified reply message and the reply message corresponding to potential errors in the second version of the software code.

2. The method of claim 1, further comprising:

responsive to identifying less than a specified number of discrepancies in the second version of the software code, replacing the first version of the software code with the second version of the software code at the front-end computing device.

3. The method of claim 2:

wherein the front-end computing device receives a plurality of request messages over a specified period of time, the plurality of request messages including the request message; and

wherein identifying less than the specified number of discrepancies in the second version of the software code comprises identifying less than the specified number of discrepancies in the second version of the software code from the plurality of request messages received over the specified period of time.

4. The method of claim 1, further comprising:

responsive to determining a discrepancy between the modified reply message and the reply message, generating a log entry or a notification.

5. The method of claim 1, wherein, prior to providing the request message, the request payload, and the response payload to the validation computing device, the method further comprises:

transmitting, by the front-end computing device to the requesting server computer over the first network, the reply message.

6. The method of claim 1, wherein providing the request message, the request payload, and the response payload to the validation computing device comprises:

invoking, via an asynchronous Hypertext Transfer Protocol (HTTP) call or an asynchronous HTTPS call, a representational state transfer (REST) function of a REST service provided by the validation computing device to upload the request message, the request payload, and the response payload to the validation computing device; and

wherein the request message, the request payload, and the response payload are provided in a markup language format.

7. The method of claim 1, wherein the comparisons of the plurality of modified request-payload fields of the modified request payload with the plurality of request-payload fields of the request payload are performed using one or more regular expressions.

8. The method of claim 1:

wherein the front-end computing device receives a plurality of request messages, the plurality of request messages including the request message; and

wherein only a portion of the plurality of request messages are provided to the validation computing device.

9. The method of claim 8, wherein the portion of the plurality of request messages that are provided to the validation computing device is determined:

at random based on a percentage that is configured to throttle a volume of request messages provided to the validation computing device;

based on one or more requesting server computers from which the plurality of request messages are received, the one or more requesting server computers comprising the requesting server computer;

based on one or more processor computers to which a plurality of request payloads generated from the plurality of request messages are transmitted, the one or more processor computers comprising the processor computer;

or

based on the plurality of request messages.

10. A server computer comprising:

a processor; and

a computer-readable medium coupled to the processor, the computer-readable medium including code comprising a first version of a software code, the code executable by the processor for executing the first version of the software code and performing a method comprising;

receiving, from a requesting server computer over a first network, a request message;

generating a request payload using the request message, the request payload having a plurality of request-payload fields;

transmitting the request payload to a processor computer over a second network;

receiving, from the processor computer, a response payload over the second network;

generating a reply message using the response payload for sending to the requesting server computer, the reply message having a plurality of reply-message fields;

providing, to a validation computing device executing in coordination with the server computer, the request message, the request payload, and the response payload, the validation computing device executing a second version of the software code;

wherein the validation computing device;

generates a modified request payload using the request message, the modified request payload having a plurality of modified request-payload fields;

compares the plurality of modified request-payload fields of the modified request payload with the plurality of request-payload fields of the request payload to identify discrepancies between the modified request payload and the request payload corresponding to potential errors in the second version of the software code;

generates a modified reply message using the response payload, the modified reply message having a plurality of modified reply-message fields; and

compares the plurality of modified reply-message fields with the plurality of reply-message fields to identify discrepancies between the modified reply message and the reply message corresponding to potential errors in the second version of the software code.

11. The server computer of claim 10, wherein the first version of the software code is replaced with the second version of the software code in response to identifying less than a specified number of discrepancies in the second version of the software code.

12. The server computer of claim 11:

wherein the server computer receives a plurality of request messages over a specified period of time, the plurality of request messages including the request message; and

wherein identifying less than the specified number of discrepancies in the second version of the software code comprises identifying less than the specified number of discrepancies in the second version of the software code from the plurality of request messages received over the specified period of time.

13. The server computer of claim 10, wherein the method further comprises:

responsive to determining a discrepancy between the modified reply message and the reply message, generates a log entry or a notification.

14. The server computer of claim 10, wherein, prior to providing the request message, the request payload, and the response payload to the validation computing device, the method further comprises:

transmitting, to the requesting server computer over the first network, the reply message.

15. The server computer of claim 10:

wherein providing the request message, the request payload, and the response payload to the validation computing device comprises invoking, via an asynchronous Hypertext Transfer Protocol (HTTP) call or an asynchronous HTTPS call, a representational state transfer (REST) function of a REST service provided by the validation computing device to upload the request message, the request payload, and the response payload to the validation computing device; and

wherein the request message, the request payload, and the response payload are provided in a markup language format.

16. The server computer of claim 10, wherein the comparisons of the plurality of modified request-payload fields of the modified request payload with the plurality of request-payload fields of the request payload are performed using one or more regular expressions.

17. The server computer of claim 10:

wherein the server computer receives a plurality of request messages, the plurality of request messages including the request message; and

wherein only a portion of the plurality of request messages are provided to the validation computing device.

18. The server computer of claim 17, wherein the portion of the plurality of request messages that are provided to the validation computing device is determined:

at random based on a percentage that is configured to throttle a volume of request messages provided to the validation computing device;

based on one or more requesting server computers from which the plurality of request messages are received, the one or more requesting server computers comprising the requesting server computer;

based on one or more processor computers to which a plurality of request payloads generated from the plurality of request messages are transmitted, the one or more processor computers comprising the processor computer;

or

based on the plurality of request messages.

19. A server computer comprising:

a processor; and

a computer-readable medium coupled to the processor, the computer-readable medium including code comprising a second version of a software code, the code executable by the processor for executing the second version of the software code and performing a method comprising;

receiving, from a front-end computing device executing in coordination with the server computer, a request message that was received over a first network from a requesting server computer by the front-end computing device, a request payload that was generated by the front-end computing device using the request message, a response payload that was received over a second network from a processor computer by the front-end computing device after the front-end computing device transmitted the request payload over the second network to the processor computer, and a reply message that was generated by the front-end computing device using the response payload, wherein the front-end computing device executes a first version of the software code;

generating a modified request payload using the request message, the modified request payload having a plurality of modified request-payload fields;

comparing the plurality of modified request-payload fields of the modified request payload with a plurality of request-payload fields of the request payload to identify discrepancies between the modified request payload and the request payload corresponding to potential errors in the second version of the software code;

generating a modified reply message using the response payload, the modified reply message having a plurality of modified reply-message fields; and

comparing the plurality of modified reply-message fields with a plurality of reply-message fields of the reply message to identify discrepancies between the modified reply message and the reply message corresponding to potential errors in the second version of the software code.

20. The server computer of claim 19, wherein the first version of the software code at the front-end computing device is replaced with the second version of the software code in response to identifying less than a specified number of discrepancies in the second version of the software code.