System and method thereof for dynamically testing networked target systems through simulation by a mobile device

• US 10,250,483 B2
• Filed: 06/24/2015
• Issued: 04/02/2019
• Est. Priority Date: 06/25/2014
• Status: Active Grant

• Current Assignee: Perforce Software Incorporated
• Original Assignee: CA, Inc. (d/b/a CA Technologies) (Broadcom, Inc.)
• Inventors: Girmonsky, Alon, Haiut, Alex
• Primary Examiner(s): Book, Phyllis A
• Application Number:
  US14/748,415
• Publication Number:
  US 20150381467A1
• Time in Patent Office: 1,378 Days
• Field of Search: None
• CPC Class Codes: H04L 43/065 related to network devices
• CPC Class Codes: H04L 43/0817 by checking functioning
• CPC Class Codes: H04L 43/50 Testing arrangements
• CPC Class Codes: H04W 24/06 Testing, supervising or monitoring using simulated traffic

Abstract

A method and system for dynamically testing a networked target system (NTS) through simulation by a mobile device. The method comprises: receiving at least one test specification designating at least a type of the test and a number of step repeater devices (SRDs) required for the test; receiving, from the mobile device, a request to establish a secure connection; establishing the secure connection with the mobile device by impersonating the NTS; capturing each step performed by a user of the mobile device on an application installed thereon, wherein the application operates in conjunction with the NTS; setting all SRDs designated in the test specification with each captured step, thereby causing the SRDs to perform the captured step; receiving, from the SRDs, information respective of performance of the NTS; and generating a performance testing report based on the received information.

Claims

1. A method, comprising:

receiving, from a mobile device by a server system not under test, at least one test specification designating at least a type of test and a number of step repeater devices (SRDs) required for the test;

receiving, from the mobile device by the server system, a request to establish a secure connection;

in response to the request to establish the secure connection, transmitting, to the mobile device by the server system, a trusted certificate corresponding to a networked target system (NTS) to impersonate the NTS;

establishing by the server system, the secure connection with the mobile device, wherein the secure connection is established after verification of the certificate by the mobile device;

capturing, by the server system, a sequence of requests over the secure connection, wherein the requests originate from the mobile device and correspond to user actions performed by a user of an application on the mobile device, the application being configured to operate in conjunction with the NTS;

determining, by the server system, a sequence of captured steps that were performed within the application based on the sequence of requests;

configuring, by the server system, all SRDs designated in the test specification with each captured step, thereby causing each of the SRDs to perform the sequence of captured steps by transmitting one or more requests to the NTS; and

receiving, from the SRDs, information about the performance of the NTS.

2. The method of claim 1, wherein the test specification further comprises at least one of:

at least one geographic location of SRDs to be used, at least one type of SRDs to be used, and at least one action to be repeated by the SRDs.

3. The method of claim 2, wherein the SRDs are dynamically configured with each captured step, the method further comprising:

determining a first captured step in the sequence of captured steps in response to receiving a first request in the sequence of requests; and

configuring, in response to determining the first captured step, the SRDs with the first captured step, thereby causing each of the SRDs to perform the first captured step by transmitting a request to the NTS,

wherein a next captured step in the sequence of captured steps is unknown prior to receiving at least one next request in the sequence of requests and the SRDs are configured to perform at least some captured steps prior to receiving the at least one next request.

4. The method of claim 1, wherein establishing the secure connection further comprises:

obtaining a certificate of the NTS; and

wherein the trusted certificate includes at least the obtained certificate of the NTS and a cryptographic system to communicate with the mobile device over the secure connection.

5. The method of claim 4, wherein the secure connection comprises a transport layer security (TLS) connection.

6. The method of claim 1, wherein the NTS comprises any one of:

a web server and an application server.

7. The method of claim 1, wherein at least one of the group consisting of the NTS and at least one of the SRDs is partially or completely deployed in a cloud-computing platform, wherein the cloud-computing platform is at least one of:

a public cloud system, a private cloud system, and a hybrid cloud system.

8. The method of claim 1, wherein receiving information about the performance of the NTS further comprises generating a performance testing report based on the received information.

9. The method of claim 8, wherein the performance testing report comprises:

an estimated maximum capacity;

if at least one error was received during testing, the at least one error received during testing;

throughput of the NTS; and

a response time of the NTS.

10. The method of claim 1, wherein:

the sequence of captured steps comprise;

selecting an item, adding an item to a shopping cart, replacing an item in the shopping cart, or filling a billing form, each in the application on the mobile device;

configuring all SRDs comprises configuring 10,000 SRDs in a geographic location designated by the test specification;

the server system controls the test and impersonates the NTS when configuring the test with the mobile device but is not part of the NTS; and

the information about the performance of the NTS comprises information about elapsed time until responses are received by SRDs after a requests to the NTS.

11. A non-transitory computer readable medium having stored thereon instructions for causing one or more processing units of the server system to execute the computerized method according to claim 1.

12. A system, comprising:

one or more computers configured to implement a server system and that comprises memory storing instructions that, when executed, effectuate operations comprising;

receive, from a mobile device, at least one test specification designating at least a type of test and a number of step repeater devices (SRDs) require for the test, the test being configured for testing a networked target system (NTS) through simulation of mobile devices, and the test not being a test of the server system;

receive, from the mobile device, a request to establish a secure connection;

transmit, to the mobile device, a trusted certificate corresponding to the NTS to impersonate the NTS in response to the request to establish the secure connection;

establish the secure connection with the mobile device, wherein the secure connection is established after verification of the certificate by the mobile device;

capture a sequence of requests over the secure connection, where the requests originate from the mobile device and correspond to user actions performed by a user of an application on the mobile device, the application being configured to operate in conjunction with the NTS;

determine a sequence of captured steps that were performed within the application based on the sequence of requests;

configure all SRDs designated in the test specification with each captured step, thereby causing each of the SRDs to perform the sequence of captured steps by transmitting one or more requests to the NTS; and

receive, from the SRDs, information about the performance of the NTS.

13. The system of claim 12, wherein the test specification further comprises at least one of:

at least one geographic location of SRDs to be used, at least one type of SRDs to be used, and at least one actions to be repeated by the SRDs.

14. The system of claim 13, wherein the SRDs are dynamically configured with each captured step, and wherein the operations of the server system comprise:

determine a first captured step in the sequence of captured steps in response to receiving a first request in the sequence of requests; and

configure, in response to determining the first captured step, the SRDs with the first captured step, thereby causing each of the SRDs to perform the first captured step by transmitting a request to the NTS,

wherein a next captured step in the sequence of captured steps is unknown prior to receiving at least one next request in the sequence of requests and the SRDs are configured to perform at least some captured steps prior to receiving the at least one next request.

15. The system of claim 13, wherein the operations comprise:

obtain a certificate of the NTS; and

wherein the trusted certificate includes at least the obtained certificate of the NTS and a cryptographic system chosen to communicate with the mobile device over the secure connection.

16. The system of claim 15, wherein the secure connection comprises a transport layer security (TLS) connection.

17. The system of claim 12, wherein the NTS comprises any one of:

a web server and an application server.

18. The system of claim 12, wherein at least one of the group consisting of the NTS and at least one of the SRDs is partially or completely deployed in a cloud-computing platform, wherein the cloud-computing platform is at least one of:

a public cloud system, a private cloud system, and a hybrid cloud system.

19. The system of claim 12, wherein the system is further configured to generate a performance testing report based on the received information.

20. The system of claim 12, wherein the performance testing report comprises:

an estimated maximum capacity;

if at least one error was received during testing, the at least one error received during testing;

throughput of the NTS; and

a response time of the NTS.