TESTING AN ONLINE SYSTEM FOR SERVICE ORIENTED ARCHITECTURE (SOA) SERVICES

• US 20200133826A1
• Filed: 10/30/2018
• Published: 04/30/2020
• Est. Priority Date: 10/30/2018
• Status: Active Grant

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Cai, Lin, Yin, Yi Ming, Chen, Di Ling, Wu, Li, Ding, Xue Gang
• Granted Patent: US 11,169,905 B2
• Time in Patent Office: Days
• CPC Class Codes: G06F 11/3664 Environments for testing or debugging software
• CPC Class Codes: G06F 11/3684 for test design, e.g. generating new test cases
• CPC Class Codes: G06F 11/3688 for test execution, e.g. scheduling of test suites
• CPC Class Codes: G06F 11/3692 for test results analysis
• CPC Class Codes: G06F 2201/81 Threshold

Abstract

The present invention generally relates to system test, and more specifically, related to online system test. In an aspect, a computer-implemented method for online system test is provided. In this method, a test rule for testing the online system is obtained. And a test result from a real user action of the online system based on the test rule will be retrieved. And a test report is generated at least based on the test result from the real user action.

Claims

1. A computer-implemented method for testing an online system, the method comprising:

obtaining, by one or more computing units, a test rule for testing the online system;

retrieving, by one or more computing units, one or more test results from one or more real user actions of the online system based on the test rule;

generating, by one or more computing units, a test report at least based on the one or more test results retrieved from the one or more real user actions; and

using the test report to diagnose the status of the online system.

2. The method of claim 1, wherein the test rule includes a timestamp, and the method further comprises:

determining, by one or more computing units, whether the timestamp is expired;

responsive to determining that the timestamp is expired, determining, by one or more computing units, whether number of the one or more test results retrieved from the one or more real user actions is below a threshold;

responsive to determining the number of the one or more test results retrieved from the one or more real user actions is below the threshold, running, by one or more computing units, a standalone test case associated with the test rule; and

retrieving, by one or more computing units, a test result from the test case.

3. The method of claim 2, wherein the step of generating further comprises:

generating, by one or more computing units, the test report at least based on the test result retrieved from the test case.

4. The method of claim 2, wherein weights are assigned to the one or more test results retrieved from the one or more real user actions and the test result retrieved from the test case in the step of generating the test report, and the weight of the one or more test results retrieved from the one or more real user actions is higher than the weight of the test result retrieved from the test case.

5. The method of claim 2, wherein:

the threshold is generated automatically based on previous real user actions; and

timestamps applied for different kinds of real user actions are different.

6. The method of claim 1, wherein:

the test rule is data that indicates;

(i) identifying information for a customer user environment, and (ii) a set of parameter value(s) related to generating diagnostic data based upon interactions between the customer environment user and the online system;

the online system is a set of computer components connected in data communication such that the set of computer components can provide online services; and

the real user actions are actions made by an end user that is a human being.

7. The method of claim 2 further comprising:

collecting, by one or more computing units, previous real user actions regarding to the online system;

establishing, by one or more computing units, a pattern based on the previous real user actions, wherein the pattern indicating the previous real user actions and a context thereof; and

generating, by one or more computing units, the test case based on the pattern.

8. The method of claim 7, wherein the context includes at least one of the following:

sequence of at least two of the previous real user actions, and frequency of at least one of the previous real user actions.

9. The method of claim 1 wherein the step of retrieving further comprises:

setting, by one or more computing units, an executor in the online system for obtaining the one or more test results retrieved from the one or more real user actions based on the test rule.

10. A computer system for testing an online system, the system comprising:

one or more processors;

a computer-readable storage medium coupled to at least one of the processors;

a set of computer program instructions stored in the computer-readable storage medium and executed by at least one of the processors in order to perform actions of;

obtaining a test rule for testing the online system,

retrieving one or more test results from one or more real user actions of the online system based on the test rule,

generating a test report at least based on the one or more test results retrieved from the one or more real user actions, and

using the test report to diagnose the status of the online system.

11. The computer system of claim 10, wherein the test rule includes a timestamp, and the actions further comprises:

determining whether the timestamp is expired;

responsive to determining that the timestamp is expired, determining whether number of the one or more test results retrieved from the one or more real user actions is below a threshold;

responsive to determining the number of the one or more test results retrieved from the one or more real user actions is below the threshold, running a standalone test case associated with the test rule; and

retrieving a test result from the test case.

12. The computer system of claim 10, wherein the action of generating the test report further comprises:

generating the test report at least based on the test result retrieved from the test case.

13. The computer system of claim 11, wherein weights are assigned to the one or more test results retrieved from the one or more real user actions and the test result retrieved from the test case in the action of generating the test report, and the weight of the one or more test results retrieved from the one or more real user actions is higher than the weight of the test result retrieved from the test case.

14. The computer system of claim 11, wherein the actions further comprises:

collecting previous real user actions regarding to the online system;

establishing a pattern based on the previous real user actions, wherein the pattern indicating the previous real user actions and a context thereof; and

generating the test case based on the pattern.

15. The computer system of claim 14, wherein the context includes at least one of the following:

sequence of at least two of the previous real user actions, and frequency of at least one of the previous real user action.

16. A computer program product for testing an online system, the computer program product comprising a computer readable storage medium having program instructions embodied therewith, the program instructions being executable by a processor(s) set to cause the computer to perform operations including the following:

obtain a test rule for testing the online system;

retrieve one or more test results from one or more real user actions of the online system based on the test rule;

generate a test report at least based on the one or more test results retrieved from the one or more real user actions; and

using the test report to diagnose the status of the online system.

17. The computer program product of claim 16, wherein the test rule includes a timestamp, and the program instructions further cause the processor(s) set to perform operations including the following:

determining whether the timestamp is expired;

responsive to determining that the timestamp is expired, determining whether number of the one or more test results retrieved from the one or more real user actions is below a threshold;

responsive to determining the number of the one or more test results retrieved from the one or more real user actions is below the threshold, running a standalone test case associated with the test rule; and

retrieving a test result from the test case.

18. The computer program product of claim 17, wherein the generating the test report further comprises:

generating the test report at least based on the test result retrieved from the test case.

19. The computer program product of claim 16, wherein weights are assigned to the one or more test results retrieved from the one or more real user actions and the test result retrieved from the test case in the action of generating the test report, and the weight of the one or more test results retrieved from the one or more real user actions is higher than the weight of the test result retrieved from the test case.

20. The computer program product of claim 16, wherein the processor(s) set further causes the computer to perform operations including the following:

collecting previous real user actions regarding to the online system;

establishing a pattern based on the previous real user actions, wherein the pattern indicating the previous real user actions and context thereof; and

generating the test case based on the pattern.