Methods and systems for executing tests using grouped/filtered test classes during testing of an application
First Claim
1. A system, comprising:
- a user system, comprising;
an input system configured to receive input parameters specified by a user of the user system, wherein the input parameters comprise;
one or more regular expressions specified by the user of the user system, wherein each regular expression is a pattern that is used to perform a pattern match to identify a particular group of one or more first test class identifiers associated with that regular expression that each correspond to a test class name of a test class;
a processing system; and
a memory configured to store;
a test class filter module executable by the processing system, wherein the test class filter module, upon being executed by the processing system, is configured to;
group and filter test class identifiers, based on one or more of the input parameters, to generate a unique test class identifier array of filtered test class identifiers that correspond to a particular subset of tests that are to be executed during testing of an application, wherein the test class filter module comprises;
a first test class fetcher comprising;
a regular expression processor configured to receive the regular expressions input by the user of the user system; and
a query builder configured to;
generate and send a query associated with each regular expression to an interface, wherein the interface is configured to receive each query, contact a data store and find matching test class names for each regular expression, and return a first test class identifier for each of the matching test class names to the query builder, and wherein the query builder is further configured to receive the first test class identifiers for each of the matching test class names, and group the first test class identifiers corresponding to each of the regular expressions into a first test class identifier array,wherein the test class filter module further comprises;
a unique class ID filter configured to;
receive the first test class identifier array and a second test class identifier array; and
filter the one or more first test class identifiers from the first test class identifier array and second test class identifiers from the second test class identifier array to generate the unique test class identifier array of filtered test class identifiers by;
combining the first test class identifiers from the first test class identifier array and the second test class identifiers from the second test class identifier array into a combined set of test class identifiers;
determining duplicate test class identifiers that are in the combined set;
determining invalid test class identifiers that are in the combined set; and
eliminating the duplicate test class identifiers and the invalid test class identifiers from the combined set to generate the unique test class identifiers array of filtered test class identifiers that correspond to the particular subset of tests that are to be executed; and
a cloud-based computing platform, communicatively coupled to the user system, and comprising;
a test execution engine configured to execute the particular subset of tests corresponding to the filtered test class identifiers specified in the unique test class identifier array.
2 Assignments
0 Petitions
Accused Products
Abstract
Computer implemented methods and systems are provided for executing tests in a system that includes a user system and a cloud-based computing platform. The user system includes a processing system, memory and an input system that receives input parameters specified by a user of the user system. The memory can store a test class filter module executable by the processing system. Upon being executed by the processing system, the test class filter module can, based on one or more of the input parameters, group and filter test class identifiers to generate a unique test class identifier array of filtered test class identifiers that correspond to a particular subset of tests that are to be executed during testing of an application. A test execution engine can then execute the particular subset of tests corresponding to the filtered test class identifiers specified in the unique test class identifier array.
-
Citations
17 Claims
-
1. A system, comprising:
-
a user system, comprising; an input system configured to receive input parameters specified by a user of the user system, wherein the input parameters comprise;
one or more regular expressions specified by the user of the user system, wherein each regular expression is a pattern that is used to perform a pattern match to identify a particular group of one or more first test class identifiers associated with that regular expression that each correspond to a test class name of a test class;a processing system; and a memory configured to store;
a test class filter module executable by the processing system, wherein the test class filter module, upon being executed by the processing system, is configured to;
group and filter test class identifiers, based on one or more of the input parameters, to generate a unique test class identifier array of filtered test class identifiers that correspond to a particular subset of tests that are to be executed during testing of an application, wherein the test class filter module comprises;a first test class fetcher comprising; a regular expression processor configured to receive the regular expressions input by the user of the user system; and a query builder configured to;
generate and send a query associated with each regular expression to an interface, wherein the interface is configured to receive each query, contact a data store and find matching test class names for each regular expression, and return a first test class identifier for each of the matching test class names to the query builder, and wherein the query builder is further configured to receive the first test class identifiers for each of the matching test class names, and group the first test class identifiers corresponding to each of the regular expressions into a first test class identifier array,wherein the test class filter module further comprises; a unique class ID filter configured to;
receive the first test class identifier array and a second test class identifier array; and
filter the one or more first test class identifiers from the first test class identifier array and second test class identifiers from the second test class identifier array to generate the unique test class identifier array of filtered test class identifiers by;
combining the first test class identifiers from the first test class identifier array and the second test class identifiers from the second test class identifier array into a combined set of test class identifiers;
determining duplicate test class identifiers that are in the combined set;
determining invalid test class identifiers that are in the combined set; and
eliminating the duplicate test class identifiers and the invalid test class identifiers from the combined set to generate the unique test class identifiers array of filtered test class identifiers that correspond to the particular subset of tests that are to be executed; anda cloud-based computing platform, communicatively coupled to the user system, and comprising; a test execution engine configured to execute the particular subset of tests corresponding to the filtered test class identifiers specified in the unique test class identifier array. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10)
-
-
11. A method for executing tests in a cloud-based computing system comprising a user system and a cloud-based computing platform communicatively coupled to the user system via an interface of the cloud-based computing platform, the method comprising:
-
receiving input parameters specified by a user form an input system of the user system, wherein the input parameters comprise;
a manifest file specified by the user of the user system, and one or more regular expressions specified by the user of the user system, wherein each regular expression is a pattern that is used to perform a pattern match to identify a particular group of one or more first test class identifiers associated with that regular expression that each correspond to a test class name of a test class;at a processing system of the user system;
grouping and filter test class identifiers, based on one or more of the input parameters, to generate a unique test class identifiers array of filtered test class identifiers that correspond to a particular subset of tests that are to be executed during testing of an application, wherein the grouping and filtering test class identifiers, further comprises;retrieving, via a manifest file processor, the manifest file, wherein the manifest file comprises a plurality of test class names that can be used to fetch a particular group of one or more second test class identifiers from a data store of the cloud-based computing platform; retrieving, via a regular expression processor, the one or more regular expressions; at a query builder;
generating a query associated with each of the one or more regular expressions;at the interface;
receiving each query generated by the query builder;
contacting the data store and finding matching test class names for each regular expression; and
returning a first test class identifier for each of the matching test class names to the query builder;at the query builder;
receiving the one or more first test class identifiers of each of the matching test class names, and grouping the one or more first test class identifiers corresponding to each of the regular expressions into a first test class identifier array;at a manifest file reader and query builder;
reading the test class names from the manifest file;
sending the test class names from the manifest file to the interface;
receiving, from the interface, the particular group of the one or more second test class identifiers corresponding to each of the test class names from the manifest file; and
grouping the particular group of the one or more second test class identifiers into a second test class identifier array;filtering, at a unique class ID filter, the one or more first test class identifiers from the first test class array and the one or more second test class identifiers from the second test class identifier array to generate the unique test class identifier array of filtered test class identifiers, wherein the unique test class identifier array of the filtered test class identifiers corresponds to a subset of test classes that have been defined based on the input parameters; and at a test execution engine of the cloud-based computing platform;
executing the particular subset of tests corresponding to the filtered test class identifiers of the unique test class identifier array. - View Dependent Claims (12, 13, 14, 15, 16)
-
-
17. A computer program product, comprising:
-
a non-transitory computer readable medium having a computer readable program code embodied therein that is readable by a processing circuit and storing instructions for execution by the processing circuit to perform a method, the method comprising; receiving input parameters specified by a user from an input system of a user system, wherein the input parameters comprise;
one or more manifest files specified by the user of the user system each comprising a plurality of test class names that can be used to fetch a particular group of one or more first test class identifiers from a data store of a cloud-based computing platform, and one or more regular expressions specified by the user of the user system, wherein each regular expression is a pattern that is used to perform a pattern match to identify a particular group of one or more second test class identifiers associated with that regular expression that each correspond to a test class name of a test class;grouping and filtering test class identifiers, based on one or more of the input parameters, to generate a unique test class identifier array of filtered test class identifiers that correspond to a particular subset of tests that are to be executed by a test execution engine during testing of an application, wherein the grouping and filtering test class identifiers, further comprises; retrieving, via a manifest file processor, the manifest file, wherein the manifest file comprises a plurality of test class names that can be used to fetch the particular group of the one or more first test class identifiers from the data store of the cloud-based computing platform; at a manifest file reader and query builder reading the test class names from the manifest file;
sending the test class names from the manifest file to the interface;
receiving, from the interface, the particular group of the one or more first test class identifiers corresponding to each of the test class names from the manifest file; and
grouping the particular group of the one or more first test class identifiers into a first test class identifier array;retrieving, via a regular expression processor, the one or more regular expressions; at a query builder, generating a query associated with each of the one or more regular expressions; at the interface receiving each query generated by the query builder;
contacting the data store and finding matching test class names for each regular expression; and
returning a second test class identifier for each of the matching test class names to the query builder;at the query builder;
receiving the one or more second test class identifiers for each of the matching test class names, and grouping the one or more second test class identifiers corresponding to each of the regular expression into a second test class identifier array;filtering, at a unique class ID filter, the one or more first test class identifiers from the first test class identifier array and the one or more second test class identifiers from the second test class identifier array to generate the unique test class identifier array of filtered test class identifiers, wherein the unique test class identifier array of the filtered test class identifiers corresponds to a subset of test classes that have been defined based on the input parameters; and executing, at a test execution engine of the cloud-based computing platform, the particular subset of tests corresponding to the filtered test class identifiers specified in the unique test class identifier array.
-
Specification