Software testing method and system
First Claim
1. A method for testing a software product comprising:
- obtaining a performance matrix for the software product, the performance matrix containing the profile results of a plurality of tests on the software product, and an expected result vector for the plurality of tests; and
executing a test sequence for the software product comprisingselecting a subset of the plurality of tests,running the test subset to obtain a new result vector for the test subset,comparing the new result vector entry with the expected result vector entry for the same test,selecting a test according to the outcome of the result vector comparison and the performance matrix, andrunning the selected test under profile.
1 Assignment
0 Petitions
Accused Products
Abstract
A software product is tested by first obtaining a performance matrix for the software product, the performance matrix containing the profile results of a plurality of tests on the software product, and an expected result vector for the plurality of tests. A test sequence is then executed for the software product, the sequence comprising selecting a subset of the plurality of tests, running the test subset to obtain a new result vector for the test subset, comparing the new result vector entry with the expected result vector entry for the same test, selecting a test (which may be one of the subset or may be a new test) according to the outcome of the result vector comparison and the performance matrix, and running the selected test under profile.
-
Citations
20 Claims
-
1. A method for testing a software product comprising:
-
obtaining a performance matrix for the software product, the performance matrix containing the profile results of a plurality of tests on the software product, and an expected result vector for the plurality of tests; and executing a test sequence for the software product comprising selecting a subset of the plurality of tests, running the test subset to obtain a new result vector for the test subset, comparing the new result vector entry with the expected result vector entry for the same test, selecting a test according to the outcome of the result vector comparison and the performance matrix, and running the selected test under profile. - View Dependent Claims (2, 3, 4, 5, 6, 7)
-
-
8. A system for testing a software product comprising
a storage device storing a performance matrix for the software product the performance matrix containing the profile results of a plurality of tests on the software product, and an expected result vector for the plurality of tests, and a processor arranged to execute a test sequence for the software product comprising: -
selecting a subset of the plurality of tests, running the test subset to obtain a new result vector for the test subset, comparing the new result vector entry with the expected result vector entry for the same test, selecting a test according to the outcome of the result vector comparison and the performance matrix, and running the selected test under profile. - View Dependent Claims (9, 10, 11, 12, 13)
-
-
14. A computer program product comprising a computer usable storage medium having stored therein computer usable program code for testing a software product, the computer usable program code, which when executed in a computer, causes the computer to perform:
-
obtaining a performance matrix for the software product, the performance matrix containing the profile results of a plurality of tests on the software product, and an expected result vector for the plurality of tests; and executing a test sequence for the software product comprising; selecting a subset of the plurality of tests, running the test subset to obtain a new result vector for the test subset, comparing the new result vector entry with the expected result vector entry for the same test and the performance matrix, selecting a test according to the outcome of the result vector comparison and the performance matrix, and running the selected test under profile. - View Dependent Claims (15, 16, 17, 18, 19, 20)
-
Specification