Method, system, and storage medium for using comparisons of empirical system data for testcase and workload profiling
First Claim
1. A method of comparing empirical system data for testcase and workload profiling, comprising:
- gathering customer data from a customer system;
gathering test data from a test system corresponding to the customer data, the test system including testcases and workloads;
improving at least one testcase or at least one workload in the test system by making comparisons between the customer data and the test data in an iterative process.
1 Assignment
0 Petitions
Accused Products
Abstract
Systems and methods for using comparisons of empirical system data, (e.g., performance, accounting, software module or function frequency), for testcase and workload profiling are provided. Instead of asking a customer what he does, simply asking for some set of empirical data that can be formatted, reduced, and analyzed. By gathering the same kind of data for the test systems that is used by the customer, testcases and workload profiling are improved by making comparisons between the customer data and the test data in an iterative process. The iterative processes change test data and compare not only customer data with test data but also compare data from prior iterations with current data. There is a feedback loop for providing a comparison of how close or distant the testcases and workload profiling are from customer-like data and workloads in a particular test.
58 Citations
18 Claims
-
1. A method of comparing empirical system data for testcase and workload profiling, comprising:
-
gathering customer data from a customer system;
gathering test data from a test system corresponding to the customer data, the test system including testcases and workloads;
improving at least one testcase or at least one workload in the test system by making comparisons between the customer data and the test data in an iterative process. - View Dependent Claims (2, 3, 4)
-
-
5. A method for using comparisons of empirical system data for testcase and workload profiling, comprising:
-
receiving customer data from a customer system, the customer data including a plurality of customer activities;
gathering test data from a test system, the test system including a plurality of testcases and a plurality of workloads, the test data including a plurality of test activities, each test activity in the test activities corresponding to a customer activity in the customer activities;
determining whether a select test activity meets or exceeds the corresponding customer activity; and
changing a workload in the test system and gathering new test data, when the select test activity does not meet or exceed the corresponding customer activity. - View Dependent Claims (6, 7, 8, 9, 10, 11)
-
-
12. A system for using comparisons of empirical system data for testcase and workload profiling, comprising:
-
a customer system for providing customer data, the customer data including a plurality of customer activities;
a test system for providing test data, the test data including a plurality of testcases and a plurality of workloads, the test data including a plurality of test activities, each test activity in the test activities corresponding to a customer activity in the customer activities;
wherein the test system changes a workload in the test system and gathers new test data, when a select test activity does not meet or exceed a corresponding customer activity. - View Dependent Claims (13, 14, 15, 16)
-
-
17. A storage medium having instructions stored thereon to perform a method of comparing empirical system data for testcase and workload profiling, the method comprising:
-
gathering customer data from a customer system;
gathering test data from a test system corresponding to the customer data, the test system including testcases and workloads;
improving at least one testcase or at least one workload in the test system by making comparisons between the customer data and the test data in an iterative process.
-
-
18. A storage medium having instructions stored thereon to perform a method for using comparisons of empirical system data for testcase and workload profiling, the method comprising:
-
receiving customer data from a customer system, the customer data including a plurality of customer activities;
gathering test data from a test system, the test system including a plurality of testcases and a plurality of workloads, the test data including a plurality of test activities, each test activity in the test activities corresponding to a customer activity in the customer activities;
determining whether a select test activity meets or exceeds the corresponding customer activity; and
changing a workload in the test system and gathering new test data, when the select test activity does not meet or exceed the corresponding customer activity.
-
Specification