Predictive model scoring to optimize test case order in real time

• US 10,592,808 B2
• Filed: 10/06/2016
• Issued: 03/17/2020
• Est. Priority Date: 07/07/2015
• Status: Active Grant

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Smith, Kevin B., Thompson, Andrew J., Waddling, David R.
• Primary Examiner(s): Wong, Lut
• Application Number:
  US15/287,247
• Publication Number:
  US 20170017893A1
• Time in Patent Office: 1,258 Days
• Field of Search: 706 46
• CPC Class Codes: G06F 11/261 by simulating additional hardware, e.g. fault simulation
• CPC Class Codes: G06F 11/3664 Environments for testing or debugging software
• CPC Class Codes: G06F 11/3684 for test design, e.g. generating new test cases
• CPC Class Codes: G06F 11/3688 for test execution, e.g. scheduling of test suites
• CPC Class Codes: G06F 11/3692 for test results analysis
• CPC Class Codes: G06F 16/14 Details of searching files based on file metadata
• CPC Class Codes: G06F 16/156 Query results presentation
• CPC Class Codes: G06F 16/17 Details of further file system functions
• CPC Class Codes: G06F 16/24578 using ranking
• CPC Class Codes: G06F 16/2465 Query processing support for facilitating data mining operations in structured databases
• CPC Class Codes: G06F 16/248 Presentation of query results
• CPC Class Codes: G06N 20/00 Machine learning
• CPC Class Codes: G06N 5/022 Knowledge engineering; Knowledge acquisition
• CPC Class Codes: G06N 7/01 Probabilistic graphical models, e.g. probabilistic networks
• CPC Class Codes: G06N 99/00 Subject matter not provided for in other groups of this subclass

Abstract

An approach for predictively scoring test case results in real-time. Test case results associated with a test run are received by a software testing environment. Using predictive statistical models, test case results and attribute relationships are matched against model rules and test case history. A statistical correlation and confidence parameter provide the ability to generate test case relationships for predicting the outcome of other test cases in the test run. The test case relationships are transformed into scoring results and output for the further processing.

Claims

1. A computer program product for predictively scoring test case results in real-time, the computer program product comprising:

one or more computer readable storage media and program instructions stored on the one or more computer readable storage media, the program instructions comprising;

program instructions to receive one or more test case results associated with a test run, wherein the one or more test case results comprise attributes associated with one or more test case relationships;

program instructions to determine one or more test case relationships based on at least one of one or more predictive statistical models and one or more attributes, wherein predictive statistical models comprise one or more of a priori, regression, clustering, tree, and neural network, wherein the one or more predictive statistical models are operational on the one or more test case results, and wherein determining the one or more test case relationships comprises data-mining historical test results to organize related attributes statistically;

program instructions to transform the one or more test case relationships into one or more scoring results based on predetermined correlation criteria, wherein predetermined correlation criteria comprise one or more of predetermined association rules and one or more predictive statistical models; and

program instructions to output the one or more scoring results for further processing, wherein the one or more scoring results comprise one or more of single-value output comprising a test case for execution, multi-value output comprising a plurality of test cases and statistical correlation and confidence ranking for execution, and multi-value prioritized output comprising a prioritized plurality of test cases for execution.