Predictive model scoring to optimize test case order in real time

• US 9,495,642 B1
• Filed: 02/03/2016
• Issued: 11/15/2016
• Est. Priority Date: 07/07/2015
• Status: Expired due to Fees

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Thompson, Andrew J., Waddling, David R., Smith, Kevin B.
• Primary Examiner(s): Wong, Lut
• Application Number:
  US15/014,486
• Time in Patent Office: 286 Days
• Field of Search: 706/46
• US Class Current: 1/1
• CPC Class Codes: G06F 11/261 by simulating additional hardware, e.g. fault simulation
• CPC Class Codes: G06F 11/3664 Environments for testing or debugging software
• CPC Class Codes: G06F 11/3684 for test design, e.g. generating new test cases
• CPC Class Codes: G06F 11/3688 for test execution, e.g. scheduling of test suites
• CPC Class Codes: G06F 11/3692 for test results analysis
• CPC Class Codes: G06F 16/14 Details of searching files based on file metadata
• CPC Class Codes: G06F 16/156 Query results presentation
• CPC Class Codes: G06F 16/17 Details of further file system functions
• CPC Class Codes: G06F 16/24578 using ranking
• CPC Class Codes: G06F 16/2465 Query processing support for facilitating data mining operations in structured databases
• CPC Class Codes: G06F 16/248 Presentation of query results
• CPC Class Codes: G06N 20/00 Machine learning
• CPC Class Codes: G06N 5/022 Knowledge engineering; Knowledge acquisition
• CPC Class Codes: G06N 7/01 Probabilistic graphical models, e.g. probabilistic networks
• CPC Class Codes: G06N 99/00 Subject matter not provided for in other groups of this subclass

Abstract

An approach for predictively scoring test case results in real-time. Test case results associated with a test run are received by a software testing environment. Using predictive statistical models, test case results and attribute relationships are matched against model rules and test case history. A statistical correlation and confidence parameter provide the ability to generate test case relationships for predicting the outcome of other test cases in the test run. The test case relationships are transformed into scoring results and output for the further processing.

Claims

1. A computer-implemented method for predictively scoring test case results in real-time, the method comprising:

receiving, by one or more computer processors, one or more test case results associated with a test run, wherein the one or more test case results comprise attributes associated with one or more test case relationships;

determining, by one or more computer processors, one or more test case relationships based on at least one of one or more predictive statistical models and one or more attributes, wherein predictive statistical models comprise one or more of a priori, regression, clustering, tree, and neural network, wherein the one or more predictive statistical models are operational on the one or more test case results, and wherein determining the one or more test case relationships comprises data-mining historical test results to organize related attributes statistically;

transforming, by one or more computer processors, the one or more test case relationships into one or more scoring results based on predetermined correlation criteria, wherein predetermined correlation criteria comprise one or more of predetermined association rules and one or more predictive statistical models; and

outputting, by one or more computer processors, the one or more scoring results for further processing, wherein the one or more scoring results comprise one or more of single-value output comprising a test case for execution, multi-value output comprising a plurality of test cases and statistical correlation and confidence ranking for execution, and multi-value prioritized output comprising a prioritized plurality of test cases for execution.