Method and apparatus for analyzing test results obtained by applying a binary table and a suite of test scripts to a test subsystem control facility for a distributed systems network
First Claim
1. A method of analyzing test results obtained by applying a binary table and a suite of test scripts to a test subsystem control facility for a distributed systems network, said binary table expressing a proposed set of requirements for a proposed subsystem control facility, said suite of test scripts being prepared from a first knowledgebase containing test generation information relating to a predetermined set of subsystem requirements, said method comprising the steps of:
- (a) providing a second knowledgebase containing said predetermined set of subsystem requirements;
(b) comparing the test results with said predetermined set of subsystem requirements in said second knowledgebase; and
(c) indicating the relative conformance of said proposed set of requirements with said predetermined set of subsystem requirements;
wherein said test results include the results of positive tests for testing the ability of said proposed subsystem control facility set of requirements to process valid commands and object types and negative tests for testing the ability of said proposed set of requirements to process invalid commands or object types.
4 Assignments
0 Petitions
Accused Products
Abstract
A technique for analyzing test results obtained by applying a binary table and a suite of test scripts to a test subsystem control facility for a distributed systems network. The binary table expresses a proposed set of requirements for a proposed subsystem control facility. The suite of test scripts is prepared from a knowledgebase containing test generation information relating to a predetermined global set of subsystem requirements. The test results are compared with the knowledgebase containing the predetermined set of subsystem requirements, and the relative performance of the proposed set of requirements with the predetermined set of subsystem requirements is graphically displayed or printed. The predetermined set of subsystem requirements includes rules governing the operation of a subject network and a library of permitted commands and object types. The proposed set of requirements includes paired selections of commands and object types from the library. The test results obtained using at least some of the paired selections of commands and object types are compared with the corresponding predetermined set of subsystem requirements in the knowledgebase, and violations of the rules are specified. The library further includes object modifiers and attributes, and the proposed set of requirements further includes selected modifiers and attributes paired to objects. The nature of any non-conformance of the proposed set of requirements to the predetermined set of subsystem requirements is indicated, along with the correction required to establish conformance. Any non-conformance is also related expressly to the predetermined set of subsystem requirements.
69 Citations
27 Claims
-
1. A method of analyzing test results obtained by applying a binary table and a suite of test scripts to a test subsystem control facility for a distributed systems network, said binary table expressing a proposed set of requirements for a proposed subsystem control facility, said suite of test scripts being prepared from a first knowledgebase containing test generation information relating to a predetermined set of subsystem requirements, said method comprising the steps of:
-
(a) providing a second knowledgebase containing said predetermined set of subsystem requirements; (b) comparing the test results with said predetermined set of subsystem requirements in said second knowledgebase; and (c) indicating the relative conformance of said proposed set of requirements with said predetermined set of subsystem requirements; wherein said test results include the results of positive tests for testing the ability of said proposed subsystem control facility set of requirements to process valid commands and object types and negative tests for testing the ability of said proposed set of requirements to process invalid commands or object types. - View Dependent Claims (2, 3, 4, 5, 6, 7)
-
-
8. A method of analyzing test results obtained by applying a binary table and a suite of test scripts to a test subsystem control facility for a distributed systems network, said binary table expressing a proposed set of requirements for a proposed subsystem control facility and said suite of test scripts being prepared from a first knowledgebase containing test generation information relating to a predetermined set of subsystem requirements, said method comprising the steps of:
-
(a) providing a second knowledgebase containing said predetermined set of subsystem requirements; (b) comparing the test results with said predetermined set of subsystem requirements in said second knowledgebase, said step of comparing including the step of selecting individual test results for analysis; and (c) indicating the relative conformance of said proposed set of requirements with said predetermined set of subsystem requirements. - View Dependent Claims (9, 10, 11, 12, 13)
-
-
14. A system for analyzing test results obtained by applying a binary table and a suite of test scripts to a test subsystem control facility for a distributed systems network, said binary table expressing a proposed set of requirements for a proposed subsystem control facility, said suite of test scripts being prepared from a first knowledgebase containing test generation information relating to a predetermined set of subsystem requirements, said system comprising:
-
(a) means for providing a second knowledgebase containing said predetermined set of subsystem requirements; (b) means for comparing the test results with said predetermined set of subsystem requirements in said second knowledgebase; and (c) means for indicating the relative conformance of said proposed set of requirements with said predetermined set of subsystem requirements; wherein said test results include the results of positive tests for testing the ability of said proposed subsystem control facility set of requirements to process valid commands and object types and negative tests for testing the ability of said proposed set of requirements to process invalid commands or object types. - View Dependent Claims (15, 16, 17, 18, 19)
-
-
20. A system for analyzing test results obtained by applying a binary table and a suite of test scripts to a test subsystem control facility for a distributed systems network, said binary table expressing a proposed set of requirements for a proposed subsystem control facility, said suite of test scripts being prepared from a first knowledgebase containing test generation information relating to a predetermined set of subsystem requirements, said system comprising:
-
(a) means for providing a second knowledgebase containing said predetermined set of subsystem requirements; (b) means for comparing the test results with said predetermined set of subsystem requirements in said second knowledgebase, said comparing means including graphical user interface means for enabling a user to specify individual test results for analysis; and (c) means for indicating the relative conformance of said proposed set of requirements with said predetermined set of subsystem requirements. - View Dependent Claims (21, 22, 23, 24, 25)
-
-
26. A system for analyzing test results obtained by applying a binary table and a suite of test scripts to a test subsystem control facility for a distributed systems network, said binary table expressing a proposed set of requirements for a proposed subsystem control facility, said suite of test scripts being prepared from a first knowledgebase containing test generation information relating to a predetermined set of subsystem requirements, said predetermined set of subsystem requirements including a library of permitted commands and object types, said test results including the results of positive tests for testing the ability of the set of requirements to process valid commands and object types and negative tests for testing the ability of said proposed set of requirements to process invalid commands or object types, said system comprising:
-
(a) means for providing a second knowledgebase containing said predetermined set of subsystem requirements; (b) means for comparing the test results with said predetermined set of subsystem requirements in said second knowledgebase; (c) means for indicating the relative conformance of said proposed set of requirements with said predetermined set of subsystem requirements, said indicating means including means for reporting any failure of the proposed set of requirements to conform under the positive tests or the negative tests.
-
-
27. A computer program product comprising:
-
a computer usable medium having computer readable code embodied therein for analyzing test results obtained by applying a binary table and a suite of test scripts to a test subsystem control facility for a distributed systems network, said binary table expressing a proposed set of requirements for a proposed subsystem control facility, said suite of test scripts being prepared from a first knowledgebase containing test generation information relating to a predetermined set of subsystem requirements, the computer program product comprising; computer readable program code devices configured to cause a computer to effect comparing the test result with said predetermined set of subsystem requirements from a second knowledgebase; and computer readable program code devices configured to cause a computer to effect indicating the relative conformance of said proposed set of requirements with said predetermined set of subsystem requirements; wherein said test results include the results of positive tests for testing the ability of said proposed subsystem control facility set of requirements to process valid commands and object types and negative tests for testing the ability of said proposed set of requirements to process invalid commands or object types.
-
Specification