Declarative test result validation
First Claim
Patent Images
1. A method comprising:
- receiving, by a processing device, a test grammar specific to a domain of a device under test;
receiving, by the processing device, a plurality of test rules specific to a type of the device under test, wherein the plurality of test rules are declarative statements defined using the test grammar for a test to be executed on the device;
determining, by the processing device, whether each of the plurality of the test rules is supported by the test grammar;
translating, by the processing device, each of the plurality of test rules into executable code using the test grammar when it is determined that each of the plurality of test rules are supported by the test grammar, wherein the plurality of test rules indicate expected test results of the test executed on the device under test; and
validating, by the processing device, generated test results of the device under test using the executable code, wherein the validating comprises comparing the generated test results with the expected test results using the test rules specifying number of messages resulting from the expected test results, property of a message from the expected test results and content of the message from the expected test results.
1 Assignment
0 Petitions
Accused Products
Abstract
A test controller translates test rules into executable code and validates the test results using the executable code. The test controller translates the test rules using a test grammar. The test rules are used to indicate expected test results of a device under test. The test controller further generates the test results by executing test instructions. In addition, the test controller uses the test grammar to validate the test rules.
17 Citations
20 Claims
-
1. A method comprising:
-
receiving, by a processing device, a test grammar specific to a domain of a device under test; receiving, by the processing device, a plurality of test rules specific to a type of the device under test, wherein the plurality of test rules are declarative statements defined using the test grammar for a test to be executed on the device; determining, by the processing device, whether each of the plurality of the test rules is supported by the test grammar; translating, by the processing device, each of the plurality of test rules into executable code using the test grammar when it is determined that each of the plurality of test rules are supported by the test grammar, wherein the plurality of test rules indicate expected test results of the test executed on the device under test; and validating, by the processing device, generated test results of the device under test using the executable code, wherein the validating comprises comparing the generated test results with the expected test results using the test rules specifying number of messages resulting from the expected test results, property of a message from the expected test results and content of the message from the expected test results. - View Dependent Claims (2, 3, 4, 5, 6, 7)
-
-
8. A non-transitory computer readable storage medium having instructions stored thereon that, when executed by a processing device, cause the processing device to perform operations comprising:
-
receiving, by a processing device, a test grammar specific to a domain of a device under test; receiving, by the processing device, a plurality of test rules specific to a type of the device under test, wherein the plurality of test rules are declarative statements defined using the test grammar for a test to be executed on the device; determining, by the processing device, whether each of the plurality of the test rules is supported by the test grammar; translating, by the processing device, each of the plurality of test rules into executable code using the test grammar when it is determined that each of the plurality of test rules are supported by the test grammar, wherein the plurality of test rules indicate expected test results of the test executed on the device under test; and validating, by the processing device, generated test results of the device under test using the executable code, wherein the validating comprises comparing the generated test results with the expected test results using the test rules specifying number of messages resulting from the expected test results, property of a message from the expected test results and content of the message from the expected test results. - View Dependent Claims (9, 10, 11, 12, 13, 14)
-
-
15. A system comprising:
-
a memory; and a processing device coupled to the memory to receive instructions from the memory to; receive a test grammar specific to a domain of a device under test; receive a plurality of test rules specific to a type of the device under test, wherein the plurality of test rules are declarative statements defined using the test grammar for a test to be executed on the device; determine whether each of the plurality of the test rules is supported by the test grammar; translate each of the plurality of test rules into executable code using the test grammar when it is determined that each of the plurality of test rules are supported by the test grammar, wherein the plurality of test rules indicate expected test results of the test executed on the device under test; and validate generated test results of the device under test using the executable code, wherein the validating comprises compare the generated test results with the expected test results using the test rules specifying number of messages resulting from the expected test results, property of a message from the expected test results and content of the message from the expected test results. - View Dependent Claims (16, 17, 18, 19, 20)
-
Specification