Methods, systems, and computer readable media for automated generation of test files and testing network equipment using same

• US 10,268,570 B2
• Filed: 05/05/2016
• Issued: 04/23/2019
• Est. Priority Date: 05/05/2016
• Status: Active Grant

• Current Assignee: Oracle International Corporation (Oracle Corporation)
• Original Assignee: Oracle International Corporation (Oracle Corporation)
• Inventors: Morris, Robert Michael
• Primary Examiner(s): Chen, Qing
• Assistant Examiner(s): Thatcher, Clint
• Application Number:
  US15/147,887
• Publication Number:
  US 20170322873A1
• Time in Patent Office: 1,083 Days
• Field of Search: 717124
• CPC Class Codes: G06F 11/22 Detection or location of defective computer hardware by testing during standby operation or during idle time, e.g. start-up testing
• CPC Class Codes: G06F 11/263 Generation of test inputs, e.g. test vectors, patterns or sequences ; with adaptation of the tested hardware for testability with external testers
• CPC Class Codes: G06F 11/3668 Software testing software testing in telephone exchanges H04M3/242, testing of hardware G06F11/22
• CPC Class Codes: G06F 11/3684 for test design, e.g. generating new test cases
• CPC Class Codes: H04L 41/00 Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
• CPC Class Codes: H04L 41/0266 using meta-data, objects or commands for formatting management information, e.g. using eXtensible markup language [XML]
• CPC Class Codes: H04L 43/50 Testing arrangements

Abstract

The subject matter described herein includes methods, systems, and computer readable media for automated generation of test files and for related testing. According to one method, the method includes receiving a configuration file, where the configuration file indicates a test case or a test plan to be generated, wherein the configuration file includes a feature identifier or a bug identifier and information about a system under test (SUT). The method also includes generating at least one test file based on the configuration file, wherein the at least one test file is for testing a feature or a bug in the SUT associated with the feature identifier or the bug identifier in the configuration file. The method further includes generating at least one directory based on the configuration file and storing the at least one test file in the at least one directory. The method also includes testing the feature or bug in the SUT using the at least one test file.

Claims

1. A method for automated generation of test files and for related testing, the method comprising:

at a test file generator, wherein the test file generator is implemented using the at least one processor, wherein the test file generator is configured for automating the generation of directories for storing test files based on a configuration file;

receiving the configuration file, where the configuration file indicates a test case or a test plan to be generated, wherein the configuration file includes a feature identifier or a bug identifier and information about a system under test (SUT), wherein the configuration file includes a plurality of test action data elements indicating a sequence of test actions for testing software of the SUT, a plurality of path data elements indicating directories for storing test files, and a plurality of test input data elements indicating valid and invalid input for testing;

generating the test files based on the configuration file and at least one test file template, wherein generating the test files includes parsing the configuration file, identifying the data elements in the configuration file, and using the identified data elements and the at least one test file template to generate the test files, wherein a first test file generated contains the sequence of test actions for testing a feature or a bug in the SUT associated with the feature identifier or the bug identifier in the configuration file, wherein a second test file generated contains valid input for testing the SUT, and wherein a third test file generated contains invalid input for testing the SUT;

generating the directories in a file system based on the configuration file, wherein generating the directories includes generating, based on a first path data element of the plurality of path data elements, a first directory for storing the first test file and generating, based on a second path data element of the plurality of path data elements, a subdirectory of the first directory for storing the second test file and the third test file, wherein the generated directories are in a hierarchical directory structure associated with the feature identifier or the bug identifier in the configuration file, wherein each of the generated directories are named using a format that indicates the feature or the bug to be tested;

storing the test files in the directories, wherein storing the files in the directories includes storing the first test file in the first directory and storing, in the subdirectory of the first directory, the second test file and the third test file, wherein the first test file is named using a format that indicates the feature or the bug to be tested associated with the feature identifier or the bug identifier in the configuration file, wherein the second test file is named using a format that indicates that the second test file includes valid input, and wherein the third test file is named using a format that indicates that the third test file includes invalid input; and

testing the feature or bug in the SUT using the test files, wherein testing the feature or bug in the SUT includes executing, by at least one computer, the sequence of test actions from the first test file using the valid input from the second test file and the invalid input from the third test file.

2. The method of claim 1 wherein the configuration file uses an initialization (INI) file format.

3. The method of claim 1 wherein the configuration file includes metadata for describing a test process, test requirements, bug information, or feature information.

4. The method of claim 1 wherein the SUT includes a network node, a network device, a Diameter signaling agent, a platform distribution system, a virtual operating environment, a platform management and configuration system, or an operating system.

5. The method of claim 1 wherein at least one of the test files uses an extensible markup language (XML) based file format or a timed text markup language (TTML) file format.

6. The method of claim 1 wherein the test plan includes one or more test cases.

7. The method of claim 1 wherein the test files and the directories are named using information stored in the configuration file.

8. A system for automated generation of test files and for related testing, the system comprising:

at least one processor;

a test file generator, wherein the test file generator is implemented using the at least one processor, wherein the test file generator is configured for automating the generation of directories for storing test files based on a configuration file, wherein the test file generator is configured to receive the configuration file, where the configuration file indicates a test case or a test plan to be generated, wherein the configuration file includes a feature identifier or a bug identifier and information about a system under test (SUT), wherein the configuration file includes a plurality of test action data elements indicating a sequence of test actions for testing software of the SUT, a plurality of path data elements indicating directories for storing test files, and a plurality of test input data elements indicating valid and invalid input for testing, to generate the test files based on the configuration file and at least one test file template, wherein generating the test files includes parsing the configuration file, identifying the data elements in the configuration file, and using the identified data elements and the at least one test file template to generate the test files, wherein a first test file generated contains the sequence of test actions for testing a feature or a bug in the SUT associated with the feature identifier or the bug identifier in the configuration file, wherein a second test file generated contains valid input for testing the SUT, and wherein a third test file generated contains invalid input for testing the SUT, to generate the directories in a file system based on the configuration file, wherein generating the directories includes generating, based on a first path data element of the plurality of path data elements, a first directory for storing the first test file and generating, based on a second path data element of the plurality of path data elements, a subdirectory of the first directory for storing the second test file and the third test file, wherein the generated directories are in a hierarchical directory structure associated with the feature identifier or the bug identifier in the configuration file, wherein each of the generated directories are named using a format that indicates the feature or the bug to be tested, and to store the test files in the directories, wherein storing the files in the directories includes storing the first test file in the first directory and storing, in the subdirectory of the first directory, the second test file and the third test file, wherein the first test file is named using a format that indicates the feature or the bug to be tested associated with the feature identifier or the bug identifier in the configuration file, wherein the second test file is named using a format that indicates that the second test file includes valid input, and wherein the third test file is named using a format that indicates that the third test file includes invalid input; and

a test controller for testing the feature or bug in the SUT using the test files, wherein testing the feature or bug in the SUT includes executing, by at least one computer, the sequence of test actions from the first test file using the valid input from the second test file and the invalid input from the third test file.

9. The system of claim 8 wherein the configuration file uses an initialization (INI) file format.

10. The system of claim 8 wherein the configuration file includes metadata for describing a test process, test requirements, bug information, or feature information.

11. The system of claim 8 wherein the SUT includes a network node, a network device, a Diameter signaling agent, a platform distribution system, a virtual operating environment, a platform management and configuration system, or an operating system.

12. The system of claim 8 wherein at least one of the test files uses an extensible markup language (XML) based file format or a timed text markup language (TTML) file format.

13. The system of claim 8 wherein the test plan includes one or more test cases.

14. The system of claim 8 wherein the test file generator is configured to name the test files and the directories using information stored in the configuration file.

15. A non-transitory computer readable medium comprising computer executable instructions that when executed by at least one processor of a computer cause the computer to perform steps comprising:

at a test file generator, wherein the test file generator is implemented using the at least one processor, wherein the test file generator is configured for automating the generation of directories for storing test files based on a configuration file;

receiving the configuration file, where the configuration file indicates a test case or a test plan to be generated, wherein the configuration file includes a feature identifier or a bug identifier and information about a system under test (SUT), wherein the configuration file includes a plurality of test action data elements indicating a sequence of test actions for testing software of the SUT, a plurality of path data elements indicating directories for storing test files, and a plurality of test input data elements indicating valid and invalid input for testing;

generating the test files based on the configuration file and at least one test file template, wherein generating the test files includes parsing the configuration file, identifying the data elements in the configuration file, and using the identified data elements and the at least one test file template to generate the test files, wherein a first test file generated contains the sequence of test actions for testing a feature or a bug in the SUT associated with the feature identifier or the bug identifier in the configuration file, wherein a second test file generated contains valid input for testing the SUT, and wherein a third test file generated contains invalid input for testing the SUT;

generating the directories in a file system based on the configuration file, wherein generating the directories includes generating, based on a first path data element of the plurality of path data elements, a first directory for storing the first test file and generating, based on a second path data element of the plurality of path data elements, a subdirectory of the first directory for storing the second test file and the third test file, wherein the generated directories are in a hierarchical directory structure associated with the feature identifier or the bug identifier in the configuration file, wherein each of the generated directories are named using a format that indicates the feature or the bug to be tested;

storing the test files in the directories, wherein storing the files in the directories includes storing the first test file in the first directory and storing, in the subdirectory of the first directory, the second test file and the third test file, wherein the first test file is named using a format that indicates the feature or the bug to be tested associated with the feature identifier or the bug identifier in the configuration file, wherein the second test file is named using a format that indicates that the second test file includes valid input, and wherein the third test file is named using a format that indicates that the third test file includes invalid input; and

testing the feature or bug in the SUT using the test files, wherein testing the feature or bug in the SUT includes executing, by at least one computer, the sequence of test actions from the first test file using the valid input from the second test file and the invalid input from the third test file.

16. The non-transitory computer readable medium of claim 15 wherein the configuration file uses an initialization (INI) file format.