System and method for configuring database result logging for a test executive sequence

• US 20030069876A1
• Filed: 10/09/2001
• Published: 04/10/2003
• Est. Priority Date: 10/09/2001
• Status: Active Grant

• Current Assignee: National Instruments Corporation (Emerson Electric Company)
• Original Assignee: National Instruments Corporation (Emerson Electric Company)
• Inventors: Richardson, Scott
• Granted Patent: US 7,146,572 B2
• Time in Patent Office: Days
• US Class Current: 707/1
• CPC Class Codes: G06F 16/2358 Change logging, detection, and notification replication G06F16/27

Abstract

A system and method for logging results for a test executive sequence to a database. The test executive software may be operable to receive user input to a graphical user interface (GUI) to specify desired database result logging criteria. In various embodiments, any of various result logging criteria may be specifiable. For example, the user input may specify a mapping of the results for the test executive sequence to the database tables. The user input may also specify criteria for limiting the amount of data logged to the database, e.g., by filtering the results that are logged in various ways. The test executive software may then log at least a portion of the execution results for the test executive sequence to a database, according to the specified result logging criteria.

Claims

1. A method for logging results for a test executive sequence to a database, the method comprising:

displaying a graphical user interface (GUI) for specifying criteria for logging results for the test executive sequence to the database;

receiving user input to the GUI specifying desired result logging criteria;

executing the test executive sequence, wherein said executing the test executive sequence produces one or more results; and

logging the results to the database according to the specified result logging criteria.

2. The method of claim 1,

wherein the test executive sequence executes under control of test executive software to test one or more units under test (UUT).

3. The method of claim 1,

wherein said executing the test executive sequence includes executing a plurality of test executive steps in the test executive sequence, wherein each executed test executive step produces one or more results.

4. The method of claim 3,

wherein the test executive sequence includes a first test executive step;

wherein, during execution of the first test executive step, the first test executive step is operable to call a user-supplied code module;

wherein results for the first test executive step are produced by execution of the user-supplied code module.

5. The method of claim 1,

wherein the results produced by execution of the test executive sequence comprise one or more of:

a result for a step in the test executive sequence;

a result for a unit under test (UUT).

6. The method of claim 1,

wherein said receiving user input to the GUI specifying desired result logging criteria comprises receiving user input specifying a mapping of results for the test executive sequence to one or more database tables;

wherein said logging the results to the database comprises logging the results to the one or more database tables.

7. The method of claim 6, further comprising:

creating the one or more database tables.

8. The method of claim 1,

wherein said receiving user input to the GUI specifying desired result logging criteria comprises receiving user input to the GUI specifying criteria for limiting the amount of data logged to the database.

9. The method of claim 8,

wherein the criteria for limiting the amount of data logged to the database is based on one or more of:

a data type;

or

a step type.

10. The method of claim 1,

wherein said receiving user input to the GUI specifying desired result logging criteria comprises receiving user input to the GUI specifying a subset of the results for the test executive sequence to log to the database.

11. The method of claim 1,

wherein the test executive sequence comprise test executive steps of different step types;

wherein said receiving user input to the GUI specifying desired result logging criteria comprises receiving user input to the GUI specifying different result logging criteria for different step types;

wherein said logging the results to the database according to the specified result logging criteria comprises logging different results to the database for steps of different step types.

12. The method of claim 1,

wherein one or more of the results have an associated property;

wherein said receiving user input to the GUI specifying desired result logging criteria comprises receiving user input to the GU specifying that a first property must exist for a first result in order for the first result to be logged to the database.

13. The method of claim 1,

wherein the test executive sequence comprises a plurality of test executive steps;

wherein said executing the test executive sequence includes executing the plurality of test executive steps, wherein each executed test executive step produces one or more results;

wherein said receiving user input to the GUI specifying desired result logging criteria comprises receiving user input specifying a precondition expression for one or more of the test executive steps;

wherein, for each test executive step having a precondition expression, results of the step are logged to the database only if the precondition expression for the step evaluates to True.

14. The method of claim 1,

wherein said receiving user input to the GUI specifying desired result logging criteria comprises receiving user input to the GUI defining one or more statements to apply to results for the test executive sequence;

wherein said logging the results to the database according to the specified result logging criteria comprises applying the one or more statements to the results.

15. The method of claim 14, wherein said receiving user input to the GUI specifying desired result logging criteria further comprises:

for each statement, receiving user input to the GUI specifying filtering criteria for identifying results for which the statement applies; and

for each statement, receiving user input to the GUI specifying columns or parameters to be logged for each result for which the statement applies.

16. The method of claim 15,

wherein said receiving user input to the GUI specifying columns or parameters to be logged for each result for which the statement applies comprises receiving user input to the GUI comprises receiving user input specifying a mapping from results to columns.

17. A method for logging results for a test executive sequence to a database, the method comprising:

displaying a graphical user interface (GUI) for specifying criteria for logging results for the test executive sequence to the database;

receiving user input to the GUI specifying desired result logging criteria, wherein said receiving user input comprises receiving user input defining one or more statements to apply to results for the test executive sequence;

executing the test executive sequence, wherein said executing the test executive sequence produces one or more results;

applying the one or more statements to the one or more results for the test executive sequence, wherein said applying the one or more statements to the one or more results operates to log at least a subset of the results to the database.

18. The method of claim 17,

wherein said receiving user input to the GUI specifying desired result logging criteria further comprises receiving user input specifying filtering criteria for filtering the results to which to apply the one or more statements;

wherein, in applying the one or more statements to the one or more results for the test executive sequence, the one or more statements are applied only to results meeting the specified filtering criteria.

19. The method of claim 17, wherein said receiving user input to the GUI specifying desired result logging criteria further comprises:

for a first statement, receiving user input to the GUI specifying a first class of results to which to apply the statement;

wherein said applying the one or more statements to the one or more results for the test executive sequence comprises applying the first statement only to results of the first class.

20. A method for logging a result set to a database, the method comprising:

displaying a graphical user interface (GUI) for specifying criteria for logging the result set to the database;

receiving user input to the GUI specifying desired result logging criteria, wherein said receiving user input comprises receiving user input defining one or more statements to apply to the result set;

generating the result set;

applying the one or more statements to the result set, wherein said applying the one or more statements to the result set operates to log at least a subset of the result set to the database.

21. The method of claim 20,

wherein the GUI is specialized for specifying criteria for logging results for a test executive sequence to the database;

wherein said generating the result set comprises executing a test executive sequence to generate one or more results;

wherein said logging at least a subset of the result set to the database comprises logging at least a portion of the one or more results for the test executive sequence to the database.

22. A memory medium for logging results for a test executive sequence to a database, the memory medium comprising program instructions executable to:

display a graphical user interface (GUI) for specifying criteria for logging results for the test executive sequence to the database;

receive user input to the GUI specifying desired result logging criteria;

execute the test executive sequence, wherein said executing the test executive sequence produces one or more results; and

log the results to the database according to the specified result logging criteria.

23. The memory medium of claim 22,

wherein said executing the test executive sequence includes executing a plurality of test executive steps in the test executive sequence, wherein each executed test executive step produces one or more results.

24. The memory medium of claim 22,

wherein the results produced by execution of the test executive sequence comprise one or more of:

a result for a step in the test executive sequence;

a result for a unit under test (UUT).

25. The memory medium of claim 22,

wherein said receiving user input to the GUI specifying desired result logging criteria comprises receiving user input specifying a mapping of results for the test executive sequence to one or more database tables;

wherein said logging the results to the database comprises logging the results to the one or more database tables.

26. The memory medium of claim 22,

wherein said receiving user input to the GUI specifying desired result logging criteria comprises receiving user input to the GUI specifying criteria for limiting the amount of data logged to the database.

27. The memory medium of claim 22,

wherein said receiving user input to the GUI specifying desired result logging criteria comprises receiving user input to the GUI specifying a subset of the results for the test executive sequence to log to the database.

28. The memory medium of claim 22,

wherein the test executive sequence comprise test executive steps of different step types;

wherein said receiving user input to the GUI specifying desired result logging criteria comprises receiving user input to the GUI specifying different result logging criteria for different step types;

wherein said logging the results to the database according to the specified result logging criteria comprises logging different results to the database for steps of different step types.

29. The memory medium of claim 22,

wherein said receiving user input to the GUI specifying desired result logging criteria comprises receiving user input to the GUI defining one or more statements to apply to results for the test executive sequence;

wherein said logging the results to the database according to the specified result logging criteria comprises applying the one or more statements to the results.

30. The memory medium of claim 29, wherein said receiving user input to the GUI specifying desired result logging criteria further comprises:

for each statement, receiving user input to the GUI specifying filtering criteria for identifying results for which the statement applies; and

for each statement, receiving user input to the GUI specifying columns or parameters to be logged for each result for which the statement applies.

31. The memory medium of claim 30,

wherein said receiving user input to the GUI specifying columns or parameters to be logged for each result for which the statement applies comprises receiving user input to the GUI comprises receiving user input specifying a mapping from results to columns.

32. A memory medium for logging results for a test executive sequence to a database, the memory medium comprising program instructions executable to:

display a graphical user interface (GUI) for specifying criteria for logging results for the test executive sequence to the database;

receive user input to the GUI specifying desired result logging criteria, wherein said receiving user input comprises receiving user input defining one or more statements to apply to results for the test executive sequence;

execute the test executive sequence, wherein said executing the test executive sequence produces one or more results;

apply the one or more statements to the one or more results for the test executive sequence, wherein said applying the one or more statements to the one or more results operates to log at least a subset of the results to the database.

33. The memory medium of claim 32,

wherein said receiving user input to the GUI specifying desired result logging criteria further comprises receiving user input specifying filtering criteria for filtering the results to which to apply the one or more statements;

wherein, in applying the one or more statements to the one or more results for the test executive sequence, the one or more statements are applied only to results meeting the specified filtering criteria.

34. The memory medium of claim 32, wherein said receiving user input to the GUI specifying desired result logging criteria further comprises:

for a first statement, receiving user input to the GUI specifying a first class of results to which to apply the statement;

wherein said applying the one or more statements to the one or more results for the test executive sequence comprises applying the first statement only to results of the first class.

35. A system comprising:

a processor;

a memory storing program instructions;

wherein the processor is operable to execute the program instructions to;

display a graphical user interface (GUI) for specifying criteria for logging results for a test executive sequence to a database;

receive user input to the GUI specifying desired result logging criteria;

execute the test executive sequence, wherein said executing the test executive sequence produces one or more results; and

log the results to the database according to the specified result logging criteria.