System and method for configuring database result logging for a test executive sequence

• US 7,146,572 B2
• Filed: 10/09/2001
• Issued: 12/05/2006
• Est. Priority Date: 10/09/2001
• Status: Active Grant

• Current Assignee: National Instruments Corporation (Emerson Electric Company)
• Original Assignee: National Instruments Corporation (Emerson Electric Company)
• Inventors: Richardson, Scott
• Primary Examiner(s): SAX, STEVEN PAUL
• Application Number:
  US09/974,267
• Publication Number:
  US 20030069876A1
• Time in Patent Office: 1,883 Days
• Field of Search: 707/100, 707/105, 707/102, 707/10, 707/5, 707/30, 707/1, 707/3, 707/2, 345/772, 345/802, 345/747, 345707-708, 715771-773, 715/969, 715/970, 715/762, 715/764, 715/968, 715/780, 715964-967, 715/746, 715/708, 714/33, 714/38, 718/100, 718/102, 718/103, 718/105, 718/104, 718/106, 718/107, 718/108, 717/128, 717/111, 702/119
• US Class Current: 715/771
• CPC Class Codes: G06F 16/2358 Change logging, detection, and notification replication G06F16/27

Abstract

A system and method for logging results for a test executive sequence to a database. The test executive software may be operable to receive user input to a graphical user interface (GUI) to specify desired database result logging criteria. In various embodiments, any of various result logging criteria may be specifiable. For example, the user input may specify a mapping of the results for the test executive sequence to the database tables. The user input may also specify criteria for limiting the amount of data logged to the database, e.g., by filtering the results that are logged in various ways. The test executive software may then log at least a portion of the execution results for the test executive sequence to a database, according to the specified result logging criteria.

Claims

1. A method for logging results for a test executive sequence to a database, the method comprising:

displaying a graphical user interface (GUI) for specifying criteria for logging results for the test executive sequence to the database;

receiving user input to the GUI specifying desired result logging criteria;

executing the test executive sequence, wherein said executing the test executive sequence includes executing a plurality of steps in the test executive sequence, wherein each of the steps executes to produce one or more results, wherein the steps include a first step that calls a user-supplied code module, wherein the one or more results produced by the first step include one or more results produced by execution of the user-supplied code module; and

logging the results of the steps to the database according to the specified result logging criteria.

2. The method of claim 1,

wherein the test executive sequence executes under control of test executive software to test one or more units under test (UUTs).

3. The method of claim 1,

wherein the results produced by execution of the steps comprise one or more test results for a unit under test (UUT).

4. The method of claim 1,

wherein said receiving user input to the GUI specifying desired result logging criteria comprises receiving user input specifying a mapping of results for the test executive sequence to one or more database tables;

wherein said logging the results to the database comprises logging the results to the one or more database tables.

5. The method of claim 4, further comprising:

creating the one or more database tables.

6. The method of claim 1,

wherein said receiving user input to the GUI specifying desired result logging criteria comprises receiving user input to the GUI specifying criteria for limiting the amount of data logged to the database.

7. The method of claim 6,

wherein the criteria for limiting the amount of data logged to the database is based on one or more of:

a data type;

or

a step type.

8. The method of claim 1,

wherein said receiving user input to the GUI specifying desired result logging criteria comprises receiving user input to the GUI specifying a subset of the results for the test executive sequence to log to the database.

9. The method of claim 1,

wherein the steps comprise steps of different step types;

wherein said receiving user input to the GUI specifying desired result logging criteria comprises receiving user input to the GUI specifying different result logging criteria for different step types;

wherein said logging the results to the database according to the specified result logging criteria comprises logging different results to the database for steps of different step types.

10. The method of claim 1,

wherein one or more of the results have an associated property;

wherein said receiving user input to the GUI specifying desired result logging criteria comprises receiving user input to the GUI specifying that a first property must exist for a first result in order for the first result to be logged to the database.

11. The method of claim 1,

wherein said receiving user input to the GUI specifying desired result logging criteria comprises receiving user input specifying a precondition expression for one or more of the steps;

wherein, for each step having a precondition expression, results of the step are logged to the database only if the precondition expression for the step evaluates to True.

12. The method of claim 1,

wherein said receiving user input to the GUI specifying desired result logging criteria comprises receiving user input to the GUI defining one or more statements to apply to results for the test executive sequence;

wherein said logging the results to the database according to the specified result logging criteria comprises applying the one or more statements to the results.

13. The method of claim 12, wherein said receiving user input to the GUI specifying desired result logging criteria further comprises:

for each statement, receiving user input to the GUI specifying filtering criteria for identifying results for which the statement applies; and

for each statement, receiving user input to the GUI specifying columns or parameters to be logged for each result for which the statement applies.

14. The method of claim 13,

wherein said receiving user input to the GUI specifying columns or parameters to be logged for each result for which the statement applies comprises receiving user input to the GUI comprises receiving user input specifying a mapping from results to columns.

15. A method for logging results for a test executive sequence to a database, the method comprising:

displaying a graphical user interface (GUI) for specifying criteria for logging results for the test executive sequence to the database;

receiving user input to the GUI specifying desired result logging criteria, wherein said receiving user input comprises receiving user input defining one or more statements to apply to results for the test executive sequence;

executing the test executive sequence, wherein said executing the test executive sequence produces one or more results;

applying the one or more statements to the one or more results for the test executive sequence, wherein said applying the one or more statements to the one or more results operates to log at least a subset of the results to the database.

16. The method of claim 15,

wherein said receiving user input to the GUI specifying desired result logging criteria further comprises receiving user input specifying filtering criteria for filtering the results to which to apply the one or more statements;

wherein, in applying the one or more statements to the one or more results for the test executive sequence, the one or more statements are applied only to results meeting the specified filtering criteria.

17. The method of claim 15, wherein said receiving user input to the GUI specifying desired result logging criteria further comprises:

for a first statement, receiving user input to the GUI specifying a first class of results to which to apply the statement;

wherein said applying the one or more statements to the one or more results for the test executive sequence comprises applying the first statement only to results of the first class.

18. A memory medium for logging results for a test executive sequence to a database, the memory medium comprising program instructions executable to:

display a graphical user interface (GUI) for specifying criteria for logging results for the test executive sequence to the database;

receive user input to the GUI specifying desired result logging criteria;

execute the test executive sequence, wherein said executing the test executive sequence includes executing a plurality of steps in the test executive sequence, wherein each of the steps executes to produce one or more results, wherein the steps include a first step that calls a user-supplied code module, wherein the one or more results produced by the first step include one or more results produced by execution of the user-supplied code module; and

log the results of the steps to the database according to the specified result logging criteria.

19. The memory medium of claim 18,

wherein the results produced by execution of the steps comprise one or more test results for a unit under test (UUT).

20. The memory medium of claim 18,

wherein said receiving user input to the GUI specifying desired result logging criteria comprises receiving user input specifying a mapping of results for the test executive sequence to one or more database tables;

wherein said logging the results to the database comprises logging the results to the one or more database tables.

21. The memory medium of claim 18,

wherein said receiving user input to the GUI specifying desired result logging criteria comprises receiving user input to the GUI specifying criteria for limiting the amount of data logged to the database.

22. The memory medium of claim 18,

wherein said receiving user input to the GUI specifying desired result logging criteria comprises receiving user input to the GUI specifying a subset of the results for the test executive sequence to log to the database.

23. The memory medium of claim 18,

wherein the steps comprise steps of different step types;

wherein said receiving user input to the GUI specifying desired result logging criteria comprises receiving user input to the GUI specifying different result logging criteria for different step types;

wherein said logging the results to the database according to the specified result logging criteria comprises logging different results to the database for steps of different step types.

24. The memory medium of claim 18,

wherein said receiving user input to the GUI specifying desired result logging criteria comprises receiving user input to the GUI defining one or more statements to apply to results for the test executive sequence;

wherein said logging the results to the database according to the specified result logging criteria comprises applying the one or more statements to the results.

25. The memory medium of claim 24, wherein said receiving user input to the GUI specifying desired result logging criteria further comprises:

for each statement, receiving user input to the GUI specifying filtering criteria for identifying results for which the statement applies; and

for each statement, receiving user input to the GUI specifying columns or

parameters to be logged for each result for which the statement applies.

26. The memory medium of claim 25,

wherein said receiving user input to the GUI specifying columns or parameters to be logged for each result for which the statement applies comprises receiving user input to the GUI comprises receiving user input specifying a mapping from results to columns.

27. A memory medium for logging results for a test executive sequence to a database, the memory medium comprising program instructions executable to:

display a graphical user interface (GUI) for specifying criteria for logging results for the test executive sequence to the database;

receive user input to the GUI specifying desired result logging criteria, wherein said receiving user input comprises receiving user input defining one or more statements to apply to results for the test executive sequence;

execute the test executive sequence, wherein said executing the test executive sequence produces one or more results;

apply the one or more statements to the one or more results for the test executive sequence, wherein said applying the one or more statements to the one or more results operates to log at least a subset of the results to the database.

28. The memory medium of claim 27,

wherein said receiving user input to the GUI specifying desired result logging criteria further comprises receiving user input specifying filtering criteria for filtering the results to which to apply the one or more statements;

wherein, in applying the one or more statements to the one or more results for the test executive sequence, the one or more statements are applied only to results meeting the specified filtering criteria.

29. The memory medium of claim 27, wherein said receiving user input to the GUI specifying desired result logging criteria further comprises:

for a first statement, receiving user input to the GUI specifying a first class of results to which to apply the statement;

wherein said applying the one or more statements to the one or more results for the test executive sequence comprises applying the first statement only to results of the first class.

30. A system comprising:

a processor;

a memory storing program instructions;

wherein the processor is operable to execute the program instructions to;

display a graphical user interface (GUI) for specifying criteria for logging results for a test executive sequence to a database;

receive user input to the GUI specifying desired result logging criteria;

execute the test executive sequence, wherein said executing the test executive sequence includes executing a plurality of steps in the test executive sequence, wherein each of the steps executes to produce one or more results, wherein the steps include a first step that calls a user-supplied code module, wherein the one or more results produced by the first step include one or more results produced by execution of the user-supplied code module; and

log the results of the steps to the database according to the specified result logging criteria.

31. The system of claim 30,

wherein the results produced by execution of the steps comprise one or more test results for a unit under test (UUT).

32. The system of claim 30,

wherein said receiving user input to the GUI specifying desired result logging criteria comprises receiving user input specifying a mapping of results for the test executive sequence to one or more database tables;

wherein said logging the results to the database comprises logging the results to the one or more database tables.

33. The system of claim 30,

wherein said receiving user input to the GUI specifying desired result logging criteria comprises receiving user input to the GUI specifying criteria for limiting the amount of data logged to the database.

34. The system of claim 30,

wherein said receiving user input to the GUI specifying desired result logging criteria comprises receiving user input to the GUI specifying a subset of the results for the test executive sequence to log to the database.

35. The system of claim 30,

wherein the steps comprise steps of different step types;

wherein said receiving user input to the GUI specifying desired result logging criteria comprises receiving user input to the GUI specifying different result logging criteria for different step types;

wherein said logging the results to the database according to the specified result logging criteria comprises logging different results to the database for steps of different step types.

36. The system of claim 30,

wherein said receiving user input to the GUI specifying desired result logging criteria comprises receiving user input to the GUI defining one or more statements to apply to results for the test executive sequence;

wherein said logging the results to the database according to the specified result logging criteria comprises applying the one or more statements to the results.