Auto-scheduling of tests

• US 20040093180A1
• Filed: 11/07/2002
• Published: 05/13/2004
• Est. Priority Date: 11/07/2002
• Status: Active Grant

• Current Assignee: National Instruments Corporation (Emerson Electric Company)
• Original Assignee: National Instruments Corporation (Emerson Electric Company)
• Inventors: Elizalde, Daniel, Grey, James A.
• Granted Patent: US 8,234,089 B2
• Time in Patent Office: Days
• US Class Current: 702/123
• CPC Class Codes: G06F 11/263 Generation of test inputs, e.g. test vectors, patterns or sequences ; with adaptation of the tested hardware for testability with external testers

Abstract

System and method for performing a multiple tests on each of one or more units, where each of the tests requires a respective resource of a plurality of resources. A first test is performed on a unit using a first resource. During performance of the first test, a search is made for a second test, requiring a second resource, where the second resource is not currently being used. If the second test is found, the second test is performed on the unit, or a second unit, using the second resource, substantially concurrently with at least a portion of the first test being performed on the unit. Performing a test includes locking the respective resource to exclude use by other tests, including acquiring the resource, and unlocking the resource upon completion of the test, including releasing the resource for use in performing the respective test on another of the units.

Claims

1. A computer-implemented method for performing a plurality of tests on each of a plurality of units, wherein each of the plurality of tests requires a respective resource of a plurality of resources, the method comprising:

for each respective unit of the plurality of units,

searching the plurality of tests to determine a respective test, wherein

     1) the respective test has not been performed on the respective unit, and

     2) the respective resource of the respective test is available for use;

if the respective test for the respective unit is found;

locking the respective resource of the respective test, wherein said locking comprises acquiring the respective resource;

performing the respective test on the respective unit; and

unlocking the respective resource of the respective test, wherein said unlocking comprises releasing the respective resource; and

wherein two or more of said respective tests on the respective units are performed substantially concurrently.

2. The method of claim 1, wherein said searching, said locking, said performing, and said unlocking are performed until one or more of:

each of the plurality of tests has been performed on each of the plurality of units; and

an ending condition is met.

3. The method of claim 1, further comprising:

if the respective test for the respective unit is not found;

continuing said searching until;

the respective test is found;

or

an ending condition is met;

4. The method of claim 3, wherein the ending condition comprises:

a time-out condition.

5. The method of claim 1, wherein the plurality of tests are comprised in a test executive sequence comprising:

at least one auto-schedule block, wherein the at least one auto-schedule block comprises;

a plurality of auto-scheduled sections, wherein each auto-scheduled section specifies a respective test of the plurality of tests, and a respective resource of the plurality of resources for use in performing the respective test.

6. The method of claim 5, wherein the at least one auto-schedule block comprises:

a begin step, wherein the begin step indicates initiation of the at least one auto-schedule block;

the plurality of auto-scheduled sections; and

an end step, wherein the end step indicates termination of the auto-schedule block.

7. The method of claim 6, wherein each of the plurality of auto-scheduled sections comprises:

a lock resource step, wherein the lock resource step indicates locking a resource;

a respective test of the plurality of tests, wherein the respective test uses the locked and acquired resource; and

an unlock resource step, wherein the unlock step indicates unlocking the resource.

8. The method of claim 1,

wherein said searching, said locking, said performing, and said unlocking are performed by a respective execution thread;

wherein each of the plurality of resources has associated with it a respective FIFO for storing threads waiting for the respective resource; and

wherein, said searching the plurality of tests to determine a respective test comprises each thread performing;

examining the plurality of resources to determine a free resource;

if a free resource is found, determining the respective test associated with the free resource; and

if no free resource is found,

determining a resource of the plurality of resources with fewest threads in the FIFO for that resource; and

adding the thread to the FIFO for the determined resource.

9. The method of claim 8, wherein said acquiring the respective resource comprises:

removing the respective thread from any other FIFOs storing the respective thread.

10. The method of claim 1, wherein one or more ordering constraints are imposed on at least a subset of the plurality of tests.

11. The method of claim 1,

wherein said searching comprises iteratively searching.

12. The method of claim 1, further comprising:

creating a test sequence in response to user input, wherein said creating the test sequence comprises;

receiving user input requesting an automatic scheduling feature; and

programmatically creating one or more steps in the test sequence to enable the automatic scheduling feature.

13. The method of claim 12, wherein the one or more steps comprise:

at least one auto-schedule block, wherein the at least one auto-schedule block comprises;

a plurality of auto-scheduled sections, wherein each auto-scheduled section specifies a respective test of the plurality of tests, and a respective resource of the plurality of resources for use in performing the respective test.

14. The method of claim 1,

wherein the plurality of tests are comprised in a selection structure comprising at least one auto-schedule block, and wherein the at least one auto-schedule block comprises:

a plurality of auto-scheduled sections, wherein each auto-scheduled section specifies a respective test of the plurality of tests, and a respective resource of the plurality of resources for use in performing the respective test.

15. The method of claim 14,

wherein the selection structure comprises a case statement;

and

wherein each of the plurality of auto-scheduled sections comprises a respective case in the case statement.

16. The method of claim 15,

wherein each respective case is selectable based on a label indicating the respective resource, where the respective resource is not currently in use.

17. A system for performing a plurality of tests on each of a plurality of units, wherein each of the plurality of tests requires a respective resource of a plurality of resources, the system comprising:

a processor; and

a memory medium coupled to the processor;

wherein the memory medium stores program instructions which are executable to;

for each respective unit of the plurality of units,

search the plurality of tests to determine a respective test, wherein

     1) the respective test has not been performed on the respective unit, and

     2) the respective resource of the respective test is available for use;

if the respective test for the respective unit is found;

lock the respective resource of the respective test, wherein said locking comprises acquiring the respective resource;

perform the respective test on the respective unit; and

unlock the respective resource of the respective test, wherein said unlocking comprises releasing the respective resource; and

wherein two or more of said respective tests on the respective units are performed substantially concurrently.

18. A carrier medium which stores program instructions for performing a plurality of tests on each of a plurality of units, wherein each of the plurality of tests requires a respective resource of a plurality of resources, wherein the program instructions are executable to perform:

for each respective unit of the plurality of units,

searching the plurality of tests to determine a respective test, wherein

     1) the respective test has not been performed on the respective unit, and

     2) the respective resource of the respective test is available for use;

if the respective test for the respective unit is found;

locking the respective resource of the respective test, wherein said locking comprises acquiring the respective resource;

performing the respective test on the respective unit; and

unlocking the respective resource of the respective test, wherein said unlocking comprises releasing the respective resource; and

wherein two or more of said respective tests on the respective units are performed substantially concurrently.

19. A computer-implemented method for performing a plurality of tests on each of a plurality of units, wherein each of the plurality of tests requires a respective resource of a plurality of resources, the method comprising:

performing a first test of the plurality of tests on a first unit using a first resource of the plurality of resources;

during said performing the first test, searching for a second test of the plurality of tests, wherein

     1) the second test requires a second resource of the plurality of resources, and

     2) the second resource is not currently being used; and

if the second test is found, then performing the second test on a second unit using the second resource;

wherein said performing the second test on the second unit is performed substantially concurrently with at least a portion of said performing the first test on the first unit.

20. The method of claim 19, wherein said performing a first test of the plurality of tests on a first unit using a first resource of the plurality of resources comprises:

locking the first resource to exclude use of the first resource by others of the plurality of tests, wherein said locking comprises acquiring the first resource for said performing the first test; and

unlocking the first resource upon completion of the first test, wherein said unlocking comprises releasing the first resource for use in performing the first test on another of the plurality of units.

21. The method of claim 19, wherein the plurality of tests are comprised in a test executive sequence comprising:

at least one auto-schedule block, wherein the at least one auto-schedule block comprises;

a plurality of auto-scheduled sections, wherein each auto-scheduled section specifies a respective test of the plurality of tests, and a respective resource of the plurality of resources for use in performing the respective test.

22. The method of claim 21, wherein the at least one auto-schedule block comprises:

a begin step, wherein the begin step indicates initiation of the at least one auto-schedule block;

the plurality of auto-scheduled sections; and

an end step, wherein the end step indicates termination of the auto-schedule block.

23. The method of claim 22, wherein each of the plurality of auto-scheduled sections comprises:

a lock resource step, wherein the lock resource step indicates locking a resource;

a respective test of the plurality of tests, wherein the respective test uses the locked and acquired resource; and

an unlock resource step, wherein the unlock step indicates unlocking the resource;

24. The method of claim 23, further comprising:

if the second test is not found, then iteratively searching the plurality of auto-scheduled sections until;

the second test is found;

or

a time-out occurs.

25. The method of claim 19, further comprising:

searching for a third test of the plurality of tests, wherein

     1) the third test requires a third resource of the plurality of resources, and

     2) the third resource is not currently being used; and

if the third test is found, then performing the third test on a third unit using the third resource;

wherein said performing the third test on the third unit is performed substantially concurrently with said performing the first test on the first unit and/or said performing the second test on the second unit.

26. The method of claim 19, further comprising:

completing said performing the first test on the first unit using the first resource, wherein said completing comprises unlocking and releasing the first resource for use by others of the plurality of tests; and

performing the first test on a different one of the plurality of units using the first resource.

27. The method of claim 26, further comprising:

searching for another test of the plurality of tests to be performed on the first unit, wherein

     1) said another test requires another resource of the plurality of resources, and

     2) said another resource is not currently being used; and

if said another test is found, then performing said another test on the first unit using said another resource;

wherein said performing said another test on the first unit is performed substantially concurrently with said performing the first test on the different one of the plurality of units.

28. The method of claim 19,

wherein the plurality of tests are comprised in a selection structure comprising at least one auto-schedule block, and wherein the at least one auto-schedule block comprises:

a plurality of auto-scheduled sections, wherein each auto-scheduled section specifies a respective test of the plurality of tests, and a respective resource of the plurality of resources for use in performing the respective test.

29. The method of claim 28,

wherein the selection structure comprises a case statement;

and

wherein each of the plurality of auto-scheduled sections comprises a respective case in the case statement.

30. The method of claim 29,

wherein each respective case is selectable based on a label indicating the respective resource, where the respective resource is not currently in use.

31. A system for performing a plurality of tests on each of a plurality of units, wherein each of the plurality of tests requires a respective resource of a plurality of resources, the system comprising:

a processor; and

a memory medium coupled to the processor;

wherein the memory medium stores program instructions which are executable to;

perform a first test of the plurality of tests on a first unit using a first resource of the plurality of resources;

while the first test is being performed, search for a second test of the plurality of tests, wherein the second test requires a second resource of the plurality of resources, and wherein the second resource is not currently being used; and

if the second test is found, then perform the second test on a second unit using the second resource;

wherein the second test is performed on the second unit and at least a portion of the first test is performed on the first unit substantially concurrently.

32. A carrier medium which stores program instructions for performing a plurality of tests on each of a plurality of units, wherein each of the plurality of tests requires a respective resource of a plurality of resources, wherein the program instructions are executable to perform:

performing a first test of the plurality of tests on a first unit using a first resource of the plurality of resources;

during said performing the first test, searching for a second test of the plurality of tests, wherein the second test requires a second resource of the plurality of resources, and wherein the second resource is not currently being used; and

if the second test is found, then performing the second test on a second unit using the second resource;

wherein said performing the second test on the second unit is performed substantially concurrently with at least a portion of said performing the first test on the first unit.

33. A system for performing a plurality of tests on each of a plurality of units, wherein each of the plurality of tests requires a respective resource of a plurality of resources, the system comprising:

means for performing a first test of the plurality of tests on a first unit using a first resource of the plurality of resources;

means for searching for a second test of the plurality of tests during said performing the first test, wherein the second test requires a second resource of the plurality of resources, and wherein the second resource is not currently being used; and

means for performing the second test on a second unit using the second resource if the second test is found;

wherein said performing the second test on the second unit is performed substantially concurrently with at least a portion of said performing the first test on the first unit.

34. A computer-implemented method for performing a plurality of tests on each of a plurality of units, wherein each of the plurality of tests requires a respective resource of a plurality of resources, the method comprising:

performing a first test of the plurality of tests on a first unit using a first resource of the plurality of resources;

during said performing the first test, identifying a second test of the plurality of tests that can be performed during said performing the first test of the plurality of tests, wherein the second test requires a second resource of the plurality of resources, and wherein the second resource is not currently being used; and

performing the second test on a second unit using the second resource;

wherein at least a portion of said performing the second test on the second unit is performed during said performing the first test.

35. A system for performing a plurality of tests on each of a plurality of units, wherein each of the plurality of tests requires a respective resource of a plurality of resources, the system comprising:

a processor; and

a memory medium coupled to the processor;

wherein the memory medium stores program instructions which are executable to;

perform a first test of the plurality of tests on a first unit using a first resource of the plurality of resources;

while the first test is being performed on the first unit, identify a second test of the plurality of tests that can be performed while the first test is being performed, wherein the second test requires a second resource of the plurality of resources, and wherein the second resource is not currently being used; and

perform the second test on a second unit using the second resource;

wherein at least a portion of the second test is performed on the second unit while the first test is performed on the first unit.

36. A carrier medium which stores program instructions for performing a plurality of tests on each of a plurality of units, wherein each of the plurality of tests requires a respective resource of a plurality of resources, wherein the program instructions are executable to perform:

performing a first test of the plurality of tests on a first unit using a first resource of the plurality of resources;

during said performing the first test, identifying a second test of the plurality of tests that can be performed during said performing the first test of the plurality of tests, wherein the second test requires a second resource of the plurality of resources, and wherein the second resource is not currently being used; and

performing the second test on a second unit using the second resource;

wherein at least a portion of said performing the second test on the second unit is performed during said performing the first test.

37. A computer-implemented method for performing a plurality of tests on a unit, wherein each of the plurality of tests requires a respective resource of a plurality of resources, the method comprising:

performing a first test of the plurality of tests on the unit using a first resource of the plurality of resources;

during said performing the first test, searching for a second test of the plurality of tests, wherein the second test requires a second resource of the plurality of resources, and wherein the second resource is not currently being used; and

if the second test is found, then performing the second test on the unit using the second resource;

wherein said performing the second test on the unit is performed substantially concurrently with at least a portion of said performing the first test on the unit.

38. The method of claim 37, wherein said performing a first test of the plurality of tests on the unit using a first resource of the plurality of resources comprises:

locking the first resource to exclude use of the first resource by others of the plurality of tests, wherein said locking comprises acquiring the first resource for said performing the first test; and

unlocking the first resource upon completion of the first test, wherein said unlocking comprises releasing the first resource for use in performing the first test on another of the plurality of units.

39. The method of claim 37, wherein the plurality of tests are comprised in a test executive sequence comprising:

at least one auto-schedule block, wherein the at least one auto-schedule block comprises;

a plurality of auto-scheduled sections, wherein each auto-scheduled section specifies a respective test of the plurality of tests, and a respective resource of the plurality of resources for use in performing the respective test.

40. The method of claim 39, wherein each of the plurality of auto-scheduled sections comprises:

a lock resource step, wherein the lock resource step indicates locking a resource;

a respective test of the plurality of tests, wherein the respective test uses the locked and acquired resource; and

an unlock resource step, wherein the unlock step indicates unlocking the resource.

41. The method of claim 40, further comprising:

if the second test is not found, then iteratively searching the plurality of auto-scheduled sections until;

the second test is found;

or

a time-out occurs.

42. The method of claim 37, further comprising:

completing said performing the first test on the first unit using the first resource, wherein said completing comprises unlocking and releasing the first resource for use by others of the plurality of tests; and

performing the first test on a different one of the plurality of units using the first resource.

43. The method of claim 42, further comprising:

searching for another test of the plurality of tests to be performed on the first unit, wherein

     1) said another test requires another resource of the plurality of resources, and

     2) said another resource is not currently being used; and

if said another test is found, then performing said another test on said another unit using said another resource;

wherein said performing said another test on said another unit is performed substantially concurrently with said performing the first test on the different one of the plurality of units.

44. The method of claim 37,

wherein the plurality of tests are comprised in a selection structure comprising at least one auto-schedule block, and wherein the at least one auto-schedule block comprises:

a plurality of auto-scheduled sections, wherein each auto-scheduled section specifies a respective test of the plurality of tests, and a respective resource of the plurality of resources for use in performing the respective test.

45. The method of claim 44,

wherein the selection structure comprises a case statement;

wherein each of the plurality of auto-scheduled sections comprises a respective case in the case statement; and

wherein each respective case is selectable based on a label indicating the respective resource, and wherein the respective resource is not currently in use.

46. A system for performing a plurality of tests on a unit, wherein each of the plurality of tests requires a respective resource of a plurality of resources, the system comprising:

a processor; and

a memory medium coupled to the processor;

wherein the memory medium stores program instructions which are executable to;

perform a first test of the plurality of tests on the unit using a first resource of the plurality of resources;

while the first test is being performed, search for a second test of the plurality of tests, wherein

     1) the second test requires a second resource of the plurality of resources, and

     2) the second resource is not currently being used; and

if the second test is found, then perform the second test on the unit using the second resource;

wherein the second test is performed on the unit and at least a portion of the first test is performed on the unit substantially concurrently.

47. A carrier medium which stores program instructions for performing a plurality of tests on each of a plurality of units, wherein each of the plurality of tests requires a respective resource of a plurality of resources, wherein the program instructions are executable to perform:

performing a first test of the plurality of tests on a first unit using a first resource of the plurality of resources;

during said performing the first test, searching for a second test of the plurality of tests, wherein

     1) the second test requires a second resource of the plurality of resources, and

     2) the second resource is not currently being used; and

if the second test is found, then performing the second test on a second unit using the second resource;

wherein said performing the second test on the second unit is performed substantially concurrently with at least a portion of said performing the first test on the first unit.

48. A system for performing a plurality of tests on each of a plurality of units, wherein each of the plurality of tests requires a respective resource of a plurality of resources, the system comprising:

means for performing a first test of the plurality of tests on a first unit using a first resource of the plurality of resources;

means for searching for a second test of the plurality of tests during said performing the first test, wherein the second test requires a second resource of the plurality of resources, and wherein the second resource is not currently being used; and

means for performing the second test on a second unit using the second resource if the second test is found;

wherein said performing the second test on the second unit is performed substantially concurrently with at least a portion of said performing the first test on the first unit.

49. A computer-implemented method for performing a plurality of tests on a unit, wherein each of the plurality of tests requires a respective resource of a plurality of resources, the method comprising:

searching the plurality of tests to determine a respective test, wherein the respective test has not been performed on the unit, and wherein the respective resource of the respective test is available for use;

if the respective test is found;

locking the respective resource of the respective test, wherein said locking comprises acquiring the respective resource;

performing the respective test on the unit; and

unlocking the respective resource of the respective test, wherein said unlocking comprises releasing the respective resource;

wherein at least portions of said searching, said locking, said performing, and said unlocking for a plurality of the respective tests are performed substantially concurrently.

50. The method of claim 49,

wherein said searching, said locking, said performing, and said unlocking are performed iteratively until each of the plurality of tests has been performed on the unit.