Method and apparatus for executing unit tests in application host environment

• US 7,954,088 B2
• Filed: 03/23/2005
• Issued: 05/31/2011
• Est. Priority Date: 03/23/2005
• Status: Expired due to Fees

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Crawford, Brian R.
• Primary Examiner(s): Dao; Thuy
• Assistant Examiner(s): BUI, HANH THI MINH
• Application Number:
  US11/087,260
• Publication Number:
  US 20060218446A1
• Time in Patent Office: 2,260 Days
• Field of Search: None
• US Class Current: 717/126
• CPC Class Codes: G06F 11/3688 for test execution, e.g. scheduling of test suites

Abstract

A development environment in which unit tests are prepared. The unit tests run in a host environment for more complete and accurate testing of program units. The development environment uses a test execution shim to access an adapter running in the host environment. The host adapter may invoke other program objects that run specific tests. Such objects may late bind to the unit under test. An accessor class may facilitate late binding to the specific unit under test while allowing tests authored in the development environment to use context sensitive information needed to access the unit under test.

Claims

1. A method of testing a program operating in a first environment, the program having a plurality of units, including at least one unit under test, the method comprising:

operating at least one programmed processor to perform a series of acts, the series of acts being identified by executable instructions with which the at least one programmed processor is programmed, the series of acts comprising;

a) executing a test agent in a second environment, the test agent specifying a test to be performed in the first environment to test the at least one unit under test and communicating regarding the specified test with the at least one unit under test in the first environment via a non-public interface of the at least one unit under test, wherein the first environment is an executing application program and the program is an add-in to the application program;

b) executing, in response to executing the test agent, the specified test in the first environment, the executing of the specified test comprising accessing, by the specified test, of non-public attributes, variables or other parameters of the application program of the first environment during the executing of the specified test and further comprising generating a test result indicative of a performance characteristic of the unit under test; and

c) providing the test result and information regarding at least some of the accessed non-public attributes of the application program of the first environment, non-public variables of the application program of the first environment or other non-public parameters of the application program of the first environment to the test agent through the execution of the specified test, wherein the providing comprises communicating to the test agent in the second environment the test result and the information via the non-public interface of the at least one unit under test.

2. The method of claim 1, wherein the series of acts additionally comprises communicating the test result from the specified test executing in the first environment to the test agent executing in the second environment.

3. The method of claim 2, wherein executing a specified test in the first environment comprises creating an object in the first environment and registering the object with an object in the second environment.

4. The method of claim 3, wherein executing a specified test further comprises:

a) executing a test object in the first environment; and

b) communicating between the object in the second environment and the test object through the object in the first environment.

5. The method of claim 2, wherein executing a specified test comprises executing a test adapter in the first environment and invoking with the test adapter the specified test.

6. The method of claim 5, wherein executing a specified test further comprises receiving with the test adapter a parameter indicative of the specified test and invoking a test selected in response to the parameter.

7. The method of claim 5, wherein the first environment comprises an extensible interface and executing a test adapter comprises executing in the first environment a test adapter in response to a command provided through the extensible interface.

8. The method of claim 1, wherein executing a specified test comprises exercising the at least one unit under test through the non-public interface.

9. The method of claim 1, wherein communicating the test result from the specified test executing in the first environment to the test agent comprises communicating the test result to the test agent via a non-public interface of the first environment.

10. The method of claim 1, wherein executing, with the testing component, the specified test in the first environment comprises executing the specified test in the first environment while the executing application program of the first environment is executing in a testing mode.

11. A method of testing a program operating in a first environment, the first environment storing data and including at least one interface to expose a first portion of the data outside the first environment, wherein the first portion of the data exposed by the at least one interface is public data and wherein a second portion of the data not exposed by the at least one interface is non-public data, the program having a plurality of units, at least one of the units being a unit under test, the method comprising:

operating at least one programmed processor to perform a series of acts, the series of acts being identified by executable instructions with which the at least one programmed processor is programmed, the series of acts comprising;

a) loading the program in the first environment;

b) exposing a first interface of an object in the first environment;

c) receiving with the object an instruction to operate the first environment in a test mode and, in response to the instruction, setting the first environment in the test mode and using the object to load a test adapter of the first environment, the test adapter of the first environment being executed within the first environment and being separate from the at least one unit under test;

d) using the test adapter executing in the first environment to execute a test of the at least one unit under test in the first environment;

e) accessing, with the test through the interface, non-public attributes in the first environment, non-public variables in the first environment or other non-public parameters in the first environment during execution of the test, wherein the accessing comprises communicating via a second interface of the unit under test, and wherein the non-public attributes, the non-public variables and the non-public parameters are non-public data not available outside the first environment via the at least one interface; and

f) providing information regarding at least some of the accessed non-public attributes, non-public variables or other non-public parameters in the first environment through the first interface to a test agent executing in a second environment.

12. The method of claim 11, wherein providing information in response to execution of a test agent in a second environment comprises executing the test agent in a development environment.

13. The method of claim 11, wherein providing information through the interface in response to execution of a test agent executing in a second environment comprises selecting a test execution shim based on an attribute of the first environment and accessing the interface through the test execution shim.

14. The method of claim 11, wherein loading the program in the first environment comprises loading an add-in program with an application program.

15. The method of claim 11, wherein the first environment is created in a first process and the second environment is created in a second process.

16. The method of claim 11, wherein the series of acts additionally comprises:

a) reflecting parameters of a unit in the first environment; and

b) using the reflected parameters to configure the test adapter.

17. A computer-readable storage medium having computer-executable instructions for performing steps implementing a software system providing a development environment in which a test program may be developed for testing a unit of a program operating in one of a plurality of host environments, the computer-executable instructions performing the steps of:

a) creating a test agent configured to execute in the development environment;

b) creating a test execution shim configured to execute in the development environment, configured to interact with the test agent, and configured to provide an interface to at least one of the plurality of host environments; and

c) creating one of a plurality of host adapters, each host adapter configured to execute in one of the plurality of host environments, each host environment being an executing application program and the host adapter being separate from a unit being tested, each host adapter being configured to be used by the test agent to invoke execution of a test program in one of the plurality of host environments, wherein invoking execution of a test program comprises late binding an accessor class of the test program to the unit of the program being tested to provide access to non-public properties of the unit.

18. The computer-readable storage medium of claim 17, wherein the software system additionally comprises computer-executable instructions for performing the steps of:

a) receiving input from a user specifying a portion of an instruction in a test program; and

b) selectively displaying in response to the input from a user context sensitive information concerning parameters that may be used in the instruction of the test program to access the unit of the program.

19. The computer-readable storage medium of claim 18, wherein the software system additionally comprises computer-executable instructions for implementing the steps of receiving parameters related to the unit of the program that have been reflected from the unit.

20. The computer-readable storage medium of claim 17, wherein the software system additionally comprising computer-executable instructions for creating an object that configures a test program based on information about the unit of the program reflected from the unit.