On-demand database service system, method, and computer program product for enforcing the inclusion of tests in a developed application

• US 8,799,298 B2
• Filed: 08/15/2008
• Issued: 08/05/2014
• Est. Priority Date: 08/17/2007
• Status: Active Grant

• Current Assignee: Salesforce.com, Inc.
• Original Assignee: Salesforce.com, Inc.
• Inventors: Weissman, Craig
• Primary Examiner(s): LU, KUEN S
• Application Number:
  US12/192,948
• Publication Number:
  US 20090049102A1
• Time in Patent Office: 2,181 Days
• Field of Search: 707/755, 707/802
• US Class Current: 707/755
• CPC Class Codes: G06F 8/70 Software maintenance or management
• CPC Class Codes: G06F 8/71 Version control security arrangements therefor G06F21/57; Configuration management

Abstract

In accordance with embodiments, there are provided mechanisms and methods for enforcing the inclusion of tests in a developed application. These mechanisms and methods for providing such enforcement can enable embodiments to ensure that new versions of developed applications will operate in the same application environment of a previous version. The ability of embodiments to enforce the inclusion of tests may lead to an improved application migration development/runtime framework, etc.

Claims

1. A method, comprising:

receiving a developed application at an on-demand database service;

determining whether at least one functional test for testing operation of the developed application is provided, where the at least one functional test tests whether the developed application is capable of invoking different portions of program instructions based on a determined version;

in response to a determination that the at least one functional test for testing the operation of the developed application is provided, executing the at least one functional test on the developed application to test the operation of the developed application; and

conditionally validating the developed application in response to the determination that the at least one functional test for testing the operation of the developed application is provided and in response to a result of the execution of the at least one functional test on the developed application meeting a predetermined acceptable result.

2. The method of claim 1, and further comprising additionally determining whether the at least one functional test meets predetermined criteria.

3. The method of claim 2, wherein it is additionally determined whether the at least one functional test adequately tests whether the developed application is capable of executing a predetermined version thereof.

4. The method of claim 2, wherein the developed application is conditionally validated based on the additional determination.

5. The method of claim 1, wherein the at least one functional test tests whether the application is capable of operation such that a first portion of the program instructions is invoked if, during runtime, it is determined that a first version of the program instructions is to be invoked, and a second portion of the program instructions is invoked if, during runtime, it is determined that a second version of the program instructions is to be invoked.

6. The method of claim 5, wherein the first version of the program instructions and the second version of the program instructions are both included with the developed application.

7. The method of claim 5, wherein the first version of the program instructions and the second version of the program instructions differ with respect to at least one method, at least one class, or at least one variable.

8. The method of claim 1, wherein it is determined whether the at least one functional test is included with the developed application.

9. The method of claim 1, wherein the on-demand database service includes a multi-tenant on-demand service.

10. The method of claim 1, wherein the developed application includes a first version of program instructions representing a first version of the developed application and a second version of program instructions updated from the first version of program instructions representing a second version of the developed application, and wherein the at least one functional test validates whether the developed application executes the first version of the program instructions in response to a determination that the first version of the developed application is to be executed and validates whether the developed application executes the second version of the program instructions in response to a determination that the second version of the developed application is to be executed.

11. A non-transitory machine-readable medium carrying one or more sequences of instructions which, when executed by one or more processors, cause the one or more processors to carry out the steps of:

receiving a developed application at an on-demand database service;

determining whether at least one functional test for testing operation of the developed application is provided, where the at least one functional test tests whether the developed application is capable of invoking different portions of program instructions based on a determined version;

in response to a determination that the at least one functional test for testing the operation of the developed application is provided, executing the at least one functional test on the developed application to test the operation of the developed application; and

conditionally validating the developed application in response to the determination that the at least one functional test for testing the operation of the developed application is provided and in response to a result of the execution of the at least one functional test on the developed application meeting a predetermined acceptable result.

12. An apparatus, comprising:

a computer processor; and

one or more stored sequences of instructions which, when executed by the computer processor, cause the computer processor to carry out the steps of;

receiving a developed application at an on-demand database service;

determining whether at least one functional test for testing operation of the developed application is provided, where the at least one functional test tests whether the developed application is capable of invoking different portions of program instructions based on a determined version;

in response to a determination that the at least one functional test for testing the operation of the developed application is provided, executing the at least one functional test on the developed application to test the operation of the developed application; and

conditionally validating the developed application in response to the determination that the at least one functional test for testing the operation of the developed application is provided and in response to a result of the execution of the at least one functional test on the developed application meeting a predetermined acceptable result.

13. A method for transmitting code for use in a multi-tenant database system on a transmission medium, the method comprising:

transmitting code for receiving a developed application at an on-demand database service;

transmitting code for determining whether at least one functional test for testing operation of the developed application is provided, where the at least one functional test tests whether the developed application is capable of invoking different portions of program instructions based on a determined version;

transmitting code for executing the at least one functional test on the developed application to test the operation of the developed application, in response to a determination that the at least one functional test for testing the operation of the developed application is provided; and

transmitting code for conditionally validating the developed application in response to the determination that the at least one functional test for testing the operation of the developed application is provided and in response to a result of the execution of the at least one functional test on the developed application meeting a predetermined acceptable result.

14. The method of claim 13, and further comprising transmitting code for additionally determining whether the at least one functional test meets predetermined criteria.

15. The method of claim 14, wherein it is additionally determined whether the at least one functional test adequately tests whether the developed application is capable of executing a predetermined version thereof.

16. The method of claim 14, wherein the developed application is conditionally validated based on the additional determination.

17. The method of claim 13, wherein the at least one functional test tests whether the application is capable of operation such that a first portion of the program instructions is invoked if, during runtime, it is determined that a first version of the program instructions is to be invoked, and a second portion of the program instructions is invoked if, during runtime, it is determined that a second version of the program instructions is to be invoked.

18. The method of claim 17, wherein the first version of the program instructions and the second version of the program instructions are both included with the developed application.

19. The method of claim 17, wherein the first version of the program instructions and the second version of the program instructions differ with respect to at least one method, at least one class, or at least one variable.