Method and system for multi-mode testing through operation interface and scenario abstraction in a multi-tenant database environment

• US 9,529,698 B2
• Filed: 03/03/2011
• Issued: 12/27/2016
• Est. Priority Date: 07/13/2010
• Status: Active Grant

• Current Assignee: Salesforce.com, Inc.
• Original Assignee: Salesforce.com, Inc.
• Inventors: Tan, Keng-Woei, Hang, James, Ashok, Divya, Tatlah, Charandeep S., Rivera, Gene
• Primary Examiner(s): Toatley, Gregory J
• Assistant Examiner(s): QUIGLEY, KYLE ROBERT
• Application Number:
  US13/039,944
• Publication Number:
  US 20120016621A1
• Time in Patent Office: 2,126 Days
• US Class Current: 1/1
• CPC Class Codes: G06F 11/3672 Test management

Abstract

Embodiments are described for a system and method for testing a hosted application through a test framework that uses the same operational test code for any one of a plurality of application interfaces. A method under embodiments defines a set of test operations comprising a test for the hosted application, each test operation interacting with the application through an interface of a plurality of interfaces; defines a set of test scenarios, with each test scenario including a number of generic test steps and test operations, and wherein each test scenario includes a function call to the test operation corresponding to the interface to be tested; and executes one or more of the test scenarios to implement a test on the interface to be tested for the hosted application.

Claims

1. A method of testing an application in an on-demand database system, the method comprising:

defining a test framework for the application, wherein the application is accessible through a plurality of interfaces, the test framework comprising;

a set of test operations, each test operation corresponding to at least one operational function of the application performed upon a database of the on-demand database system and each test operation corresponding to one of the plurality of interfaces, the plurality of interfaces including at least a local interface, a web-based user interface and an application programming interface, the set of test operations including a test operation to synchronize records within the on-demand database system;

a set of test scenarios including a test scenario to test record synchronization on at least two of the plurality of interfaces, the at least two of the plurality of interfaces including an application programming interface, the test scenarios being defined in a separate class from the test operations, the test scenario to test record synchronization including;

i) at least one generic test step corresponding to at least one standard action being performed independent of the interfaces to be tested; and

ii) at least one test command configured to invoke the test operations to synchronize records corresponding to the interfaces to be tested, the test operations being received by the test scenario as arguments, the test command causing the operational function of the application corresponding to the received test operation to be executed through the corresponding interface; and

executing one or more of the test scenarios to implement a test on the interfaces to be tested for the application, wherein the executing is performed based on the at least one generic test step and the received test operations.

2. The method of claim 1 wherein the web-based user interface is configured to interact with the application through a web browser executed on a client computer coupled to a server computer hosting the application.

3. The method of claim 2 wherein the application programming interface comprises a remote application programming interface executed on the client computer.

4. The method of claim 2 wherein the local interface comprises a local application programming interface executed on the server computer.

5. The method of claim 1 wherein the application is maintained by a server computer coupled to a web-based client computer over the Internet, and comprises a front-end process accessible through the web-based user interface, and a back-end process accessible through one of a remote application programming interface and a local application programming interface.

6. The method of claim 5 wherein the set of test operations comprises part of a database record synchronization function.

7. The method of claim 6 wherein the application comprises part of a customer relationship management (CRM) system and the server computer is configured to function as a platform for the CRM system for a plurality of distributed client computers, and wherein the database record synchronization function is configured to synchronize customer opportunities with specific quotes.

8. A system for testing an application in an on-demand database system, the system comprising:

one or more processors; and

a non-transitory computer readable medium storing a plurality of instructions, which when executed, cause the one or more processors to;

defining a test framework for the application, wherein the application is accessible through a plurality of interfaces, the test framework comprising;

a set of test operations, each test operation corresponding to at least one operational function of the application performed upon a database of the on-demand database system and each test operation corresponding to one of the plurality of interfaces, the plurality of interfaces including at least a local interface, a web-based user interface and an application programming interface, the set of test operations including a test operation to synchronize records within the on-demand database system;

a set of test scenarios including a test scenario to test record synchronization on at least two of the plurality of interfaces, the at least two of the plurality of interfaces including an application programming interface, the test scenarios being defined in a separate class from the test operations, the test scenario to test record synchronization including;

i) at least one generic test step corresponding to at least one standard action being performed independent of the interfaces to be tested; and

ii) at least one test command configured to invoke the test operations to synchronize records corresponding to the interfaces to be tested, the test operations being received by the test scenario as arguments, the test command causing the operational function of the application corresponding to the received test operation to be executed through the corresponding interface; and

execute one or more of the test scenarios to implement a test on the interfaces to be tested for the application, wherein the executing is performed based on the at least one generic test step and the received test operations.

9. The system of claim 8 wherein the plurality of instructions, when executed, further cause the one or more processors to interact with the application through a web browser executed on a client computer coupled to a server computer hosting the application.

10. The system of claim 9 wherein the application programming interface comprises a remote application programming interface executed on the client computer.

11. The system of claim 9 wherein the local interface comprises a local application programming interface executed on the server computer.

12. The system of claim 8 wherein the application is maintained by a server computer coupled to a web-based client computer over the Internet and comprises a front-end process accessible through the web-based user interface, and a back-end process accessible through one of a remote application programming interface and a local application programming interface.

13. The system of claim 12 wherein the set of test operations comprises part of a database record synchronization function.

14. The system of claim 13 wherein the application comprises part of a customer relationship management (CRM) system and the server computer is configured to function as a platform for the CRM system for a plurality of distributed client computers, and wherein the database record synchronization function is configured to synchronize customer opportunities with specific quotes.

15. A non-transitory computer program product comprising computer readable program code for testing an application in an on-demand database system, the program code to be executed by one or more processors when retrieved from a non-transitory machine-readable medium, the program code including instructions to:

defining a test framework for the application, wherein the application is accessible through a plurality of interfaces, the test framework comprising;

a set of test operations, each test operation corresponding to at least one operational function of the application performed upon a database of the on-demand database system and each test operation corresponding to one of the plurality of interfaces, the plurality of interfaces including at least a local interface, a web-based user interface and an application programming interface, the set of test operations including a test operation to synchronize records within the on-demand database system;

a set of test scenarios, including a test scenario to test record synchronization on at least two of the plurality of interfaces, the at least two of the plurality of interfaces including an application programming interface, the test scenarios being defined in a separate class from the test operations, the test scenario to test record synchronization including;

i) at least one generic test step corresponding to at least one standard action being performed independent of the interface to be tested; and

ii) at least one test command configured to invoke the test operations to synchronize records corresponding to the interfaces to be tested, the test operations being received by the test scenario as arguments, the test command causing the operational function of the application corresponding to the received test operation to be executed through the corresponding interface; and

execute one or more of the test scenarios to implement a test on the interfaces to be tested for the application, wherein the executing is performed based on the at least one generic test step and the received test operations.

16. The medium of claim 15 wherein the application is maintained by a server computer coupled to a web-based client computer over the Internet and comprises a front-end process accessible through the web-based user interface, and a back-end process accessible through one of a remote application programming interface and a local application programming interface.

17. The medium of claim 16 wherein the set of test operations comprises part of a database record synchronization function.

18. The medium of claim 17 wherein the application comprises part of a customer relationship management (CRM) system and the server computer functions as a platform for the CRM system for a plurality of distributed client computers, and wherein the database record synchronization function synchronizes customer opportunities with specific quotes.