Performing asynchronous testing of an application occasionally connected to an online services system

• US 8,271,837 B2
• Filed: 09/02/2010
• Issued: 09/18/2012
• Est. Priority Date: 06/07/2010
• Status: Active Grant

• Current Assignee: Salesforce.com, Inc.
• Original Assignee: Salesforce.com, Inc.
• Inventors: Prophete, Didier, Fischer, Ronald, Rohde, Sönke, Hardikar, Amol, Pathak, Madhav, Movida, Mark, Kesel, Artur
• Primary Examiner(s): Ehne, Charles
• Application Number:
  US12/874,963
• Publication Number:
  US 20110302454A1
• Time in Patent Office: 747 Days
• Field of Search: 714/4.1, 714/38.1, 714/47.1
• US Class Current: 714/38.1
• CPC Class Codes: G06F 11/3688 for test execution, e.g. scheduling of test suites

Abstract

In a method, system, and computer-readable medium having instructions for performing asynchronous testing of an application that is occasionally connected to an online services system, metadata describing at least a portion of an online services database is retrieved and the at least a portion of the online services database is authorized for replication at a software application, information is determined for an entity for an application database from the metadata, a request is sent for a database using the software application interface and the request has an asynchronous operation call to the database for the entity, an execution of the asynchronous operation call is recorded within a callback function, a response is received for the asynchronous operation call, and a result is determined for the software application performance.

Claims

1. A method for performing asynchronous testing of an application that is occasionally connected to an online services system, the method comprising:

retrieving metadata describing at least a portion of an online services database, wherein the at least a portion of the online services database is authorized for replication at a software application;

determining information for an entity for an application database from the metadata;

sending a request for a database using the software application interface, wherein the request comprises an asynchronous operation call to the database for the entity;

recording an execution of the asynchronous operation call within a callback function;

receiving a response for the asynchronous operation call;

determining a result for the software application performance;

performing responder chaining with a wrapped callback function;

recording an execution latency experienced with the asynchronous operation call using the wrapped callback function, wherein recording the execution latency comprises recording a time that the asynchronous operation call is sent and a time for receipt of the response to the asynchronous operation call; and

determining whether an error with the software application occurred before the time for receipt of the response to the asynchronous operation call.

2. A method for performing asynchronous testing of an application that is occasionally connected to an online services system, the method comprising:

retrieving metadata describing at least a portion of an online services database, wherein the at least a portion of the online services database is authorized for replication at a software application;

determining information for an entity for an application database from the metadata;

sending a request for a database using the software application interface, wherein the request comprises an asynchronous operation call to the database for the entity;

recording an execution of the asynchronous operation call within a callback function;

receiving a response for the asynchronous operation call;

determining a result for the software application performance;

detecting no connection to an online services system;

determining a delay that is an estimated amount of time to wait for execution of the asynchronous operation call that may be experienced by the software application during normal execution of the software application;

introducing the delay with a timed wait; and

sending the request for the application database after the timed wait.

3. A method for performing asynchronous testing of an application that is occasionally connected to an online services system, the method comprising:

retrieving metadata describing at least a portion of an online services database, wherein the at least a portion of the online services database is authorized for replication at a software application;

determining information for an entity for an application database from the metadata;

sending a request for a database using the software application interface, wherein the request comprises an asynchronous operation call to the database for the entity;

recording an execution of the asynchronous operation call within a callback function;

receiving a response for the asynchronous operation call;

determining a result for the software application performance;

detecting a connection to an online services system; and

retrieving metadata from the online services database, wherein the request for the database comprises a request for the online services database.

4. A method for performing asynchronous testing of an application that is occasionally connected to an online services system, the method comprising:

retrieving metadata describing at least a portion of an online services database, wherein the at least a portion of the online services database is authorized for replication at a software application;

determining information for an entity for an application database from the metadata;

sending a request for a database using the software application interface, wherein the request comprises an asynchronous operation call to the database for the entity;

recording an execution of the asynchronous operation call within a callback function;

receiving a response for the asynchronous operation call; and

determining a result for the software application performance, wherein the result for the software application performance comprises performance of the software application in handling conflict resolution.

5. A method for performing asynchronous testing of an application that is occasionally connected to an online services system, the method comprising:

retrieving metadata describing at least a portion of an online services database, wherein the at least a portion of the online services database is authorized for replication at a software application;

determining information for an entity for an application database from the metadata;

sending a request for a database using the software application interface, wherein the request comprises an asynchronous operation call to the database for the entity;

recording an execution of the asynchronous operation call within a callback function;

receiving a response for the asynchronous operation call; and

determining a result for the software application performance, wherein the result for the software application performance comprises performance of the software application in at least one of replication of the entity from the online services database and synchronization of data for the entity between the application database and the online services database.

6. A computer-readable storage medium having one or more instructions thereon for performing asynchronous testing of an application that is occasionally connected to an online services system, the instructions when executed by one or more processors causing the one or more processors to carry out:

retrieving metadata describing at least a portion of an online services database, wherein the at least a portion of the online services database is authorized for replication at a software application;

determining information for an entity for an application database from the metadata;

sending a request for a database using the software application interface, wherein the request comprises an asynchronous operation call to the database for the entity;

recording an execution of the asynchronous operation call within a callback function;

receiving a response for the asynchronous operation call;

determining a result for the software application performance;

performing responder chaining with a wrapped callback function;

recording an execution latency experienced with the asynchronous operation call using the wrapped callback function, wherein recording the execution latency comprises recording a time that the asynchronous operation call is sent and a time for receipt of the response to the asynchronous operation call; and

determining whether an error with the software application occurred before the time for receipt of the response to the asynchronous operation call.

7. A computer-readable storage medium having one or more instructions thereon for performing asynchronous testing of an application that is occasionally connected to an online services system, the instructions when executed by one or more processors causing the one or more processors to carry out:

retrieving metadata describing at least a portion of an online services database, wherein the at least a portion of the online services database is authorized for replication at a software application;

determining information for an entity for an application database from the metadata;

sending a request for a database using the software application interface, wherein the request comprises an asynchronous operation call to the database for the entity;

recording an execution of the asynchronous operation call within a callback function;

receiving a response for the asynchronous operation call;

determining a result for the software application performance;

detecting no connection to an online services system;

determining a delay that is an estimated amount of time to wait for execution of the asynchronous operation call that may be experienced by the software application during normal execution of the software application;

introducing the delay with a timed wait; and

sending the request for the application database after the timed wait.

8. A computer-readable storage medium having one or more instructions thereon for performing asynchronous testing of an application that is occasionally connected to an online services system, the instructions when executed by one or more processors causing the one or more processors to carry out:

retrieving metadata describing at least a portion of an online services database, wherein the at least a portion of the online services database is authorized for replication at a software application;

determining information for an entity for an application database from the metadata;

sending a request for a database using the software application interface, wherein the request comprises an asynchronous operation call to the database for the entity;

recording an execution of the asynchronous operation call within a callback function;

receiving a response for the asynchronous operation call;

determining a result for the software application performance;

detecting a connection to an online services system; and

retrieving metadata from the online services database, wherein the request for the database comprises a request for the online services database.