Methods and systems for testing methods in a multi-tenant database environment
First Claim
1. A method in a host organization, wherein the method comprises:
- hosting a plurality of customer codebases within the host organization, each of the plurality of customer codebases having a plurality of operational statements and one or more test methods, the plurality of customer codebases belonging to customer organizations and executable under the direction and control of the customer organizations;
the host organization performing regression testing by;
(i) the host organization executing the one or more test methods belonging to the customer organizations against a production release codebase of the host organization to generate a first test result set;
(ii) the host organization again executing the one or more test methods belonging to the customer organizations against a pre-release codebase of the host organization to generate a second test result; and
(iii) the host organization identifying errors associated with the pre-release codebase based on a comparison of the first test result set and the second test result set.
1 Assignment
0 Petitions
Accused Products
Abstract
In accordance with embodiments disclosed herein, there are provided systems, devices, and methods for testing methods in a multi-tenant database environment, including, for example, hosting a plurality of customer codebases within a host organization, where each of the plurality of customer codebases includes a plurality of operational statements and one or more test methods. Such a method further includes generating a first test result set by executing the one or more test methods associated with each of the plurality of customer codebases against a production release codebase of the host organization; generating a second test result set by executing the one or more test methods associated with each of the plurality of customer codebases against a pre-release codebase of the host organization; and identifying errors associated with the pre-release codebase based on a comparison of the first test result set and the second test result set.
150 Citations
20 Claims
-
1. A method in a host organization, wherein the method comprises:
-
hosting a plurality of customer codebases within the host organization, each of the plurality of customer codebases having a plurality of operational statements and one or more test methods, the plurality of customer codebases belonging to customer organizations and executable under the direction and control of the customer organizations; the host organization performing regression testing by; (i) the host organization executing the one or more test methods belonging to the customer organizations against a production release codebase of the host organization to generate a first test result set; (ii) the host organization again executing the one or more test methods belonging to the customer organizations against a pre-release codebase of the host organization to generate a second test result; and (iii) the host organization identifying errors associated with the pre-release codebase based on a comparison of the first test result set and the second test result set. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17)
-
-
18. Non-transitory computer readable storage media having instructions stored thereupon that, when executed by a processor of a host organization, the processor causes the host organization to perform operations comprising:
-
hosting a plurality of customer codebases within the host organization, each of the plurality of customer codebases having a plurality of operational statements and one or more test methods, the plurality of customer codebases belonging to customer organizations and executable under the direction and control of the customer organizations; the host organization performing regression testing by; (i) the host organization executing the one or more test methods belonging to the customer organizations against a production release codebase of the host organization to generate a first test result set; (ii) the host organization again executing the one or more test methods belonging to the customer organizations against a pre-release codebase of the host organization to generate a second test result; and (iii) the host organization identifying errors associated with the pre-release codebase based on a comparison of the first test result set and the second test result set. - View Dependent Claims (19)
-
-
20. A host organization comprising:
-
a processor and a memory; a datastore to store a plurality of customer codebases within the host organization, each of the plurality of customer codebases having a plurality of operational statements and one or more test methods, the plurality of customer codebases belonging to customer organizations and executable under the direction and control of the customer organizations; the host organization to execute, via a test executor, the one or more test methods belonging to the customer organizations against a production release codebase of the host organization to generate a first test result set; the host organization to again execute, via the test executor, the one or more test methods belonging to the customer organizations against a pre-release codebase of the host organization to generate a second test result set; the host organization to identify, via a results analyzer errors associated with the pre-release codebase based on a comparison of the first test result set and the second test result set.
-
Specification