Quality on submit process

• US 8,984,489 B2
• Filed: 10/28/2013
• Issued: 03/17/2015
• Est. Priority Date: 12/16/2010
• Status: Active Grant

• Current Assignee: Sap Portals Israel Ltd (SAP SE)
• Original Assignee: Sap Portals Israel Ltd (SAP SE)
• Inventors: Yassin, Ohad, Koren, Nir, Nelinger, Eran, Saar, Asaf
• Primary Examiner(s): Wong, Don
• Assistant Examiner(s): HEBERT, THEODORE E
• Application Number:
  US14/064,969
• Publication Number:
  US 20140053138A1
• Time in Patent Office: 505 Days
• Field of Search: 717/126
• US Class Current: 717/126
• CPC Class Codes: G06F 11/3672 Test management
• CPC Class Codes: G06F 11/3692 for test results analysis
• CPC Class Codes: G06F 8/36 Software reuse

Abstract

The present disclosure involves systems, software, and computer implemented methods for providing a quality on submit process. One process includes operations for monitoring a source control system for submissions of new source code and determining that new source code has been submitted by a user to the source control system. A request to perform a quality control task for the new source code is sent to at least one quality control application. A report from the quality control application regarding results of the quality control task is received. A general report of results of each quality control task performed by each of the at least one quality control application is generated. The general report is sent to the user.

Claims

1. A computer-implemented method performed by one or more processors, the method comprising:

identifying a plurality of different quality control applications to perform different quality control tasks on source code;

sending a request to each quality control application to perform a quality control task for new source code received at a source control system, wherein each quality control task includes a plurality of test phases, each test phase associated with one or more tests to be applied to the new source code;

receiving a plurality of reports, each report received from each quality control application regarding results of the quality control task performed by each quality control application in response to the request, wherein each report includes a plurality of test results generated at each test phase included in each quality control application;

identifying a plurality of standards requirements, each standards requirement associated with a respective product standard;

determining a level of compliance of the new source code with a plurality of standards requirements, each standards requirement associated with a respective product standard, wherein the level of compliance is determined based, at least in part, on the plurality of test results included in the plurality of reports; and

providing a general report generated based on the plurality of reports and based on results of each quality control task performed by each of the plurality of quality control applications.

2. The method of claim 1, wherein the results of the quality control task include a number of defects found in the new source code.

3. The method of claim 1, wherein the quality control task includes at least one of building the new source code, performing a static code analysis on the new source code, performing a unit test on the new source code, or performing a user interface automation test on the new source code.

4. The method of claim 1, wherein sending the request to each quality control application comprises:

determining a particular order for sending requests to the plurality of different quality control applications to perform the different quality control tasks; and

sending the requests to the plurality of different quality control applications based on the particular order.

5. The method of claim 4, wherein sending the requests to the plurality of different quality control applications based on the particular order comprises sending the requests to the plurality of different quality control applications sequentially in the particular order, each request sent after receiving the report from a quality control application previously requested for performing a quality control task.

6. The method of claim 5, further comprising:

determining that a particular report received from a quality control application indicates a quality level below a certain threshold; and

canceling subsequent requests to be sent in the particular order in response to determining that the particular report indicates the quality level below the certain threshold.

7. The method of claim 1, further comprising maintaining statistical data based on the results of each quality control task performed.

8. The method of claim 7, wherein the statistical data includes data arranged by at least one of a user associated with a defect found in the new source code, dates associated with defects, frequency of defects, types of defects, severity of defects, or sections of the new source code associated with defects.

9. A non-transitory computer-readable medium storing instructions executable by one or more processors to perform operations comprising:

identifying a plurality of different quality control applications to perform different quality control tasks on source code;

sending a request to each quality control application to perform a quality control task for new source code received at a source control system, wherein each quality control task includes a plurality of test phases, each test phase associated with one or more tests to be applied to the new source code;

receiving a plurality of reports, each report received from each quality control application regarding results of the quality control task performed by each quality control application in response to the request, wherein each report includes a plurality of test results generated at each test phase included in each quality control application;

identifying a plurality of standards requirements, each standards requirement associated with a respective product standard;

determining a level of compliance of the new source code with a plurality of standards requirements, each standards requirement associated with a respective product standard, wherein the level of compliance is determined based, at least in part, on the plurality of test results included in the plurality of reports; and

providing a general report generated based on the plurality of reports and based on results of each quality control task performed by each of the plurality of quality control applications.

10. The medium of claim 9, wherein the results of the quality control task include a number of defects found in the new source code.

11. The medium of claim 9, wherein the quality control task includes at least one of building the new source code, performing a static code analysis on the new source code, performing a unit test on the new source code, or performing a user interface automation test on the new source code.

12. The medium of claim 9, wherein sending the request to each quality control application comprises:

determining a particular order for sending requests to the plurality of different quality control applications to perform the different quality control tasks; and

sending the requests to the plurality of different quality control applications based on the particular order.

13. The medium of claim 12, wherein sending the requests to the plurality of different quality control applications based on the particular order comprises sending the requests to the plurality of different quality control applications sequentially in the particular order, each request sent after receiving the report from a quality control application previously requested for performing a quality control task.

14. The medium of claim 13, the operations further comprising:

determining that a particular report received from a quality control application indicates a quality level below a certain threshold; and

canceling subsequent requests to be sent in the particular order in response to determining that the particular report indicates the quality level below the certain threshold.

15. The medium of claim 13, the operations further comprising generating the general report by analyzing an effect of the new source code on at least one product standard of a product associated with the new source code.

16. The medium of claim 15, wherein analyzing the effect of the new source code comprises:

mapping a result from a particular quality control task to a requirement of the at least one product standard; and

determining a level of compliance with the at least one product standard based on the mapping of the result from the particular quality control task to the requirement of the at least one product standard.

17. The medium of claim 15, wherein the at least one product standard includes at least one of accessibility, application integration and interfaces, functional correctness, globalization, information lifecycle management, information technology (IT) service and application management, open source and third party usage, performance, security and data privacy and protection, technical implementation and change management, or usability.

18. A system comprising:

one or more processors; and

a computer-readable medium storing instructions executable by the one or more processors to perform operations comprising;

identifying a plurality of different quality control applications to perform different quality control tasks on source code;

sending a request to each quality control application to perform a quality control task for new source code received at a source control system, wherein each quality control task includes a plurality of test phases, each test phase associated with one or more tests to be applied to the new source code;

receiving a plurality of reports, each report received from each quality control application regarding results of the quality control task performed by each quality control application in response to the request, wherein each report includes a plurality of test results generated at each test phase included in each quality control application;

identifying a plurality of standards requirements, each standards requirement associated with a respective product standard;

determining a level of compliance of the new source code with a plurality of standards requirements, each standards requirement associated with a respective product standard, wherein the level of compliance is determined based, at least in part, on the plurality of test results included in the plurality of reports; and

providing a general report generated based on the plurality of reports and based on results of each quality control task performed by each of the plurality of quality control applications.

19. The system of claim 18, wherein sending the request to each quality control application comprises:

determining a particular order for sending requests to the plurality of different quality control applications to perform the different quality control tasks; and

sending the requests to the plurality of different quality control applications based on the particular order.

20. The system of claim 18, the operations further comprising generating the general report by analyzing an effect of the new source code on at least one product standard of a product associated with the new source code.