Quality on submit process

• US 8,584,079 B2
• Filed: 12/16/2010
• Issued: 11/12/2013
• Est. Priority Date: 12/16/2010
• Status: Active Grant

• Current Assignee: SAP SE
• Original Assignee: Sap Portals Israel Ltd (SAP SE)
• Inventors: Yassin, Ohad, Koren, Nir, Nelinger, Eran, Saar, Asaf
• Primary Examiner(s): Wong, Don
• Assistant Examiner(s): HEBERT, THEODORE E
• Application Number:
  US12/970,474
• Publication Number:
  US 20120159420A1
• Time in Patent Office: 1,062 Days
• Field of Search: 717/101
• US Class Current: 717/101
• CPC Class Codes: G06F 11/3672 Test management
• CPC Class Codes: G06F 11/3692 for test results analysis
• CPC Class Codes: G06F 8/36 Software reuse

Abstract

The present disclosure involves systems, software, and computer implemented methods for providing a quality on submit process. One process includes operations for monitoring a source control system for submissions of new source code and determining that new source code has been submitted by a user to the source control system. A request to perform a quality control task for the new source code is sent to at least one quality control application. A report from the quality control application regarding results of the quality control task is received. A general report of results of each quality control task performed by each of the at least one quality control application is generated. The general report is sent to the user.

Claims

1. A computer implemented method performed by one or more processors for providing a quality on submit process, the method comprising the following operations:

monitoring a source control system for submissions of new source code;

determining that new source code has been submitted by a user to the source control system;

identifying a plurality of different quality control applications to perform different quality control tasks;

sending a request to each quality control application to perform a quality control task for the new source code, wherein each quality control application includes a plurality of test phases, each test phase associated with one or more tests to be applied to the new source code;

identifying a plurality of standards requirements, each standards requirement associated with a respective product standard;

receiving a plurality of reports, each report received from each quality control application regarding results of the quality control task performed by each quality control application in response to the request, wherein each report includes a plurality of test results generated at each test phase included in each quality control application;

determining a level of compliance of the new source code with the identified plurality of standards requirements based, at least in part, on the plurality of test results included in the plurality of reports,

generating a general report from the plurality of reports, wherein the general report is based on results of each quality control task performed by each of the plurality of quality control applications; and

sending the general report to the user.

2. The method of claim 1, wherein the results of the quality control task include a number of defects found in the new source code.

3. The method of claim 1, wherein the quality control task includes at least one of building the new source code, performing a static code analysis on the new source code, performing a unit test on the new source code, or performing a user interface automation test on the new source code.

4. The method of claim 1, wherein sending the request to each quality control application comprises:

determining a particular order for sending requests to the quality control applications to perform the different quality control tasks; and

sending the requests to the plurality of quality control applications based on the particular order.

5. The method of claim 4, wherein the requests are sent to the plurality of quality control applications sequentially in the particular order, each request sent after receiving the report from a quality control application previously requested for performing a quality control task.

6. The method of claim 5, wherein subsequent requests to be sent in the particular order are canceled if a particular report received from a quality control application indicates a quality level below a certain threshold.

7. The method of claim 1, further comprising maintaining statistical data based on the results of each quality control task performed.

8. The method of claim 7, the statistical data including data arranged by at least one of a user associated with a defect found in submitted source code, dates associated with defects, frequency of defects, types of defects, severity of defects, or sections of the new source code associated with defects.

9. The method of claim 1, wherein generating the general report includes determining a value representing a relative quality level of the new source code, the value determined based at least in part on a number of defects found in the new source code, a level of complexity of the new source code, or an analysis of the report received from the quality control application.

10. The method of claim 1, wherein generating the general report includes analyzing an effect of the new source code on at least one product standard of a product associated with the new source code.

11. The method of claim 10, wherein analyzing the effect of the new source code comprises:

mapping a result from a particular quality control task to a requirement of the at least one product standard; and

determining a level of compliance with the at least one product standard based on the mapping of the result from the particular quality control task to the requirement of the at least one product standard.

12. The method of claim 10, wherein the at least one product standard includes at least one of accessibility, application integration and interfaces, functional correctness, globalization, information lifecycle management, information technology (IT) service and application management, open source and third party usage, performance, security and data privacy and protection, technical implementation and change management, or usability.

13. A non-transitory computer-readable medium storing computer readable instructions for causing one or more processors to perform operations comprising:

monitoring a source control system for submissions of new source code;

determining that new source code has been submitted by a user to the source control system;

identifying a plurality of different quality control applications to perform different quality control tasks;

sending a request to each quality control application to perform a quality control task for the new source code;

receiving a plurality of reports, each report received from each quality control application regarding results of the quality control task performed by each quality control application in response to the request;

determining an effect of the new source code on a product standard of a product associated with the new source code;

generating a general report from the plurality of reports, wherein the general report is based on results of each quality control task performed by each of the plurality of quality control applications, wherein the general report includes the effect of the new source code on the product standard; and

sending the general report to the user.

14. The medium of claim 13, wherein the quality control task includes at least one of building the new source code, performing a static code analysis on the new source code, performing a unit test on the new source code, or performing a user interface automation test on the new source code.

15. The medium of claim 13, wherein the product standard includes at least one of accessibility, application integration and interfaces, functional correctness, globalization, information lifecycle management, information technology (IT) service and application management, open source and third party usage, performance, security and data privacy and protection, technical implementation and change management, or usability.

16. The medium of claim 13, wherein generating the general report includes determining a value representing a relative quality level of the new source code, the value determined based at least in part on a number of defects found in the new source code, a level of complexity of the new source code, or an analysis of the report received from the quality control application.

17. A system, comprising:

memory operable to store reports generated by quality control applications; and

one or more processors operable to;

monitor a source control system for submissions of new source code;

determine that new source code has been submitted by a user to the source control system;

identify a plurality of different quality control applications to perform different quality control tasks;

determine a particular order for sending requests to the plurality of quality control applications to perform the different quality control tasks;

send a request to each quality control application to perform a quality control task for the new source code according to the order;

receive a plurality of reports, each report received from each quality control application regarding results of the quality control task performed by each quality control application in response to the request;

generate a general report from the plurality of reports, wherein the general report is based on results of each quality control task performed by each of the plurality of quality control applications; and

send the general report to the user.

18. The system of claim 17, wherein the results of the quality control task include a number of defects found in the new source code.

19. The system of claim 17, wherein the quality control task includes at least one of building the new source code, performing a static code analysis on the new source code, performing a unit test on the new source code, or performing a user interface automation test on the new source code.

20. The system of claim 19, the one or more processors further operable to maintain statistical data based on the results of each quality control task performed.