SYSTEM FOR DISTRIBUTED SOFTWARE QUALITY IMPROVEMENT

• US 20130152047A1
• Filed: 11/21/2012
• Published: 06/13/2013
• Est. Priority Date: 11/22/2011
• Status: Active Grant

• Current Assignee: Solano Labs, Inc.. (General Electric Company)
• Original Assignee: Solano Labs, Inc.. (General Electric Company)
• Inventors: Moorthi, Jay, Thorpe, Christopher A., Josephson, William
• Granted Patent: US 9,898,393 B2
• Time in Patent Office: Days
• US Class Current: 717/124
• CPC Class Codes: G06F 11/3664 Environments for testing or debugging software
• CPC Class Codes: G06F 11/368 for test version control, e.g. updating test cases to a new software version
• CPC Class Codes: G06F 11/3688 for test execution, e.g. scheduling of test suites
• CPC Class Codes: G06F 8/71 Version control security arrangements therefor G06F21/57; Configuration management

Abstract

Provided is a system for building and validating an application (including e.g., various software versions and revisions, programming languages, code segments, among other examples) without any scripting required by a system user. In one embodiment, an SDLC system is configured to construct a build and test environment, by automatically analyzing a submitted project. The build environment is configured to assemble existing user code, for example, to generate an application to test. Code building can include any one or more of code compilation, assembly, and code interpretation. The system can include a user interface provided to clients, users, and/or customer environments to facilitate user interaction and control of build and test validation. The system can accept user specification of configurations that controls the way the system runs the user'"'"'s tests. The system can also provide flexible billing models for different customers.

Claims

1. A system for continuous integration of source code revisions, the system comprising:

at least one processor operatively connected to a memory, the processor when executing is configured to;

register a test suite for distributed execution, wherein the test suite defines source code and at least one test to be executed for an application, wherein registering includes identifying a code repository for the source code associated with the application to be tested;

determine, automatically, configuration requirements for the test suite based on analysis of the code repository, wherein determining configuration requirements includes determining execution dependencies for the test suite and the application to be tested;

generate instructions for executing a plurality of execution instances, wherein at least some of the plurality of execution instances are configured to;

define an execution environment based on the configuration requirements,

execute at least a portion of the source code, and

execute at least one test;

communicate, the instructions for executing the plurality of execution instances to at least one compute resource; and

receive results from execution of the plurality of execution instances.

2. The system according to claim 1, wherein the processor is configured to provision the at least one compute resource from a plurality of cloud compute providers.

3. The system according to claim 2, wherein the processor is configured to:

determine a cost for a plurality of compute resources available at the plurality of cloud compute providers; and

select the at least one compute resource responsive to a price constraint.

4. The system according to claim 3, wherein the processor is configured to select the at least one compute resource responsive to completion criteria.

5. The system according to claim 2, wherein the processor is configured to:

determine a cost for a plurality of compute resources;

determine a volume of compute resources based on completion criteria; and

wherein the provisioning of the at least one compute resource includes provisioning the volume of compute resources require to meet the completion criteria against a price constraint.

6. The system according to claim 1, wherein the processor is configured to analyze, automatically, the test suite to determine the compute tasks necessary to define the execution environment, execute the at least the portion of the source code, and execute the at least one test.

7. The system according to claim 6, wherein the processor is configured to determine requirements for serial execution for the compute tasks;

and wherein generating the instructions for executing the plurality of execution instances includes grouping the plurality of execution instances responsive to the requirements for serial execution.

8. The system according to claim 6, wherein the processor is configured to determine capability for parallel execution for the compute tasks, and wherein generating the instructions for executing the plurality of execution instances is responsive to the determined capability for parallel execution.

9. The system according to claim 7, wherein the processor is configured to determine the capability for parallel execution for the compute tasks within any grouping based on serial execution of the plurality of execution instances.

10. The system according to claim 1, wherein the processor is configured to:

generate a coarse schedule for the execution of the plurality of execution instances responsive to the determination of execution dependencies.

11. The system according to claim 10, wherein the processor is configured to establish completion criteria for at least one of the plurality of execution instances.

12. The system according to claim 11, wherein the processor is configured to generate an order for the execution of the plurality of execution instances responsive to the completion criteria.

13. The system according to claim 10, wherein communicating the plurality of execution instances, includes generating, automatically, a distribution of the plurality of execution instances between a plurality of compute resources.

14. The system according to claim 13, wherein the plurality of compute resources includes a plurality of networked virtual machines.

15. The system according to claim 10, wherein the coarse schedule defines at least a plurality of compute tasks having dependencies that require serial execution.

16. The system according to claim 15, wherein the processor is configured to generate a fine schedule within the plurality of tasks requiring serial execution.

17. The system according to claim 16, wherein communicating the plurality of execution instances, includes generating, automatically, a distribution of the plurality of execution instances between a plurality of compute resources according to the fine schedule.

18. The system according to claim 1, wherein the processor is configured to isolate execution of at least some of the execution instances.

19. The system according to claim 18, wherein the processor is configured to limit access to the at least some of the execution instances based on access privileges defined for the test suite.

20. The system according to claim 18, wherein the processor is configured to isolate execution by performing at least one of:

generating isolated virtual machines, generating a plurality of execution containers for the plurality of execution instances, and implementing processes isolation.

21. The system according to claim 1, wherein the processor is configured to identify configuration files within the code repository to determine the configuration requirements.

22. The system according to claim 1, wherein the processor is configured to identify patterns within at least one of the code repository and source code to determine the configuration requirements.

32. The method according to claim 1, further comprising generating a coarse schedule for the execution of the plurality of execution instances responsive to the determination of execution dependencies.

33. The method according to claim 32, further comprising establishing completion criteria for at least one of the plurality of execution instances.

34. The method according to claim 33, further comprising generating the order for the execution of the plurality of execution instances responsive to the completion criteria.

35. The method according to claim 32, wherein the act of communicating the plurality of execution instances, includes generating, automatically, a distribution of the plurality of execution instances between a plurality of compute resources.

36. The method according to claim 35, wherein the plurality of compute resources includes a plurality of networked virtual machines.

37. The method according to claim 32, wherein the coarse schedule defines at least a plurality of compute tasks having dependencies that require serial execution.

38. The method according to claim 37, further comprising generating a fine schedule within the plurality of tasks requiring serial execution.

39. The method according to claim 38, wherein the act of communicating the plurality of execution instances, includes generating, automatically, a distribution of the plurality of execution instances between a plurality of compute resources according to the fine schedule.

23. A computer implemented method for continuous integration of source code revisions, the method comprising:

registering, by a computer system, a test suite for distributed execution, wherein the test suite defines source code and at least one test to be executed for an application, wherein registering includes identifying a code repository for the source code associated with the application to be tested;

determining, automatically, by the computer system, configuration requirements for the test suite based on analysis of the code repository, wherein determining configuration requirements includes determining execution dependencies for the test suite and the application to be tested;

generating, by the computer system, instructions for executing a plurality of execution instances, wherein at least some of the plurality of execution instances are configured to;

define an execution environment based on the configuration requirements, execute at least a portion of the source code, and execute at least one test;

communicating, by the computer system, the instructions for executing the plurality of execution instances to at least one compute resource; and

receiving, by the computer system, results from execution of the plurality of execution instances.

24. The method according to claim 23, further comprising an act of provisioning the at least one compute resource from a plurality of cloud compute providers.

25. The method according to claim 24, further comprising:

determining a cost for a plurality of compute resources available at the plurality of cloud compute providers; and

selecting the at least one compute resource responsive to a price constraint.

26. The method according to claim 25, further comprising selecting the at least one compute resource responsive to a completion criteria.

27. The method according to claim 24, further comprising;

determining a cost for a plurality of compute resources;

determining a volume of compute resources based on a completion criteria; and

wherein the act of provisioning of the at least one compute resource includes provisioning the volume of compute resources require to meet the completion criteria against a price constraint.

28. The method according to claim 23, further comprising analyzing, automatically, the test suite to determine the compute tasks necessary to define the execution environment, execute the at least the portion of the source code, and execute the at least one test.

29. The method according to claim 28, further comprising determining requirements for serial execution for the compute tasks;

and wherein the act of generating the instructions for executing the plurality of execution instances includes grouping the plurality of execution instances responsive to the requirements for serial execution.

30. The method according to claim 28, further comprising determining a capability for parallel execution for the compute tasks, and wherein the act of generating the instructions for executing the plurality of execution instances is responsive to the determined capability for parallel execution.

31. The method according to claim 29, further comprising determining the capability for parallel execution for the compute tasks within any grouping of the plurality of execution instances responsive to the requirements for serial execution.

40. The method according to claim 23, further comprising isolating execution of at least some of the execution instances.

41. The method according to claim 40, further comprising limiting access to the at least some of the execution instances based on access privileges defined for the test suite.

42. The method according to claim 40, further comprising isolating execution by performing at least one of:

generating isolated virtual machines, generating a plurality of execution containers for the plurality of execution instances, and implementing processes isolation.

43. The method according to claim 23, further comprising identifying configuration files within the code repository to determine the configuration requirements.

44. The method according to claim 23, further comprising identifying patterns within at least one of the code repository and source code to determine the configuration requirements.

45. The method according to claim 23, where in the at least one test includes a test configured to pass upon execution.