Distributed parallel build system

• US 8,972,937 B2
• Filed: 05/28/2013
• Issued: 03/03/2015
• Est. Priority Date: 03/31/2006
• Status: Active Grant

• Current Assignee: eBay Inc.
• Original Assignee: eBay Inc.
• Inventors: Gu, Kevin
• Primary Examiner(s): Khatri, Anil
• Application Number:
  US13/903,614
• Publication Number:
  US 20130268915A1
• Time in Patent Office: 644 Days
• Field of Search: 717101-108, 717/114, 717/116, 717120-123
• US Class Current: 717/122
• CPC Class Codes: G06F 8/41 Compilation
• CPC Class Codes: G06F 8/70 Software maintenance or management
• CPC Class Codes: G06F 8/71 Version control security arrangements therefor G06F21/57; Configuration management

Abstract

Systems, articles of manufacture, and methods for managing distributed parallel builds comprising identifying one or more software components in a software project; determining a build configuration for each software component, wherein the build configuration includes a mapping from each software component to a set of build servers, the set selected on an optimizing factor including capability; and building each software component using the mapped set of build servers in the corresponding build configuration, wherein the building includes compiling one or more source files associated with each software component to one or more object files, by distributing the one or more source files to one or more compilation machines.

Claims

1. A computer-implemented method to manage parallel builds in a networked system, comprising:

identifying one or more software components in a software project;

detecting a plurality of build servers;

determining a build configuration for each software component, the build configuration including a mapping from each software component to a set of the plurality of build services, the set selected on an optimizing factor including network capability; and

building each software component using the mapped set in the corresponding build configuration, the building including compiling one or more source files associated with each software component to one or more object files by distributing the one or more source files to one or more compilation machines.

2. The method of claim 1 further including linking the one or more object tiles associated with each software component by distributing the one or more object files to one or more linking machines.

3. The method of claim 2 further including packaging each software component and transferring each packaged software component to one of a development area or a release area.

4. The method of claim 1, further comprising scheduling one or more builds.

5. The method of claim 4, wherein the scheduling is periodic or recurring.

6. The method of claim 1, further comprising queuing one or more builds.

7. The method of claim 6, wherein the queuing is based on one or more of a project type, a requestor, a project size, a project priority, or a project request time.

8. The method of claim 6, wherein the queuing is organized by one or more of a project-level, a component-level, or a file-level.

9. A system to manage parallel builds in a networked system, comprising:

at least computer processor and storage configured to;

identify one or more software components in a software project;

detect a plurality of build servers;

determine a build configuration for each software component, the build configuration includes a mapping from each software component to a set of the plurality of build servers, the set selected based on an optimizing factor including network capability; and

build each software component using the mapped set in the corresponding build configuration, by compiling one or more source files associated with each software component to one or more object files by distributing the one or more source files to one or more compilation machines.

10. The system of claim 9, the at least one computer processor and storage further configured to link the one or more object files associated with each software component by distributing the one or more object files to one or more linking machines.

11. The system of claim 10, the at least one computer processor and storage further configured to package each software component and to transfer each packaged software component to one of a development area or a release area.

12. The system of claim 9, the at least one computer processor and storage further configured to schedule one or more builds.

13. The system of claim 12, wherein the schedule is periodic or recurring.

14. The system of claim 9, the at least one computer processor and storage further configured to queue one or more builds.

15. The system of claim 14, wherein the queue is based on one or more of a project type, a requestor, a project size, a project priority, or a project request time.

16. The system of claim 14, wherein the queue is organized by one or more of a project-level, a component-level, or a file-level.

17. A non-transitory machine-readable storage device having embedded therein a set of instructions which, when executed by a machine, causes execution of the machine to perform operations comprising:

identifying one or more software components in a software project;

detecting a plurality of build servers;

determining a build configuration for each software component, the build configuration including a mapping from each software component to a set of the plurality of build servers, the set selected on an optimizing factor including network capability; and

building each software component using the mapped set in the corresponding build configuration, the building including compiling one or more source files associated with each software component to one or more object files by distributing the one or more source files to one or more compilation machines.

18. The machine-readable storage device of claim 17, the operations further comprising linking the one or more object files associated with each software component by distributing the one or more object files to one or more linking machines.

19. The machine-readable storage device of claim 18, the operations further comprising packaging each software component and transferring each packaged software component to one of a development area or a release area.

20. The machine-readable storage device of claim 17, the operations further comprising scheduling one or more builds.