Systems and methods for peer-to-peer build sharing

• US 10,713,035 B2
• Filed: 12/12/2018
• Issued: 07/14/2020
• Est. Priority Date: 12/21/2016
• Status: Active Grant

• Current Assignee: Palantir Technologies Incorporated
• Original Assignee: Palantir Technologies Incorporated
• Inventors: Avant, Matthew
• Primary Examiner(s): Morshed, Hossain M
• Application Number:
  US16/218,325
• Publication Number:
  US 20190114163A1
• Time in Patent Office: 580 Days
• Field of Search: None
• CPC Class Codes: G06F 16/2246 Trees, e.g. B+trees
• CPC Class Codes: G06F 16/284 Relational databases
• CPC Class Codes: G06F 16/951 Indexing; Web crawling techniques
• CPC Class Codes: G06F 8/36 Software reuse
• CPC Class Codes: G06F 8/65 Updates security arrangements therefor G06F21/57
• CPC Class Codes: G06F 8/71 Version control security arrangements therefor G06F21/57; Configuration management
• CPC Class Codes: G06F 9/5061 Partitioning or combining of resources
• CPC Class Codes: H04L 67/10 in which an application is distributed across nodes in the network software deployment G06F8/60; multiprogramming arrangements G06F9/46

Abstract

Systems and methods are provided for obtaining a build object over a communication network, the build object comprising at least a portion of a first build. The build object is stored locally. A build modification object is obtained over the communication network, the build modification object comprising a change between the first build and a second build. The build object updated using the build modification object obtained over the communication network. At least a portion of the updated build object is provided to a first peer build system over the communication network.

Claims

1. A system comprising:

one or more processors; and

memory storing instructions that, when executed by the one or more processors, cause the system to perform;

obtaining a build object over a communication network, the build object comprising at least a portion of a first build and comprising content items stored in leaf nodes of a hash tree structure;

storing the build object;

obtaining a build modification object over the communication network, the build modification object comprising a change in the hash tree structure;

updating the build object using the build modification object obtained over the communication network, the updating the build object comprising generating a second build object using the build modification object; and

providing at least a portion of the updated build object to a first peer build system over the communication network, the at least a portion of the updated build object comprising the second build object.

2. The system of claim 1, wherein each of the content items comprises any of a file or a binary.

3. The system of claim 1, wherein the obtaining the build object over the communication network comprises obtaining the build object from a second peer build system over the communication network, and the obtaining the build modification object over the communication network comprises obtaining the build modification object over the communication from an originating build system storing a complete instance of the first build and a complete instance of the second build.

4. The system of claim 1, wherein the build object comprises an immutable build object.

5. The system of claim 1, wherein the instructions further cause the system to perform:

predicting one or more respective build objects stored by a plurality of respective peer build systems;

receiving a build action request;

selecting a third peer build system from the plurality of respective peer build systems based on the build action request and the prediction;

obtaining a second build object from the third peer build system based on the build action request;

determining whether the second build object satisfies the build action request;

if the second build object satisfies the build action request, processing the build action request using the second build object; and

if the second build object does not satisfy the build action request, iteratively obtaining one or more different build objects from one or more different peer build systems from the plurality of respective build systems until a particular build object of the one or more different build objects satisfies the build action request; and

processing the build action request using the particular build object of the one or more different build objects.

6. The system of claim 5, wherein the selecting a third peer build system from the plurality of respective peer build systems based on the build action request and the prediction comprises selecting a particular peer build system predicted to store a particular build object indicated by the build action request.

7. The system of claim 6, wherein the particular peer build system is selected based on a latency relative to one or more other peers of the plurality of peers predicted to store the particular build object indicated by the build action request.

8. The system of claim 1, wherein the instructions further cause the system to perform:

obtaining one or more additional build objects from one or more additional peer build systems; and

creating a complete instance of the second build from the updated build object and the one or more additional build objects, the complete instance of the second build comprising a hash tree structure.

9. The system of claim 1, wherein storing the build object comprises storing the build object in a Merkle tree structure, the build object comprising a portion of a software build.

10. A method being implemented by a computing system including one or more physical processors and storage media storing machine-readable instructions, the method comprising:

obtaining a build object over a communication network, the build object comprising at least a portion of a first build and comprising content items stored in leaf nodes of a hash tree structure;

storing the build object;

obtaining a build modification object over the communication network, the build modification object comprising a change in the hash tree structure;

updating the build object using the build modification object obtained over the communication network, the updating the build object comprising generating a second build object using the build modification object; and

providing at least a portion of the updated build object to a first peer build system over the communication network, the at least a portion of the updated build object comprising the second build object.

11. The method of claim 10, wherein each of the content items comprises any of a file or a binary.

12. The method of claim 10, wherein the obtaining the build object over the communication network comprises obtaining the build object from a second peer build system over the communication network, and the obtaining the build modification object over the communication network comprises obtaining the build modification object over the communication from an originating build system storing a complete instance of the first build and a complete instance of the second build.

13. The method of claim 10, wherein the build object comprises an immutable build object.

14. The method of claim 10, further comprising:

predicting one or more respective build objects stored by a plurality of respective peer build systems;

receiving a build action request;

selecting a third peer build system from the plurality of respective peer build systems based on the build action request and the prediction;

obtaining a second build object from the third peer build system based on the build action request;

determining whether the second build object satisfies the build action request;

if the second build object satisfies the build action request, processing the build action request using the second build object; and

if the second build object does not satisfy the build action request, iteratively obtaining one or more different build objects from one or more different peer build systems from the plurality of respective build systems until a particular build object of the one or more different build objects satisfies the build action request; and

processing the build action request using the particular build object of the one or more different build objects.

15. The method of claim 14, wherein the selecting a third peer build system from the plurality of respective peer build systems based on the build action request and the prediction comprises selecting a particular peer build system predicted to store a particular build object indicated by the build action request.

16. The method of claim 15, wherein the particular peer build system is selected based on a latency relative to one or more other peers of the plurality of peers predicted to store the particular build object indicated by the build action request.

17. The method of claim 10, further comprising:

obtaining one or more additional build objects from one or more additional peer build systems; and

creating a complete instance of the second build from the updated build object and the one or more additional build objects, the complete instance of the second build comprising a hash tree structure.

18. A non-transitory computer readable medium comprising instructions that, when executed, cause one or more processors to perform:

obtaining a build object over a communication network, the build object comprising at least a portion of a first build and comprising content items stored in leaf nodes of a hash tree structure;

storing the build object;

obtaining a build modification object over the communication network, the build modification object comprising a change in the hash tree structure;

updating the build object using the build modification object obtained over the communication network, the updating the build object comprising generating a second build object using the build modification object; and

providing at least a portion of the updated build object to a first peer build system over the communication network, the at least a portion of the updated build object comprising the second build object.