On-demand provisioning of customized developer environments

• US 10,606,661 B2
• Filed: 12/15/2017
• Issued: 03/31/2020
• Est. Priority Date: 12/15/2017
• Status: Active Grant

• Current Assignee: Rubrik, Inc.
• Original Assignee: Rubrik, Inc.
• Inventors: Dao, Stefan, To, Kenny, Yeh, Pete
• Primary Examiner(s): Bui, Jonathan A
• Application Number:
  US15/844,253
• Publication Number:
  US 20190188047A1
• Time in Patent Office: 837 Days
• CPC Class Codes: G06F 11/1451 by selection of backup contents
• CPC Class Codes: G06F 11/1484 involving virtual machines
• CPC Class Codes: G06F 11/301 where the computing system is a virtual computing platform, e.g. logically partitioned systems virtual machines G06F9/45533; logical partitioning of resources G06F9/5077
• CPC Class Codes: G06F 11/3664 Environments for testing or debugging software
• CPC Class Codes: G06F 2009/45562 Creating, deleting, cloning virtual machine instances
• CPC Class Codes: G06F 2009/4557 Distribution of virtual machine instances; Migration and load balancing
• CPC Class Codes: G06F 2209/5011 Pool
• CPC Class Codes: G06F 2209/503 Resource availability
• CPC Class Codes: G06F 9/45558 Hypervisor-specific management and integration aspects
• CPC Class Codes: G06F 9/5038 considering the execution order of a plurality of tasks, e.g. taking priority or time dependency constraints into consideration scheduling strategies G06F9/4881 and subgroups
• CPC Class Codes: G06F 9/5061 Partitioning or combining of resources
• CPC Class Codes: G06F 9/5077 Logical partitioning of resources; Management or configuration of virtualized resources specific details on emulation or internal functioning of virtual machines G06F9/455

Abstract

Systems and techniques are provided for managing and creating customized testing and development environments by a custom environment manager for computer or data management systems. In a specific implementation, the custom environment manager includes request receivers that receive orders associated with a prioritization from custom environment requestors and store the received orders in a request queue that holds multiple orders having different prioritizations and made by different requestors. The custom environment manager also includes pooled resource managers that track available virtual and physical computing resources needed to build custom environments. The custom environment manager also includes configurators that create custom environments based upon prioritization of the orders and available resources and return the custom environment to the requestor of the order.

Claims

1. A system for managing custom environments, including:

one or more processors coupled with memory storing instructions that, when executed, perform actions implementing;

one or more request receivers that receive orders from requestors including a first order requesting a custom environment or modification to a custom environment;

the first order including a first prioritization that depends upon a quota for prioritized allocation of resources of a first requestor making the first order, and a specified test scenario to be performed; and

store the first order in a request queue that holds multiple orders having different prioritizations and made by different requestors;

one or more pooled resource managers that track available resources and unavailable resources in a resource pool comprising of virtual resources and physical resources deployed on machines external to the system;

one or more configurators that create custom environments based upon multiple orders received by;

retrieving an order in the request queue, checking whether the order retrieved has higher prioritization than other orders in the request queue and whether resources are available in the resource pool to meet the order, and whenever the order has a higher prioritization than other orders in the request queue and there are sufficient resources available in the resource pool to fill the order, allocating available virtual resources and physical resources from the resource pool to create or customize the custom environment specified in the order including allocating specific ones of virtual resources and physical resources to meet requirements of the specified test scenario; and

at least commence returning the custom environment to the requestor of the order; and

wherein the one or more pooled resource managers is configured to automatically recover virtual resources and physical resources in the custom environment when tasks using the physical resources and the virtual resources ordered are complete, wherein the recovering includes closing nodes in virtual resources allocated and freeing physical resources allocated.

2. The system of claim 1, further including a recipe database and further including retrieving specific virtual resources and physical resource configurations stored in the recipe database;

and allocating virtual resources and physical resources according to the virtual resources and physical resources configurations retrieved from the recipe database.

3. The system of claim 1, wherein allocating virtual resources and physical resources includes creating one or more nodes of a virtual type in the virtual resources and a physical type in the physical resources and populating the one or more nodes created with data sources.

4. The system of claim 1, wherein allocating virtual resources and physical resources includes locating one or more nodes of a virtual type available in the virtual resources in the resource pool and one or more nodes of a physical type available in the physical resources in the resource pool and populating the one or more nodes located with data sources.

5. The system of claim 1, further including allocating resources to subsequent orders from a second requestor at a lower prioritization than the first order by a first requester when quota for the second requestor is depleted.

6. The system of claim 1, further including

receiving from a second requestor a second order, the second order including a second prioritization that depends upon a quota of the second requestor making the second order, wherein the second prioritization of the second order is greater than the first prioritization of the first order;

suspending processing of the first order; and

allocating resources to the second order from the second requestor at a higher priority level than the first order until occurrence of either quota for the second requestor is depleted or the second order is completed.

7. The system of claim 1, further including:

receiving an update communicating one or more changes to an order, including at least one of adding comments, extending time limit of the order, changing requesters of the order, closing the order, and adding more physical resources and virtual resources to the order.

8. The system of claim 1, further including:

creating a pre-bootstrapped custom environment image for immediate deployment and saving the pre-bootstrapped custom environment image for subsequent provisioning.

9. The system of claim 8, further including:

retrieving a saved pre-bootstrapped custom environment image and creating one or more custom environments.

10. The system of claim 1, further including a centralized collector to collect and store data across multiple custom environments, and present data collected by creating one or more dashboard displays to present data visualize collected in a centralized location.

11. The system of claim 1, further including predicting future orders, anticipating requirements for the future orders predicted and preparing nodes in virtual resources and physical resources to be allocated to meet the requirements anticipated.

12. The system of claim 1, further including testing functionality of a resource prior to allocating the resource to an order, and when a resource is determined to be inoperable, determining a replacement resource to be allocated to the order.

13. A method for managing custom environments, including:

at a computer system, receiving orders from requestors including a first order requesting a custom environment or modification to a custom environment;

the first order including a first prioritization that depends upon a quota for prioritized allocation of resources of a first requestor making the first order and a specified test scenario to be performed; and

storing the first order in a request queue that holds multiple orders having different prioritizations and made by different requestors;

at the computer system, tracking available resources and unavailable resources in a resource pool comprising of virtual resources and physical resources deployed on machines external to the computer system;

at the computer system, creating custom environments based upon orders received by;

retrieving an order in the request queue, checking whether the order retrieved has higher prioritization than other orders in the request queue and whether resources are available in the resource pool to meet the order, and whenever the order has a higher prioritization than other orders in the request queue and there are sufficient resources available in the resource pool to fill the order, allocating available virtual resources and physical resources from the resource pool to create or customize the custom environment specified, including allocating specific ones of virtual resources and physical resources to meet requirements of the specified test scenario, and at least commence returning the custom environment to the requestor of the order; and

at the computer system, automatically recovering virtual resources and physical resources in the custom environment when tasks using the physical resources and the virtual resources ordered are complete, wherein the recovering includes closing nodes in virtual resources allocated and freeing physical resources allocated.

14. The method of claim 13, further including a recipe database and further including retrieving specific virtual resources and physical resource configurations stored in the recipe database;

and allocating virtual resources and physical resources according to the virtual resources and physical resources configurations retrieved from the recipe database.

15. The method of claim 13, wherein allocating virtual resources and physical resources includes creating one or more nodes of a virtual type in the virtual resources and a physical type in the physical resources and populating the one or more nodes created with data sources.

16. The method of claim 13, wherein allocating virtual resources and physical resources includes locating one or more nodes of a virtual type available in the virtual resources in the resource pool and one or more nodes of a physical type available in the physical resources in the resource pool and populating the one or more nodes located with data sources.

17. The method of claim 13, further including allocating resources to subsequent orders from a second requestor at a lower prioritization than the first order by a first requester when quota for the second requestor is depleted.

18. The method of claim 13, further including

receiving from a second requestor a second order, the second order including a second prioritization that depends upon a quota of the second requestor making the second order, wherein the second prioritization of the second order is greater than the first prioritization of the first order;

suspending processing of the first order; and

allocating resources to the second order from the second requestor at a higher priority level than the first order until occurrence of either quota for the second requestor is depleted or the second order is completed.

19. The method of claim 13, further including:

receiving an update communicating one or more changes to an order, including at least one of adding comments, extending time limit of the order, changing requesters of the order, closing the order, and adding more physical resources and virtual resources to the order.

20. The method of claim 13, further including:

creating a pre-bootstrapped custom environment image for immediate deployment and saving the pre-bootstrapped custom environment image for subsequent provisioning.

21. The method of claim 20, further including:

retrieving a saved pre-bootstrapped custom environment image and creating one or more custom environments.

22. The method of claim 13, further including a centralized collector to collect and store data across multiple custom environments, and present data collected by creating one or more dashboard displays to present data visualize collected in a centralized location.

23. The method of claim 13, further including predicting future orders, anticipating requirements for the future orders predicted and preparing nodes in virtual resources and physical resources to be allocated to meet the requirements anticipated.

24. The method of claim 13, further including testing functionality of a resource prior to allocating the resource to an order;

and when a resource is determined to be inoperable, determining a replacement resource to be allocated to the order.

25. A non-transitory computer readable medium storing instructions for creating and managing custom environments, which instructions when executed by one or more processors implement:

receiving from one or more requestors, orders requesting custom environments, wherein a requestor has a quota for prioritized allocation of resources to orders of the requestor; and

wherein the orders include a first order requesting a custom environment or modification to a custom environment;

the first order including a prioritization that depends upon a quota of a first requestor making the order and a specified test scenario to be performed;

storing the first order in a request queue that holds multiple orders having different prioritizations and made by different requestors;

tracking available resources and unavailable resources in a resource pool comprising of virtual resources and physical resources deployed on machines external to the non-transitory computer readable medium;

creating custom environments based upon orders received by;

retrieving an order in the request queue;

checking whether the order retrieved has higher prioritization than other orders in the request queue and whether resources are available in the resource pool to meet the order;

whenever the order has a higher prioritization than other orders in the request queue and there are sufficient resources available in the resource pool to fill the order, allocating available virtual resources and physical resources from the resource pool to create or customize the custom environment specified in the order including allocating specific ones of virtual resources and physical resources to meet requirements of the specified test scenario;

at least commence returning the custom environment to the requestor of the order; and

automatically recovering virtual resources and physical resources in the custom environment when tasks using the physical resources and the virtual resources ordered are complete, wherein the recovering includes closing nodes in virtual resources allocated and freeing physical resources allocated.