Distributed workflow manager

• US 9,588,685 B1
• Filed: 05/03/2013
• Issued: 03/07/2017
• Est. Priority Date: 05/03/2013
• Status: Active Grant

• Current Assignee: Emc IP Holding Company LLC (Dell Technologies Inc.)
• Original Assignee: Emc IP Holding Company LLC (Dell Technologies Inc.)
• Inventors: Watson, Thomas L., Ninan, Anoop G., Elliott, William J. IV
• Primary Examiner(s): Miller, Alan S
• Application Number:
  US13/886,786
• Time in Patent Office: 1,404 Days
• Field of Search: 705 711- 742, 717/100, 717/174, 718/1, 718/100, 707/600, 707/607, 707/608, 707609-675, 707/912, 707/964, 709201-203, 709217-220
• US Class Current: 1/1
• CPC Class Codes: G06F 3/0604 Improving or facilitating administration, e.g. storage management
• CPC Class Codes: G06F 3/0631 by allocating resources to storage systems
• CPC Class Codes: G06F 3/0655 Vertical data movement, i.e. input-output transfer; data movement between one or more hosts and one or more storage devices
• CPC Class Codes: G06F 3/0665 at area level, e.g. provisioning of virtual or logical volumes
• CPC Class Codes: G06F 3/067 Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
• CPC Class Codes: G06F 3/0683 Plurality of storage devices

Abstract

A method for orchestrating a workflow, including one or more steps, for provisioning a data service on a data storage system, the data storage system including one or more sub-systems, the method comprising orchestrating the execution of the workflow on the data storage system by analyzing the workflow to determine a dependency of each of the one or more steps for provisioning the data service; and based on the dependency of each of the one or more steps, scheduling the one or more steps for execution on the one or more sub-systems of the data storage system, wherein a first step of the one or more steps scheduled on a first sub-system of the one or more sub-systems is scheduled in parallel with a second step of the one or more steps scheduled on a second sub-system of the one or more sub-systems.

Claims

1. A computer-executable method for orchestrating a workflow, including one or more steps, for provisioning a data service on a data storage system, the data storage system including one or more sub-systems, the computer-executable method comprising:

orchestrating the execution of the workflow on the data storage system by;

analyzing the workflow to determine a dependency of each of the one or more steps for provisioning the data service wherein analyzing includes detecting whether one or more portions of the workflow are enabled to be executed serially or in parallel; and

based on the dependency of each of the one or more steps, scheduling the one or more steps for execution on the one or more sub-systems of the data storage system, wherein a first step of the one or more steps scheduled on a first sub-system of the one or more sub-systems is executed serially with a second step of the one or more steps scheduled on the first sub-system;

determining, at a sub-system of the sub-systems receiving a step of the one or more steps, whether to create a workflow based on the step;

wherein the data storage system is enabled to dynamically add one or more steps to the workflow to enable the data storage system to roll back one or more portions of the workflow.

2. The computer-executable method of claim 1, wherein the scheduling of the one or more steps further comprises:

scheduling a third step of the one or more steps on a second sub-system of the one or more sub-systems, wherein the third step is scheduled in parallel with the first step of the one or more steps.

3. The computer-executable method of claim 1, wherein the orchestrating further comprises:

executing the one or more steps of the workflow;

monitoring the one or more steps for a status, wherein if the first step of the one or more steps successfully completes, the second step executes;

wherein if the first sub-system fails while executing the first step of the one or more steps, the first step restarts on a third sub-system of the one or more sub-systems.

4. The computer-executable method of claim 3, wherein if the first step of the one or more steps fails to successfully complete, the dependency of each of the one or more steps for provisioning the data storage volume is used to schedule one or more rollback steps.

5. The computer-executable method of claim 1, wherein each of the one or more steps for provisioning the data service is associated a rollback step, wherein the rollback step reverses an action of the associated step of the one or more steps.

6. The computer-executable method of claim 1, wherein each of the one or more sub-systems scheduled to execute one or more steps provides a status related to the one or more steps.

7. A system, comprising:

a data storage system having one or more sub-systems; and

computer-executable logic encoded in memory of one or more computers in communication with the data storage system to enable provisioning of a data service on the data storage system by orchestrating a workflow, the workflow including one or more steps, wherein the computer-executable logic is configured for the execution of;

orchestrating the execution of the workflow on the data storage system by;

analyzing the workflow to determine a dependency of each of the one or more steps for provisioning the data service wherein analyzing includes detecting whether one or more portions of the workflow are enabled to be executed serially or in parallel; and

based on the dependency of each of the one or more steps, scheduling the one or more steps for execution on the one or more sub-systems of the data storage system, wherein a first step of the one or more steps scheduled on a first sub-system of the one or more sub-systems is executed serially with a second step of the one or more steps scheduled on the first sub-system;

determining, at a sub-system of the sub-systems receiving a step of the one or more steps, whether to create a workflow based on the step;

wherein the data storage system is enabled to dynamically add one or more steps to the workflow to enable the data storage system to roll back one or more portions of the workflow.

8. The system of claim 7, wherein the scheduling of the one or more steps further comprises:

scheduling a third step of the one or more steps on a second sub-system of the one or more sub-systems, wherein the third step is scheduled in parallel with the first step of the one or more steps.

9. The system of claim 7, wherein the orchestrating further comprises:

executing the one or more steps of the workflow;

monitoring the one or more steps for a status, wherein if the first step of the one or more steps successfully completes, a third step of the one or more steps dependent on the first step executes;

wherein if the first sub-system fails while executing the first step of the one or more steps, the first step restarts on a third sub-system of the one or more sub-systems.

10. The system of claim 9, wherein if the first step of the one or more steps fails to successfully complete, the dependency of each of the one or more steps for provisioning the data storage volume is used to schedule one or more rollback steps.

11. The system of claim 7, wherein each of the one or more steps for provisioning the data service is associated to a rollback step, wherein the rollback step reverses an action of the associated step of the one or more steps.

12. The system of claim 7, wherein each of the one or more sub-systems scheduled to execute one or more steps provides a status related to the one or more steps.

13. A computer program product for orchestrating a workflow, including one or more steps, for provisioning a data service on a data storage system, the data storage system including one or more sub-systems, the computer program product comprising:

orchestrating the execution of the workflow on the data storage system by;

analyzing the workflow to determine a dependency of each of the one or more steps for provisioning the data service wherein analyzing includes detecting whether one or more portions of the workflow are enabled to be executed serially or in parallel; and

based on the dependency of each of the one or more steps, scheduling the one or more steps for execution on the one or more sub-systems of the data storage system, wherein a first step of the one or more steps scheduled on a first sub-system of the one or more sub-systems is executed serially with a second step of the one or more steps scheduled on the first sub-system;

determining, at a sub-system of the sub-systems receiving a step of the one or more steps, whether to create a workflow based on the step;

wherein the data storage system is enabled to dynamically add one or more steps to the workflow to enable the data storage system to roll back one or more portions of the workflow.

14. The computer program product of claim 13, wherein the scheduling of the one or more steps further comprises:

scheduling a third step of the one or more steps on a second sub-system of the one or more sub-systems, wherein the third step is scheduled in parallel with the first step of the one or more steps.

15. The computer program product of claim 13, wherein the orchestrating further comprises:

executing the one or more steps of the workflow;

monitoring the one or more steps for a status, wherein if the first step of the one or more steps successfully completes, a third step of the one or more steps dependent on the first step executes;

wherein if the first sub-system fails while executing the first step of the one or more steps, the first step restarts on a third sub-system of the one or more sub-systems.

16. The computer program product of claim 15, wherein if the first step of the one or more steps fails to successfully complete, the dependency of each of the one or more steps for provisioning the data storage volume is used to schedule one or more rollback steps.

17. The computer program product of claim 13, wherein each of the one or more steps for provisioning the data service is associated a rollback step, wherein the rollback step reverses an action of the associated step of the one or more steps.

18. The computer program product of claim 13, wherein each of the one or more sub-systems scheduled to execute one or more steps provides a status related to the one or more steps.