Hierarchical federated area trees

• US 10,095,553 B2
• Filed: 02/15/2018
• Issued: 10/09/2018
• Est. Priority Date: 02/05/2016
• Status: Active Grant

• Current Assignee: SAS Institute Incorporated
• Original Assignee: SAS Institute Incorporated
• Inventors: Bequet, Henry Gabriel Victor, Yang, Eric Jian, Arfaoui, Kais, Stogner, Ronald Earl
• Primary Examiner(s): PATEL, HIREN P
• Application Number:
  US15/897,675
• Publication Number:
  US 20180189111A1
• Time in Patent Office: 236 Days
• Field of Search: None
• CPC Class Codes: G06F 16/9014 hash tables
• CPC Class Codes: G06F 16/90344 by using string matching techniques
• CPC Class Codes: G06F 9/5083 Techniques for rebalancing the load in a distributed system
• CPC Class Codes: G06N 3/045 Combinations of networks
• CPC Class Codes: G06N 3/084 Backpropagation, e.g. using gradient descent
• CPC Class Codes: G06N 5/01 Dynamic search techniques; Heuristics; Dynamic trees; Branch-and-bound

Abstract

An apparatus includes a processor to: grant a first device access to a first federated area, but not a second device; grant the second device access to a second federated area, but not the first device; grant the first and second devices access to a base federated area; maintain inheritance relationships among the federated areas so an object stored in the base federated area is as accessible to the first device as an object in the first federated area and is as accessible to the second device as an object in the second federated area; and maintain priority relationships among the federated areas so priority is given to providing the first device access to a task routine stored in the first federated area, and to providing the second device access to a task routine stored in the second federated area, over a task routine stored in the base federated area.

Claims

1. An apparatus comprising a processor and a storage to store instructions that, when executed by the processor, cause the processor to perform operations comprising:

grant, at a portal, and to a first requesting device via a network, access to a first federated area maintained within one or more storage devices to store multiple objects comprising multiple data sets, multiple job flow definitions, multiple task routines, multiple result reports and multiple instance logs;

grant, at the portal, and to a second requesting device via the network, access to a second federated area maintained within the one or more storage devices to store multiple objects comprising multiple data sets, multiple job flow definitions, multiple task routines, multiple result reports and multiple instance logs;

deny, to the first requesting device, access to the second federated area;

deny, to the second requesting device, access to the first federated area;

grant, at the portal, and to the first and second requesting devices, access to a base federated area maintained within the one or more storage devices to store multiple objects comprising multiple data sets, multiple job flow definitions, multiple task routines, multiple result reports and multiple instance logs, wherein;

the portal is provided on the network to control access to federated areas by devices requesting access to federated areas via the network;

the base federated area defines a root of a tree of federated areas;

the first federated area at least partially defines a first branch of the tree; and

the second federated area at least partially defines a second branch of the tree;

receive, at the portal, and from the first requesting device via the network, a first request to perform at least a first task of a first job flow with at least a first data set;

maintain a first inheritance relationship between the first federated area and the base federated area in which the processor is caused to make a base object stored within the base federated area as accessible to the first requesting device as a first object stored within the first federated area;

maintain a first priority relationship between the first federated area and the base federated area as an exception to the first inheritance relationship in which the processor is caused to;

determine whether the first object is a task routine comprising executable instructions;

determine whether the base object is a task routine comprising executable instructions;

determine whether the first object and the base object share a first flow task identifier that indicates that the first object and the base object perform the first task when executed;

in response to determinations by the processor that the first object is a task routine, the base object is a task routine, and the first object and the base object share the first flow task identifier, the processor is caused to select the first object to execute to perform the first task, regardless of whether the base object is a newer version of a task routine to perform the first task than the first object; and

in response to determinations by the processor that the base object is a task routine, and that either the first object is not a task routine, or the first object and the base object do not share the first flow task identifier, the processor is caused to execute the instructions of the base object to perform the first task;

receive, at the portal, and from the second requesting device via the network, a second request to perform at least one task of a second job flow with at least a second data set;

maintain a second inheritance relationship between the second federated area and the base federated area in which the processor is caused to make the base object stored within the base federated area as accessible to the second requesting device as a second object stored within the second federated area; and

maintain a second priority relationship between the second federated area and the base federated area as an exception to the second inheritance relationship in which the processor is caused to;

determine whether the second object is a task routine comprising executable instructions;

determine whether the second object and the base object share a second flow task identifier that indicates that the second object and the base object perform the second task when executed; and

in response to determinations by the processor that the second object is a task routine, the base object is a task routine, and the second object and the base object share the second flow task identifier, the processor is caused to select the second object to execute to perform the second task, regardless of whether the base object is a newer version of a task routine to perform the second task than the second object.

2. The apparatus of claim 1, wherein the processor is caused to perform operations comprising:

assign a base URL to the base federated area to enable the first requesting device and the second requesting device to access the base federated area at the base URL through the network via a web access protocol;

assign a first branch URL to the first federated area to enable the first requesting device to access the first federated area at the first branch URL through the network via a web access protocol, wherein the first branch URL comprises the base URL as a portion of the first branch URL; and

assign a second branch URL to the second federated area to enable the second requesting device to access the second federated area at the second branch URL through the network via a web access protocol, wherein the second branch URL comprises the base URL as a portion of the second branch URL.

3. The apparatus of claim 1, wherein:

the first federated area comprises a first private federated area associated with the first requesting device; and

the processor is caused to perform operations comprising;

receive, at the portal, and from the second requesting device via the network, a third request to provide access via the network to the base federated area to the first requesting device;

examine a security credential associated with the second requesting device to determine whether the third request is authorized; and

in response to a determination by the processor that the third request is authorized, the processor is caused to allocate storage space within the one or more storage devices for the first private federated area and to grant access to the first private federated area to the first requesting device as part of granting access to the base federated area to the first requesting device.

4. The apparatus of claim 1, wherein:

the first federated area comprises a first intervening federated area interposed between the base federated area and a first private federated area within the first branch; and

the processor is caused to perform operations comprising;

maintain a third inheritance relationship between the first private federated area and the first intervening federated area in which the processor is caused to make the first object stored in the first intervening federated area and the base object stored in the base federated area as accessible to the first requesting device as a third object stored in the first private federated area; and

maintain a third priority relationship between the first private federated area and the first intervening federated area as an exception to the third inheritance relationship in which the processor is caused to;

determine whether the third object is a task routine comprising executable instructions;

determine whether the third object shares the first flow task identifier with at least one of the first object and the base object; and

in response to determinations by the processor that the third object is a task routine, at least one of the first object and the base object is a task routine, and the third object shares the first flow task identifier with at least one of the first object and the base object, the processor is caused to select the third object to execute to perform the first task, regardless of whether the first object is a newer version of a task routine to perform the first task than the third object, and regardless of whether the base object is a newer version of a task routine to perform the first task than the third object.

5. The apparatus of claim 4, wherein:

the second federated area comprises a second intervening federated area interposed between the base federated area and a second private federated area within the second branch; and

the processor is caused to perform operations comprising;

maintain a fourth inheritance relationship between the second private federated area and the second intervening federated area in which the processor is caused to make the second object stored in the second intervening federated area and the base object stored in the base federated area as accessible to the second requesting device as a fourth object stored in the second private federated area; and

maintain a fourth priority relationship between the second private federated area and the second intervening federated area as an exception to the fourth inheritance relationship in which the processor is caused to;

determine whether the fourth object is a task routine comprising executable instructions;

determine whether the fourth object shares the second flow task identifier with at least one of the second object and the base object; and

in response to determinations by the processor that the fourth object is a task routine, at least one of the second object and the base object is a task routine, and the fourth object shares the second flow task identifier with at least one of the second object and the base object, the processor is caused to select the fourth object to execute to perform the second task, regardless of whether the second object is a newer version of a task routine to perform the second task than the fourth object, and regardless of whether the base object is a newer version of a task routine to perform the second task than the fourth object.

6. The apparatus of claim 5, wherein:

the first task comprises generating at least the second data set from at least the first data set; and

the processor is caused, in response to a performance of at least the first task of the first job flow, to perform operations comprising;

analyze the second data set to determine whether results of the performance of at least the first task of the first job flow meets criteria specified by a control flow definition; and

in response to a determination that the criteria are met by the performance of at least the first task of the first job flow, perform operations comprising;

copy the second data set from the first intervening federated area and to the second intervening federated area; and

perform at least the second task of the second job flow.

7. The apparatus of claim 1, wherein the processor is caused to perform operations comprising:

receive, at the portal, and from the first requesting device via the network, a third request to store the first object among the multiple objects in one of the first federated area and the base federated area specified in the third request, wherein the first object comprises a first task routine that comprises;

the first flow task identifier to indicate that the first task is performed when instructions of the first task routine are executed;

a first input interface by which the first task routine is to receive data of at least the first data set; and

a first output interface;

determine whether another task routine is already stored in at least one of the first federated area and the base federated area that also comprises the first flow task identifier to indicate that the first task is performed when instructions of the other task routine are executed; and

in response to a determination that another task routine that comprises the first flow task identifier is stored in at least one of the first federated area and the base federated area, perform operations comprising;

compare the first input interface to a corresponding input interface of the other task routine;

compare the first output interface to a corresponding output interface of the other task routine; and

in response to a determination that the first input interface matches the corresponding input interface, and in response to a determination that the first output interface matches or is a superset of the corresponding output interface, store the first task routine among the multiple task routines in the specified one of the first federated area and the base federated area, and store an indication of the storage of more than one task routine comprising the first flow task identifier in one of the first federated area and the base federated area.

8. The apparatus of claim 7, wherein the processor is caused to perform operations comprising:

receive, at the portal, and from the second requesting device via the network, a fourth request to store the second object among the multiple objects in one of the second intervening federated area and the base federated area, wherein the second object comprises a second task routine that comprises;

the second flow task identifier to indicate that the second task is performed when instructions of the second task routine are executed;

a second input interface by which the second task routine is to receive data of at least the second data set; and

a second output interface;

determine whether another task routine is already stored in at least one of the second intervening federated area and the base federated area that also comprises the second flow task identifier to indicate that the second task is performed when instructions of the other task routine are executed; and

in response to a determination that another task routine that comprises the second flow task identifier is stored in at least one of the second intervening federated area and the base federated area, perform operations comprising;

compare the second input interface to a corresponding input interface of the other task routine;

compare the second output interface to a corresponding output interface of the other task routine; and

in response to a determination that the second input interface matches the corresponding input interface, and in response to a determination that the second output interface matches or is a superset of the corresponding output interface, store the second task routine among the multiple task routines in the specified one of the second intervening federated area and the base federated area, and store an indication of the storage of more than one task routine comprising the second flow task identifier in one of the second intervening federated area and the base federated area.

9. The apparatus of claim 1, wherein the processor is caused to perform operations comprising:

receive, at the portal, and from the first requesting device via the network, a third request to store a first job flow definition in a specified one of the first federated area and the base federated area, wherein the first job flow definition comprises;

at least one flow task identifier that specifies at least the first task to be performed when instructions of at least one corresponding task routine are executed; and

at least one data set identifier that specifies at least the first data set to be used as an input to the performance of the first task;

for each flow task identifier of the at least one flow task identifier, search the first federated area and the base federated area to determine whether there is at least one corresponding task routine stored in at least one of the first federated area and the base federated area;

for each data set identifier of the at least one data set identifier, search the first federated area and the base federated area to determine whether there is at least one corresponding data set stored in at least one of the first federated area and the base federated area; and

in response to a determination that there is at least one corresponding task routine stored in at least one of the first federated area and the base federated area for each flow task identifier of the at least one flow task identifier, and in response to a determination that there is at least one corresponding data set stored in at least one of the first federated area and the base federated area for each data set identifier of the at least one data set identifier, permit storage of the first job flow definition in the specified one of the first federated area and the base federated area.

10. The apparatus of claim 9, wherein the processor is caused to perform operations comprising:

receive, at the portal, and from the second requesting device via the network, a fourth request to store a second job flow definition in a specified one of the second federated area and the base federated area, wherein the second job flow definition comprises;

at least one flow task identifier that specifies at least the second task to be performed when instructions of at least one corresponding task routine are executed; and

at least one data set identifier that specifies at least the second data set to be used as an input to the performance of the second task;

for each flow task identifier of the at least one flow task identifier, search the second federated area and the base federated area to determine whether there is at least one corresponding task routine stored in at least one of the second federated area and the base federated area;

for each data set identifier of the at least one data set identifier, search the second federated area and the base federated area to determine whether there is at least one corresponding data set stored in at least one of the second federated area and the base federated area; and

in response to a determination that there is at least one corresponding task routine stored in at least one of the second federated area and the base federated area for each flow task identifier of the at least one flow task identifier, and in response to a determination that there is at least one corresponding data set stored in at least one of the second federated area and the base federated area for each data set identifier of the at least one data set identifier, permit storage of the second job flow definition in the specified one of the second federated area and the base federated area.

11. A computer-program product tangibly embodied in a non-transitory machine-readable storage medium, the computer-program product including instructions operable to cause a processor to perform operations comprising:

grant, at a portal, and to a first requesting device via a network, access to a first federated area maintained within one or more storage devices to store multiple objects comprising multiple data sets, multiple job flow definitions, multiple task routines, multiple result reports and multiple instance logs;

grant, at the portal, and to a second requesting device via the network, access to a second federated area maintained within the one or more storage devices to store multiple objects comprising multiple data sets, multiple job flow definitions, multiple task routines, multiple result reports and multiple instance logs;

deny, to the first requesting device, access to the second federated area;

deny, to the second requesting device, access to the first federated area;

grant, at the portal, and to the first and second requesting devices, access to a base federated area maintained within the one or more storage devices to store multiple objects comprising multiple data sets, multiple job flow definitions, multiple task routines, multiple result reports and multiple instance logs, wherein;

the portal is provided on the network to control access to federated areas by devices requesting access to federated areas via the network;

the base federated area defines a root of a tree of federated areas;

the first federated area at least partially defines a first branch of the tree; and

the second federated area at least partially defines a second branch of the tree;

receive, at the portal, and from the first requesting device via the network, a first request to perform at least a first task of a first job flow with at least a first data set;

maintain a first inheritance relationship between the first federated area and the base federated area in which the processor is caused to make a base object stored within the base federated area as accessible to the first requesting device as a first object stored within the first federated area;

maintain a first priority relationship between the first federated area and the base federated area as an exception to the first inheritance relationship in which the processor is caused to;

determine whether the first object is a task routine comprising executable instructions;

determine whether the base object is a task routine comprising executable instructions;

determine whether the first object and the base object share a first flow task identifier that indicates that the first object and the base object perform the first task when executed;

in response to determinations by the processor that the first object is a task routine, the base object is a task routine, and the first object and the base object share the first flow task identifier, the processor is caused to select the first object to execute to perform the first task, regardless of whether the base object is a newer version of a task routine to perform the first task than the first object; and

in response to determinations by the processor that the base object is a task routine, and that either the first object is not a task routine, or the first object and the base object do not share the first flow task identifier, the processor is caused to execute the instructions of the base object to perform the first task;

receive, at the portal, and from the second requesting device via the network, a second request to perform at least one task of a second job flow with at least a second data set;

maintain a second inheritance relationship between the second federated area and the base federated area in which the processor is caused to make the base object stored within the base federated area as accessible to the second requesting device as a second object stored within the second federated area; and

maintain a second priority relationship between the second federated area and the base federated area as an exception to the second inheritance relationship in which the processor is caused to;

determine whether the second object is a task routine comprising executable instructions;

determine whether the second object and the base object share a second flow task identifier that indicates that the second object and the base object perform the second task when executed; and

in response to determinations by the processor that the second object is a task routine, the base object is a task routine, and the second object and the base object share the second flow task identifier, the processor is caused to select the second object to execute to perform the second task, regardless of whether the base object is a newer version of a task routine to perform the second task than the second object.

12. The computer-program of claim 11, wherein the processor is caused to perform operations comprising:

assign a base URL to the base federated area to enable the first requesting device and the second requesting device to access the base federated area at the base URL through the network via a web access protocol;

assign a first branch URL to the first federated area to enable the first requesting device to access the first federated area at the first branch URL through the network via a web access protocol, wherein the first branch URL comprises the base URL as a portion of the first branch URL; and

assign a second branch URL to the second federated area to enable the second requesting device to access the second federated area at the second branch URL through the network via a web access protocol, wherein the second branch URL comprises the base URL as a portion of the second branch URL.

13. The computer-program product of claim 11, wherein:

the first federated area comprises a first private federated area associated with the first requesting device; and

the processor is caused to perform operations comprising;

receive, at the portal, and from the second requesting device via the network, a third request to provide access via the network to the base federated area to the first requesting device;

examine a security credential associated with the second requesting device to determine whether the third request is authorized; and

in response to a determination by the processor that the third request is authorized, the processor is caused to allocate storage space within the one or more storage devices for the first private federated area and to grant access to the first private federated area to the first requesting device as part of granting access to the base federated area to the first requesting device.

14. The computer-program product of claim 11, wherein:

the first federated area comprises a first intervening federated area interposed between the base federated area and a first private federated area within the first branch; and

the processor is caused to perform operations comprising;

maintain a third inheritance relationship between the first private federated area and the first intervening federated area in which the processor is caused to make the first object stored in the first intervening federated area and the base object stored in the base federated area as accessible to the first requesting device as a third object stored in the first private federated area; and

maintain a third priority relationship between the first private federated area and the first intervening federated area as an exception to the third inheritance relationship in which the processor is caused to;

determine whether the third object is a task routine comprising executable instructions;

determine whether the third object shares the first flow task identifier with at least one of the first object and the base object; and

in response to determinations by the processor that the third object is a task routine, at least one of the first object and the base object is a task routine, and the third object shares the first flow task identifier with at least one of the first object and the base object, the processor is caused to select the third object to execute to perform the first task, regardless of whether the first object is a newer version of a task routine to perform the first task than the third object, and regardless of whether the base object is a newer version of a task routine to perform the first task than the third object.

15. The computer-program product of claim 14, wherein:

the second federated area comprises a second intervening federated area interposed between the base federated area and a second private federated area within the second branch; and

the processor is caused to perform operations comprising;

maintain a fourth inheritance relationship between the second private federated area and the second intervening federated area in which the processor is caused to make the second object stored in the second intervening federated area and the base object stored in the base federated area as accessible to the second requesting device as a fourth object stored in the second private federated area; and

maintain a fourth priority relationship between the second private federated area and the second intervening federated area as an exception to the fourth inheritance relationship in which the processor is caused to;

determine whether the fourth object is a task routine comprising executable instructions;

determine whether the fourth object shares the second flow task identifier with at least one of the second object and the base object; and

in response to determinations by the processor that the fourth object is a task routine, at least one of the second object and the base object is a task routine, and the fourth object shares the second flow task identifier with at least one of the second object and the base object, the processor is caused to select the fourth object to execute to perform the second task, regardless of whether the second object is a newer version of a task routine to perform the second task than the fourth object, and regardless of whether the base object is a newer version of a task routine to perform the second task than the fourth object.

16. The computer-program product of claim 15, wherein:

the first task comprises generating at least the second data set from at least the first data set; and

the processor is caused, in response to a performance of at least the first task of the first job flow, to perform operations comprising;

analyze the second data set to determine whether results of the performance of at least the first task of the first job flow meets criteria specified by a control flow definition; and

in response to a determination that the criteria are met by the performance of at least the first task of the first job flow, perform operations comprising;

copy the second data set from the first intervening federated area and to the second intervening federated area; and

perform at least the second task of the second job flow.

17. The computer-program product of claim 11, wherein the processor is caused to perform operations comprising:

receive, at the portal, and from the first requesting device via the network, a third request to store the first object among the multiple objects in one of the first federated area and the base federated area specified in the third request, wherein the first object comprises a first task routine that comprises;

the first flow task identifier to indicate that the first task is performed when instructions of the first task routine are executed;

a first input interface by which the first task routine is to receive data of at least the first data set; and

a first output interface;

determine whether another task routine is already stored in at least one of the first federated area and the base federated area that also comprises the first flow task identifier to indicate that the first task is performed when instructions of the other task routine are executed; and

in response to a determination that another task routine that comprises the first flow task identifier is stored in at least one of the first federated area and the base federated area, perform operations comprising;

compare the first input interface to a corresponding input interface of the other task routine;

compare the first output interface to a corresponding output interface of the other task routine; and

in response to a determination that the first input interface matches the corresponding input interface, and in response to a determination that the first output interface matches or is a superset of the corresponding output interface, store the first task routine among the multiple task routines in the specified one of the first federated area and the base federated area, and store an indication of the storage of more than one task routine comprising the first flow task identifier in one of the first federated area and the base federated area.

18. The computer-program product of claim 17, wherein the processor is caused to perform operations comprising:

receive, at the portal, and from the second requesting device via the network, a fourth request to store the second object among the multiple objects in one of the second intervening federated area and the base federated area, wherein the second object comprises a second task routine that comprises;

the second flow task identifier to indicate that the second task is performed when instructions of the second task routine are executed;

a second input interface by which the second task routine is to receive data of at least the second data set; and

a second output interface;

determine whether another task routine is already stored in at least one of the second intervening federated area and the base federated area that also comprises the second flow task identifier to indicate that the second task is performed when instructions of the other task routine are executed; and

in response to a determination that another task routine that comprises the second flow task identifier is stored in at least one of the second intervening federated area and the base federated area, perform operations comprising;

compare the second input interface to a corresponding input interface of the other task routine;

compare the second output interface to a corresponding output interface of the other task routine; and

in response to a determination that the second input interface matches the corresponding input interface, and in response to a determination that the second output interface matches or is a superset of the corresponding output interface, store the second task routine among the multiple task routines in the specified one of the second intervening federated area and the base federated area, and store an indication of the storage of more than one task routine comprising the second flow task identifier in one of the second intervening federated area and the base federated area.

19. The computer-program of claim 11, wherein the processor is caused to perform operations comprising:

receive, at the portal, and from the first requesting device via the network, a third request to store a first job flow definition in a specified one of the first federated area and the base federated area, wherein the first job flow definition comprises;

at least one flow task identifier that specifies at least the first task to be performed when instructions of at least one corresponding task routine are executed; and

at least one data set identifier that specifies at least the first data set to be used as an input to the performance of the first task;

for each flow task identifier of the at least one flow task identifier, search the first federated area and the base federated area to determine whether there is at least one corresponding task routine stored in at least one of the first federated area and the base federated area;

for each data set identifier of the at least one data set identifier, search the first federated area and the base federated area to determine whether there is at least one corresponding data set stored in at least one of the first federated area and the base federated area; and

in response to a determination that there is at least one corresponding task routine stored in at least one of the first federated area and the base federated area for each flow task identifier of the at least one flow task identifier, and in response to a determination that there is at least one corresponding data set stored in at least one of the first federated area and the base federated area for each data set identifier of the at least one data set identifier, permit storage of the first job flow definition in the specified one of the first federated area and the base federated area.

20. The computer-implemented program of claim 19, wherein the processor is caused to perform operations comprising:

receive, at the portal, and from the second requesting device via the network, a fourth request to store a second job flow definition in a specified one of the second federated area and the base federated area, wherein the second job flow definition comprises;

at least one flow task identifier that specifies at least the second task to be performed when instructions of at least one corresponding task routine are executed; and

at least one data set identifier that specifies at least the second data set to be used as an input to the performance of the second task;

for each flow task identifier of the at least one flow task identifier, search the second federated area and the base federated area to determine whether there is at least one corresponding task routine stored in at least one of the second federated area and the base federated area;

for each data set identifier of the at least one data set identifier, search the second federated area and the base federated area to determine whether there is at least one corresponding data set stored in at least one of the second federated area and the base federated area; and

in response to a determination that there is at least one corresponding task routine stored in at least one of the second federated area and the base federated area for each flow task identifier of the at least one flow task identifier, and in response to a determination that there is at least one corresponding data set stored in at least one of the second federated area and the base federated area for each data set identifier of the at least one data set identifier, permit storage of the second job flow definition in the specified one of the second federated area and the base federated area.

21. A computer-implemented method comprising:

granting, at a server by a processor, and via a portal on a network to a first requesting device, access to a first federated area maintained within one or more storage devices to store multiple objects comprising multiple data sets, multiple job flow definitions, multiple task routines, multiple result reports and multiple instance logs;

granting, at the server by the processor, and via the portal on the network to a second requesting device, access to a second federated area maintained within the one or more storage devices to store multiple objects comprising multiple data sets, multiple job flow definitions, multiple task routines, multiple result reports and multiple instance logs;

denying, to the first requesting device, access to the second federated area;

denying, to the second requesting device, access to the first federated area;

granting, at a server by the processor, and via the portal on the network to the first and second requesting devices, access to a base federated area maintained within the one or more storage devices to store multiple objects comprising multiple data sets, multiple job flow definitions, multiple task routines, multiple result reports and multiple instance logs, wherein;

the portal is provided on the network to control access to federated areas by devices requesting access to federated areas via the network;

the base federated area defines a root of a tree of federated areas;

the first federated area at least partially defines a first branch of the tree; and

the second federated area at least partially defines a second branch of the tree;

receiving, at the server by the processor, and via the portal on the network from the first requesting device, a first request to perform at least a first task of a first job flow with at least a first data set;

maintaining a first inheritance relationship between the first federated area and the base federated area in which a base object stored within the base federated area is made as accessible to the first requesting device as a first object stored within the first federated area;

maintaining a first priority relationship between the first federated area and the base federated area as an exception to the first inheritance relationship by performing operations comprising;

determining whether the first object is a task routine comprising executable instructions;

determining whether the base object is a task routine comprising executable instructions;

determining whether the first object and the base object share a first flow task identifier that indicates that the first object and the base object perform the first task when executed;

in response to determinations by the processor that the first object is a task routine, the base object is a task routine, and the first object and the base object share the first flow task identifier, selecting, by the processor, the first object to execute to perform the first task, regardless of whether the base object is a newer version of a task routine to perform the first task than the first object;

or

in response to determinations by the processor that the base object is a task routine, and that either the first object is not a task routine, or the first object and the base object do not share the first flow task identifier, executing, by the processor, the instructions of the base object to perform the first task;

receiving, at the server by the processor, and via the portal on the network from the second requesting, a second request to perform at least one task of a second job flow with at least a second data set;

maintaining a second inheritance relationship between the second federated area and the base federated area in which the base object stored within the base federated area is made as accessible to the second requesting device as a second object stored within the second federated area; and

maintaining a second priority relationship between the second federated area and the base federated area as an exception to the second inheritance relationship by performing operations comprising;

determining whether the second object is a task routine comprising executable instructions;

determining whether the second object and the base object share a second flow task identifier that indicates that the second object and the base object perform the second task when executed; and

in response to determinations by the processor that the second object is a task routine, the base object is a task routine, and the second object and the base object share the second flow task identifier, selecting, by the processor, the second object to execute to perform the second task, regardless of whether the base object is a newer version of a task routine to perform the second task than the second object.

22. The computer-implemented method of claim 21, comprising:

assigning a base URL to the base federated area to enable the first requesting device and the second requesting device to access the base federated area at the base URL through the network via a web access protocol;

assigning a first branch URL to the first federated area to enable the first requesting device to access the first federated area at the first branch URL through the network via a web access protocol, wherein the first branch URL comprises the base URL as a portion of the first branch URL; and

assigning a second branch URL to the second federated area to enable the second requesting device to access the second federated area at the second branch URL through the network via a web access protocol, wherein the second branch URL comprises the base URL as a portion of the second branch URL.

23. The computer-implemented method of claim 21, wherein:

the first federated area comprises a first private federated area associated with the first requesting device; and

the method comprises;

receiving, at the server by the processor, and via the portal on the network from the second requesting device, a third request to provide access via the network to the base federated area to the first requesting device;

examining a security credential associated with the second requesting device to determine whether the third request is authorized; and

in response to a determination by the processor that the third request is authorized, allocating storage space within the one or more storage devices for the first private federated area and to grant access to the first private federated area to the first requesting device as part of granting access to the base federated area to the first requesting device.

24. The computer-implemented method of claim 21, wherein:

the first federated area comprises a first intervening federated area interposed between the base federated area and a first private federated area within the first branch; and

the method comprises;

maintaining a third inheritance relationship between the first private federated area and the first intervening federated area in which the first object stored in the first intervening federated area and the base object stored in the base federated area are made as accessible to the first requesting device as a third object stored in the first private federated area; and

maintaining a third priority relationship between the first private federated area and the first intervening federated area as an exception to the third inheritance relationship by performing operations comprising;

determining whether the third object is a task routine comprising executable instructions;

determining whether the third object shares the first flow task identifier with at least one of the first object and the base object; and

in response to determinations by the processor that the third object is a task routine, at least one of the first object and the base object is a task routine, and the third object shares the first flow task identifier with at least one of the first object and the base object, selecting, by the processor, the third object to execute, regardless of whether the first object is a newer version of a task routine to perform the first task than the third object, and regardless of whether the base object is a newer version of a task routine to perform the first task than the third object.

25. The computer-implemented method of claim 24, wherein:

the second federated area comprises a second intervening federated area interposed between the base federated area and a second private federated area within the second branch; and

the method comprises;

maintaining a fourth inheritance relationship between the second private federated area and the second intervening federated area in which the second object stored in the second intervening federated area and the base object stored in the base federated area are made as accessible to the second requesting device as a fourth object stored in the second private federated area; and

maintaining a fourth priority relationship between the second private federated area and the second intervening federated area as an exception to the fourth inheritance relationship by performing operations comprising;

determining whether the fourth object is a task routine comprising executable instructions;

determining whether the fourth object shares the second flow task identifier with at least one of the second object and the base object; and

in response to determinations by the processor that the fourth object is a task routine, at least one of the second object and the base object is a task routine, and the fourth object shares the second flow task identifier with at least one of the second object and the base object, selecting, by the processor, the fourth object to execute, regardless of whether the second object is a newer version of a task routine to perform the second task than the fourth object, and regardless of whether the base object is a newer version of a task routine to perform the second task than the fourth object.

26. The computer-implemented method of claim 25, wherein:

the first task comprises generating at least the second data set from at least the first data set; and

the method comprises, in response to a performance of at least the first task of the first job flow, performing operations comprising;

analyzing the second data set to determine whether results of the performance of at least the first task of the first job flow meets criteria specified by a control flow definition; and

in response to a determination, by the processor, that the criteria are met by the performance of at least the first task of the first job flow, performing operations comprising;

copying the second data set from the first intervening federated area and to the second intervening federated area; and

performing, by the processor, at least the second task of the second job flow.

27. The computer-implemented method of claim 21, comprising:

receiving, at the server by the processor, and via the portal from the first requesting device, a third request to store the first object among the multiple objects in one of the first federated area and the base federated area specified in the third request, wherein the first object comprises a first task routine that comprises;

the first flow task identifier to indicate that the first task is performed when instructions of the first task routine are executed;

a first input interface by which the first task routine is to receive data of at least the first data set; and

a first output interface;

determining whether another task routine is already stored in at least one of the first federated area and the base federated area that also comprises the first flow task identifier to indicate that the first task is performed when instructions of the other task routine are executed; and

in response to a determination by the processor that another task routine that comprises the first flow task identifier is stored in at least one of the first federated area and the base federated area, perform operations comprising;

comparing the first input interface to a corresponding input interface of the other task routine;

comparing the first output interface to a corresponding output interface of the other task routine; and

in response to a determination by the processor that the first input interface matches the corresponding input interface, and in response to a determination that the first output interface matches or is a superset of the corresponding output interface, storing the first task routine among the multiple task routines in the specified one of the first federated area and the base federated area, and storing an indication of the storage of more than one task routine comprising the first flow task identifier in one of the first federated area and the base federated area.

28. The computer-implemented method of claim 27, comprising:

receiving, at the server by the processor, and via the portal from the second requesting device, a fourth request to store the second object among the multiple objects in one of the second intervening federated area and the base federated area, wherein the second object comprises a second task routine that comprises;

the second flow task identifier to indicate that the second task is performed when instructions of the second task routine are executed;

a second input interface by which the second task routine is to receive data of at least the second data set; and

a second output interface;

determining whether another task routine is already stored in at least one of the second intervening federated area and the base federated area that also comprises the second flow task identifier to indicate that the second task is performed when instructions of the other task routine are executed; and

in response to a determination by the processor that another task routine that comprises the second flow task identifier is stored in at least one of the second intervening federated area and the base federated area, perform operations comprising;

comparing the second input interface to a corresponding input interface of the other task routine;

comparing the second output interface to a corresponding output interface of the other task routine; and

in response to a determination by the processor that the second input interface matches the corresponding input interface, and in response to a determination that the second output interface matches or is a superset of the corresponding output interface, storing the second task routine among the multiple task routines in the specified one of the second intervening federated area and the base federated area, and storing an indication of the storage of more than one task routine comprising the second flow task identifier in one of the second intervening federated area and the base federated area.

29. The computer-implemented method of claim 21, comprising:

receiving, at the server by the processor, and via the portal from the first requesting device, a third request to store a first job flow definition in a specified one of the first federated area and the base federated area, wherein the first job flow definition comprises;

at least one flow task identifier that specifies at least the first task to be performed when instructions of at least one corresponding task routine are executed; and

at least one data set identifier that specifies at least the first data set to be used as an input to the performance of the first task;

for each flow task identifier of the at least one flow task identifier, searching the first federated area and the base federated area to determine whether there is at least one corresponding task routine stored in at least one of the first federated area and the base federated area;

for each data set identifier of the at least one data set identifier, searching the first federated area and the base federated area to determine whether there is at least one corresponding data set stored in at least one of the first federated area and the base federated area; and

in response to a determination by the processor that there is at least one corresponding task routine stored in at least one of the first federated area and the base federated area for each flow task identifier of the at least one flow task identifier, and in response to a determination by the processor that there is at least one corresponding data set stored in at least one of the first federated area and the base federated area for each data set identifier of the at least one data set identifier, permitting, by the processor, storage of the first job flow definition in the specified one of the first federated area and the base federated area.

30. The computer-implemented method of claim 29, comprising:

receiving, at the server by the processor, and via the portal from the second requesting device, a fourth request to store a second job flow definition in a specified one of the second federated area and the base federated area, wherein the second job flow definition comprises;

at least one flow task identifier that specifies at least the second task to be performed when instructions of at least one corresponding task routine are executed; and

at least one data set identifier that specifies at least the second data set to be used as an input to the performance of the second task;

for each flow task identifier of the at least one flow task identifier, searching the second federated area and the base federated area to determine whether there is at least one corresponding task routine stored in at least one of the second federated area and the base federated area;

for each data set identifier of the at least one data set identifier, searching the second federated area and the base federated area to determine whether there is at least one corresponding data set stored in at least one of the second federated area and the base federated area; and

in response to a determination by the processor that there is at least one corresponding task routine stored in at least one of the second federated area and the base federated area for each flow task identifier of the at least one flow task identifier, and in response to a determination by the processor that there is at least one corresponding data set stored in at least one of the second federated area and the base federated area for each data set identifier of the at least one data set identifier, permitting, by the processor, storage of the second job flow definition in the specified one of the second federated area and the base federated area.