Storlet workflow optimization leveraging clustered file system placement optimization features

• US 9,876,853 B2
• Filed: 08/19/2015
• Issued: 01/23/2018
• Est. Priority Date: 08/19/2015
• Status: Active Grant

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Eda, Sasikanth, Ghuge, Deepak R., Katruwar, Kaustubh I., Patil, Sandeep R.
• Primary Examiner(s): Luu, Le H
• Application Number:
  US14/830,383
• Publication Number:
  US 20170054796A1
• Time in Patent Office: 888 Days
• CPC Class Codes: G06F 3/06 Digital input from, or digital output to, record carriers , e.g. RAID, emulated record carriers or networked record carriers
• CPC Class Codes: G06F 9/5005 to service a request
• CPC Class Codes: G06F 9/5072 Grid computing
• CPC Class Codes: H04L 67/1001 for accessing one among a plurality of replicated servers
• CPC Class Codes: H04L 67/1004 Server selection for load balancing
• CPC Class Codes: H04L 67/1014 based on the content of a request
• CPC Class Codes: H04L 67/1097 for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
• CPC Class Codes: H04L 67/56 Provisioning of proxy services store-and-forward switching systems in data switching networks H04L12/54
• CPC Class Codes: H04L 67/565 Conversion or adaptation of application format or content adding application control or application functional data H04L67/561

Abstract

According to one exemplary embodiment, a method for embedded compute engine architecture optimization is provided. The method may include receiving an object. The method may also include determining a first category for the received object, whereby the determined first category is associated with a node. The method may then include storing the received object on the node associated with the determined first category. The method may further include receiving an algorithm. The method may also include determining a second category for the received algorithm, whereby the determined second category is associated with the node. The method may then include executing the received algorithm on the node, whereby the received algorithm uses the received object stored on the node.

Claims

1. A method for embedded compute engine architecture optimization, the method comprising:

receiving an object;

determining a first category for the received object, wherein the determined first category is associated with a node;

storing the received object on the node associated with the determined first category;

receiving an algorithm;

determining a second category for the received algorithm, wherein the determined second category is associated with the node; and

executing the received algorithm on the node, wherein the received algorithm uses the received object stored on the node.

2. The method of claim 1, wherein determining the first category for the received object comprises analyzing the received object and searching an operations table for an entry corresponding to the received object, and wherein the corresponding entry within the operations table indicates the first category for the received object.

3. The method of claim 2, wherein determining the first category for the received object comprises selecting the node based on the entry within the operations table for the first category corresponding to the received object.

4. The method of claim 2, wherein the operations table comprises a plurality of entries, and wherein each entry within the plurality of entries includes a category value, a computational operation value, a storage path value, and a node value.

5. The method of claim 1, wherein determining the first category for the received object comprises identifying a user-specified category within metadata associated with the received object.

6. The method of claim 1, wherein determining the second category for the received algorithm comprises analyzing the received algorithm and searching an operations table for an entry corresponding to the received algorithm, and wherein the corresponding entry within the operations table indicates the second category for the received algorithm.

7. The method of claim 1, wherein executing the received algorithm on the node comprises a virtualization element associated with the node executing the received algorithm.

8. A computer system for embedded compute engine architecture optimization, comprising:

one or more processors, one or more computer-readable memories, one or more computer-readable tangible storage medium, and program instructions stored on at least one of the one or more tangible storage medium for execution by at least one of the one or more processors via at least one of the one or more memories, wherein the computer system is capable of performing a method comprising;

receiving an object;

determining a first category for the received object, wherein the determined first category is associated with a node;

storing the received object on the node associated with the determined first category;

receiving an algorithm;

determining a second category for the received algorithm, wherein the determined second category is associated with the node; and

executing the received algorithm on the node, wherein the received algorithm uses the received object stored on the node.

9. The computer system of claim 8, wherein determining the first category for the received object comprises analyzing the received object and searching an operations table for an entry corresponding to the received object, and wherein the corresponding entry within the operations table indicates the first category for the received object.

10. The computer system of claim 9, wherein determining the first category for the received object comprises selecting the node based on the entry within the operations table for the first category corresponding to the received object.

11. The computer system of claim 9, wherein the operations table comprises a plurality of entries, and wherein each entry within the plurality of entries includes a category value, a computational operation value, a storage path value, and a node value.

12. The computer system of claim 8, wherein determining the first category for the received object comprises identifying a user-specified category within metadata associated with the received object.

13. The computer system of claim 8, wherein determining the second category for the received algorithm comprises analyzing the received algorithm and searching an operations table for an entry corresponding to the received algorithm, and wherein the corresponding entry within the operations table indicates the second category for the received algorithm.

14. The computer system of claim 8, wherein executing the received algorithm on the node comprises a virtualization element associated with the node executing the received algorithm.

15. A computer program product for embedded compute engine architecture optimization, comprising:

one or more non-transitory computer-readable storage media storing program instructions executable by a processor for embedded compute engine architecture optimization, the program instructions comprising;

program instructions to receive an object;

program instructions to determine a first category for the received object, wherein the determined first category is associated with a node;

program instructions to store the received object on the node associated with the determined first category;

program instructions to receive an algorithm;

program instructions to determine a second category for the received algorithm, wherein the determined second category is associated with the node; and

program instructions to execute the received algorithm on the node, wherein the received algorithm uses the received object stored on the node.

16. The computer program product of claim 15, wherein determining the first category for the received object comprises analyzing the received object and searching an operations table for an entry corresponding to the received object, and wherein the corresponding entry within the operations table indicates the first category for the received object.

17. The computer program product of claim 16, wherein determining the first category for the received object comprises selecting the node based on the entry within the operations table for the first category corresponding to the received object.

18. The computer program product of claim 15, wherein determining the first category for the received object comprises identifying a user-specified category within metadata associated with the received object.

19. The computer program product of claim 15, wherein determining the second category for the received algorithm comprises analyzing the received algorithm and searching an operations table for an entry corresponding to the received algorithm, and wherein the corresponding entry within the operations table indicates the second category for the received algorithm.

20. The computer program product of claim 15, wherein executing the received algorithm on the node comprises a virtualization element associated with the node executing the received algorithm.