Dynamic discovery and management of microservices for multi-cluster computing platforms

• US 10,178,045 B2
• Filed: 09/07/2016
• Issued: 01/08/2019
• Est. Priority Date: 09/07/2016
• Status: Active Grant

• Current Assignee: SAP SE
• Original Assignee: SAP SE
• Inventors: Kumar, Dinesh
• Primary Examiner(s): Bengzon, Greg C
• Application Number:
  US15/258,272
• Publication Number:
  US 20180069806A1
• Time in Patent Office: 853 Days
• CPC Class Codes: G06F 9/5061 Partitioning or combining of resources
• CPC Class Codes: H04L 47/782 Hierarchical allocation of resources, e.g. involving a hierarchy of local and centralised entities
• CPC Class Codes: H04L 47/826 Involving periods of time
• CPC Class Codes: H04L 47/827 Aggregation of resource allocation or reservation requests
• CPC Class Codes: H04L 47/829 Topology based

Abstract

Computer-implemented systems and methods for processing a request from a client are provided. A request for a computer-implemented process to be performed is received from a client. A group of computer resources responsible for performing the computer-implemented process is identified. Dependency information indicating dependency relationships between pairs of computer resources of the identified group is determined. For pairs of computer resources determined to have a dependency relationship, a cost incurred when a first computer resource of the pair invokes a second computer resource of the pair is determined at multiple points in time. It is determined whether to add, remove, or migrate additional computer resources to the group based on the cost information.

Claims

1. A computer-implemented method for processing a request from a client, the method comprising:

receiving from a client a request for a computer-implemented process to be performed, the computer-implemented process requiring at least one microservice for performing a specified database function and/or generating a report in response to a database request;

identifying a group of computer resources responsible for performing the computer-implemented process;

determining, using a microservice dependency graph, dependency information indicating dependency relationships between pairs of computer resources of the identified group;

for pairs of computer resources determined to have a dependency relationship, determining at multiple points in time cost information indicating a cost incurred when a first computer resource of the pair invokes a second computer resource of the pair;

determining whether to add additional computer resources to the group based on the cost information; and

executing the requested computer-implemented process using the additional computer resources when it is determined to add such additional computer resources;

wherein;

a resource manager monitors invocations of microservices and either dynamically updates an existing microservice dependency graph with nodes reflecting an invocation of a microservice or generates a new microservice dependency graph with nodes reflecting an invocation of a microservice if a microservice dependency graph does not exist;

the determining of whether to add additional computer resources to the group based on the cost information comprises;

using the cost information to calculate an average cost of invoking a given computer resource at a time of day over a predetermined period of time;

comparing the calculated average to a threshold value;

based on a determination that the average is not greater than the threshold value, determining that the additional computer resources are not to be added to the group; and

based on a determination that the average is greater than or equal to the threshold value, determining that the additional computer resources are to be added to the group.

2. The computer-implemented method of claim 1, further comprising:

allocating the additional computer resources to the group when it is determined that the additional computer resources are to be added to the group.

3. The computer-implemented method of claim 1, wherein when it is determined that additional computer resources are to be added to the group, the method further comprises:

determining a number of additional computer resources to be added to the group;

determining whether the number can be met by activating unused computer resources of the group; and

based on a determination that the number cannot be met by activating unused computer resources, identifying computer resources of another group of resources to be added to the identified group of resources.

4. The computer-implemented method of claim 1, further comprising:

determining whether to deactivate computer resources of the group based on the cost information.

5. The computer-implemented method of claim 1, wherein in the determining of whether to add the additional computer resources to the group, the cost information comprises historical cost information determined during a predetermined period of time in the past.

6. The computer-implemented method of claim 1, wherein the determining of the cost information comprises:

calculating the cost information based on a computer-implemented process that utilizes calculated weights for multiple cost variables, the cost variables comprising (i) a first variable based on a current number of requests being serviced by a given computer resource, and (ii) a second variable based on an average amount of time required for the given computer resource to service a request.

7. A computer-implemented system for processing a request from a client, the system comprising:

a processing system including at least one programmable data processor; and

computer-readable memory in communication with the processing system encoded with instructions for commanding the processing system to execute steps comprising;

receiving from a client a request for a computer-implemented process to be performed, the computer-implemented process requiring at least one microservice for performing a specified database function and/or generating a report in response to a database request;

identifying a group of computer resources responsible for performing the computer-implemented process;

determining, using a microservice dependency graph, dependency information indicating dependency relationships between pairs of computer resources of the identified group;

for pairs of computer resources determined to have a dependency relationship, determining at multiple points in time cost information indicating a cost incurred when a first computer resource of the pair invokes a second computer resource of the pair;

determining whether to add additional computer resources to the group based on the cost information; and

executing the requested computer-implemented process using the additional computer resources when it is determined to add such additional computer resources;

wherein;

a resource manager monitors invocations of microservices and either dynamically updates an existing microservice dependency graph with nodes reflecting an invocation of a microservice or generates a new microservice dependency graph with nodes reflecting an invocation of a microservice if a microservice dependency graph does not exist;

the determining of whether to add additional computer resources to the group based on the cost information comprises;

using the cost information to calculate an average cost of invoking a given computer resource at a time of day over a predetermined period of time;

comparing the calculated average to a threshold value;

based on a determination that the average is not greater than the threshold value, determining that the additional computer resources are not to be added to the group; and

based on a determination that the average is greater than or equal to the threshold value, determining that the additional computer resources are to be added to the group.

8. The computer-implemented system of claim 7, wherein the steps executed by the processing system further comprise:

allocating the additional computer resources to the group when it is determined that the additional computer resources are to be added to the group.

9. The computer-implemented system of claim 7, wherein the steps further comprise:

determining whether to deactivate computer resources of the group based on the cost information.

10. The computer-implemented system of claim 7, wherein when it is determined that additional computer resources are to be added to the group, the steps further comprise:

determining a number of additional computer resources to be added to the group;

determining whether the number can be met by activating unused computer resources of the group; and

based on a determination that the number cannot be met by activating unused computer resources, identifying computer resources of another group of resources to be added to the identified group of resources.

11. The computer-implemented system of claim 7, wherein in the determining of whether to add the additional computer resources to the group, the cost information comprises historical cost information determined during a predetermined period of time in the past.

12. The computer-implemented system of claim 7, wherein the determining of the cost information comprises:

calculating the cost information based on a computer-implemented process that utilizes calculated weights for multiple cost variables, the cost variables comprising (i) a first variable based on a current number of requests being serviced by a given computer resource, and (ii) a second variable based on an average amount of time required for the given computer resource to service a request.

13. A non-transitory computer-readable storage medium for processing a request from a client, the computer-readable storage medium comprising computer executable instructions which, when executed, cause a processing system including at least one programmable data processor to execute steps including:

receiving from a client a request for a computer-implemented process to be performed, the computer-implemented process requiring at least one microservice for performing a specified database function and/or generating a report in response to a database request;

identifying a group of computer resources responsible for performing the computer-implemented process;

determining, using a microservice dependency graph, dependency information indicating dependency relationships between pairs of computer resources of the identified group;

for pairs of computer resources determined to have a dependency relationship, determining at multiple points in time cost information indicating a cost incurred when a first computer resource of the pair invokes a second computer resource of the pair;

determining whether to add additional computer resources to the group based on the cost information; and

executing the requested computer-implemented process using the additional computer resources when it is determined to add such additional computer resources;

wherein;

a resource manager monitors invocations of microservices and either dynamically updates an existing microservice dependency graph with nodes reflecting an invocation of a microservice or generates a new microservice dependency graph with nodes reflecting an invocation of a microservice if a microservice dependency graph does not exist;

the determining of whether to add additional computer resources to the group based on the cost information comprises;

using the cost information to calculate an average cost of invoking a given computer resource at a time of day over a predetermined period of time;

comparing the calculated average to a threshold value;

based on a determination that the average is not greater than the threshold value, determining that the additional computer resources are not to be added to the group; and

based on a determination that the average is greater than or equal to the threshold value, determining that the additional computer resources are to be added to the group.

14. The non-transitory computer-readable storage medium of claim 13, wherein the steps executed by the processing system further comprise:

allocating the additional computer resources to the group when it is determined that the additional computer resources are to be added to the group.

15. The non-transitory computer-readable storage medium of claim 13, wherein the steps further comprise:

determining whether to deactivate computer resources of the group based on the cost information.

16. The non-transitory computer-readable storage medium of claim 13, wherein when it is determined that additional computer resources are to be added to the group, the steps further comprise:

determining a number of additional computer resources to be added to the group;

determining whether the number can be met by activating unused computer resources of the group; and

based on a determination that the number cannot be met by activating unused computer resources, identifying computer resources of another group of resources to be added to the identified group of resources.

17. The non-transitory computer-readable storage medium of claim 13, wherein in the determining of whether to add the additional computer resources to the group, the cost information comprises historical cost information determined during a predetermined period of time in the past.

18. The non-transitory computer-readable storage medium of claim 13, wherein the determining of the cost information comprises:

calculating the cost information based on a computer-implemented process that utilizes calculated weights for multiple cost variables, the cost variables comprising (i) a first variable based on a current number of requests being serviced by a given computer resource, and (ii) a second variable based on an average amount of time required for the given computer resource to service a request.