Dynamic rerouting of service requests between service endpoints for web services in a composite service

• US 9,979,631 B2
• Filed: 02/11/2015
• Issued: 05/22/2018
• Est. Priority Date: 10/18/2010
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: Mercuri, Marc
• Primary Examiner(s): HOANG, HIEU T
• Application Number:
  US14/619,718
• Publication Number:
  US 20150222525A1
• Time in Patent Office: 1,196 Days
• Field of Search: 709224-226
• CPC Class Codes: G06F 2209/501 Performance criteria
• CPC Class Codes: G06F 9/5027 the resource being a machine, e.g. CPUs, Servers, Terminals
• CPC Class Codes: H04L 41/5019 Ensuring fulfilment of SLA
• CPC Class Codes: H04L 43/0876 Network utilisation, e.g. volume of load or congestion level
• CPC Class Codes: H04L 45/22 Alternate routing
• CPC Class Codes: H04L 47/2425 for supporting services specification, e.g. SLA
• CPC Class Codes: H04L 67/1001 for accessing one among a plurality of replicated servers
• CPC Class Codes: H04L 67/1008 based on parameters of servers, e.g. available memory or workload monitoring of computer activity G06F11/30
• CPC Class Codes: H04L 67/101 based on network conditions
• CPC Class Codes: H04L 67/1012 based on compliance of requirements or conditions with available server resources

Abstract

Technologies are described herein for rerouting a service request between service endpoints. The service request is received, at a first web service, from a second web service. The first web service and the second web service may be components of a composite service. The service request is routed to an initial service endpoint configured to respond to the service request according to a service level agreement between the first web service and the second web service. Service criteria associated with the initial service endpoint are monitored. A determination is made as to whether the service criteria meet a performance threshold specified by the service level agreement. If the service criteria do not meet the performance threshold specified by the service level agreement, then the service request is rerouted from the initial service endpoint to an alternate service endpoint.

Claims

1. A computer-implemented method for rerouting a service request between service endpoints, the method comprising computer-implemented operations for:

receiving, at a second web service, the service request from a first web service separate from the second web service, the first web service providing a first service and the second web service consumed by the first service in a composite service;

routing the service request to an initial service endpoint of the second web service configured to respond to the service request according to a service level agreement between the first web service and the second web service;

monitoring service criteria associated with the initial service endpoint;

determining, at the second web service, whether the service criteria associated with the initial service endpoint meet a performance threshold specified by the service level agreement; and

in response to determining that the service criteria do not meet the performance threshold specified by the service level agreement, rerouting the service request from the initial service endpoint of the second web service to a second service endpoint of the second web service or to an alternate service endpoint of a third web service, separate from the first web service and the second web service, for servicing the service request at the second web service or the third web service.

2. The computer-implemented method of claim 1, wherein the service request comprises a request for information provided by the second web service to the first web service.

3. The computer-implemented method of claim 1, routing the service request to an initial service endpoint configured to respond to the service request according to a service level agreement between the first web service and the second web service comprises routing the service request to a first server computer configured to respond to the service request according to the service level agreement between the first web service and the second web service.

4. The computer-implemented method of claim 3, wherein monitoring the service criteria associated with the initial service endpoint comprises monitoring server load of the first server computer, service outages of the first server computer, or response times of the first server computer.

5. The computer-implemented method of claim 4, wherein determining whether the service criteria meet a performance threshold specified by the service level agreement comprises determining whether the server load, the service outages, or the response times meet the performance threshold specified by the service level agreement.

6. The computer-implemented method of claim 5, wherein in response to determining that the service criteria do not meet the performance threshold specified by the service level agreement, rerouting the service request from the initial service endpoint to an alternate service endpoint comprises in response to determining that the server load, the service outages, or the response times do not meet the performance threshold specified by the service level agreement, rerouting the service request from the first server computer to a second server computer.

7. The computer-implemented method of claim 1, wherein rerouting the service request from the initial service endpoint to an alternate service endpoint comprises:

identifying a plurality of alternate service endpoints configured to respond to the service request according to the service level agreement between the first web service and the second web service;

selecting the alternate service endpoint from the plurality of alternate service endpoints based on efficiency of the alternate service endpoint; and

rerouting the service request from the initial service endpoint to the selected alternated service endpoint.

8. The computer-implemented method of claim 7, wherein selecting the alternate service endpoint from the plurality of alternate service endpoints based on efficiency of the alternate service endpoint comprises selecting the alternate service endpoint having a lowest current server load from the plurality of alternate service endpoints.

9. The computer-implemented method of claim 7, wherein selecting the alternate service endpoint from the plurality of alternate service endpoints based on efficiency of the alternate service endpoint comprises selecting the alternate service endpoint having a lowest anticipated server load based on load patterns.

10. The computer-implemented method of claim 7, wherein selecting the alternate service endpoint from the plurality of alternate service endpoints based on efficiency of the alternate service endpoint comprises selecting the alternate service endpoint having a lowest monetary cost from the plurality of alternate service endpoints.

11. The computer-implemented method of claim 10, wherein the plurality of alternate service endpoints comprises a first alternate service endpoint associated with a third web service in the composite service and a second alternate service endpoint associated with a fourth web service in the composite service;

wherein the first alternate service endpoint is associated with a higher fee between the second web service and the third web service and the second alternate service endpoint is associated with a lower fee between the second web service and the fourth web service; and

wherein selecting the alternate service endpoint having a lowest monetary cost from the plurality of alternate service endpoints comprises selecting the second alternate service endpoint associated with the lower fee from the plurality of alternate service endpoints.

12. A computer system, comprising:

a processor;

a memory communicatively coupled to the processor; and

a program module that, when executed by the processor, causes the computer system to reroute a service request between service endpoints by;

receiving, at a second web service, the service request from a first web service separate from the second web service, the first web service providing a first service and the second web service consumed by the first service in a composite service;

routing the service request to an initial service endpoint of the second web service configured to respond to the service request according to a service level agreement between the first web service and the second web service;

monitoring service criteria associated with the initial service endpoint;

determining, at the second web service, whether the service criteria meet a performance threshold specified by the service level agreement; and

in response to determining that the service criteria do not meet the performance threshold specified by the service level agreement, identifying, at the second web service, a plurality of alternate service endpoints configured to respond to the service request according to the service level agreement and a monetary cost of utilizing each of the plurality of alternative service endpoints.

13. The computer system of claim 12, wherein the program module further causes the causes the computer system to reroute a service request between service endpoints by

selecting an alternate service endpoint from the plurality of alternate service endpoints based on efficiency of the alternate service endpoint comprises selecting the alternate service endpoint having a lowest current server load from the plurality of alternate service endpoints;

and

rerouting the service request from the initial service endpoint to the selected alternate service endpoint.

14. The computer system of claim 13, wherein selecting an alternate service endpoint from the plurality of alternate service endpoints based on efficiency of the alternate service endpoint further comprises selecting the alternate service endpoint having a lowest anticipated server load based on load patterns.

15. The computer system of claim 13, wherein selecting the alternate service endpoint from the plurality of alternate service endpoints based on efficiency of the alternate service endpoint further comprises selecting the alternate service endpoint having a lowest monetary cost from the plurality of alternate service endpoints.

16. The computer system of claim 15, wherein the plurality of alternate service endpoints comprises a first alternate service endpoint associated with a third web service in the composite service and a second alternate service endpoint associated with a fourth web service in the composite service;

wherein the first alternate service endpoint is associated with a higher fee between the second web service and the third web service and the second alternate service endpoint is associated with a lower fee between the second web service and the fourth web service; and

wherein selecting the alternate service endpoint having a lowest monetary cost from the plurality of alternate service endpoints comprises selecting the second alternate service endpoint associated with the lower fee from the plurality of alternate service endpoints.

17. The computer system of claim 13, wherein rerouting the service request to an initial service endpoint configured to respond to the service request according to a service level agreement between the first web service and the second web service comprises routing the service request to a first server computer configured to respond to the service request according to the service level agreement between the first web service and the second web service.

18. The computer system of claim 17, wherein monitoring the service criteria associated with the initial service endpoint comprises monitoring server load of the first server computer, service outages of the first server computer, or response times of the first server computer;

and

wherein determining whether the service criteria meet a performance threshold specified by the service level agreement comprises determining whether the server load, the service outages, or the response times meet the performance threshold specified by the service level agreement.

19. The computer system of claim 18, wherein in response to determining that the service criteria do not meet the performance threshold specified by the service level agreement, rerouting the service request from the initial service endpoint to an alternate service endpoint comprises in response to determining that the server load, the service outages, or the response times do not meet the performance threshold specified by the service level agreement, rerouting the service request from the first server computer to a second server computer.

20. A computer storage device having computer-executable instructions stored thereon which, when executed by a computer, cause the computer to:

receive, at a second web service, a service request from a first web service, the first web service separate from the second web service, the first web service providing a first service and the second web service consumed by the first service-in a composite service;

route the service request to an initial server computer of the second web service configured to respond to the service request according to a service level agreement between the first web service and the second web service;

monitor server load of the initial server computer, service outages of the initial server computer, or response times of the initial server computer;

determine whether the server load, the service outages, or the response times meet a performance threshold specified by the service level agreement;

in response to determining that the server load, the service outages, or the response times do not meet the performance threshold specified by the service level agreement, identify a plurality of alternate server computers of the second web service or a third web service configured to respond to the service request according to the service level agreement;

select an alternate server computer from the plurality of alternate server computers based on efficiency of the alternate server computer and monetary cost; and

reroute the service request from the initial server computer to the selected alternate server computer.

21. A computer-implemented method for rerouting a service request between service endpoints, the method comprising computer-implemented operations for:

receiving, at a computer associated with a second web service, the service request from another computer separate from the second web service, the other computer providing a first service and the computer associated with the second web service providing a second service consumed by the first service in a composite service;

routing the service request to an initial service endpoint of the second web service configured to respond to the service request according to a service level agreement between the other computer and the second web service;

monitoring service criteria associated with the initial service endpoint;

determining, at the second web service, whether the service criteria associated with the initial service endpoint meet a performance threshold specified by the service level agreement; and

in response to determining that the service criteria do not meet the performance threshold specified by the service level agreement, rerouting the service request from the initial service endpoint of the second web service to a second service endpoint of the second web service or to an alternate service endpoint of a third web service, separate from the first web service and the second web service, for servicing the service request at the second web service or the third web service.

22. The computer-implemented method of claim 21, wherein the service request comprises a request for information provided by the second web service to the other computer.

23. The computer-implemented method of claim 21, routing the service request to an initial service endpoint configured to respond to the service request according to a service level agreement between the other computer and the second web service comprises routing the service request to a first server computer configured to respond to the service request according to the service level agreement between the other computer and the second web service.

24. The computer-implemented method of claim 23, wherein monitoring the service criteria associated with the initial service endpoint comprises monitoring server load of the first server computer, service outages of the first server computer, or response times of the first server computer.

25. The computer-implemented method of claim 24, wherein determining whether the service criteria meet a performance threshold specified by the service level agreement comprises determining whether the server load, the service outages, or the response times meet the performance threshold specified by the service level agreement.

26. The computer-implemented method of claim 25, wherein in response to determining that the service criteria do not meet the performance threshold specified by the service level agreement, rerouting the service request from the initial service endpoint to an alternate service endpoint comprises in response to determining that the server load, the service outages, or the response times do not meet the performance threshold specified by the service level agreement, rerouting the service request from the first server computer to a second server computer.

27. The computer-implemented method of claim 21, wherein rerouting the service request from the initial service endpoint to an alternate service endpoint comprises:

identifying a plurality of alternate service endpoints configured to respond to the service request according to the service level agreement between the other computer and the second web service;

selecting the alternate service endpoint from the plurality of alternate service endpoints based on efficiency of the alternate service endpoint; and

rerouting the service request from the initial service endpoint to the selected alternated service endpoint.

28. The computer-implemented method of claim 27, wherein selecting the alternate service endpoint from the plurality of alternate service endpoints based on efficiency of the alternate service endpoint comprises selecting the alternate service endpoint having a lowest current server load from the plurality of alternate service endpoints.

29. The computer-implemented method of claim 27, wherein selecting the alternate service endpoint from the plurality of alternate service endpoints based on efficiency of the alternate service endpoint comprises selecting the alternate service endpoint having a lowest anticipated server load based on load patterns.

30. The computer-implemented method of claim 27, wherein selecting the alternate service endpoint from the plurality of alternate service endpoints based on efficiency of the alternate service endpoint comprises selecting the alternate service endpoint having a lowest monetary cost from the plurality of alternate service endpoints.

31. The computer-implemented method of claim 30, wherein the plurality of alternate service endpoints comprises a first alternate service endpoint associated with a third web service in the composite service and a second alternate service endpoint associated with a fourth web service in the composite service;

wherein the first alternate service endpoint is associated with a higher fee between the second web service and the third web service and the second alternate service endpoint is associated with a lower fee between the second web service and the fourth web service; and

wherein selecting the alternate service endpoint having a lowest monetary cost from the plurality of alternate service endpoints comprises selecting the second alternate service endpoint associated with the lower fee from the plurality of alternate service endpoints.