Dynamic rerouting of service requests between service endpoints for web services in a composite service

• US 8,959,219 B2
• Filed: 10/18/2010
• Issued: 02/17/2015
• Est. Priority Date: 10/18/2010
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: Mercuri, Marc
• Primary Examiner(s): HOANG, HIEU T
• Application Number:
  US12/906,144
• Publication Number:
  US 20120096183A1
• Time in Patent Office: 1,583 Days
• Field of Search: 709/224, 709/225, 709/226
• US Class Current: 709/226
• CPC Class Codes: G06F 2209/501 Performance criteria
• CPC Class Codes: G06F 9/5027 the resource being a machine, e.g. CPUs, Servers, Terminals
• CPC Class Codes: H04L 41/5019 Ensuring fulfilment of SLA
• CPC Class Codes: H04L 43/0876 Network utilisation, e.g. volume of load or congestion level
• CPC Class Codes: H04L 45/22 Alternate routing
• CPC Class Codes: H04L 47/2425 for supporting services specification, e.g. SLA
• CPC Class Codes: H04L 67/1001 for accessing one among a plurality of replicated servers
• CPC Class Codes: H04L 67/1008 based on parameters of servers, e.g. available memory or workload monitoring of computer activity G06F11/30
• CPC Class Codes: H04L 67/101 based on network conditions
• CPC Class Codes: H04L 67/1012 based on compliance of requirements or conditions with available server resources

Abstract

Technologies are described herein for rerouting a service request between service endpoints. The service request is received, at a first web service, from a second web service. The first web service and the second web service may be components of a composite service. The service request is routed to an initial service endpoint configured to respond to the service request according to a service level agreement between the first web service and the second web service. Service criteria associated with the initial service endpoint are monitored. A determination is made as to whether the service criteria meet a performance threshold specified by the service level agreement. If the service criteria do not meet the performance threshold specified by the service level agreement, then the service request is rerouted from the initial service endpoint to an alternate service endpoint.

Claims

1. A computer-implemented method for rerouting a service request between service endpoints, the method comprising computer-implemented operations for:

receiving, at a second web service, the service request from a first web service, the first web service and the second web service in a composite service, wherein the second web service comprises an initial service endpoint and an alternate service endpoint;

routing the service request to the initial service endpoint configured to respond to the service request according to a service level agreement between the first web service and the second web service;

monitoring service criteria associated with the initial service endpoint;

determining, at the second web service, whether the service criteria associated with the initial service endpoint meet a performance threshold specified by the service level agreement; and

in response to determining that the service criteria do not meet the performance threshold specified by the service level agreement, determining at the second web service if an alternate service endpoint of the second web service meets the performance threshold specified by the service level agreement;

in response to determining that the alternate service endpoint of the second web service meets the performance criteria, servicing the service request at the second web service; and

in response to determining, at the second web service, that the alternate service endpoint of the second web service does not meet the performance criteria, rerouting from the second web service the service request from the initial service endpoint of the second web service to an alternate service endpoint of a third web service for servicing the service request at the third web service.

2. The computer-implemented method of claim 1, wherein the service request comprises a request for information provided by the second web service to the first web service.

3. The computer-implemented method of claim 1, wherein routing the service request to an initial service endpoint configured to respond to the service request according to a service level agreement between the first web service and the second web service comprises routing the service request to a first server computer configured to respond to the service request according to the service level agreement between the first web service and the second web service.

4. The computer-implemented method of claim 3, wherein monitoring the service criteria associated with the initial service endpoint comprises monitoring server load of the first server computer, service outages of the first server computer, or response times of the first server computer.

5. The computer-implemented method of claim 4, wherein determining whether the service criteria meet a performance threshold specified by the service level agreement comprises determining whether the server load, the service outages, or the response times meet the performance threshold specified by the service level agreement.

6. The computer-implemented method of claim 1, wherein determining at the second web service if an alternate service endpoint of the second web service meets the performance threshold specified by the service level agreement comprises:

identifying a plurality of alternate service endpoints at the second web service or the third web service configured to respond to the service request according to the service level agreement between the first web service and the second web service; and

selecting the alternate service endpoint of the second web service or the alternate service endpoint of the third web service based on the efficiency of the alternate service endpoint of the second web service or the alternate service endpoint of the third web service.

7. The computer-implemented method of claim 6, wherein selecting the alternate service endpoint from the plurality of alternate service endpoints based on efficiency of the alternate service endpoint of the second web service or the alternate service endpoint of the third web service comprises selecting, at the second web service, the alternate service endpoint of the second web service or the alternate service endpoint of the third web service having a lowest current server load from the plurality of alternate service endpoints.

8. The computer-implemented method of claim 6, wherein selecting the alternate service endpoint from the plurality of alternate service endpoints based on efficiency of the alternate service endpoint of the second web service or the alternate service endpoint of the third web service comprises selecting, at the second web service, the alternate service endpoint of the second web service or the alternate service endpoint of the third web service having a lowest anticipated server load based on load patterns.

9. The computer-implemented method of claim 6, wherein selecting the alternate service endpoint from the plurality of alternate service endpoints of the second web service or the alternate service endpoint of the third web service based on efficiency of the alternate service endpoint of the second web service or the alternate service endpoint of the third web service comprises selecting, at the second web service, the alternate service endpoint having a lowest cost from the plurality of alternate service endpoints.

10. The computer-implemented method of claim 9,

wherein selecting the alternate service endpoint having a lowest cost from the plurality of alternate service endpoints of the second web service or the alternate service endpoint of the third web service comprises selecting the alternate service endpoint of the second web service or the alternate service endpoint of the third web service associated with a lower fee.

11. A computer system, comprising:

a processor; and

a memory communicatively coupled to the processor having stored therein a program module which executes in the processor from the memory and which, when executed by the processor, causes the computer system to reroute a service request between service endpoints by

receiving, at a second web service, the service request from a first web service, the first web service and the second web service in a composite service, wherein the second web service comprises an initial service endpoint and a plurality of alternate service endpoints;

routing the service request to the initial service endpoint configured to respond to the service request according to a service level agreement between the first web service and the second web service;

monitoring service criteria associated with the initial service endpoint;

determining at the second web service whether the service criteria associated with the initial service endpoint meet a performance threshold specified by the service level agreement;

in response to determining that the service criteria do not meet the performance threshold specified by the service level agreement, determining at the second web service if at least one service endpoint of the plurality of service endpoints of the second web service meet the performance threshold specified by the service level agreement;

in response to determining, at the second web service, that at least one service endpoint of the plurality of alternate service endpoints meets the performance threshold, selecting the at least one service endpoint of the plurality of alternate service endpoints based on efficiency of the at least one service endpoint of the plurality of alternate service endpoints; and

rerouting the service request from the initial service endpoint to the at least one service endpoint of the plurality of alternate service endpoints.

12. The computer system of claim 11, wherein selecting the at least one service endpoint of the plurality of alternate service endpoints based on efficiency of the alternate service endpoint comprises selecting the alternate service endpoint having a lowest current server load from the plurality of alternate service endpoints.

13. The computer system of claim 11, wherein selecting the at least one service endpoint of the plurality of alternate service endpoints based on efficiency of the at least one service endpoint of the plurality of alternate service endpoints comprises selecting the alternate service endpoint having a lowest anticipated server load based on load patterns.

14. The computer system of claim 11, wherein selecting the at least one service endpoint of the plurality of alternate service endpoints based on efficiency of the at least one service endpoint of the plurality of alternate service endpoints comprises selecting the at least one service endpoint of the plurality of alternate service endpoints based on a lowest cost.

15. The computer system of claim 14,

wherein selecting the at least one service endpoint of the plurality of alternate service endpoints based on the lowest cost comprises selecting the at least one service endpoint of the plurality of alternate service endpoints based on associated with a lower fee.

16. The computer system of claim 11, wherein monitoring the service criteria associated with the initial service endpoint comprises monitoring server load of the first server computer, service outages of the first server computer, or response times of the first server computer;

and

wherein determining whether the service criteria meet a performance threshold specified by the service level agreement comprises determining whether the server load, the service outages, or the response times meet the performance threshold specified by the service level agreement.

17. The computer system of claim 16, wherein the service criteria comprises server load, service outages, or response times.

18. An optical disk, a magnetic disk storage device, or a solid state storage device having computer-executable instructions stored thereon which, when executed by a computer, cause the computer to:

receive, at a second web service, a service request from a first web service, the first web service and the second web service in a composite service, wherein the second web service comprises an initial server computer and a plurality of alternate server computers;

route the service request to the initial server computer configured to respond to the service request according to a service level agreement between the first web service and the second web service;

monitor server load of the initial server computer, service outages of the initial server computer, or response times of the initial server computer;

determine whether the server load, the service outages, or the response times meet a performance threshold specified by the service level agreement;

in response to determining that the server load, the service outages, or the response times do not meet the performance threshold specified by the service level agreement, identify the plurality of alternate server computers configured to respond to the service request according to the service level agreement;

select, at the second web service, an alternate server computer from the plurality of alternate server computers based on efficiency of the alternate server computer; and

route from the second web service the service request from the initial server computer to the selected alternated server computer.