SYSTEM AND METHOD FOR ROUTING SERVICE REQUESTS
First Claim
Patent Images
1. A computer-implemented method of routing service requests, comprising:
- receiving a request in the service framework;
discovering a plurality of candidate hosts operable to respond to the request;
selecting a candidate host based on a probabilistic distribution of the candidate hosts corresponding to least one of a network latency, a redirection latency and a service latency; and
routing the service request to the selected candidate host.
0 Assignments
0 Petitions
Accused Products
Abstract
A computer-implemented method routes service requests to services in a service framework provided by a plurality of hosts. The method comprises receiving a service request for a service in the service framework and discovering a plurality of candidate hosts that host the service. The plurality of candidate hosts are a subset of the plurality of hosts. The method further comprises selecting a candidate host from the plurality of candidate hosts based on measured latencies for the plurality of candidate hosts and routing the service request to the selected candidate host.
-
Citations
29 Claims
-
1. A computer-implemented method of routing service requests, comprising:
-
receiving a request in the service framework; discovering a plurality of candidate hosts operable to respond to the request; selecting a candidate host based on a probabilistic distribution of the candidate hosts corresponding to least one of a network latency, a redirection latency and a service latency; and routing the service request to the selected candidate host. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15)
-
-
16. A computer-implemented method of routing requests to hosts, the method comprising:
-
storing a model of the service framework organized in a hierarchy comprising; a first level including a plurality of leaf nodes, each of the leaf nodes corresponding to one of the plurality of hosts, and a second level including a first plurality of zones, wherein each of the first plurality of zones comprise a subset of the plurality of leaf nodes, and wherein each of the first plurality of zones includes a proxy host of the plurality of leaf nodes; and for each request to be processed by a host; discovering a plurality of candidate hosts from the leaf nodes and proxy hosts for processing the request; selecting a candidate host based on a probabilistic distribution of measured latencies for the plurality of candidate hosts; and routing the request to the selected candidate host. - View Dependent Claims (17, 18, 19)
-
-
20. A system comprising:
-
a plurality of computing devices for responding to requests, wherein the plurality of computing devices are organized in a hierarchy comprising; a first level including a plurality of leaf nodes, each of the leaf nodes corresponding to one of the plurality of computing devices; and a second level including a first plurality of zones which each comprise a subset of the plurality of leaf nodes; wherein the system is configured to; dispatch requests based on a probabilistic distribution of measured latencies between different levels in the hierarchy. - View Dependent Claims (21, 22, 23, 24, 25)
-
-
26. A tangible computer-accessible medium bearing computer-executable instructions which, when executed on a computing device, direct the computing system to:
-
responsive to a request, discover a set of candidate host computers, the set of candidate host computers being a subset of the plurality of available computers; select a candidate host computer from the set of candidate host computers, the selection of the candidate host computer based on a probabilistic distribution, the probabilistic distribution corresponding to latencies of the candidate host computers; and route the service request to the selected candidate host computer. - View Dependent Claims (27, 28, 29)
-
Specification