SYSTEM AND METHOD FOR ROUTING SERVICE REQUESTS
First Claim
Patent Images
1. A computer-implemented method of routing service requests, comprising:
- receiving a request in the service framework;
discovering a plurality of candidate hosts operable to respond to the request;
selecting a candidate host based on a probabilistic distribution of the candidate hosts corresponding to least one of a network latency, a redirection latency and a service latency; and
routing the service request to the selected candidate host.
0 Assignments
0 Petitions
Accused Products
Abstract
A computer-implemented method routes service requests to services in a service framework provided by a plurality of hosts. The method comprises receiving a service request for a service in the service framework and discovering a plurality of candidate hosts that host the service. The plurality of candidate hosts are a subset of the plurality of hosts. The method further comprises selecting a candidate host from the plurality of candidate hosts based on measured latencies for the plurality of candidate hosts and routing the service request to the selected candidate host.
97 Citations
29 Claims
-
1. A computer-implemented method of routing service requests, comprising:
-
receiving a request in the service framework; discovering a plurality of candidate hosts operable to respond to the request; selecting a candidate host based on a probabilistic distribution of the candidate hosts corresponding to least one of a network latency, a redirection latency and a service latency; and routing the service request to the selected candidate host. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15)
-
-
16. A computer-implemented method of routing requests to hosts, the method comprising:
-
storing a model of the service framework organized in a hierarchy comprising; a first level including a plurality of leaf nodes, each of the leaf nodes corresponding to one of the plurality of hosts, and a second level including a first plurality of zones, wherein each of the first plurality of zones comprise a subset of the plurality of leaf nodes, and wherein each of the first plurality of zones includes a proxy host of the plurality of leaf nodes; and for each request to be processed by a host; discovering a plurality of candidate hosts from the leaf nodes and proxy hosts for processing the request; selecting a candidate host based on a probabilistic distribution of measured latencies for the plurality of candidate hosts; and routing the request to the selected candidate host. - View Dependent Claims (17, 18, 19)
-
-
20. A system comprising:
-
a plurality of computing devices for responding to requests, wherein the plurality of computing devices are organized in a hierarchy comprising; a first level including a plurality of leaf nodes, each of the leaf nodes corresponding to one of the plurality of computing devices; and a second level including a first plurality of zones which each comprise a subset of the plurality of leaf nodes; wherein the system is configured to; dispatch requests based on a probabilistic distribution of measured latencies between different levels in the hierarchy. - View Dependent Claims (21, 22, 23, 24, 25)
-
-
26. A tangible computer-accessible medium bearing computer-executable instructions which, when executed on a computing device, direct the computing system to:
-
responsive to a request, discover a set of candidate host computers, the set of candidate host computers being a subset of the plurality of available computers; select a candidate host computer from the set of candidate host computers, the selection of the candidate host computer based on a probabilistic distribution, the probabilistic distribution corresponding to latencies of the candidate host computers; and route the service request to the selected candidate host computer. - View Dependent Claims (27, 28, 29)
-
Specification