System and method for routing service requests
First Claim
Patent Images
1. A computer-implemented method of routing service requests, comprising:
- receiving, by a first candidate host, a service request, wherein the first candidate host is operable to service the service request;
discovering a plurality of candidate hosts operable to respond to the service request;
obtaining latency data corresponding to one or more of the plurality of candidate hosts, wherein the latency data corresponds to at least one of a network latency, a redirection latency and a service latency;
obtaining latency data associated with the first candidate host;
determining whether the service request should be serviced by the first candidate host or routed to one or more of the plurality of candidate hosts, wherein the determination is based on a probabilistic distribution of the first candidate host and each of one or more of the plurality of candidate hosts corresponding to the latency data associated with the first candidate host and the latency data corresponding to one or more of the plurality of candidate hosts; and
in response to the determination of whether the service request should be serviced by the first candidate host or routed to one or more of the plurality of candidate hosts, servicing the service request by the first candidate host.
0 Assignments
0 Petitions
Accused Products
Abstract
A computer-implemented method routes service requests to services in a service framework provided by a plurality of hosts. The method comprises receiving a service request for a service in the service framework and discovering a plurality of candidate hosts that host the service. The plurality of candidate hosts are a subset of the plurality of hosts. The method further comprises selecting a candidate host from the plurality of candidate hosts based on measured latencies for the plurality of candidate hosts and routing the service request to the selected candidate host.
-
Citations
20 Claims
-
1. A computer-implemented method of routing service requests, comprising:
-
receiving, by a first candidate host, a service request, wherein the first candidate host is operable to service the service request; discovering a plurality of candidate hosts operable to respond to the service request; obtaining latency data corresponding to one or more of the plurality of candidate hosts, wherein the latency data corresponds to at least one of a network latency, a redirection latency and a service latency; obtaining latency data associated with the first candidate host; determining whether the service request should be serviced by the first candidate host or routed to one or more of the plurality of candidate hosts, wherein the determination is based on a probabilistic distribution of the first candidate host and each of one or more of the plurality of candidate hosts corresponding to the latency data associated with the first candidate host and the latency data corresponding to one or more of the plurality of candidate hosts; and in response to the determination of whether the service request should be serviced by the first candidate host or routed to one or more of the plurality of candidate hosts, servicing the service request by the first candidate host. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14)
-
-
15. A non-transitory tangible computer-accessible medium bearing computer-executable instructions which, when executed on a computing device, direct the computing system to:
-
responsive to a service request at a first candidate host, discover a set of candidate host computers, the set of candidate host computers being a subset of the plurality of available computers; determine whether the service request should be serviced by the first candidate host or routed to one or more candidate host computers of the set of candidate host computers, the determination based on a probabilistic distribution, the probabilistic distribution corresponding to latencies associated with the first candidate host and each of the one or more candidate host computers of the set of candidate host computers; and responsive to the determination of whether the service request should be serviced by the first candidate host or routed to one or more candidate host computers of the set of candidate host computers, service route the service request at the determined first candidate host or one or more candidate host computers of the set of candidate host computers. - View Dependent Claims (16, 17, 18, 19, 20)
-
Specification