Providing faster data access using multiple caching servers

• US 9,854,053 B1
• Filed: 03/24/2014
• Issued: 12/26/2017
• Est. Priority Date: 03/24/2014
• Status: Expired due to Fees

• Current Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Original Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Inventors: Joseph, Infant Gerald Prasath
• Primary Examiner(s): Sall, El Hadji
• Application Number:
  US14/223,699
• Time in Patent Office: 1,373 Days
• Field of Search: 709213, 709203, 709200, 709226
• CPC Class Codes: H04L 67/568 Storing data temporarily at an intermediate stage, e.g. caching

Abstract

A method and system for identifying an optimal server to receive requests for network content requested by a user of a network device is provided. A browser application in a network device receives a request for network content from a user and transmits the request to a server. The browser application receives the network content from the server and renders the network content to the user on the network device. Executable code in the rendered network content enables the browser application to identify an optimal server to receive subsequent items of network content requested by the user. When the user selects an item of network content in the rendered network page, the browser application connects to the optimal server to receive subsequent items of network content for the user.

Claims

1. A computer-implemented method comprising:

receiving an indication of a first item of network content;

generating a first request for the first item of network content;

transmitting from a network client, the first request for the first item of network content to a plurality of servers, the plurality of servers comprising at least a host server and one or more cache servers, wherein the first request is transmitted to the plurality of servers substantially simultaneously;

receiving, from at least a subset of the plurality of servers, a plurality of responses to the first request that comprises at least the first item of network content;

determining, for each received response in the plurality of responses, a round trip latency for the first request based at least in part on an amount of time to receive the response;

determining, by the network client, a particular server of the plurality of servers associated with a received response having the lowest round trip latency of the plurality of responses;

receiving an indication of a second item of network content;

transmitting, from the network client, a second request for the second item of network content to the particular server; and

determining, based at least in part on historical performance data related to the particular server, a lock-in period for the network client, wherein one or more subsequent requests received from the network client are transmitted to the particular server during the lock-in period.

2. The computer-implemented method of claim 1, wherein the distinct round trip latencies are determined based at least in part on an amount of time between transmitting the first request and receiving an initial portion of the respective plurality of responses.

3. The computer-implemented method of claim 1, wherein the distinct round trip latencies are determined based at least in part on an amount of time between transmitting the first request and receiving a final portion of the respective plurality of responses.

4. The computer-implemented method of claim 1, wherein the round trip latencies are determined based at least in part on determining an amount of the network content in a network page corresponding to the first item of network content.

5. The computer-implemented method of claim 1, wherein the round trip latencies are determined based at least in part on transmitting, substantially simultaneously, a plurality of light-weight probe requests to the plurality of servers.

6. The computer-implemented method of claim 1, wherein the particular server is determined based at least in part on having a minimum round trip latency.

7. The computer-implemented method of claim 6, further comprising determining a lock-in period for the optimal server, wherein the particular server is selected for the second requests for the second item of network content during the lock-in period.

8. The computer-implemented method of claim 1, wherein the round trip latency is stored in a cookie in a browser application.

9. The computer-implemented method of claim 1, wherein transmitting the first request to the plurality of servers comprises transmitting a plurality of light-weight probe requests to the plurality of servers.

10. The computer-implemented method of claim 9, further comprising receiving the individual round trip latencies of the plurality of servers via responses to the plurality of light-weight probe requests.

11. The computer-implemented method of claim 1, further comprising identifying the plurality of servers based at least in part on a geographical location of each of the plurality of servers.

12. The computer-implemented method of claim 1, further comprising identifying the plurality of servers based at least in part on server load information.

13. The computer-implemented method of claim 1, further comprising identifying the plurality of servers based at least in part on prior static knowledge of hop distances to the plurality of servers.

14. The computer-implemented method of claim 1, wherein at least one of the plurality of responses is received from at least one cache server, and wherein at least another of the plurality of responses is received from a host server.