Producer computing system leasing on behalf of consumer computing system

• US 9,780,993 B2
• Filed: 06/26/2013
• Issued: 10/03/2017
• Est. Priority Date: 06/26/2013
• Status: Active Grant

• Current Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Original Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Inventors: Parakh, Vishal, Dickinson, Andrew Bruce, Vincent, Pradeep
• Primary Examiner(s): Cheema, Umar
• Assistant Examiner(s): Fan, John
• Application Number:
  US13/927,995
• Publication Number:
  US 20150006729A1
• Time in Patent Office: 1,560 Days
• Field of Search: None
• CPC Class Codes: G06F 2209/502 Proximity
• CPC Class Codes: G06F 9/4486 Formation of subprogram jump address
• CPC Class Codes: G06F 9/505 considering the load
• CPC Class Codes: H04L 67/10 in which an application is distributed across nodes in the network software deployment G06F8/60; multiprogramming arrangements G06F9/46
• CPC Class Codes: H04L 67/1078 Resource delivery mechanisms

Abstract

Processes and systems are disclosed for leasing a producer virtual machine on behalf of a consumer virtual machine in an overlay network. The consumer host of the consumer virtual machine can communicate with a set of leasing agents to obtain the identity of a number of producer virtual machines capable of providing the consumer virtual machine with access to a service. When the consumer virtual machine attempts to communicate with a producer system, the consumer host can identify a producer host that hosts a target producer virtual machine and redirect a service request to the producer host.

Claims

1. A method of accessing a service provided by a producer virtual machine in an overlay network, the method comprising:

by a consumer system host comprising one or more processors, the consumer system host configured to host one or more consumer virtual machines, wherein at least one of the consumer virtual machines is associated with a first overlay network;

receiving a service access request sent from a consumer virtual machine to the consumer system host to access a service provided by a producer virtual machine hosted by a producer system host in communication with the consumer system host, the consumer virtual machine hosted by the consumer system host, wherein the service access request includes an inner header, the inner header comprising a consumer virtual machine address associated with the consumer virtual machine and a target virtual address;

determining whether there is a lease pool associated with the consumer virtual machine by accessing a virtual machine mapping repository storing lease information identifying one or more pools of producer virtual machines hosted by the producer system host and leased on behalf of the one or more consumer virtual machines;

in response to determining that there is a lease pool associated with the consumer virtual machine, accessing the lease pool associated with the consumer virtual machine, the lease pool including a set of leased producer virtual machines currently leased on behalf of the consumer virtual machine, wherein the consumer virtual machine is authorized to access one or more services provided by any of the producer virtual machines in the lease pool;

determining whether the lease information accessed from the virtual machine mapping repository indicates that the lease pool includes at least one unused producer virtual machine usable to handle the service access request from the consumer virtual machine;

in response to determining that the lease information accessed from the virtual machine mapping repository indicates that the lease pool includes at least one unused producer virtual machine, selecting a leased producer virtual machine to be used to provide the service requested by the consumer virtual machine from the at least one unused producer virtual machine in the lease pool;

replacing the target virtual address in the inner header with a producer virtual machine address associated with the leased producer virtual machine;

identifying the producer system host associated with the leased producer virtual machine, the producer system host configured to host one or more producer virtual machines, wherein at least one of the producer virtual machines is associated with the first overlay network;

encapsulating the service access request with an outer header comprising a producer system host address associated with the producer system host and a consumer system host address associated with the consumer system host; and

providing the service access request received from the consumer virtual machine to the producer system host via a network, thereby enabling the producer system host to process the service access request.

2. The method of claim 1, further comprising:

removing the selected leased producer virtual machine from the lease pool.

3. The method of claim 1, further comprising:

obtaining, on behalf of the consumer virtual machine, leases for a set of producer virtual machines included in the first overlay network;

initiating connections with individual producer virtual machines from the set of leased producer virtual machines; and

for individual successfully established connections, adding the corresponding producer virtual machine to the lease pool,

wherein selecting the leased producer virtual machine further comprises selecting one of the producer virtual machines added to the lease pool and removing the selected leased producer virtual machine from the lease pool.

4. The method of claim 3, wherein obtaining leases for the set of producer virtual machines comprises:

generating a lease request to obtain a lease to a producer virtual machine included in the first overlay network for the consumer virtual machine;

providing the lease request to a set of leasing agents; and

for at least some of the leasing agents in the set of leasing agents, receiving connection information for a producer virtual machine thereby enabling a connection to be initiated with the producer virtual machine.

5. The method of claim 4, wherein the set of leasing agents comprises a subset of leasing agents in the network.

6. The method of claim 1, further comprising:

receiving, from the producer system host, a response to the service access request provided to the producer system host;

de-encapsulating the response by removing an outer header of the response to obtain access to an inner header of the response;

determining a recipient consumer virtual machine based on the inner header of the response, the recipient consumer virtual machine one of the consumer virtual machines hosted by the consumer system host; and

providing the de-encapsulated response to the recipient consumer virtual machine.

7. The method of claim 6, wherein the recipient consumer virtual machine and the consumer virtual machine are the same.

8. The method of claim 6, further comprising:

identifying, based on the inner header of the response, a source virtual address associated with a source producer virtual machine associated with the response; and

substituting an address included in the inner header associated with the source producer virtual machine with the source virtual address.

9. The method of claim 8, wherein the source producer virtual machine corresponds to the selected leased producer virtual machine, the source virtual address corresponds to the target virtual address, and the recipient consumer virtual machine corresponds to the consumer virtual machine.

10. The method of claim 1, wherein at least one of the consumer virtual machines is associated with a second overlay network.

11. The method of claim 1, wherein at least one of the producer virtual machines is associated with a second overlay network.

12. The method of claim 1, further comprising:

receiving a second request to access the service;

determining whether a load of the leased producer virtual machine satisfies a load threshold; and

in response to determining that the load of the leased producer virtual machine satisfies the load threshold;

selecting from the lease pool a second leased producer virtual machine from which to access the service; and

providing the second request to a second producer system host that hosts the second leased producer virtual machine.

13. The method of claim 12, wherein, in response to determining that the load of the leased producer virtual machine satisfies the load threshold, the method further comprises terminating a connection to the leased producer virtual machine.

14. A system for accessing a service provided by a producer in an overlay network, the system comprising:

a consumer system host comprising one or more processors, the consumer system host configured to host one or more consumers, the consumer system host comprising;

a mapping repository configured to store a mapping of producers to producer system hosts and lease information identifying one or more producers hosted by the producer system hosts and leased on behalf of the one or more consumers; and

an overlay network proxy configured to;

receive a request sent from a consumer hosted by the consumer system host to the consumer system host to access a service provided by a producer hosted by one of the producer system hosts in communication with the consumer system host;

access the lease information stored in the mapping repository;

determine whether the lease information accessed from the mapping repository indicates that a lease pool associated with the consumer includes at least one unused producer usable to handle the request from the consumer;

in response to determining that the lease information accessed from the mapping repository indicates that the lease pool includes at least one unused producer, select a leased producer from the at least one unused producer in the lease pool, the lease pool including a set of leased producers currently leased on behalf of the consumer, the leased producers comprising physical or virtual computing devices, wherein the consumer is authorized to access one or more services provided by any of the producers in the lease pool;

access the mapping in the mapping repository to identify a producer system host associated with the selected leased producer, the producer system host configured to host one or more producers; and

send the request received from the consumer to the producer system host.

15. The system of claim 14, wherein:

the mapping repository is further configured to store the lease pool associated with the consumer.

16. The system of claim 15, wherein the overlay network proxy is further configured to:

generate a request to obtain a lease to a producer for the consumer;

provide the request to a set of leasing agents; and

for at least some of the leasing agents in the set of leasing agents, receive connection information for a producer.

17. The system of claim 16, wherein the mapping repository is further configured to store the connection information in the lease pool associated with the consumer.

18. The system of claim 14, wherein the overlay network proxy is further configured to:

receive, from the producer system host, a response to the request sent to the producer system host;

determine a recipient consumer based on an inner header of the response, the recipient consumer comprising the consumer; and

provide the response to the consumer.

19. The system of claim 18, wherein the overlay network proxy is further configured to:

identify a source virtual address associated with the selected leased producer; and

substitute an address included in the inner header associated with selected the leased producer with the source virtual address prior to providing the response to the consumer.

20. The system of claim 14, wherein the overlay network proxy is further configured to encapsulate the request with an outer header comprising a producer system host address associated with the producer system host and a consumer system host address associated with the consumer system host.

21. Non-transitory physical computer storage comprising computer-executable instructions that, when implemented in one or more processors, direct a computing system to provide access to a service provided by a producer virtual machine in an overlay network by at least:

in response to receiving a request sent from a consumer virtual machine hosted by the computing system to the computing system to access a service provided by a producer virtual machine hosted by a producer system host in communication with the computing system, determining whether lease information accessed from a mapping repository indicates that a lease pool associated with the consumer virtual machine includes at least one unused producer virtual machine usable to handle the request from the consumer virtual machine, the request including a target virtual address,

in response to determining that the lease information accessed from the mapping repository indicates that the lease pool associated with the consumer virtual machine includes at least one unused producer virtual machine, selecting a leased producer virtual machine to be used to provide the service requested by the consumer virtual machine from the at least one unused producer virtual machine in the lease pool, the lease pool comprising connection information for producer virtual machines currently leased on behalf of the consumer virtual machine, wherein the consumer virtual machine is authorized to access one or more services provided by any of the producer virtual machines in the lease pool;

replacing the target virtual address in a header of the request with a producer virtual machine address associated with the leased producer virtual machine;

determining the producer system host associated with the leased producer virtual machine; and

causing the request received from the consumer virtual machine to be sent to the producer system host to be provided to the leased producer virtual machine thereby enabling the lease producer virtual machine to process the request to access the service.

22. The non-transitory physical computer storage of claim 21, wherein the instructions further direct the computing system to:

obtain, on behalf of the consumer virtual machine, leases for a set of producer virtual machines included in the overlay network;

initiate connections with individual producer virtual machines from the set of leased producer virtual machines; and

for successfully established connections, add connection information for the corresponding producer virtual machine to the lease pool.

23. The non-transitory physical computer storage of claim 22, wherein selecting the leased producer virtual machine from the at least one unused producer virtual machine in the lease pool associated with the consumer virtual machine comprises selecting one of the producer virtual machines whose connection information was added to the lease pool.