Emulating circuit switching in cloud networking environments

• US 9,306,870 B1
• Filed: 06/28/2012
• Issued: 04/05/2016
• Est. Priority Date: 06/28/2012
• Status: Active Grant

• Current Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Original Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Inventors: Klein, Matthew D., Marr, Michael David
• Primary Examiner(s): Mian, Omer S
• Application Number:
  US13/535,715
• Time in Patent Office: 1,377 Days
• US Class Current: 1/1
• CPC Class Codes: H04L 47/19 at layers above the network layer network arrangements for networked applications for scheduling or organising the servicing of application requests H04L67/60
• CPC Class Codes: H04L 47/22 Traffic shaping
• CPC Class Codes: H04L 47/32 by discarding or delaying data units, e.g. packets or frames
• CPC Class Codes: H04L 47/783 Distributed allocation of resources, e.g. bandwidth brokers
• CPC Class Codes: H04L 47/83 based on usage prediction
• CPC Class Codes: H04L 65/00 Network arrangements, protocols or services for supporting real-time applications in data packet communication real-time or near real-time messaging, e.g. instant messaging [IM] H04L51/04; selective video distribution H04N21/00
• CPC Class Codes: H04L 65/1069 Session establishment or de-establishment
• CPC Class Codes: H04L 65/40 Support for services or applications

Abstract

Methods and apparatus for emulating circuit switching in cloud networking environments are disclosed. A system includes a plurality of resources of a provider network and a resource manager. The resource manager receives a circuit switching emulation request specifying (a) a first resource group and a second resource group, and (b) a desired network traffic rate to be supported between the first and second resource groups. In response to a determination to accept the circuit switching emulation request, the resource manager initiates configuration operations associated with a network path between the first and second resource groups to allow network traffic between the first and second resource groups at a rate up to the desired network traffic rate.

Claims

1. A system, comprising:

a plurality of computing devices configured to implement a plurality of resources in a cloud computing environment within a provider network; and

one or more computing devices configured to implement an interface for a client device of a client to generate and submit circuit switching emulation requests for emulated circuits between resource endpoints within the provider network, wherein the interface is configured to enable the client to specify at least three parameters for an emulated circuit between cloud resources within the provider network via at least three separate descriptor data fields, wherein the one or more computing devices are further configured to;

receive a circuit switching emulation request from the client device, wherein the circuit switching emulation request received from the client device comprises the at least three separate descriptor data fields, wherein the at least three separate descriptor data fields comprise;

(a) a first descriptor data field comprising descriptor data specifying a first one of the at least three parameters comprising a first cloud resource group including descriptor data specifying a first resource endpoint for the first cloud resource group,

(b) a second descriptor data field comprising additional descriptor data specifying a second one of the at least three parameters comprising a second cloud resource group including descriptor data specifying a second resource endpoint for the second resource group, wherein each of the first and second cloud resource groups comprises one or more cloud resources within the provider network and at least one cloud resource of the first cloud resource group is allocated to the client, and

(c) a third descriptor data field comprising descriptor data specifying a third one of the at least three parameters comprising a desired network traffic rate between the first and second cloud resource groups,

in response to a determination to accept the circuit switching emulation request, initiate one or more configuration operations associated with a network path between the first resource end-point and the second resource end-point to allow network traffic within the provider network between the first and second cloud resource groups at a rate up to the desired network traffic rate; and

subsequent to initiating the one or more configuration operations, send a notification to the client device indicating that the emulated circuit has been established between the first and second resource endpoints.

2. The system as recited in claim 1, wherein the one or more computing devices are further operable to:

initiate a bandwidth throttling operation to discard one or more network packets transmitted from the first resource end-point to the second resource end-point in response to a detection of a transfer rate in excess of the desired network traffic rate.

3. The system as recited in claim 1, wherein the circuit switching emulation request comprises an indication of one or more properties of a network route to be used between the first and second cloud resource groups, wherein the one or more configuration operations comprise at least one routing configuration operation in accordance with the indication.

4. The system as recited in claim 1, wherein the circuit switching emulation request comprises a designation of the first resource end-point of the first resource group as a gateway resource for traffic between the first resource group and the second resource group, wherein the one or more computing devices are further operable to:

initiate one or more networking configuration operations to route, via the gateway resource, traffic that originates at resource of the first cloud resource group other than the first resource end-point and has a destination within the second cloud resource group.

5. The system as recited in claim 1, wherein the desired network traffic rate is specified for traffic originating at the first cloud resource group and directed at the second cloud resource group, and wherein the circuit switching emulation request comprises a second desired network traffic rate to be supported for traffic originating at the second cloud resource group and directed at the first cloud resource group, wherein the one or more computing devices are further operable to:

initiate one or more additional configuration operations associated with the network path to allow network traffic originating at the second cloud resource group and directed at the first cloud resource group at a rate up to the second desired network traffic rate.

6. A method, comprising:

implementing an interface for a client device of a client of a provider network to allow the client to submit a circuit switching emulation request for an emulated switched circuit between cloud resources of the provider network wherein the provider network comprises a plurality of computing devices that implement a cloud computing environment;

receiving, via the interface, the circuit switching emulation request from the client device, wherein the circuit switching emulation request comprises at least three separate descriptor data fields that enable the client of the provider network to specify at least three separate parameters for the emulated circuit between cloud resources of the provider network, wherein the at least three separate descriptor data fields comprise;

(a) a first descriptor data field comprising descriptor data specifying a first one of the at least three parameters comprising a first resource end-point for a first cloud resource group,

(b) a second descriptor data field comprising additional descriptor data specifying a second one of the at least three parameters comprising a second resource end-point for a second cloud resource group, wherein each of the first and second cloud resource groups comprises one or more resources of the provider network and at least one cloud resource of the first resource group is allocated to the client, and

(c) a third descriptor data field comprising data specifying a third one of the at least three parameters comprising a desired network traffic rate to be supported between the first and second cloud resource groups; and

in response to a determination to accept the circuit switching emulation request, initiating one or more configuration operations associated with a network path between the first and second cloud resource groups to allow network traffic between the first and second cloud resource groups at a rate up to the desired network traffic rate; and

subsequent to initiating the one or more configuration operations, sending a notification to the client device indicating that the emulated circuit has been established between the first and second resource endpoints.

7. The method as recited in claim 6, further comprising:

initiating a bandwidth throttling operation to discard one or more network packets transmitted from the first resource end-point to the second resource end-point in response to a detection of a transfer rate in excess of the desired network traffic rate.

8. The method as recited in claim 6, wherein the circuit switching emulation request comprises an indication of one or more properties of a network route to be used between the first and second cloud resource groups, wherein the one or more configuration operations comprise at least one routing configuration operation in accordance with the indication.

9. The method as recited in claim 6, wherein the circuit switching emulation request comprises a designation of the first resource end-point of the first cloud resource group as a gateway resource for traffic between the first cloud resource group and the second cloud resource group, further comprising:

initiating one or more networking configuration operations to route, via the gateway resource, traffic that originates at resource of the first cloud resource group other than the first resource end-point and has a destination within the second cloud resource group.

10. The method as recited in claim 6, wherein the desired network traffic rate is specified for traffic originating at the first cloud resource group and directed at the second cloud resource group, and wherein the circuit switching emulation request comprises a second desired network traffic rate to be supported for traffic originating at the second cloud resource group and directed at the first cloud resource group, further comprising:

initiating one or more additional configuration operations associated with the network path to allow network traffic originating at the second cloud resource group and directed at the first cloud resource group at a rate up to the second desired network traffic rate.

11. The method as recited in claim 6, further comprising:

determining whether to accept the circuit switching emulation request based at least in part on at least one of;

(a) a bid amount included in the request, (b) a circuit emulation duration indicated in the request, or (c) analysis of network traffic metrics of the provider network.

12. The method as recited in claim 6, wherein the first cloud resource group comprises a plurality of compute resources configured to implement a distributed application, and wherein the second cloud resource group comprises a plurality of storage resources at which at least a portion of data manipulated by the distributed application is stored.

13. The method as recited in claim 6, wherein the first cloud resource group comprises a plurality of cloud resources in a particular availability zone, and wherein the second cloud resource group comprises at least one cloud resource in a different availability zone.

14. A non-transitory computer-accessible storage medium storing program instructions that when executed on one or more processors:

implement an interface for a client device of a client of a provider network to allow the client to submit a circuit switching emulation request for an emulated switched circuit between cloud resources of the provider network wherein the provider network comprises a plurality of computing devices that implement a cloud computing environment;

receive, via the interface, the circuit switching emulation request from the client device, wherein the circuit switching emulation request comprises at least three separate descriptor data fields that enable the client of the provider network to specify at least three separate parameters for an emulated circuit between cloud resources of the provider network, wherein the at least three descriptor data fields comprise;

(a) a first descriptor data field comprising descriptor data specifying a first one of the at least three parameters comprising a first resource end-point for a first cloud resource group,

(b) a second descriptor data field comprising additional descriptor data specifying a second one of the at least three parameters comprising a second resource end-point for a second cloud resource group, wherein each of the first and second cloud resource groups comprises one or more cloud resources of the provider network and at least one cloud resource of the first resource group is allocated to the client, and

(c) a third descriptor data field comprising data specifying a third one of the at least three parameters comprising a desired network traffic rate to be supported between the first and second cloud resource groups;

in response to a determination to accept the circuit switching emulation request, initiate one or more configuration operations associated with a network path between the first and second cloud resource groups to allow network traffic between the first and second cloud resource groups at a rate up to the desired network traffic rate; and

subsequent to initiating the one or more configuration operations, send a notification to the client device indicating that the emulated circuit has been established between the first and second resource endpoints.

15. The storage medium as recited in claim 14, wherein the instructions when executed on the one or more processors:

initiate an operation to discard one or more network packets transmitted from the first cloud resource group to the second cloud resource group in response to a detection of a transfer rate in excess of the desired network traffic rate.

16. The storage medium as recited in claim 14, wherein

the circuit switching emulation request comprises an indication of one or more preferences for a network route to be used between the first and second cloud resource groups, wherein the one or more configuration operations comprise at least one routing configuration operation in accordance with the indication.

17. The storage medium as recited in claim 14, wherein the circuit switching emulation request comprises a designation of the first resource end-point of the first resource group as a gateway resource for traffic between the first cloud resource group and the second cloud resource group, wherein the instructions when executed on the one or more processors:

initiate one or more networking configuration operations to route, via the gateway resource, traffic that originates at resource of the first cloud resource group other than the first resource end-point and has a destination within the second cloud resource group.

18. The storage medium as recited in claim 14, wherein the desired network traffic rate is specified for traffic originating at the first cloud resource group and directed at the second cloud resource group, wherein the circuit switching emulation request comprises a second desired network traffic rate to be supported for traffic originating at the second cloud resource group and directed at the first cloud resource group, wherein the instructions when executed on the one or more processors:

initiate one or more additional configuration operations associated with the network path to allow network traffic originating at the second cloud resource group and directed at the first cloud resource group at a rate up to the second desired network traffic rate.

19. The storage medium as recited in claim 14, wherein the instructions when executed on the one or more processors:

determine whether to accept the circuit switching emulation request based at least in part on at least one of;

(a) a bid amount included in the request, (b) a circuit emulation duration indicated in the request, or (c) analysis of network traffic metrics of the provider network.

20. The storage medium as recited in claim 14, wherein the first cloud resource group comprises a plurality of compute resources configured to implement a distributed application, and wherein the second cloud resource group comprises a plurality of storage resources at which at least a portion of data manipulated by the distributed application is stored.

21. The storage medium as recited in claim 14, wherein the first cloud resource group comprises a plurality of resources in a particular data center, and wherein the second cloud resource group comprises at least one resource in a different data center.