Load-balanced, persistent connection techniques

• US 9,781,214 B2
• Filed: 04/08/2013
• Issued: 10/03/2017
• Est. Priority Date: 04/08/2013
• Status: Active Grant

• Current Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Original Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Inventors: Torok, Fred, Deramat, Frederic Johan Georges, Gundeti, Vikram Kumar, VanLund, Peter Spalding
• Primary Examiner(s): ZAND, DAVOUD AMAN
• Application Number:
  US13/858,753
• Publication Number:
  US 20140304418A1
• Time in Patent Office: 1,639 Days
• Field of Search: 709201, 709227, 709228, 709229
• CPC Class Codes: H04L 12/2803 Home automation networks
• CPC Class Codes: H04L 61/2503 Translation of Internet protocol [IP] addresses
• CPC Class Codes: H04L 61/4552 Lookup mechanisms between a plurality of directories; Synchronisation of directories, e.g. metadirectories
• CPC Class Codes: H04L 67/1001 for accessing one among a plurality of replicated servers
• CPC Class Codes: H04L 67/1006 with static server selection, e.g. the same server being selected for a specific client
• CPC Class Codes: H04L 67/1027 Persistence of sessions during load balancing
• CPC Class Codes: H04L 67/142 Managing session states for stateless protocols; Signalling session states; State transitions; Keeping-state mechanisms
• CPC Class Codes: H04L 67/143 Termination or inactivation of sessions, e.g. event-controlled end of session
• CPC Class Codes: H04L 67/145 avoiding end of session, e.g. keep-alive, heartbeats, resumption message or wake-up for inactive or interrupted session
• CPC Class Codes: H04L 67/303 Terminal profiles
• CPC Class Codes: H04L 69/14 Multichannel or multilink protocols
• CPC Class Codes: H04W 76/25 Maintenance of established connections

Abstract

Techniques for creating a persistent connection between client devices and one or more remote computing resources, which may form a portion of a network-accessible computing platform. This connection may be considered “permanent” or “nearly permanent” to allow the client device to both send data to and receive data from the remote resources at nearly any time. In addition, both the client device and the remote resources may establish virtual channels over this single connection. If no data is exchanged between the client device and the remote computing resources for a threshold amount of time, then the connection may be severed and the client device may attempt to establish a new connection with the remote computing resources.

Claims

1. An apparatus comprising:

a microphone unit to detect sound and generate a first audio signal based on the sound;

a speaker to output sound corresponding to a second audio signal received from a first server instance;

one or more processors; and

memory storing;

an address that is associated with a first server instance address and a second server instance address, the first server instance address being associated with the first server instance and the second server instance address being associated with a second server instance; and

computer-executable instructions that, when executed by the one or more processors, cause the one or more processors to perform acts comprising;

establishing, using the address, a first connection between the apparatus and the first server instance;

sending, via the first connection, the first audio signal to the first server instance;

receiving, via the first connection, the second audio signal from the first server instance;

determining that less than a threshold amount of data has been transferred between the apparatus and the first server instance over a period of time;

based at least in part on the determining, severing the first connection between the apparatus and the first server instance; and

in response to severing the first connection between the apparatus and the first server instance, establishing, using the address, a second connection between the apparatus and the second server instance.

2. An apparatus as recited in claim 1, wherein the sending of the first audio signal and the receiving of the second audio signal comprises iterating between sending one or more frames of the first audio signal over a first channel of the first connection and receiving one or more frames of the second audio signal over a second channel of the first connection.

3. An apparatus as recited in claim 1, wherein:

the address comprises a virtual internet protocol (VIP) address; and

the first server instance address includes an Internet Protocol (IP) address corresponding to the first server instance.

4. An apparatus as recited in claim 1, wherein the determining comprises:

determining that no data has been transferred between the apparatus and the first server instance for the period of time.

5. The apparatus of claim 1, wherein the acts further comprise:

determining to sever the first connection between the apparatus and the first server instance based at least in part on a processing load on the first server instance;

wherein the severing the first connection between the apparatus and the first server instance is based at least in part on the determining to sever the first connection between the apparatus and the first server instance.

6. The apparatus of claim 1, wherein the acts further comprise:

determining to sever the first connection between the apparatus and the first server instance based on at least one of a speed of traffic over the first connection or a quality of the first connection;

wherein the severing the first connection between the apparatus and the first server instance is based at least in part on the determining to sever the first connection between the apparatus and the first server instance.

7. One or more non-transitory computer-readable media storing computer-executable instructions that, when executed by one or more processors, cause the one or more processors to perform acts comprising:

establishing, using an address stored on a client device, a first connection between the client device and a first server instance;

generating, at a microphone of the client device, an audio signal representing a voice command from a user;

providing the audio signal to the first server instance;

receiving a response to the voice command from the first server instance;

outputting the response via a speaker of the client device;

based at least partly on a property of the first connection, dropping the first connection; and

based at least in part on dropping the first connection, establishing, using the address stored on the client device, a second connection between the client device and a second server instance.

8. One or more non-transitory computer-readable media as recited in claim 7, wherein the property of the first connection comprises:

an amount of data transferred between the client device and the first server instance over a period of time, an amount of data transferred from the client device to the first server instance over a period of time, an amount of data transferred from the first server instance to the client device over a period of time, a duration of the first connection, or a bandwidth of the first connection.

9. One or more non-transitory computer-readable media as recited in claim 7, the acts further comprising iterating between sending data from the client device over a first channel of the first connection to the first server instance and receiving data at the client device over a second channel of the first connection from the first server instance.

10. One or more non-transitory computer-readable media as recited in claim 7, wherein the address includes a virtual internet protocol (VIP) address, the VIP address corresponding to a load-balancing service that balances load between the first server instance and the second server instance.

11. One or more non-transitory computer-readable media as recited in claim 7, wherein:

the first server instance forms a portion of a network-accessible computing platform; and

the establishing of the first connection occurs regardless of whether the client device has data to send to the network-accessible computing platform.

12. One or more non-transitory computer-readable media as recited in claim 7, the acts further comprising iterating between sending data from the client device over a first channel of the first connection to the first server instance and receiving data at the client device over a second channel of the first connection from the first server instance, and wherein the sending of the data from the client device over the first channel comprises sending an audio signal generated by the client device based on sound detected within an environment in which the client device resides.

13. One or more non-transitory computer-readable media as recited in claim 7, wherein the establishing of the second connection comprises attempting to establish the second connection a certain amount of time after the dropping, the certain amount of time including a degree of randomness.

14. One or more non-transitory computer-readable media as recited in claim 7, wherein:

the first server instance is associated with a first server instance address, the first server instance address being associated with the address; and

the second server instance is associated with a second server instance address, the second server instance address being associated with the address.

15. One or more non-transitory computer-readable media as recited in claim 7, wherein the property of the first connection includes an amount of time that the client device has been connected to the first server instance after establishing the first connection between the client device and the first server instance.

16. One or more non-transitory computer-readable media as recited in claim 7, wherein the property of the first connection includes a quality of the first connection between the client device and the first server instance.

17. A system comprising:

one or more processors;

one or more computer-readable media storing computer-executable instructions that, when executed by the one or more processors, cause the one or more processors to perform acts comprising;

establishing, using an address, a first connection between a device and a first server instance, wherein the address is associated with a first server instance address and a second server instance address, the first server instance address being associated with the first server instance and the second server instance address being associated with a second server instance;

sending, via the first connection, a first audio signal to the first server instance;

receiving, via the first connection, a second audio signal from the first server instance;

severing the first connection at least partly based on at least one of an amount of data transferred from the device to the first server instance over a period of time or an amount of data transferred from the first server instance to the device over the period of time; and

based at least in part on severing the first connection, establishing, using the address, a second connection between the device and the second server instance.

18. The system as recited in claim 17, wherein the device comprises:

a microphone unit to detect sound and generate the first audio signal based on the sound;

a speaker to output sound corresponding to the second audio signal received from the first server instance.

19. The system as recited in claim 17, wherein the sending of the first audio signal and the receiving of the second audio signal comprises iterating between sending one or more frames of the first audio signal over a first channel of the first connection and receiving one or more frames of the second audio signal over a second channel of the first connection.

20. The system as recited in claim 17, wherein:

the address comprises a virtual internet protocol (VIP) address; and

the first server instance address includes an Internet Protocol (IP) address.

21. The system as recited in claim 17, wherein the acts further comprise:

determining that no data has been transferred between the device and the first server instance for the period of time;

wherein the severing the first connection is based at least in part on the determining.

22. A client device comprising:

one or more processors; and

one or more computer-readable media storing computer-executable instructions that, when executed by the one or more processors, cause the one or more processors to perform acts comprising;

establishing, using an address, a first connection between the client device and a first server instance;

generating, at a microphone of the client device, an audio signal that includes a command from a user;

providing the audio signal to the first server instance;

receiving a response to the command from the first server instance;

outputting the response via a speaker of the client device;

based at least partly on a property of the first connection, dropping the first connection; and

in response to dropping the first connection, establishing, using the address, a second connection between the client device and a second server instance.

23. The client device as recited in claim 22, wherein the property of the first connection comprises:

an amount of data transferred between the client device and the first server instance over a period of time, an amount of data transferred from the client device to the first server instance over a period of time, an amount of data transferred from the first server instance to the client device over a period of time, a duration of the first connection, or a bandwidth of the first connection.

24. The client device as recited in claim 22, the acts further comprising iterating between sending data from the client device over a first channel of the first connection to the first server instance and receiving data at the client device over a second channel of the first connection from the first server instance.

25. The client device as recited in claim 22, wherein the address includes a virtual internet protocol (VIP) address, the VIP address corresponding to a load-balancing service that balances load between the first server instance and the second server instance.

26. The client device as recited in claim 22, the acts further comprising iterating between sending data from the client device over a first channel of the first connection to the first server instance and receiving data at the client device over a second channel of the first connection from the first server instance, and wherein the sending of the data from the client device over the first channel comprises sending an audio signal generated by the client device based on sound detected within an environment in which the client device resides.

27. The client device as recited in claim 22, wherein the command is a voice command from the user.