Remote storage gateway management using gateway-initiated connections

• US 9,866,622 B1
• Filed: 11/27/2013
• Issued: 01/09/2018
• Est. Priority Date: 06/30/2011
• Status: Active Grant

• Current Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Original Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Inventors: Sorenson, III, James Christopher, Lin, Yun, Salyers, David Carl, Khetrapal, Ankur, Alapati, Nishanth
• Primary Examiner(s): Barry, Lance L
• Application Number:
  US14/092,785
• Time in Patent Office: 1,504 Days
• Field of Search: 709201-253
• CPC Class Codes: H04L 41/0803 Configuration setting
• CPC Class Codes: H04L 67/1097 for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
• CPC Class Codes: H04L 67/14 Session management for real-time applications in data packet communications networks H04L65/1066
• CPC Class Codes: H04L 67/141 Setup of application sessions admission control or resource allocation in data switching networks H04L47/70
• CPC Class Codes: H04L 67/568 Storing data temporarily at an intermediate stage, e.g. caching

Abstract

Methods, apparatus, and computer-accessible storage media for remotely managing a gateway that serves as an interface between processes on a customer network and a service provider, for example to store data to a remote data store. The gateway sends a connection request to a gateway control server. The server holds the connection until the server receives information (e.g., information from the customer sent via the service provider) for the gateway. The server sends the information as requests via the gateway-initiated connection, and continues to hold the connection. If a server receives information for a gateway to which it does not hold a connection, the server sends the information to the server that does hold the connection. The server may either discover the appropriate server via a registration service that registers connections to gateways or broadcast the information to peer servers identified through a registration service.

Claims

1. A non-transitory computer-readable storage medium storing program instructions that, when executed by a computer, implement a gateway process configured to:

send a connection request to a remote storage service provider to establish a gateway-management connection to the gateway process to receive configuration or management information from the remote storage service provider, wherein the gateway process operates as an interface between one or more customer processes on a customer network and a storage service provided by the remote storage service provider, and wherein a process of the remote storage service provider holds the gateway-management connection to the gateway process to maintain the gateway-management connection to the gateway process from the remote storage service provider;

subsequent to the requested gateway-management connection being established, and maintained by the remote storage service provider;

wait to receive one or more configuration or management messages from the remote storage service provider via the gateway-management connection being maintained by the remote storage service provider, wherein the gateway process does not initiate requests for configuration or management information to the remote storage service provider via the gateway-management connection being maintained by the remote storage service provider; and

receive one or more messages from the remote storage service provider via the gateway management connection being maintained by the gateway process, wherein the one or more messages each include configuration or management information for the gateway process, the information for the gateway process obtained by the remote storage service provider, and forwarded to the gateway process by the process that holds the data connection to the gateway process; and

establish a data connection to send data from the customer network to be stored at the remote storage service provider.

2. The non-transitory computer-readable storage medium as recited in claim 1 wherein the gateway process operates as an interface between the one or more customer processes on the customer network and the storage service to store customer data to a remote data store provided by the remote service provider.

3. The non-transitory computer-readable storage medium as recited in claim 1, wherein the process of the remote service provider is one of a plurality of gateway control processes, and wherein only one connection to the gateway process from the remote service provider is maintained by the plurality of gateway control processes at a given time.

4. The non-transitory computer-readable storage medium as recited in claim 1, wherein the gateway process is further configured to send at least one message to the remote service provider via the data connection in response to the one or more request messages received from the remote service provider.

5. The non-transitory computer-readable storage medium as recited in claim 1, wherein the gateway process is further configured to:

detect that the data connection to the gateway process from the remote service provider has been dropped; and

in response to said detect, send another connection request to the remote service provider to establish another data connection to the gateway process from the remote service provider.

6. The non-transitory computer-readable storage medium as recited in claim 5, wherein, to detect that the data connection to the gateway process from the remote service provider has been dropped, the gateway process is further configured to detect that ping messages are not being received from the remote service provider over the data connection.

7. A method, comprising:

performing, by one or more computing devices;

sending a connection request to a remote storage service provider to establish a gateway-management connection to a gateway process to receive configuration or management information from the remote storage service provider, wherein the gateway process operates as an interface between one or more customer processes on a customer network and a storage service provided by the remote storage service provider, and wherein a process of the remote storage service provider holds the gateway-management connection to the gateway process to maintain the gateway-management connection to the gateway process from the remote storage service provider;

subsequent to the requested gateway-management connection being established, and maintained by the remote storage service provider;

waiting to receive one or more configuration or management messages from the remote storage service provider via the gateway-management connection being maintained by the remote storage service, wherein the gateway process does not initiate requests for configuration information or management information to the remote storage service provider via the gateway-management connection being maintained by the remote storage service provider; and

receiving one or more messages from the remote storage service provider via the gateway-management connection being maintained by the gateway process, wherein the one or more messages each include configuration or management information for the gateway process, the information for the gateway process obtained by the remote storage service provider and forwarded to the gateway process by the process that holds the data connection to the gateway process; and

establishing a data connection to send data from the customer network to be stored at the remote storage service provider.

8. The method as recited in claim 7, wherein the gateway process operates as an interface between the one or more customer processes on the customer network and the storage service to store customer data to a remote data store provided by the remote service provider.

9. The method as recited in claim 7, wherein the process of the remote service provider is one of a plurality of gateway control processes, and wherein only one connection to the gateway process from the remote service provider is maintained by the plurality of gateway control processes at a given time.

10. The method as recited in claim 7, further comprising sending at least one message to the remote service provider via the data connection in response to the one or more request messages received from the remote service provider.

11. The method as recited in claim 7, further comprising:

detecting that the data connection to the gateway process from the remote service provider has been dropped; and

subsequent to said detecting, sending another connection request to the remote service provider to establish another data connection to the gateway process from the remote service provider.

12. The method as recited in claim 11, wherein detecting that the data connection to the gateway process from the remote service provider has been dropped comprises detecting that ping messages are not being received from the remote service provider over the data connection.

13. The method as recited in claim 7, further comprising:

periodically or aperiodically receiving ping messages from the gateway process over the data connection; and

indicating that the data connection to the gateway process from the remote service provider has not been dropped, wherein said indicating comprises responding to the received ping messages over the data connection.

14. A device, comprising:

at least one processor; and

a memory comprising program instructions, wherein the program instructions are executable by the at least one processor to implement a gateway process configured to;

send a connection request to a remote storage service provider to establish a gateway-management connection to the gateway process to receive configuration or management information from the remote storage service provider, wherein the gateway process operates as an interface between one or more customer processes on a customer network and a storage service provided by the remote storage service provider, and wherein a process of the remote storage service provider holds the gateway-management connection to the gateway process to maintain the gateway-management connection to the gateway process from the remote storage service provider;

subsequent to the requested gateway-management connection being established, and maintained by the remove storage service provider;

wait to receive one or more configuration or management messages from the remote storage service provider via the gateway-management connection being maintained by the remote storage service provider, wherein the gateway process does not initiate requests for configuration or management information to the remote storage service provider via the gateway-management connection that is being maintained by the remote storage service provider; and

receive one or more messages from the remote storage service provider via the gateway-management connection being maintained by the gateway process, wherein the one or more messages each include configuration or management information for the gateway process, the information for the gateway process obtained by the remote storage service provider and forwarded to the gateway process by the process that holds the data connection to the gateway process; and

establish a data connection to send data from the customer network to be stored at the remote storage service provider.

15. The device as recited in claim 14, wherein the gateway process operates as an interface between the one or more customer processes on the customer network and the storage service to store customer data to a remote data store provided by the remote service provider.

16. The device as recited in claim 14, wherein the process of the remote service provider is one of a plurality of gateway control processes, and wherein only one connection to the gateway process from the remote service provider is maintained by the plurality of gateway control processes at a given time.

17. The device as recited in claim 14, wherein the gateway process is further configured to send at least one message to the remote service provider via the data connection in response to the one or more request messages received from the remote service provider.

18. The device as recited in claim 14, wherein the gateway process is further configured to:

detect that the data connection to the gateway process from the remote service provider has been dropped; and

in response to said detecting, send another connection request to the remote service provider to establish another data connection to the gateway process from the remote service provider.

19. The device as recited in claim 18, wherein, to detect that the data connection to the gateway process from the remote service provider has been dropped, the gateway process is further configured to detect that ping messages are not being received from the remote service provider over the data connection.

20. The device as recited in claim 14, wherein the gateway process is further configured to accept a limited number of externally-initiated connections to one or more data ports exposed to customer processes on a client network such that configuration and management of the gateway process is only performed through the service provider.