Remote storage gateway management using gateway-initiated connections

• US 8,601,134 B1
• Filed: 06/30/2011
• Issued: 12/03/2013
• Est. Priority Date: 06/30/2011
• Status: Active Grant

• Current Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Original Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Inventors: Sorenson, James Christopher III, Lin, Yun, Salyers, David C., Khetrapal, Ankur, Alapati, Nishanth
• Primary Examiner(s): Barry, Lance L
• Application Number:
  US13/174,524
• Time in Patent Office: 887 Days
• Field of Search: 709201-253
• US Class Current: 709/227
• CPC Class Codes: H04L 41/0803 Configuration setting
• CPC Class Codes: H04L 67/1097 for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
• CPC Class Codes: H04L 67/14 Session management for real-time applications in data packet communications networks H04L65/1066
• CPC Class Codes: H04L 67/141 Setup of application sessions admission control or resource allocation in data switching networks H04L47/70
• CPC Class Codes: H04L 67/568 Storing data temporarily at an intermediate stage, e.g. caching

Abstract

Methods, apparatus, and computer-accessible storage media for remotely managing a gateway that serves as an interface between processes on a customer network and a service provider, for example to store data to a remote data store. The gateway sends a connection request to a gateway control server. The server holds the connection until the server receives information (e.g., information from the customer sent via the service provider) for the gateway. The server sends the information as requests via the gateway-initiated connection, and continues to hold the connection. If a server receives information for a gateway to which it does not hold a connection, the server sends the information to the server that does hold the connection. The server may either discover the appropriate server via a registration service that registers connections to gateways or broadcast the information to peer servers identified through a registration service.

Claims

1. A method, comprising:

implementing, at a service provider, a plurality of gateway control servers;

receiving, at a particular one of the plurality of gateway control servers, a connection request from a particular storage gateway on a customer network, wherein the storage gateway operates as an interface between one or more customer processes on the customer network and the service provider to store customer data to a remote data store provided by the service provider;

in response to the connection request, holding, by the particular gateway control server, a connection to the particular storage gateway, wherein the storage gateway waits to receive requests from the service provider via the connection and does not initiate requests to the gateway control server via the connection;

obtaining, by the service provider, information for the particular storage gateway;

providing the information for the particular storage gateway to the particular gateway control server; and

sending, by the particular gateway control server, one or more request messages to the particular storage gateway via the connection, wherein said one or more request messages include the obtained information.

2. The method as recited in claim 1, further comprising the particular gateway control server continuing to hold the connection to the particular storage gateway after said sending the one or more request messages to the particular storage gateway.

3. The method as recited in claim 1, wherein said providing the information for the particular storage gateway to the particular gateway control server comprises:

receiving, by a different gateway control server, the information for the particular storage gateway, wherein the different gateway control server does not hold a connection to the particular storage gateway;

discovering, by the different gateway control server, the particular gateway control server that holds the connection to the particular storage gateway; and

forwarding the information for the particular storage gateway to the particular gateway control server that holds the connection to the particular storage gateway.

4. The method as recited in claim 1, wherein said providing the information for the particular storage gateway to the particular gateway control server comprises:

receiving, by a different gateway control server, the information for the particular storage gateway, wherein the different gateway control server does not hold a connection to the particular storage gateway; and

broadcasting, by the different gateway control server, the information for the particular storage gateway to the plurality of gateway control servers.

5. The method as recited in claim 1, further comprising the particular gateway control server dropping the connection to the particular storage gateway upon detecting that the particular storage gateway is no longer connected.

6. The method as recited in claim 5, wherein said detecting that the particular storage gateway is no longer connected comprises:

periodically or aperiodically sending ping messages to the particular storage gateway over the connection, wherein the storage gateway is operable to respond to received ping messages; and

detecting that the particular storage gateway is no longer connected by determining that the particular storage gateway is not responding to the ping messages over the connection.

7. A device, comprising:

at least one processor; and

a memory comprising program instructions, wherein the program instructions are executable by the at least one processor to implement a gateway control process operable to;

receive a connection request from a storage gateway on a customer network, wherein the storage gateway operates as an interface between one or more customer processes on the customer network and a service provider to store customer data to a remote data store provided by the service provider;

in response to the connection request, hold a connection to the storage gateway, wherein the storage gateway waits to receive requests from the service provider via the connection and does not initiate requests to the gateway control process via the connection;

obtain information for the storage gateway; and

send a request message to the storage gateway via the connection, wherein said request message includes the obtained information.

8. The device as recited in claim 7, wherein the gateway control process is further operable to continue to hold the connection to the storage gateway after said sending the request message to the storage gateway.

9. The device as recited in claim 7, wherein, to obtain information for the storage gateway, the gateway control process is further operable to receive the information from a second gateway control process that does not hold a connection to the storage gateway.

10. The device as recited in claim 9, wherein the information is received from the second gateway control process as a forwarded message specifically to the gateway control process that holds the connection to the storage gateway.

11. The device as recited in claim 10, wherein the gateway control process registers the connection to the storage gateway with a registration service, and wherein the second gateway control process discovers the gateway control process that holds the connection to the respective storage gateway via the registration service.

12. The device as recited in claim 9, wherein the information is received from the second gateway control process as a broadcast message from the second gateway control process to one or more gateway control processes.

13. The device as recited in claim 12, wherein each gateway control process registers its presence with a registration service, and wherein the second gateway control process discovers the one or more gateway control processes via the registration service.

14. The device as recited in claim 7, wherein, to obtain information for the storage gateway, the gateway control process is further operable to receive the information from a console process of the service provider, wherein the console process received the information from an administrative process on the customer network.

15. The device as recited in claim 7, wherein the information includes configuration or management instructions for the storage gateway.

16. The device as recited in claim 7, wherein the gateway control process is one of a plurality of gateway control processes, and wherein only one connection from the storage gateway is held by the plurality of gateway control processes at a given time.

17. The device as recited in claim 7, wherein the gateway control process is further operable to drop the connection to the storage gateway upon detecting that the storage gateway is no longer connected.

18. The device as recited in claim 17, wherein, to detect that the storage gateway is no longer connected, the gateway control process is further operable to:

periodically or aperiodically send ping messages to the storage gateway over the connection, wherein the storage gateway is operable to respond to received ping messages; and

determine that the storage gateway is not responding to the ping messages over the connection.

19. A non-transitory computer-accessible storage medium storing program instructions computer-executable to implement a gateway control process operable to:

receive a connection request from a gateway process on a customer network, wherein the gateway process operates as an interface between one or more customer processes on the customer network and a service provided by a remote service provider;

in response to the connection request, hold a connection to the gateway process, wherein the storage gateway waits to receive requests from the service provider via the connection and does not initiate requests to the gateway control process via the connection;

obtain information for the gateway process; and

send one or more request messages to the gateway process via the connection, wherein said one or more request messages include the obtained information.

20. The non-transitory computer-accessible storage medium as recited in claim 19, wherein the gateway control process is further operable to:

obtain subsequent information for the gateway process; and

send one or more subsequent responses to the gateway process via the connection, wherein said additional responses include the additional information.

21. The non-transitory computer-accessible storage medium as recited in claim 19, wherein the connection request includes security credentials that identify the gateway process to the gateway control process.

22. The non-transitory computer-accessible storage medium as recited in claim 19, wherein, to obtain information for the gateway process, the gateway control process is further operable to receive the information from another process of the service provider.

23. The non-transitory computer-accessible storage medium as recited in claim 22, wherein the information is received from the other process as a forwarded message specifically to the control process that holds the connection to the gateway process.

24. The non-transitory computer-accessible storage medium as recited in claim 22, wherein the information is received from the other process as a broadcast message on a network of the service provider.

25. The non-transitory computer-accessible storage medium as recited in claim 19, wherein the gateway control process is further operable to register the connection to the gateway process with a registration service of the service provider, wherein the connection to the gateway process is discoverable by other processes via the registration service.

26. The non-transitory computer-accessible storage medium as recited in claim 19, wherein the gateway control process is further operable to register its presence with a registration service of the service provider, wherein the gateway control process is discoverable by other processes via the registration service.

27. The non-transitory computer-accessible storage medium as recited in claim 19, wherein, to obtain information for the gateway process, the gateway control process is further operable to receive the information from a console process of the service provider, wherein the console process receives the information from an administrative process on the customer network, and wherein the information includes configuration information for the gateway process.

28. The non-transitory computer-accessible storage medium as recited in claim 19, wherein the service is a storage service, and wherein the gateway process operates as an interface between the one or more customer processes on the customer network and the storage service to store customer data to a remote data store provided by the service provider.

29. The non-transitory computer-accessible storage medium as recited in claim 19, wherein the gateway control process is further operable to:

periodically or aperiodically send ping messages to the storage gateway over the connection, wherein the storage gateway is operable to respond to received ping messages; and

drop the connection to the storage gateway upon detecting that the storage gateway is not responding to the ping messages over the connection.