Filesystem redirection

• US 10,402,373 B1
• Filed: 02/08/2016
• Issued: 09/03/2019
• Est. Priority Date: 02/08/2016
• Status: Active Grant

• Current Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Original Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Inventors: VanderKnyff, Christopher Michael
• Primary Examiner(s): Pham, Tuan A
• Application Number:
  US15/018,718
• Time in Patent Office: 1,303 Days
• Field of Search: None
• CPC Class Codes: G06F 16/172 Caching, prefetching or hoarding of files
• CPC Class Codes: G06F 16/182 Distributed file systems
• CPC Class Codes: G06F 16/188 Virtual file systems
• CPC Class Codes: G06F 16/2365 Ensuring data consistency and integrity
• CPC Class Codes: G06F 16/957 Browsing optimisation, e.g. caching or content distillation
• CPC Class Codes: G06F 2009/45579 I/O management, e.g. providing access to device drivers or storage
• CPC Class Codes: G06F 9/45533 Hypervisors; Virtual machine monitors
• CPC Class Codes: G06F 9/45558 Hypervisor-specific management and integration aspects

Abstract

Systems and methods are described for providing a proxied filesystem in a hosted computing environment. A provider of hosted computing services provides a filesystem proxy server. The server proxies filesystems on a client computing device utilizing the hosted computing environment, enabling the resources of the hosted computing environment to access the filesystems of the client computing device. Requests for resources in the proxied filesystem may be cached, and updates to cached resources may be communicated as a set of changes that, when applied to the cached resource, transform it into the current version of the resource. The filesystem proxy server may proxy read requests, write requests, requests for information pertaining to the filesystem, and may be implemented within a virtual machine in the hosted computing environment or as a standalone service.

Claims

1. A system comprising:

a local data store configured to store cached data files and specific computer-executable instructions; and

a computing device including a processor in communication with the local data store, wherein the specific computer-executable instructions, when executed by the processor, configure the processor to at least;

obtain, from a client filesystem, client filesystem information;

cache the client filesystem information in the local data store;

cause transmission of the client filesystem information to a virtual machine executing on behalf of a client;

obtain, from the virtual machine, a request for a client data file, wherein the client data file is represented in the client filesystem information;

determine that a cached data file stored in the local data store is associated with the client data file;

determine a cached file version identifier based at least in part on the cached data file;

cause transmission of the cached file version identifier to a client filesystem application executing on a client computing device associated with the client filesystem, wherein the client filesystem application identifies, based at least in part on the cached file version identifier, one or more changes made to the client data file;

obtain, from the client filesystem application, the one or more changes;

apply the one or more changes to the cached data file to form a current data file;

store the current data file in the local data store; and

cause transmission of the current data file to the virtual machine.

2. The system of claim 1, wherein the one or more changes comprise one or more edit operations.

3. The system of claim 2, wherein apply the one or more changes to the cached data file, the processor is configured to apply the one or more edit operations to the cached data file.

4. The system of claim 1, wherein the processor is further configured to at least:

prior to causing transmission of the client filesystem information to a virtual machine executing on behalf of a client,

determine a cached information version based at least in part on the cached filesystem information;

cause transmission of the cached information version to the client filesystem application executing on the client computing device;

determine that the cached information version does not correspond to a current filesystem information version; and

update the cached filesystem information with current filesystem information.

5. The system of claim 4, wherein the client filesystem information comprises directory information.

6. A computer-implemented method comprising:

obtaining, by a filesystem proxy, remote filesystem information from a remote filesystem;

caching, by the filesystem proxy, the remote filesystem information in a filesystem cache;

transmitting, by the filesystem proxy to a virtual machine, the remote filesystem information;

obtaining, by the filesystem proxy, a first request from the virtual machine, the first request including at least a first requested resource, wherein the first requested resource is represented in the remote filesystem information;

determining, by the filesystem proxy, that a first cached resource in the filesystem cache corresponds to the first requested resource;

determining, by the filesystem proxy, an identifier corresponding to the first cached resource;

transmitting, by the filesystem proxy to the remote filesystem, the identifier corresponding to the first cached resource, wherein the remote filesystem identifies, based at least in part on the identifier corresponding to the first cached resource, a first set of changes made to the first requested resource;

obtaining, by the filesystem proxy from the remote filesystem, the first set of changes;

applying, by the filesystem proxy, the first set of changes to the first cached resource to form a first current resource; and

transmitting, by the filesystem proxy, the first current resource to the virtual machine in response to the first request.

7. The computer-implemented method of claim 6, wherein the identifier corresponding to the first cached resource comprises at least one of a version number, timestamp, checksum, or hash value.

8. The computer-implemented method of claim 6, wherein the set of changes comprises one or more edit operations applicable to the first cached resource.

9. The computer-implemented method of claim 6 further comprising:

storing, by the filesystem proxy, the first current resource in the filesystem cache.

10. The computer-implemented method of claim 6 further comprising:

obtaining, by the filesystem proxy, a second request from the virtual machine, the second request including at least a second requested resource;

determining, by the filesystem proxy, that no cached resource in the filesystem cache corresponds to the second requested resource;

obtaining, by the filesystem proxy, the second requested resource from the remote filesystem; and

transmitting, by the filesystem proxy, the second requested resource to the virtual machine, in response to the second request.

11. The computer-implemented method of claim 10 further comprising:

storing, by the filesystem proxy, the second requested resource in the filesystem cache.

12. The computer-implemented method of claim 6 further comprising:

obtaining, by the filesystem proxy, a second request from the virtual machine, the second request including a second requested resource;

determining, by the filesystem proxy, that a second cached resource in the filesystem cache corresponds to the second requested resource;

determining, by the filesystem proxy, an identifier corresponding to the second cached resource;

transmitting, by the filesystem proxy to the remote filesystem, the identifier corresponding to the second cached resource;

obtaining, by the filesystem proxy, the second requested resource from the remote filesystem;

storing, by the filesystem proxy, the second requested resource in the filesystem cache; and

transmitting, by the filesystem proxy, the second requested resource to the virtual machine in response to the second request.

13. The computer-implemented method of claim 6 further comprising:

obtaining, by the filesystem proxy, a second request the virtual machine, the second request including at least a second requested resource;

determining, by the filesystem proxy, that a second cached resource in the filesystem cache corresponds to the second requested resource;

determining, by the filesystem proxy, that the second cached resource is current; and

transmitting, by the filesystem proxy, the second cached resource to the virtual machine in response to the second request.

14. The computer-implemented method of claim 13, wherein determining that the second cached resource is current comprises:

determining, by the filesystem proxy, an identifier corresponding to the second cached resource;

transmitting, by the filesystem proxy, the identifier corresponding to the second cached resource to the remote filesystem; and

obtaining, by the filesystem proxy, an indication from the remote filesystem that the second cache resource is current.

15. The computer-implemented method of claim 6 further comprising:

obtaining, by the filesystem proxy, a second request from the virtual machine, the second request including a second requested resource associated with a second cached resource in the filesystem cache;

obtaining, by the filesystem proxy, from the remote filesystem, a second set of changes made to the second requested resource associated with the second cached resource;

applying, by the filesystem proxy, the second set of changes to the second cached resource to form a second current resource; and

storing, by the filesystem proxy, the second current resource in the filesystem cache.

16. A non-transitory computer-readable medium comprising computer-executable instructions that when executed by a first computing device comprising a processor and a memory cause the first computing device to at least:

obtain, from a filesystem application, filesystem information associated with a remote filesystem monitored by the filesystem application;

cache the filesystem information in a data store configured to store cached resources;

transmit the filesystem information;

obtain a request for a resource represented in the filesystem information;

determine that a cached resource in the data store is associated with the resource specified in the request;

cause the filesystem application to identify a set of changes made to the resource specified in the request, the set of changes determined based at least in part on an identifier associated with the cached resource;

obtain, from the filesystem application, the set of changes made to the resource identified in the request;

apply the set of changes to the cached resource to form a current resource; and

transmit the current resource in response to the request.

17. The non-transitory computer-readable medium of claim 16, wherein the computer-executable instructions further cause the first computing device to at least cache the current resource in the data store.

18. The non-transitory computer-readable medium of claim 16, wherein the request is a write request, and wherein the computer-executable instructions further cause the first computing device to at least cause transmission of at least one of the set of changes or the current resource to a second computing device associated with the filesystem application.

19. The non-transitory computer-readable medium of claim 16, wherein the computer-executable instructions further cause the first computing device to at least:

determine that the set of changes exceeds a threshold; and

responsive to determining that the set of changes exceeds a threshold, cause transmission of the current resource to a second computing device associated with the filesystem application.

20. The non-transitory computer-readable medium of claim 19, wherein to determine that the set of changes exceeds a threshold the computer-executable instructions cause the first computing device to at least determine that a duration required to obtain the set of changes exceeds the threshold.

21. The non-transitory computer-readable medium of claim 19, wherein the threshold is a size threshold, and wherein computer-executable instructions further cause the first computing device to at least determine the threshold based at least in part on a size of the current resource.