Method and system for providing on-demand services through a virtual file system at a computing device

• US 8,694,564 B2
• Filed: 11/24/2010
• Issued: 04/08/2014
• Est. Priority Date: 08/28/2009
• Status: Active Grant

• Current Assignee: Beijing Innovation Works Technology Company Limited
• Original Assignee: Beijing Innovation Works Technology Company Limited
• Inventors: Guarraci, Brian J.
• Primary Examiner(s): TRUONG, CAM Y T
• Application Number:
  US12/954,371
• Publication Number:
  US 20110066668A1
• Time in Patent Office: 1,231 Days
• Field of Search: 707/831, 707/999.1, 707/999.204, 707/638
• US Class Current: 707/831
• CPC Class Codes: G06F 16/188 Virtual file systems
• CPC Class Codes: G06F 16/27 Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor

Abstract

A method of providing on-demand service through a virtual file system is implemented at a computing device. In response to receiving a request for a file associated with an instance of the virtual file system, the computing device checks the metadata of the requested file in the virtual file system to identify a first set of data blocks of the requested file that is not present at the computing device and retrieves the first set of data blocks from at least one of a plurality of storage devices associated with the virtual file system. The computing device generates a copy of the requested file using the retrieved first set of data blocks and returns the generated copy of the requested file to the requesting application or user.

Claims

1. A computer-implemented method, comprising:

at a computing device;

receiving, from an application, a request for a file associated with an instance of a virtual file system, wherein the file has multiple revisions and the request identifies a particular revision to the file and the virtual file system includes metadata of the multiple revisions to the requested file;

creating a commit tree based on metadata blocks associated with the particular revision of the virtual file system and wherein the particular revision to the requested file is associated with a file node of the commit tree, wherein the commit tree includes all subsequent operations of the file;

checking the metadata to identify a first set of data blocks of the particular revision to the requested file that is not present at the computing device, further including looking up the commit tree associated with the instance of the virtual file system for location information of the first set of data blocks associated with the particular revision to the requested file, wherein the commit tree includes multiple branches, each branch having an associated list of block identifiers corresponding to a respective revision to the file and a file revision identifier referencing an earlier revision to the file, and looking up the commit tree including laterally traversing the multiple branches using respective file revision identifiers until a list of block identifiers corresponding to the first set of data blocks of the particular revision to the requested file is identified, wherein the checking the metadata includes identifying a second set of data blocks of the particular revision to the requested file that is already present at the computing device;

retrieving the first set of data blocks from at least one of a plurality of storage devices associated with the virtual file system using the identified list of block identifiers corresponding to the first set of data blocks of the particular revision to the requested file and in accordance with the location information of the first set of data blocks;

generating a copy of the particular revision to the requested file using the retrieved first set of data blocks, wherein the generating a copy of the particular revision to the requested file includes merging the first set of data blocks of the particular revision to the requested file with the second set of data blocks, wherein the merging further includes replacing an old data block in the second set with a new data block in the first set if the new data block includes at least one update to the old data block;

and returning the generated copy of the particular revision to the requested file to the requesting application.

2. The computer-implemented method of claim 1, wherein the metadata of the requested file was retrieved from at least one of the plurality of storage devices during the instantiation of the virtual file system at the computing device.

3. The computer-implemented method of claim 1, wherein the particular revision to the requested file is associated with a file node of the commit tree.

4. The computer-implemented method of claim 3, wherein the commit tree includes a plurality of commit tree branches, each commit tree branch corresponding to a respective revision of the virtual file system.

5. The computer-implemented method of claim 4, wherein a respective commit tree branch includes at least a commit node, a directory node, and a file node, and the commit tree branch is configured such that the commit node includes a reference to the directory node and the directory node includes a reference to the file node.

6. The computer-implemented method of claim 4, wherein a respective commit tree branch includes at least one reference to another commit tree branch and the two commit tree branches correspond to two consecutive revisions of the virtual file systems.

7. The computer-implemented method of claim 6, wherein there is at least one difference between the two consecutive revisions of the virtual file systems.

8. The computer-implemented method of claim 1, wherein checking the metadata includes identifying a second set of data blocks of the particular revision to the requested file that is already present at the computing device.

9. The computer-implemented method of claim 8, wherein at least one of the second set of data blocks is part of a file associated with the virtual file system that is different from the particular revision to the requested file.

10. The computer-implemented method of claim 8, wherein at least one of the second set of data blocks is part of an old version of the particular revision to the requested file.

11. The computer-implemented method of claim 1, wherein generating a copy of the particular revision to the requested file includes updating the metadata of the particular revision to the requested file in the commit tree in accordance with the retrieved first set of data blocks at the computing device.

12. The computer-implemented method of claim 11, wherein the commit tree has one or more commit tree branches, each commit tree branch having at least one commit node, at least one directory node, and at least one file node, and the particular revision to the requested file is associated with a file node of a respective commit tree branch, and updating the metadata of the particular revision to the requested file includes updating the file node, the directory node, and the commit node of the respective commit tree branch in accordance with the retrieved first set of data blocks at the computing device.

13. The computer-implemented method of claim 1, wherein the plurality of storage devices include at least one storage device remote from the computing device that is associated with a cloud storage service provided by a third party.

14. The computer-implemented method of claim 1, wherein retrieving the first set of data blocks includes:

selecting an adapter for a respective storage device that has one or more of the first set of data blocks; and

causing the selected adapter to issue one or more requests for the data blocks stored at the respective storage device.

15. The computer-implemented method of claim 1, wherein the computing device is one selected from the group consisting of a desktop computer, a laptop computer, a tablet computer, and a mobile telephone.

16. The computer-implemented method of claim 1, wherein the computing device has a local file system and the local file system includes directories and files associated with the virtual file system.

17. The computer-implemented method of claim 16, wherein a total size of the local file system is less than a total size of the virtual file system.

18. A computing device, comprising:

one or more processors;

memory; and

one or more programs stored in the memory for execution by the one or more processors, the one or more programs comprising instructions for;

receiving, from an application, a request for a file associated with an instance of a virtual file system, wherein the file has multiple revisions and the request identifies a particular revision to the file and the virtual file system includes metadata of the multiple revisions to the requested file;

creating a commit tree based on metadata blocks associated with the particular revision of the virtual file system and wherein the particular revision to the requested file is associated with a file node of the commit tree, wherein the commit tree includes all subsequent operations of the file;

checking the metadata to identify a first set of data blocks of the particular revision to the requested file that is not present at the computing device, further including looking up the commit tree associated with the instance of the virtual file system for location information of the first set of data blocks associated with the particular revision to the requested file, wherein the commit tree includes multiple branches, each branch having an associated list of block identifiers corresponding to a respective revision to the file and a file revision identifier referencing an earlier revision to the file, and looking up the commit tree including laterally traversing the multiple branches using respective file revision identifiers until a list of block identifiers corresponding to the first set of data blocks of the particular revision to the requested file is identified, wherein the checking the metadata includes identifying a second set of data blocks of the particular revision to the requested file that is already present at the computing device;

retrieving the first set of data blocks from at least one of a plurality of storage devices associated with the virtual file system using the identified list of block identifiers corresponding to the first set of data blocks of the particular revision to the requested file and in accordance with the location information of the first set of data blocks;

generating a copy of the particular revision to the requested file using the retrieved first set of data blocks, wherein the generating a copy of the particular revision to the requested file includes merging the first set of data blocks of the particular revision to the requested file with the second set of data blocks, wherein the merging further includes replacing an old data block in the second set with a new data block in the first set if the new data block includes at least one update to the old data block; and

returning the generated copy of the particular revision to the requested file to the requesting application.

19. A non-transitory computer readable storage medium storing one or more programs configured for execution by a computing device having one or more processors and memory storing one or more programs for execution by the one or more processors, the one or more programs comprising instructions to:

receive, from an application, a request for a file associated with an instance of a virtual file system, wherein the file has multiple revisions and the request identifies a particular revision to the file and the virtual file system includes metadata of the multiple revisions to the requested file;

creating a commit tree based on metadata blocks associated with the particular revision of the virtual file system and wherein the particular revision to the requested file is associated with a file node of the commit tree, wherein the commit tree includes all subsequent operations of the file;

check the metadata to identify a first set of data blocks of the particular revision to the requested file that is not present at the computing device, further including looking up the commit tree associated with the instance of the virtual file system for location information of the first set of data blocks associated with the particular revision to the requested file, wherein the commit tree includes multiple branches, each branch having an associated list of block identifiers corresponding to a respective revision to the file and a file revision identifier referencing an earlier revision to the file, and looking up the commit tree including laterally traversing the multiple branches using respective file revision identifiers until a list of block identifiers corresponding to the first set of data blocks of the particular revision to the requested file is identified, wherein the checking the metadata includes identifying a second set of data blocks of the particular revision to the requested file that is already present at the computing device;

retrieve the first set of data blocks from at least one of a plurality of storage devices associated with the virtual file system using the identified list of block identifiers corresponding to the first set of data blocks of the particular revision to the requested file and in accordance with the location information of the first set of data blocks;

generate a copy of the particular revision to the requested file using the retrieved first set of data blocks, wherein the generating a copy of the particular revision to the requested file includes merging the first set of data blocks of the particular revision to the requested file with the second set of data blocks, wherein the merging further includes replacing an old data block in the second set with a new data block in the first set if the new data block includes at least one update to the old data block; and

return the generated copy of the particular revision to the requested file to the requesting application.