Virtual file system for cloud-based shared content

• US 10,114,835 B2
• Filed: 04/27/2016
• Issued: 10/30/2018
• Est. Priority Date: 04/29/2015
• Status: Active Grant

• Current Assignee: Box Incorporated
• Original Assignee: Box Incorporated
• Inventors: Malhotra, Ritik, Luthra, Tanooj, Tallamraju, Sri Sarat Ravikumar
• Primary Examiner(s): Meng, Jau Shya
• Application Number:
  US15/140,179
• Publication Number:
  US 20160321291A1
• Time in Patent Office: 916 Days
• Field of Search: None
• CPC Class Codes: G06F 12/0891 using clearing, invalidating or resetting means
• CPC Class Codes: G06F 12/1081 for peripheral access to main memory, e.g. direct memory access [DMA]
• CPC Class Codes: G06F 12/122 of the least frequently used [LFU] type, e.g. with individual count value
• CPC Class Codes: G06F 16/113 Details of archiving lifecycle management in storage systems G06F3/0649; backup systems G06F11/1446
• CPC Class Codes: G06F 16/172 Caching, prefetching or hoarding of files
• CPC Class Codes: G06F 16/1727 Details of free space management performed by the file system saving storage space on storage systems G06F3/0608; management of blocks in storage devices G06F3/064
• CPC Class Codes: G06F 16/1748 De-duplication implemented within the file system, e.g. based on file segments de-duplication techniques in storage systems for the management of data blocks G06F3/0641
• CPC Class Codes: G06F 16/1774 Locking methods, e.g. locking methods for file systems allowing shared and concurrent access to files
• CPC Class Codes: G06F 16/182 Distributed file systems
• CPC Class Codes: G06F 16/183 Provision of network file services by network file servers, e.g. by using NFS, CIFS network file access protocols H04L67/1097
• CPC Class Codes: G06F 16/185 Hierarchical storage management [HSM] systems, e.g. file migration or policies thereof details of archiving G06F16/11
• CPC Class Codes: G06F 16/188 Virtual file systems
• CPC Class Codes: G06F 16/196 Specific adaptations of the file system to access devices and non-file objects via standard file system access operations, e.g. pseudo file systems dedicated interfaces to storage systems G06F3/0601
• CPC Class Codes: G06F 16/22 Indexing; Data structures therefor; Storage structures
• CPC Class Codes: G06F 16/23 Updating
• CPC Class Codes: G06F 16/2443 Stored procedures
• CPC Class Codes: G06F 16/9574 of access to content, e.g. by caching
• CPC Class Codes: G06F 2212/1016 Performance improvement
• CPC Class Codes: G06F 2212/1044 Space efficiency improvement
• CPC Class Codes: G06F 2212/154 Networked environment
• CPC Class Codes: G06F 2212/463 : File
• CPC Class Codes: G06F 2212/60 : Details of cache memory
• CPC Class Codes: G06F 2212/657 : Virtual address space management
• CPC Class Codes: G06F 9/46 : Multiprogramming arrangements
• CPC Class Codes: H04L 63/0428 : wherein the data content is protected, e.g. by encrypting or encapsulating the payload
• CPC Class Codes: H04L 65/70 : Media network packetisation
• CPC Class Codes: H04L 65/762 : at the source reformatting of additional data in video distribution servers H04N21/2355
• CPC Class Codes: H04L 65/80 : Responding to QoS
• CPC Class Codes: H04L 67/06 : specially adapted for file transfer, e.g. file transfer protocol [FTP]
• CPC Class Codes: H04L 67/1097 : for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
• CPC Class Codes: H04L 67/34 : involving the movement of software or configuration parameters network booting or remote initial program loading [RIPL] G06F9/4416
• CPC Class Codes: H04N 19/40 : using video transcoding, i.e. partial or full decoding of a coded input stream followed by re-encoding of the decoded output stream

Abstract

A server in a cloud-based environment interfaces with storage devices that store shared content accessible by two or more users. Individual items within the shared content are associated with respective object metadata that is also stored in the cloud-based environment. Download requests initiate downloads of instances of a virtual file system module to two or more user devices associated with two or more users. The downloaded virtual file system modules capture local metadata that pertains to local object operations directed by the users over the shared content. Changed object metadata attributes are delivered to the server and to other user devices that are accessing the shared content. Peer-to-peer connections can be established between the two or more user devices. Object can be divided into smaller portions such that processing the individual smaller portions of a larger object reduces the likelihood of a conflict between user operations over the shared content.

Claims

1. A method for accessing a file system in a cloud-based storage platform that stores shared content accessible over a network by two or more user devices, the method comprising:

implementing a file system interface between the cloud-based storage platform and a virtual file system, in which the file system interface directs file system calls from an application running on one of the user devices to the virtual file system;

processing at least some of the file system calls received at the file system interface through a first operation pipeline comprising a local data manager that issues one or more of the file system calls to a file system executor that performs local processing to produce a series of file events;

receiving a file event from the first pipeline and initiating processing of the file event through a second pipeline comprising at least a first operation to access local metadata corresponding to the series of file events and a second operation to access a local cache to identify a portion of a file within the virtual file system; and

providing at least an identification of contents of the local cache to a remote storage application programming interface to initiate a change in the file system of the cloud-based storage platform, wherein the change to the file system of the cloud-based storage platform corresponds to the file event that was processed by accessing to the local metadata.

2. The method of claim 1, further comprising uploading the portion of the file within the virtual file system to the cloud-based storage platform.

3. The method of claim 2, further comprising receiving an updated portion of the file by at least one second user device from the user devices.

4. The method of claim 3, further comprising initiating conflict remediation responsive to receiving the updated portion of the file.

5. The method of claim 3, wherein storing the updated portion of the file from the at least one second user device and uploading the portion of the file occur asynchronously.

6. The method of claim 1, wherein the file event is a file access request that is placed into an event queue.

7. The method of claim 1, further comprising determining at least one of, local metadata attributes, or object metadata attributes, based at least in part on a set of object locking rules.

8. The method of claim 7, wherein at least one permissions attribute from at least one of, the local metadata attributes, or the object metadata attributes, is based at least in part on the object locking rules.

9. The method of claim 1, wherein the remote storage application programming interface implements the change in the file system of the cloud-based storage platform.

10. A computer readable medium, embodied in a non-transitory computer readable medium, the non-transitory computer readable medium having stored thereon a sequence of instructions which, when stored in memory and executed by a processor causes the processor to perform a set of acts for accessing a file system in a cloud-based storage platform that stores shared content accessible over a network by two or more user devices, the acts comprising:

implementing a file system interface between the cloud-based storage platform and a virtual file system, in which the file system interface directs file system calls from an application running on one of the user devices to the virtual file system;

processing at least some of the file system calls received at the file system interface through a first operation pipeline comprising a local data manager that issues one or more of the file system calls to a file system executor that performs local processing to produce a series of file events;

receiving a file event from the first pipeline and initiating processing of the file event through a second pipeline comprising at least a first operation to access local metadata corresponding to the series of file events and a second operation to access a local cache to identify a portion of a file within the virtual file system; and

providing at least an identification of contents of the local cache to a remote storage application programming interface to initiate a change in the file system of the cloud-based storage platform, wherein the change to the file system of the cloud-based storage platform corresponds to the file event that was processed by accessing to the local metadata.

11. The computer readable medium of claim 10, further comprising instructions which, when stored in memory and executed by the processor causes the processor to perform acts of uploading the portion of the file within the virtual file system to the cloud-based storage platform.

12. The computer readable medium of claim 11, further comprising instructions which, when stored in memory and executed by the processor causes the processor to perform acts of receiving an updated portion of the file by at least one second user device from the user devices.

13. The computer readable medium of claim 12, further comprising instructions which, when stored in memory and executed by the processor causes the processor to perform acts of initiating conflict remediation responsive to receiving the updated portion of the file.

14. The computer readable medium of claim 12, wherein storing the updated portion of the file from the at least one second user device and uploading the portion of the file occur asynchronously.

15. The computer readable medium of claim 10, wherein the file event is a file access request that is placed into an event queue.

16. The computer readable medium of claim 10, further comprising instructions which, when stored in memory and executed by the processor causes the processor to perform acts of determining at least one of, local metadata attributes, or object metadata attributes, based at least in part on a set of object locking rules.

17. The computer readable medium of claim 16, wherein at least one permissions attribute from at least one of, the local metadata attributes, or the object metadata attributes, is based at least in part on the object locking rules.

18. The computer readable medium of claim 10, wherein the remote storage application programming interface implements the change in the file system of the cloud-based storage platform.

19. A system for accessing a file system in a cloud-based storage platform that stores shared content accessible over a network by two or more user devices, the system comprising:

a storage medium having stored thereon a sequence of instructions; and

a processor or processors that execute the instructions to cause the processor or processors to perform a set of acts, the acts comprising,

implementing a file system interface between the cloud-based storage platform and a virtual file system, in which the file system interface directs file system calls from an application running on one of the user devices to the virtual file system;

processing at least some of the file system calls received at the file system interface through a first operation pipeline comprising a local data manager that issues one or more of the file system calls to a file system executor that performs local processing to produce a series of file events;

receiving a file event from the first pipeline and initiating processing of the file event through a second pipeline comprising at least a first operation to access local metadata corresponding to the series of file events and a second operation to access a local cache to identify a portion of a file within the virtual file system; and

providing at least an identification of contents of the local cache to a remote storage application programming interface to initiate a change in the file system of the cloud-based storage platform, wherein the change to the file system of the cloud-based storage platform corresponds to the file event that was processed by accessing to the local metadata.

20. The system of claim 19, further comprising storing an updated portion of a file from at least one second user device.