Selective synchronization and distributed content item block caching for multi-premises hosting of digital content items

• US 9,852,147 B2
• Filed: 12/22/2015
• Issued: 12/26/2017
• Est. Priority Date: 04/01/2015
• Status: Active Grant

• Current Assignee: Dropbox, Inc.
• Original Assignee: Dropbox, Inc.
• Inventors: von Muhlen, Marcio, Bunger, Nils
• Primary Examiner(s): PARK, GRACE A
• Application Number:
  US14/979,226
• Publication Number:
  US 20160292179A1
• Time in Patent Office: 735 Days
• CPC Class Codes: G06F 16/172 Caching, prefetching or hoarding of files
• CPC Class Codes: G06F 16/176 Support for shared access to files; File sharing support
• CPC Class Codes: G06F 16/178 Techniques for file synchronisation in file systems
• CPC Class Codes: G06F 16/188 Virtual file systems

Abstract

Selective synchronization and distributed content item block cache optimization for multi-premises hosting of digital content items. In one embodiment, for example, a method comprises: detecting an attempt to access a placeholder file corresponding to a content item, the placeholder file stored in the local storage of the computing device; determining one or more identifiers of one or more content item blocks of which the content item is composed; determining any content item blocks of the one or more content item blocks that are not stored in the local storage of the computing device; downloading, from one or more other computing devices coupled to a network to which the computing device is coupled, any content item blocks of the one of more content item blocks that are not stored locally in the local storage of the computing device; and filling the placeholder file with the one or more content item blocks.

Claims

1. A method, comprising:

at a computing device comprising local storage, one or more processors, and storage media storing one or more computer programs executed by the one or more processors to perform the method, performing operations comprising;

creating a placeholder file in a file system of the local storage, the placeholder file corresponding to a content item hosted with an online content management service, the content item belonging to a content item namespace, the content item namespace mounted in the file system, the content item namespace associated with a user account held with the online content management service that hosts the content item;

receiving identifiers of content item blocks of which the content item is composed from a server of the online content management service;

detecting an attempt to access the placeholder file;

based, at least in part, on the identifiers of the content items blocks received from the server of the online content management service, determining one or more content item blocks, of the content item blocks of which the content item is composed, that are not stored in the local storage of the computing device;

downloading, from one or more computing devices, the one or more content item blocks, of the content item blocks of which the content item is composed, that are not stored locally in the local storage of the computing device;

filling the placeholder file with the content item blocks of which the content item is composed;

wherein;

the receiving the identifiers of the content item blocks of which the content item is composed from the server of the online content management service is based, at least in part on, sending a client journal cursor value to the server;

the client journal cursor value represents updates to the content item namespace for which metadata about the updates have already been received at the computing device from a server of the online content management service;

the method further comprises receiving, from the server of the online content management service, one or more other identifiers of one or more other content items blocks of which one or more other content items belonging to the content item namespace is composed; and

the receiving the one or more other identifiers is based at least in part on the sending the client journal cursor value to the server.

2. The method of claim 1, wherein the operation of detecting the attempt to access the placeholder file comprises the operation of receiving a notification from an operating system of the computing device via an application programming interface offered by the operating system.

3. The method of claim 1, wherein the placeholder file is a zero-byte file.

4. The method of claim 1, wherein the operation of detecting the attempt to access the placeholder file comprises the operation of detecting an attempt to open the placeholder file.

5. The method of claim 1, wherein the operation of detecting the attempt to access the placeholder file comprises the operation of detecting an attempt to read from the placeholder file.

6. The method of claim 1, further comprising storing the identifiers of the content items blocks, received from the server of the online content management service, in an entry in a client content item journal stored at the computing device, the entry representing the content item.

7. The method of claim 1, wherein the local storage comprises a content item block pool area, and wherein the determining the one or more content item blocks, of the content item blocks of which the content item is composed, that are not stored in the local storage of the computing device is based, at least in part, on determining one or more content items blocks that are not stored in the content item block pool area.

8. The method of claim 1, wherein the of determining the one or more content item blocks, of the content item blocks of which the content item is composed, that are not stored in the local storage of the computing device is based, at least in part, on determining one or more identifiers of one or more content item blocks that do not exist in a content item block list, the content item block list stored at the computing device and identifying content item blocks stored in the local storage.

9. The method of claim 1, wherein the operation of downloading, from the one or more computing devices, the one or more content item blocks, of the content item blocks of which the content item is composed, that are not stored locally in the local storage of the computing device is based, at least in part, on providing one or more identifiers of one or more content item blocks to the one or more computing devices.

10. The method of claim 1, wherein the operation of filling the placeholder file with the content item blocks of which the content item is composed comprises the operation of replacing the placeholder file in a file system with a file comprising the content item blocks of which the content item is composed.

11. A computing device, comprising:

local storage;

one or more processors; and

storage media storing one or more computer programs comprising instructions configured for;

creating a placeholder file in a file system of the local storage, the placeholder file corresponding to a content item hosted with an online content management service, the content item belonging to a content item namespace, the content item namespace mounted in the file system, the content item namespace associated with a user account held with the online content management service that hosts the content item;

receiving identifiers of content item blocks of which the content item is composed from a server of the online content management service;

detecting an attempt to access the placeholder file;

based, at least in part, on the identifiers of the content items blocks received from the server of the online content management service, determining one or more content item blocks of the content item blocks of which the content item is composed that are not stored in the local storage of the computing device;

downloading, from one or more computing devices, the one or more content item blocks, of the content item blocks of which the content item is composed, that are not stored locally in the local storage of the computing device;

filling the placeholder file with the content item blocks of which the content item is composed;

wherein;

the receiving the identifiers of the content item blocks of which the content item is composed from the server of the online content management service is based, at least in part on, sending a client journal cursor value to the server;

the client journal cursor value represents updates to the content item namespace for which metadata about the updates have already been received at the computing device from a server of the online content management service;

the instructions further configured for receiving, from the server of the online content management service, one or more other identifiers of one or more other content items blocks of which one or more other content items belonging to the content item namespace is composed; and

the receiving the one or more other identifiers is based at least in part on the sending the client journal cursor value to the server.

12. The computing device of claim 11, wherein the instructions configured for detecting the attempt to access the placeholder file comprise instructions configured for receiving a notification from an operating system of the computing device via an application programming interface offered by the operating system.

13. The computing device of claim 11, wherein the placeholder file is a zero-byte file.

14. The computing device of claim 11, wherein the instructions configured for detecting the attempt to access the placeholder file comprise instructions configured for detecting an attempt to open the placeholder file.

15. The computing device of claim 11, wherein the instructions configured for detecting the attempt to access the placeholder file comprise instructions configured for detecting an attempt to read from the placeholder file.

16. The computing device of claim 11, the instructions further comprising instructions configured for storing the identifiers of the content items blocks, received from the server of the online content management service, in an entry in a client content item journal stored at the computing device, the entry representing the content item.

17. The computing device of claim 11, wherein the local storage comprises a content item block pool area;

wherein the instructions configured for determining the one or more content item blocks, of the content item blocks of which the content item is composed, that are not stored in the local storage of the computing device comprise instructions configured for determining one or more content items blocks of that are not stored in the content item block pool area.

18. The computing device of claim 11, wherein the instructions configured for determining the one or more content item blocks, of the content item blocks of which the content item is composed, that are not stored in the local storage of the computing device comprise instructions configured for determining one or more identifiers of one or more content item blocks that do not exist in a content item block list, the content item block list stored at the computing device and identifying content item blocks stored in the local storage.

19. The computing device of claim 11, wherein the instructions configured for downloading, from the one or more computing devices, the one or more content item blocks, of the content item blocks of which the content item is composed, that are not stored locally in the local storage of the computing device comprise instructions configured for providing one or more identifiers of one or more content item blocks to the one or more computing devices.

20. The computing device of claim 11, wherein the instructions configured for filling the placeholder file with the content item blocks of which the content item is composed comprise instructions configured for replacing the placeholder file in a file system with a file comprising the content item blocks of which the content item is composed.

21. The computing device of claim 11, wherein the metadata about the updates comprises content item block identifiers of content item blocks of which content items belonging to the content item namespace are composed.