Synchronization system for multiple client devices

• US 10,387,451 B2
• Filed: 09/30/2014
• Issued: 08/20/2019
• Est. Priority Date: 05/30/2014
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Habouzit, Pierre, Bonnet, Olivier, Morard, Jean-Gabriel
• Primary Examiner(s): Beausoliel, Jr., Robert W
• Assistant Examiner(s): Khakhar, Nirav K
• Application Number:
  US14/501,799
• Publication Number:
  US 20150347552A1
• Time in Patent Office: 1,785 Days
• CPC Class Codes: G06F 16/178 Techniques for file synchronisation in file systems
• CPC Class Codes: G06F 16/273 Asynchronous replication or reconciliation

Abstract

Systems and methods are disclosed for synchronizing one or more user data sets on one or more client devices of a user, using a synchronization system. Each client device can have two independent and asynchronously-operating synchronization engines. The synchronization system can include a synchronization system manager that can resolve conflicts in data that arise from different versions of software being used generate a data set. Each client can maintain two separate databases: a first database that can contain a snapshot of the state of the user data sets across client devices, as known to the synchronization system. The second database can contain a snapshot of the local file system and information about the state of synchronization of the local file system with the synchronization system.

Claims

1. A computer-implemented method practiced on a client device comprising two synchronization engines, the method comprising:

receiving, by the client device, a synchronization token for a user data set to synchronize down from a synchronization service to the client device, the receiving based at least in part on one or more synchronization preferences specified by the client device being met;

in response to receiving the synchronization token and determining that the received synchronization token is more recent than a corresponding synchronization token for the data set on the client device;

receiving, from the synchronization service, by the client device utilizing a first synchronization engine, a first snapshot of user data stored by a remote storage service, wherein timing of the receiving is dynamically adjustable by the synchronization service based on a first set of conditions that include whether one or more synchronization preferences of the client device coincide with a determination by the synchronization service that a synchronize down operation is needed, independent from the synchronization service detecting a change to user data at the remote storage service;

storing the first snapshot of the user data in a first database on the client device;

downloading content corresponding to one or more differences between the user data on the remote storage service and the user data on the client device file system;

updating a file system on the client device with the downloaded content to reflect one or more differences between the user data on the remote storage service and the user data on the file system, as indicated in the first snapshot;

generating a second snapshot of the user data from the file system on the client device;

storing the second snapshot in a second database on the client device, the second database different from the first database; and

transmitting the second snapshot in the second database on the client device to the remote storage service, utilizing a second synchronization engine, for processing by the synchronization service, wherein timing of the transmitting to the remote storage service is dynamically determined by the client device based on a second set of conditions, different from the first set of conditions.

2. The method of claim 1, further comprising:

updating the second snapshot of the user data in response to one or more changes to the file system on the client device.

3. The method of claim 2, wherein:

transmitting the updated second snapshot of the user data to the remote storage service for processing by the remote storage service is in response to one or more conditions of the second set of conditions being met.

4. The method of claim 3, further comprising:

uploading content associated with changes in the updated second snapshot of the user data, the uploading of the content being performed before transmitting the updated second snapshot.

5. The method of claim 1, further comprising:

receiving, from the remote storage service, by the client device, an update to the first snapshot of the user data stored by the remote storage service, wherein the update to the first snapshot includes at least one change to the user data stored by the remote storage service;

updating the first snapshot stored in the first database with the update to the first snapshot received from the remote storage service; and

updating the file system on the client device to reflect the at least one change to the user data stored by the remote storage server that is included in the updated first snapshot received from the remote storage service.

6. The method of claim 1, wherein the first snapshot of user data comprises synchronization metadata including:

a tag for each file or directory in the user data that identifies a specific version of the metadata for a document or directory, one or more file identifiers for each file or directory, and a hash of each file or directory.

7. The method of claim 6, wherein the one or more file identifiers for each file or directory comprise a universally unique file identifier.

8. The method of claim 1, further comprising:

transmitting, by the client device to a synchronization service, synchronize down frequency preference information comprising one or more synchronize down preferences;

wherein synchronize down preference information includes one or more of;

a specified number of items to be synchronized down being met, or a quality of service of a communication line between the client device and the synchronization service being met, and

wherein the synchronization down timing is dynamically adjustable by the synchronization service to a timing that differs from the synchronize down preference information.

9. The method of claim 1 wherein:

at least one of the one or more synchronization preferences of the client device is overridden by the synchronization service.

10. The method of claim 1, wherein the downloaded content is converted by the synchronization service to a format that is compatible with one or more applications on the client device, prior to the client downloading the content.

11. The method of claim 1, wherein the first snapshot includes metadata describing a state of synchronization of the user data stored on the remote storage service.

12. A non-transitory computer readable medium programmed with executable instructions that, when executed by a processing system, perform operations that implement two synchronization engines on a client device, the operations comprising:

receiving, by the client device, a synchronization token for a user data set to synchronize down from a synchronization service to the client device, the receiving based at least in part on one or more synchronization preferences specified by the client device being met;

in response to receiving the synchronization token and determining that the received synchronization token is more recent than a corresponding synchronization token for the data set on the client device;

receiving, from the synchronization service, by the client device utilizing a first synchronization engine, a first snapshot of user data stored by a remote storage service, wherein timing of the receiving is dynamically adjustable by the synchronization service based on a first set of conditions that include whether one or more synchronization preferences of the client device coincide with a determination by the synchronization service that a synchronize down operation is needed, independent from the synchronization service detecting a change to user data at the remote storage service;

storing the first snapshot of the user data in a first database on the client device;

downloading content corresponding to one or more differences between the user data on the remote storage service and the user data on the client device file system;

updating a file system on the client device with the downloaded content to reflect one or more differences between the user data on the remote storage service and the user data on the file system, as indicated in the first snapshot;

generating a second snapshot of the user data from the file system on the client device;

storing the second snapshot in a second database on the client device, the second database different from the first database; and

transmitting the second snapshot in the second database on the client device to the remote storage service, utilizing a second synchronization engine, for processing by the synchronization service, wherein timing of the transmitting to the remote storage service is dynamically determined by the client device based on a second set conditions different from the first set of conditions.

13. The medium of claim 12, further comprising:

updating the second snapshot of the user data in response to one or more changes to the file system on the client device.

14. The medium of claim 13, wherein

transmitting the updated second snapshot of the user data to the remote storage service for processing by the remote storage service is in response to one or more conditions of the second set of conditions being met.

15. The medium of claim 14, further comprising:

uploading content associated with changes in the updated second snapshot of the user data, the uploading of the content being performed before transmitting the updated second snapshot.

16. The medium of claim 12, further comprising:

receiving, from the remote storage service, by the client device, an update to the first snapshot of the user data stored by the remote storage service, wherein the update to the first snapshot includes at least one change to the user data stored by the remote storage service;

updating the first snapshot stored in the first database with the update to the first snapshot received from the remote storage service; and

updating the file system on the client device to reflect the at least one change to the user data stored by the remote storage server that is included in the updated first snapshot received from the remote storage service.

17. The medium of claim 12, wherein the first snapshot of user data comprises synchronization metadata including:

a tag for each file or directory in the user data that identifies a specific version of the metadata for a document or directory, one or more file identifiers for each file or directory, and a hash of each file or directory.

18. The medium of claim 17, wherein the one or more file identifiers for each file or directory comprise a universally unique file identifier.

19. A system comprising:

a processing system programmed with executable instructions that, when executed, perform operations that implement two synchronization engines on a client device, the operations comprising;

receiving, by the client device, a synchronization token for a user data set to synchronize down from a synchronization service to the client device, the receiving based at least in part on one or more synchronization preferences specified by the client device being met;

in response to receiving the synchronization token and determining that the received synchronization token is more recent than a corresponding synchronization token for the data set on the client device;

receiving, from the synchronization service, by the client device utilizing a first synchronization engine, a first snapshot of user data stored by a remote storage service, wherein timing of the receiving is dynamically adjustable by the synchronization service based on a first set of conditions that include whether one or more synchronization preferences of the client device coincide with a determination by the synchronization service that a synchronize down operation is needed, independent from the synchronization service detecting a change to user data at the remote storage service;

storing the first snapshot of the user data in a first database on the client device;

downloading content corresponding to one or more differences between the user data on the remote storage service and the user data on the client device file system;

updating a file system on the client device with the downloaded content to reflect one or more differences between the user data on the remote storage service and the user data on the file system, as indicated in the first snapshot;

generating a second snapshot of the user data from the file system on the client device;

storing the second snapshot in a second database on the client device, the second database different from the first database; and

transmitting the second snapshot in the second database on the client device to the remote storage service, utilizing a second synchronization engine, for processing by the synchronization service, wherein timing of the transmitting to the remote storage service is dynamically determined by the client device based on a second set of conditions, different from the first set of conditions.

20. The system of claim 19, further comprising:

updating the second snapshot of the user data in response to one or more changes to the file system on the client device.

21. The system of claim 20,

wherein transmitting the updated second snapshot of the user data to the remote storage service for processing by the remote storage service is in response to one or more conditions of the second set of conditions being met.

22. The system of claim 21, further comprising:

uploading content associated with changes in the updated second snapshot of the user data, the uploading of the content being performed before transmitting the updated second snapshot.

23. The system of claim 19, further comprising:

receiving, from the remote storage service, by the client device, an update to the first snapshot of the user data stored by the remote storage service, wherein the update to the first snapshot includes at least one change to the user data stored by the remote storage service;

updating the first snapshot stored in the first database with the update to the first snapshot received from the remote storage service; and

updating the file system on the client device to reflect the at least one change to the user data stored by the remote storage server that is included in the updated first snapshot received from the remote storage service.

24. The system of claim 19, wherein the first snapshot of user data comprises synchronization metadata including:

a tag for each file or directory in the user data that identifies a specific version of the metadata for a document or directory, one or more file identifiers for each file or directory, and a hash of each file or directory.

25. The system of claim 24, wherein the one or more file identifiers for each file or directory comprise a universally unique file identifier.