Object replication using object device links and flags

• US 9,300,737 B1
• Filed: 06/23/2015
• Issued: 03/29/2016
• Est. Priority Date: 06/02/2015
• Status: Active Grant

• Current Assignee: Mylio, LLC
• Original Assignee: Mylio, LLC
• Inventors: Agsen, Mohsen, Brewis, Deon, Al-Ghosien, Momin, Duplessis, Jean Pierre, Symonds, Craig, de Regt, David
• Primary Examiner(s): Patel, Hitesh
• Application Number:
  US14/747,955
• Time in Patent Office: 280 Days
• Field of Search: 709/217, 709223-226, 709/228
• US Class Current: 1/1
• CPC Class Codes: H04L 67/1095 Replication or mirroring of data, e.g. scheduling or transport for data synchronisation between network nodes
• CPC Class Codes: H04L 67/1097 for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]

Abstract

Systems and methods for providing data replication and/or synchronization across multiple processor-based devices. Data objects (e.g., image files, video files, audio files) may exist in a plurality of forms (e.g., original, preview, thumbnail). The systems and methods utilize object device links (ODLs) and needs/has flags which are replicated to multiple processor-based devices to provide partial or full object replication between multiple processor-based devices. Some implementations provide complete replica backups of objects. Some implementations provide temporary protection of original forms of objects, for example, when a user is traveling. Some implementations provide for relaying and shuttling of objects across multiple devices via one or more networks and/or via peer-to-peer wired or wireless communications also allowing for offsite and remote location backup of objects. Some implementations provide support for container and individual object replication policies with inheritance. Some implementations can provide load balancing storage of objects. Some implementations can provide for efficient space management of objects on storage-constrained devices.

Claims

1. A method of operation for a data storage system to replicate a plurality of objects across a plurality of processor-based devices, the method comprising:

receiving, by at least one processor, replication configuration information which identifies, for each of the plurality of processor-based devices, whether the processor-based device needs a form of each of the objects, and whether the processor-based device presently has a form of each of the plurality of objects stored on a respective nontransitory processor-readable medium of the processor-based device;

storing, by the at least one processor, the replication configuration information on the nontransitory processor-readable medium of each of the plurality of processor-based devices;

causing, by the at least one processor, a transfer of at least one form of at least one of the objects between at least two of the plurality of processor-based devices over a data communications channel based at least in part on the stored replication configuration information;

determining, by at least one processor of one of the processor-based devices, a need for a first form of an object by the one of the processor-based devices;

determining, by the at least one processor of the one of the processor-based devices, that a second form of the object is currently stored on the nontransitory processor-readable medium of the one of the processor-based devices, the second form of the object different from the first form of the object;

automatically generating, by the at least one processor of the one of the processor-based devices, the first form of the object from the second form of the object; and

storing, by the at least one processor of the one of the processor-based devices, the generated first form of the object on the nontransitory processor-readable medium of the one of the processor-based devices.

2. The method of claim 1 wherein storing the replication configuration information comprises storing, by the at least one processor, the replication configuration information as an object device link (ODL) table on a nontransitory processor-readable medium of each of the plurality of processor-based devices, the ODL table comprising a plurality of device-needs flags for each form of each of the plurality of objects, each device-needs flag is indicative of whether one of the processor-based devices needs a form of the object, the ODL table further comprising a plurality of device-has flags for each form of each of the plurality of objects, each device-has flag is indicative of whether one of the processor-based devices currently has a form of the object stored on the respective nontransitory processor-readable medium of the processor-based device.

3. The method of claim 1, further comprising:

updating, by the at least one processor, the respective replication configuration information stored on the nontransitory processor-readable medium of each of the respective plurality of processor-based devices responsive to causing the transfer of at least one form of at least one of the forms of objects between at least two of the plurality of processor-based devices over the data communications channel.

4. The method of claim 1 wherein receiving replication configuration information comprises receiving, by the at least one processor, replication configuration information which identifies, for each of the plurality of processor-based devices, whether the processor-based device needs a particular one or more of a plurality of forms of each of the objects, and whether the processor-based device presently has a particular one or more of the plurality of forms of each of the plurality of objects stored on the respective nontransitory processor-readable medium of the processor-based device.

5. The method of claim 1, further comprising:

receiving, by the at least one processor, replication policy information for at least one of the plurality of processor-based devices;

generating, by the at least one processor, replication configuration information for the at least one of the plurality of processor-based devices based on the received replication policy information; and

storing, by the at least one processor, the replication configuration information on the nontransitory processor-readable medium of each of the plurality of processor-based devices.

6. The method of claim 5 wherein receiving replication policy information for at least one of the plurality of processor-based devices comprises receiving replication policy information which indicates the at least one of the plurality of processor-based devices needs each of a plurality of forms of at least a subset of the plurality of objects.

7. The method of claim 5 wherein receiving replication policy information for at least one of the plurality of processor-based devices comprises receiving replication policy information which indicates the at least one of the plurality of processor-based devices needs only one form of a plurality of forms of at least a subset of the plurality of objects.

8. The method of claim 5 wherein at least some of the plurality of objects are logically associated with at least one container, and receiving replication policy information for at least one of the plurality of processor-based devices comprises receiving replication policy information which indicates the at least one of the plurality of processor-based devices needs at least one form of each of the plurality of objects logically associated with a particular container.

9. The method of claim 5 wherein receiving replication policy information for at least one of the plurality of processor-based devices comprises receiving replication policy information which indicates that at least a plurality of the processor-based devices need to have an original form of at least a subset of the plurality of objects.

10. The method of claim 5 wherein receiving replication policy information for at least one of the plurality of processor-based devices comprises receiving replication policy information for a first processor-based device which indicates the first processor-based device needs any form of an object which a second processor-based device needs but does not currently have stored in the nontransitory processor-readable medium of the second processor-based device.

11. The method of claim 5 wherein receiving replication policy information for at least one of the plurality of processor-based devices comprises receiving replication policy information which indicates the at least one of the plurality of processor-based devices needs at least one form of an object based at least in part on at least one of:

a rating of the object, a range of ratings of the object, a label logically associated with the object, a keyword logically associated with the object, or a container logically associated with the object.

12. The method of claim 5 wherein receiving replication policy information for at least one of the plurality of processor-based devices comprises receiving replication policy information for at least one of the plurality of processor-based devices which indicates the at least one of the plurality of processor-based devices needs at least one form of an object based at least in part on a property of the object.

13. The method of claim 1 wherein the plurality of objects are logically stored in hierarchical containers, the method further comprising:

automatically generating, by the at least one processor, replication policy information for a child container based on the replication policy information for a parent container of the child container.

14. The method of claim 1, further comprising:

causing, by the at least one processor, a replication policy modification interface to be presented to a user via a user interface of at least one of the plurality of processor-based devices.

15. The method of claim 14 wherein causing a replication policy modification interface to be presented comprises causing a replication policy modification interface to be presented which allows the user to modify replication policy information for at least two of the plurality of processor-based devices.

16. The method of claim 14 wherein causing a replication policy modification interface to be presented comprises causing a replication policy modification interface to be presented which provides an indication of replication status for at least two of the plurality of processor-based devices.

17. The method of claim 1 wherein at least some of the plurality of objects each comprise a photo object, and wherein receiving replication configuration information comprises receiving replication configuration information which identifies, for each of the plurality of processor-based devices, whether the processor-based device needs each of a plurality of forms of each of the photo objects, and whether the processor-based device presently has each of the plurality of forms of each of the photo objects stored on the respective nontransitory processor-readable medium of the processor-based device, and each of the plurality of forms of each of the photo objects differs from each other at least by photo resolution.

18. A data storage system to selectively replicate a plurality of objects across a plurality of processor-based devices, the data storage system comprising:

at least one nontransitory processor-readable medium that stores processor-executable instructions; and

at least one processor communicably coupled to the at least one nontransitory processor-readable medium, the at least one processor;

receives replication configuration information which identifies, for each of the plurality of processor-based devices, whether the processor-based device needs a form of each of the objects, and whether the processor-based device presently has a form of each of the plurality of objects stored on a respective nontransitory processor-readable medium of the processor-based device;

stores the replication configuration information on the nontransitory processor-readable medium of each of the plurality of processor-based devices;

causes a transfer of at least one form of at least one of the objects between at least two of the plurality of processor-based devices over a data communications channel based at least in part on the stored replication configuration information;

determines a need for a first form of an object by the one of the processor-based devices;

determines that a second form of the object is currently stored on the nontransitory processor-readable medium of the one of the processor-based devices, the second form of the object different from the first form of the object;

automatically generates the first form of the object from the second form of the object; and

stores the generated first form of the object on the nontransitory processor-readable medium of the one of the processor-based devices.

19. The data storage system of claim 18 wherein the at least one processor:

stores the replication configuration information as an object device link (ODL) table on the nontransitory processor-readable medium of each of the plurality of processor-based devices, the ODL table comprising a plurality of device-needs flags for each form of each of the plurality of objects, each device-needs flag is indicative of whether one of the processor-based devices needs a form of the object, the ODL table further comprising a plurality of device-has flags for each form of each of the plurality of objects, each device-has flag is indicative of whether one of the processor-based devices currently has a form of the object stored on the respective nontransitory processor-readable medium of the processor-based device.

20. The data storage system of claim 18 wherein the at least one processor:

updates the respective replication configuration information stored on the nontransitory processor-readable medium of each of the respective plurality of processor-based devices responsive to the causation of the transfer of at least one form of at least one of the objects between at least two of the plurality of processor-based devices over the data communications channel.

21. The data storage system of claim 18 wherein the at least one processor:

receives replication configuration information which identifies, for each of the plurality of processor-based devices, whether the processor-based device needs a particular one or more of a plurality of forms of each of the objects, and whether the processor-based device presently has a particular one or more of the plurality of forms of each of the plurality of objects stored on the respective nontransitory processor-readable medium of the processor-based device.

22. The data storage system of claim 18 wherein the at least one processor:

receives replication policy information for at least one of the plurality of processor-based devices;

generates replication configuration information for the at least one of the plurality of processor-based devices based on the received replication policy information; and

stores the replication configuration information on the nontransitory processor-readable medium of each of the plurality of processor-based devices.

23. The data storage system of claim 22 wherein the at least one processor:

receives replication policy information which indicates the at least one of the plurality of processor-based devices needs each of a plurality of forms of at least a subset of the plurality of objects.

24. The data storage system of claim 22 wherein the at least one processor:

determines a physical location of a first processor-based device of the plurality of processor-based devices relative to a physical location of a second processor-based device of the plurality of processor-based devices; and

receives replication policy information for the first processor-based device which indicates the first processor-based device needs at least one form of each object in at least a subset of the plurality of objects unless the at least one form of the respective object is currently stored on the nontransitory processor-readable medium of the second processor-based device physically proximate the first processor-based device.

25. The data storage system of claim 22 wherein the at least one processor:

receives replication policy information for a first processor-based device which indicates the first processor-based device needs any form of an object which a second processor-based device needs but does not currently have stored in the nontransitory processor-readable medium of the second processor-based device.

26. The data storage system of claim 22 wherein the at least one processor:

receives replication policy information which indicates the at least one of the plurality of processor-based devices needs at least one form of an object based at least in part on at least one of;

a rating of the object, a range of ratings of the object, a label logically associated with the object, a keyword logically associated with the object, or a container logically associated with the object.

27. The data storage system of claim 18 wherein the plurality of objects are logically stored in hierarchical containers, and the at least one processor:

automatically generates replication policy information for a child container based on the replication policy information for a parent container of the child container.

28. The data storage system of claim 18 wherein the at least one processor:

causes a replication policy setting interface to be presented to a user via a user interface of at least one of the plurality of processor-based devices.