Distributed storage system for long term data storage

• US 10,069,914 B1
• Filed: 04/21/2015
• Issued: 09/04/2018
• Est. Priority Date: 04/21/2014
• Status: Active Grant

• Current Assignee: David Lane Smith
• Original Assignee: David Lane Smith
• Inventors: Smith, David Lane
• Primary Examiner(s): Brown, Sheree N
• Application Number:
  US14/692,699
• Time in Patent Office: 1,232 Days
• Field of Search: 709213
• CPC Class Codes: H04L 63/0428 wherein the data content is protected, e.g. by encrypting or encapsulating the payload
• CPC Class Codes: H04L 63/0823 using certificates cryptographic mechanisms or cryptographic arrangements for entity authentication involving certificates H04L9/3263
• CPC Class Codes: H04L 67/1095 Replication or mirroring of data, e.g. scheduling or transport for data synchronisation between network nodes
• CPC Class Codes: H04L 67/1097 for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
• CPC Class Codes: H04L 67/568 Storing data temporarily at an intermediate stage, e.g. caching
• CPC Class Codes: H04L 67/60 Scheduling or organising the servicing of application requests, e.g. requests for application data transmissions using the analysis and optimisation of the required network resources admission control or resource allocation H04L47/70

Abstract

A distributed storage system for the long-term storage of data objects that is implemented utilizing one or more distinct storage sites that may be comprised of system controllers and object storage systems that act in concert to embody a single distributed storage system. A system may include a one or more types and/or instances of object storage systems in which replicas of objects are stored in at least two of the said object storage systems. A system may further include system controllers associated with logical and/or physical sites that coordinate object, user, device, and system management functionally.

Claims

1. A system for facilitating efficient long-term data storage system, the system comprising:

at least one first storage site, the at least one first storage site comprising;

one or more processing devices; and

a non-transitory computer readable storage medium storing program instructions that are executed by the one or more processing devices, causing the one or more processing devices to implement the following;

a storage delegate configured to;

receive a data object from at least one of a user or a client;

store the data object associated with the at least one of a user or a client on one or more of a plurality of data storage nodes, and

a site control application configured to;

receive a request from the storage delegate to authenticate the storage delegate request;

associate the storage delegate request with the at least one of a user or a client;

authenticate the at least one of a user or a client;

queue operational requests for data object management;

manage operational request queues granting ordered continuity for requests, and

at least one second storage site, the at least one second storage site comprising;

one or more processing devices; and

a non-transitory computer readable storage medium storing program instructions that are executed by the one or more processing devices, causing the one or more processing devices to implement the following;

a storage delegate configured to;

receive a data object associated with the at least one of a user or a client from the at least one first storage site;

store the data object associated with the at least one of a user or a client on one or more of a plurality of data storage nodes, and

a site control application configured to;

receive a request from the storage delegate to authenticate the storage delegate request;

associate the storage delegate request with the at least one of a user or a client;

validate the storage delegate request from the at least one first storage site;

queue operational requests for data object management;

manage operational request queues granting ordered continuity for requests, and

wherein the site control application of the at least one first storage site and the site control application of the at least one second storage site are further configured to;

replicate the data objects stored on the at least one first storage site to the at least one second storage site;

maintain the consistency and validity of the stored data objects on the at least one first storage site and the at least one second storage site;

queue operational requests for data object management for requests that operate on the at least one first storage site and the at least one second storage site; and

manage operational request queues granting ordered continuity for requests that operate on the at least one first storage site and the at least one second storage site.

2. The system of claim 1 wherein the at least one first storage site and the at least one second storage site are located in more than one physical location.

3. The system of claim 1 wherein the at least one first storage site and the at least one second storage site are linked by a communication network and function as a distributed storage system for the data objects and replicas of the data objects.

4. The system of claim 1 wherein the at least one first storage site and the at least one second storage site are configured to store the data objects using on-line, near-line, or off-line data storage nodes.

5. The system of claim 1 wherein the at least one first storage site and the at least one second storage site are configured to provide rule-based replication, location selection, and data storage node media selection.

6. The system of claim 1 wherein the at least one first storage site provides at least one web service, command line, or custom protocol access point that allow at least one of the user or the client to access and manage the data objects.

7. The system of claim 1 wherein the site control application of the at least one first storage site is further configured to provide services that allow authorized the at least one of the user or the client to manage the data objects in a manner constrained by account parameters, the account parameters comprising at least one of the following:

storage limits, bandwidth limits, authorized user, authorized device, user geographical location, user authentication level, or user access rights.

8. The system of claim 1 wherein the site control application of the at least one first storage site is further configured to:

collect operational data from the one or more processing devices that comprise the at least one first storage site;

control the powered state of the one or more processing devices that comprise the at least one first storage site; and

control the powered state of the data storage nodes included in the at least one first storage site such that each data storage node is either active for reading and writing, active for reading, powered on in standby waiting to be made active, powered on for consistency verification and repair, or powered down.

9. The system of claim 1 wherein the site control application of the at least one first storage site is further configured to provide storage operation functionality for the data objects, the object storage operation functionality comprising at least one of the following operations:

write, read, delete, update, replace, validate, cache, route, or transfer.

10. The system of claim 1 wherein the site control application of the at least one second storage site is further configured to provide services that allow the at least one first storage site and another at least one second storage site to manage data objects stored within the at least one second storage site.

11. The system of claim 1 wherein the site control application of the at least one second storage site is further configured to:

collect operational data from the one or more processing devices that comprise the at least one second storage site;

control the powered state of the one or more processing devices that comprise the at least one second storage site; and

control the powered state of the data storage nodes included in the at least one second storage site such that each data storage node is either active for reading and writing, active for reading, powered on in standby waiting to be made active, powered on for consistency verification and repair, or powered down.

12. The system of claim 1 wherein the site control application of the at least one second storage site is further configured to provide storage operation functionality for the data objects, the object storage operation functionality comprising at least one of the following operations:

write, read, delete, update, replace, validate, cache, route, or transfer.

13. The system of claim 1, wherein the site control application of the at least one second storage site is further configured to implement effective equivalence of duty-cycle operations, wherein under supervision of the site control application of the at least one second storage site, portions of the data storage nodes are powered on for a limited period of time during which operations such as reads, writes, updates, deletions, maintenance, file-consistency checking, and replication operations are performed;

and

operational requests for data object management are queued until the site control application of the at least one second storage site determines that the data storage nodes are powered-on to act on queued operations.

14. The system of claim 1, wherein the data objects or replicas of the data objects and accompanying control and descriptive information associated with the data objects or replicas of the data objects are transported between the at least one first storage site and the at least one second storage site by means of the physical transportation of at least one of portable storage media, data storage node, data storage delegate, or object storage system.

15. The system of claim 1, wherein the determined or self-reported geographic location of the at least one of a user or a client is utilized in the determination of the physical locations of the at least one first storage site and the at least one second storage site that are utilized to store the data objects.

16. The system of claim 1 wherein at least one of a user or a client selects the physical locations of the at least one first storage site and the at least one second storage site that are utilized to store the data objects.

17. The system of claim 1 wherein at least one of a user or a client selects the desired types of storage media utilized by the data storage nodes that are utilized to store the data objects.

18. The system of claim 1 wherein the at least one of a user or a client is informed of the status of the stored data objects comprising replica status, instance status, size, last update, revisions, locations, and errors.

19. The system of claim 1, wherein the stored data objects are encrypted under the control of the at least one of a user or a client such that encryption is performed by one or more authorized server or client devices in which the authorized server or the client devices are isolated from or connected to other networked devices.

20. The system of claim 1, wherein at least one of a user or a client is reliably authenticated as an authorized user of the at least one first storage site using single or multiple factor authentication protocols as a precondition for accessing and managing the data objects.

21. The system of claim 1, wherein a device is reliably authenticated as an authorized device of the at least one first storage site using single or multiple factor authentication protocols as a precondition for accessing and managing the data objects.

22. The system of claim 1, wherein a first user bequeaths the rights of access and/or ownership of the data objects to at least one second user thereby granting the at least one second user access to and management of the data objects according to policies established by the first user in the event that the first user encounters emergency, disaster, death, or other unusual circumstance which temporarily or permanently prevent the first user from gaining access to the data objects.

23. The system of claim 1, wherein the at least one first storage site and the at least one second storage site are comprised of data storage nodes that provide data storage using a plurality of types of data storage functionality that comprises spinning-platter hard disk drives, solid state storage devices, linear tape file systems with removable magnetic tapes, optical disk systems with removable optical disks, third-party object storage systems, or a device that prints, burns, lases, etches, chisels, or otherwise durably marks the surface of a physical object with a human-readable or machine-readable embodiment of the stored data object, the physical objects comprised of paper, metal, plastic, stone, cement, glass, semiconductor, or nanotubes.

24. The system of claim 1, wherein the at least one first storage site and the at least one second storage site utilizes one or more distinct storage delegates or object storage systems in order to store and retrieve the data objects and operational messages at rest and in transit to and from the at least one of a user or a client, the at least one first storage site, or the at least one second storage site.

25. The system of claim 1, wherein the at least one first storage site and the at least one second storage site utilizes one or more distinct storage delegates or object storage systems in order to provide for storage of the data object, a revision of the data object, or a replica of the data object for a designated period of time after any additions, updates, or deletions of the data object, the data objects subject to rule based erasure for purposes of enforcing data retention polices established by the at least one of the user or the client or storage system policy.

26. A computer implemented method for facilitating efficient long-term data storage system, the method comprising:

providing at least one first storage site, the at least one first storage site comprising;

a storage delegate;

receiving a data object from at least one of a user or a client;

storing the data object associated with the at least one of a user or a client on one or more of a plurality of data storage nodes, and

a site control application;

receiving a request from the storage delegate to authenticate the storage delegate request;

associating the storage delegate request with the at least one of a user or a client;

authenticating the at least one of a user or a client;

queuing operational requests for data object management;

managing operational request queues granting ordered continuity for requests, and

providing at least one second storage site, the at least one second storage site comprising;

a storage delegate;

receiving a data object associated with the at least one of a user or a client from the at least one first storage site;

storing the data object associated with the at least one of a user or a client on one or more of a plurality of data storage nodes, and

a site control application;

receiving a request from the storage delegate to authenticate the storage delegate request;

associating the storage delegate request with the at least one of a user or a client;

validating the storage delegate request from the at least one first storage site

queuing operational requests for data object management;

managing operational request queues granting ordered continuity for requests, and

wherein the site control application of the at least one first storage site and the site control application of the at least one second storage site are further;

replicating the data objects stored on the at least one first storage site to the at least one second storage site;

maintaining the consistency and validity of the stored data objects on the at least one first storage site and the at least one second storage site;

queuing operational requests for data object management for requests that operate on the at least one first storage site and the at least one second storage site; and

managing operational request queues granting ordered continuity for requests that operate on the at least one first storage site and the at least one second storage site.

27. The method of claim 26 wherein the at least one first storage site and the at least one second storage site are located in more than one physical location.

28. The method of claim 26 wherein the at least one first storage site and the at least one second storage site are linked by a communication network and function as a distributed storage system for the data objects and replicas of the data objects.

29. The method of claim 26 wherein the at least one first storage site and the at least one second storage site are configured to store the data objects using on-line, near-line, or off-line data storage nodes.

30. The method of claim 26 wherein the at least one first storage site and the at least one second storage site are configured to provide rule-based replication, location selection, and data storage node media selection.

31. The method of claim 26 wherein the at least one first storage site provides at least one web service, command line, or custom protocol access point that allow at least one of the user or the client to access and manage the data objects.

32. The method of claim 26 wherein the site control application of the at least one first storage site is further providing services that allow authorized the at least one of the user or the client to manage the data objects in a manner constrained by account parameters, the account parameters comprising at least one of the following:

storage limits, bandwidth limits, authorized user, authorized device, user geographical location, user authentication level, or user access rights.

33. The method of claim 26 wherein the site control application of the at least one first storage site is further:

collecting operational data from the one or more processing devices that comprise the at least one first storage site;

controlling the powered state of the one or more processing devices that comprise the at least one first storage site; and

controlling the powered state of the data storage nodes included in the at least one first storage site such that each data storage node is either active for reading and writing, active for reading, powered on in standby waiting to be made active, powered on for consistency verification and repair, or powered down.

34. The method of claim 26 wherein the site control application of the at least one first storage site is further providing storage operation functionality for the data objects, the object storage operation functionality comprising at least one of the following operations:

write, read, delete, update, replace, validate, cache, route, or transfer.

35. The method of claim 26 wherein the site control application of the at least one second storage site is further providing services that allow the at least one first storage site and another at least one second storage site to manage data objects stored within the at least one second storage site.

36. The method of claim 26 wherein the site control application of the at least one second storage site is further:

collecting operational data from the one or more processing devices that comprise the at least one second storage site;

controlling the powered state of the one or more processing devices that comprise the at least one second storage site; and

controlling the powered state of the data storage nodes included in the at least one second storage site such that each data storage node is either active for reading and writing, active for reading, powered on in standby waiting to be made active, powered on for consistency verification and repair, or powered down.

37. The method of claim 26 wherein the site control application of the at least one second storage site is further providing storage operation functionality for the data objects, the object storage operation functionality comprising at least one of the following operations:

write, read, delete, update, replace, validate, cache, route, or transfer.

38. The method of claim 26, wherein the site control application of the at least one second storage site is implementing effective equivalence of duty-cycle operations, wherein under supervision of the site control application of the at least one second storage site, portions of the data storage nodes are powered on for a limited period of time during which operations such as reads, writes, updates, deletions, maintenance, file-consistency checking, and replication operations are performed;

and

operational requests for data object management are queued until the site control application of the at least one second storage site determines that the data storage nodes are powered-on to act on queued operations.

39. The method of claim 26, wherein the data objects or replicas of the data objects and accompanying control and descriptive information associated with the data objects or replicas of the data objects are transported between the at least one first storage site and the at least one second storage site by means of the physical transportation of at least one of portable storage media, data storage node, data storage delegate, or object storage system.

40. The method of claim 26, wherein the determined or self-reported geographic location of the at least one of a user or a client is utilized in the determination of the physical locations of the at least one first storage site and the at least one second storage site that are utilized to store the data objects.

41. The method of claim 26 wherein at least one of a user or a client selects the physical locations of the at least one first storage site and the at least one second storage site that are utilized to store the data objects.

42. The method of claim 26 wherein at least one of a user or a client selects the desired types of storage media utilized by the data storage nodes that are utilized to store the data objects.

43. The method of claim 26 wherein the at least one of a user or a client is informed of the status of the stored data objects comprising replica status, instance status, size, last update, revisions, locations, and errors.

44. The method of claim 26, wherein the stored data objects are encrypted under the control of the at least one of a user or a client such that encryption is performed by one or more authorized server or client devices in which the authorized server or the client devices are isolated from or connected to other networked devices.

45. The method of claim 26, wherein at least one of a user or a client is reliably authenticated as an authorized user of the at least one first storage site using single or multiple factor authentication protocols as a precondition for accessing and managing the data objects.

46. The method of claim 26, wherein a device is reliably authenticated as an authorized device of the at least one first storage site using single or multiple factor authentication protocols as a precondition for accessing and managing the data objects.

47. The method of claim 26, wherein a first user bequeaths the rights of access and/or ownership of the data objects to at least one second user thereby granting the at least one second user access to and management of the data objects according to policies established by the first user in the event that the first user encounters emergency, disaster, death, or other unusual circumstance which temporarily or permanently prevent the first user from gaining access to the data objects.

48. The method of claim 26, wherein the at least one first storage site and the at least one second storage site are comprised of data storage nodes that provide data storage using a plurality of types of data storage functionality that comprises spinning-platter hard disk drives, solid state storage devices, linear tape file systems with removable magnetic tapes, optical disk systems with removable optical disks, third-party object storage systems, or a device that prints, burns, lases, etches, chisels, or otherwise durably marks the surface of a physical object with a human-readable or machine-readable embodiment of the stored data object, the physical objects comprised of paper, metal, plastic, stone, cement, glass, semiconductor, or nanotubes.

49. The method of claim 26, wherein the at least one first storage site and the at least one second storage site utilizes one or more distinct storage delegates or object storage systems in order to store and retrieve the data objects and operational messages at rest and in transit to and from the at least one of a user or a client, the at least one first storage site, or the at least one second storage site.

50. The method of claim 26, wherein the at least one first storage site and the at least one second storage site utilizes one or more distinct storage delegates or object storage systems in order to provide for storage of the data object, a revision of the data object, or a replica of the data object for a designated period of time after any additions, updates, or deletions of the data object, the data objects subject to rule based erasure for purposes of enforcing data retention polices established by the at least one of the user or the client or storage system policy.