Method for improving mean time to data loss (MTDL) in a fixed content distributed data storage

• US 9,672,372 B2
• Filed: 02/26/2016
• Issued: 06/06/2017
• Est. Priority Date: 07/27/2005
• Status: Active Grant

• Current Assignee: Hitachi Vantara, LLC (Hitachi, Ltd.)
• Original Assignee: Hitachi Data Systems Corporation (Hitachi, Ltd.)
• Inventors: Mason, Robert S.
• Primary Examiner(s): Phillips, Hassan
• Assistant Examiner(s): RAHGOZAR, OMEED DANIEL
• Application Number:
  US15/054,279
• Publication Number:
  US 20160180106A1
• Time in Patent Office: 466 Days
• Field of Search: None
• CPC Class Codes: G06F 16/122 using management policies backup systems G06F11/1446; file migration policies for HSM systems G06F16/185
• CPC Class Codes: G06F 16/181 providing write once read many [WORM] semantics
• CPC Class Codes: G06F 16/1824 implemented using Network-attached Storage [NAS] architecture distributed or networked storage systems G06F3/067; protocols for distributed storage of data in a network H04L67/1097
• CPC Class Codes: G06F 21/6209 to a single file or object, e.g. in a secure envelope, encrypted and accessed using a key, or with access control rules appended to the object itself

Abstract

An archival storage cluster of preferably symmetric nodes includes a data protection management system that periodically organizes the then-available nodes into one or more protection sets, with each set comprising a set of n nodes, where “n” refers to a configurable “data protection level” (DPL). At the time of its creation, a given protection set is closed in the sense that each then available node is a member of one, and only one, protection set. When an object is to be stored within the archive, the data protection management system stores the object in a given node of a given protection set and then constrains the distribution of copies of that object to other nodes within the given protection set. As a consequence, all DPL copies of an object are all stored within the same protection set, and only that protection set. This scheme significantly improves MTDL for the cluster as a whole, as the data can only be lost if multiple failures occur within nodes of a given protection set. This is far more unlikely than failures occurring across any random distribution of nodes within the cluster.

Claims

1. A system comprising:

a plurality of servers, each of the servers configured to be grouped, for a data protection level which defines a number of servers to be able to store a copy of content data, into one of a plurality of protection sets being associated with the data protection level and not into any other protection set being associated with the data protection level, each protection set including at least two servers; and

a network that couples the plurality of servers, and

wherein the system is configured to, upon receipt of first content data that has the data protection level, store copies of the first content data to each server in a first protection set which is associated with the data protection level, and prevent distribution of the copies of the first content data to any other servers in any other protection set which is associated with the data protection level.

2. The system according to claim 1,

wherein one of the plurality of servers is a member of plural protection sets which are associated with other data protection levels different from the data protection level, respectively, but is only the member of the one protection set among the plurality of protection sets being associated with the data protection level.

3. The system according to claim 1,

wherein one of the plurality of servers manages to store the copies of the first content data to each server in the first protection set which is associated with the data protection level, and prevent distribution of the copies of the first content data to any other servers in any other protection set which is associated with the data protection level.

4. The system according to claim 1,

wherein the plurality of servers manage a protection set map which defines the plurality of protection sets being associated with the data protection level.

5. The system according to claim 4,

wherein one of the plurality of servers is configured to update the protection set map periodically or upon a given occurrence.

6. The system according to claim 5,

wherein the one of the plurality of servers is configured to broadcast the updated protection set map to other servers.

7. In a system having a plurality of servers, each of the servers configured to be grouped, for a data protection level which defines a number of servers to be able to store a copy of content data, into one of a plurality of protection sets being associated with the data protection level and not into any other protection set being associated with the data protection level, each protection set including at least two servers;

and a network that couples the plurality of servers, a method comprising the steps of;

upon receipt of first content data that has the data protection level, storing copies of the first content data to each server in a first protection set which is associated with the data protection level; and

preventing distribution of the copies of the first content data to any other servers in any other protection set which is associated with the data protection level.

8. The method according to claim 7,

wherein one of the plurality of servers is a member of plural protection sets which are associated with other data protection levels different from the data protection level, respectively, but is only the member of the one protection set among the plurality of protection sets being associated with the data protection level.

9. The method according to claim 7, further comprising the steps of:

managing, by one of the plurality of servers, the storing of the copies of the first content data to each server in the first protection set which is associated with the data protection level, and preventing distribution of the copies of the first content data to any other servers in any other protection set which is associated with the data protection level.

10. The method according to claim 7, further comprising the step of:

managing, by the plurality of servers, a protection set map which defines the plurality of protection sets being associated with the data protection level.

11. The method according to claim 10, further comprising the step of:

updating, by one of the plurality of servers, the protection set map periodically or upon a given occurrence.

12. The method according to claim 11, further comprising the step of:

broadcasting, by the one of the plurality of servers, the updated protection set map to other servers.

13. A non-transitory computer readable storage media in a system having a plurality of servers, each of the servers configured to be grouped, for a data protection level which defines a number of servers to be able to store a copy of content data, into one of a plurality of protection sets being associated with the data protection level and not into any other protection set being associated with the data protection level, each protection set including at least two servers;

and a network that couples the plurality of servers, the non-transitory computer readable storage media comprising code having a plurality of instructions to execute the steps of;

upon receipt of first content data that has the data protection level, storing copies of the first content data to each server in a first protection set which is associated with the data protection level; and

preventing distribution of the copies of the first content data to any other servers in any other protection set which is associated with the data protection level.

14. The non-transitory computer readable storage media according to claim 13,

wherein one of the plurality of servers is a member of plural protection sets which are associated with other data protection levels different from the data protection level, respectively, but is only the member of one protection set among the plurality of protection sets being associated with the data protection level.

15. The non-transitory computer readable storage media according to claim 13, wherein the code further includes instructions to execute the steps of:

managing, by one of the plurality of servers, the storing of the copies of the first content data to each server in the first protection set which is associated with the data protection level, and preventing distribution of the copies of the first content data to any other servers in any other protection set which is associated with the data protection level.

16. The non-transitory computer readable storage media according to claim 13, wherein the code further includes instructions to execute the step of:

managing, by the plurality of servers, a protection set map which defines the plurality of protection sets being associated with the data protection level.

17. The non-transitory computer readable storage media according to claim 16, wherein the code further includes instructions to execute the step of:

updating, by one of the plurality of servers, the protection set map periodically or upon a given occurrence.

18. The non-transitory computer readable storage media according to claim 17, wherein the code further includes instructions to execute the step of:

broadcasting, by the one of the plurality of servers, the updated protection set map to other servers.