Distributed storage network

• US 8,463,867 B2
• Filed: 12/31/2003
• Issued: 06/11/2013
• Est. Priority Date: 12/31/2002
• Status: Active Grant

• Current Assignee: British Telecommunications PLC (BT Group PLC)
• Original Assignee: British Telecommunications PLC (BT Group PLC)
• Inventors: Robertson, Derrick D, Mckee, Paul F
• Primary Examiner(s): Fan, Hua
• Application Number:
  US10/541,061
• Publication Number:
  US 20060117046A1
• Time in Patent Office: 3,450 Days
• Field of Search: 709/216
• US Class Current: 709/216
• CPC Class Codes: G06F 16/122 using management policies backup systems G06F11/1446; file migration policies for HSM systems G06F16/185
• CPC Class Codes: G06F 16/1824 implemented using Network-attached Storage [NAS] architecture distributed or networked storage systems G06F3/067; protocols for distributed storage of data in a network H04L67/1097
• CPC Class Codes: H04L 67/104 Peer-to-peer [P2P] networks
• CPC Class Codes: H04L 67/1068 Discovery involving direct consultation or announcement among potential requesting and potential source peers
• CPC Class Codes: H04L 67/107 with limitation or expansion of the discovery scope
• CPC Class Codes: H04L 67/1089 Hierarchical topologies
• CPC Class Codes: H04L 67/51 Discovery or management thereof, e.g. service location protocol [SLP] or web services

Abstract

A determination as to whether to store a data item at a computer connected to a distributed storage network of computers is made in dependence on a policy document associated with that data item. The policy document is constructed in accordance with a Document Type Definition expressed in extensible Markup Language (XML). This provides a more flexible method of system managed storage.

Claims

1. A distributed storage network comprising a plurality of interconnected computers, said computers including a plurality of host computers, each having a store for data items, and at least one client computer, wherein said client computer stores client code comprising:

a) storage initiation code executable to initiate storage of a data item in one or more of said plurality of host computers'"'"' stores;

b) storage condition generation code executable to generate one or more interpretable storage conditions which must be met by a candidate host computer store in order for said candidate host computer store to store said data item, said interpretable storage conditions indicating a required value of one or more time-varying storage characteristics;

c) storage condition sending code executable to send said one or more interpretable storage conditions to one or more of said plurality of host computers;

wherein each of said host computers stores host code including;

d) storage condition reception code executable to receive said one or more interpretable storage conditions from another of said plurality of host computers;

e) host computer store characteristic provision code executable to provide host storage characteristic data indicating the value of one or more time-varying characteristics of said host computer'"'"'s stores;

f) storage condition interpreter code executable to interpret said one or more interpretable storage conditions in the light of said host storage characteristic data provided by said host computer and thereby to establish whether said host computer'"'"'s store meets said storage conditions;

g) data item storage code executable to store said data item in said host computer'"'"'s store on the execution of said condition interpreter code finding that said host computer meets said storage conditions; and

h) storage condition forwarding code executable, on the execution of said condition interpreter code finding that said host computer'"'"'s store does not meet said storage conditions, to forward said storage conditions to another of said plurality of host computers.

2. A distributed storage network according to claim 1 in which at least one of said plurality of interconnected computers stores both said client code and said host code.

3. A distributed storage network according to claim 1 in which said one or more interpretable storage conditions are persistently stored at one or more of said plurality of interconnected computers.

4. A distributed storage network according to claim 3 wherein said persistent storage is provided by a database stored at each of said one or more computers providing persistent storage of said interpretable storage conditions.

5. A distributed storage network according to claim 3 in which said one or more of said plurality of interconnected computers further stores storage condition editor code executable to provide a user with an interface enabling the user to update said interpretable storage conditions or to record new interpretable storage conditions.

6. A distributed storage network according to claim 5 in which said client computer further stores said storage condition editor code.

7. A distributed storage network according to claim 1 in which said storage condition interpreter code interprets said one or more interpretable storage conditions using schema data which indicates a common structure for said interpretable storage conditions.

8. A distributed storage network according to claim 1 in which said interpretable storage conditions form a component of a rules data structure which further includes action data indicating actions to be carried out by one of said plurality of host computers on the store of said one of said plurality of host computers meeting said one or more interpretable storage conditions.

9. A distributed storage network according to claim 8 in which said rules data structure forms a component of a policy data structure which further includes event data indicating one or more events which must take place in order to trigger the execution of said storage condition interpreter code.

10. A distributed storage network according to claim 1 in which said host storage characteristic data include stored data item description data which describes data items already stored in said host computer store.

11. A distributed storage network according to claim 1 in which said plurality of interconnected computers comprise computers having differing hardware architectures and operating system programs stored thereon, each of said plurality of interconnected computers further storing common machine emulation code executable to translate code executable on said common machine to code executable on the hardware architecture and operating system of the interconnected computer on which the emulation code is executed.

16. A distributed storage network as in claim 1 wherein the data item is forwarded with the storage condition in step h).

12. A method of operating a network of interconnected computers, said interconnected computers including a plurality of host computers, each host computer having a store for data items, and a least one client computer, said method including:

operating said client computer to;

a) initiate storage of a data item in one or more of said host computer stores; and

b) generate one or more interpretable storage conditions indicating a required value of one or more time-varyinq characteristics of host computer stores which must be met by a candidate host computer store in order for said candidate host computer store to store said data item;

c) send said one or more interpretable storage conditions to one or more of said host computers;

operating each of said plurality of host computers to;

d) receive said one or more interpretable storage conditions from another of said plurality of host computers;

e) provide host storage characteristic data indicating the value of one or more time-varying characteristics of said host computer'"'"'s store;

f) interpret said one or more interpretable storage conditions in the light of said host storage characteristic data provided by said host computer store and thereby to establish whether said host computer'"'"'s store meets said storage conditions;

g) store said data item in said host computer'"'"'s store on finding that said host computer'"'"'s store meets said storage conditions; and

h) forward said storage conditions to another of said plurality of host computers on finding that said host computer'"'"'s store does not meet said storage conditions.

13. A non-transitory computer readable storage medium storing code executable by at least one computer processor to carry out the method steps of claim 12.

17. A method as in claim 12 wherein the data item is forwarded with the storage condition in step h).

14. A host computer configured to be part of a distributed storage network comprising a plurality of interconnected computers including a plurality of host computers, said plurality of host computers including said specific host computer, each of said plurality of host computers having a store for data items, and at least one client computer storing client code including storage initiation code executable to initiate storage of a data item in one or more of said plurality of host computers'"'"' stores and storage condition generation code executable to generate one or more interpretable storage conditions indicating a required value of one or more time-varying characteristics which must be met by a candidate host computer store in order for said candidate host computer store to store said data item, said specific host computer storing host code including:

a) storage condition reception code executable to receive said one or more interpretable storage conditions from another of said plurality of host computers;

b) host computer storage characteristic provision code executable to provide host storage characteristic data indicating the value of one or more time-varying characteristics of said specific host computer'"'"'s store;

c) storage condition interpreter code executable to interpret said one or more interpretable storage conditions in the light of said host storage characteristic data provided by said specific host computer and thereby to establish whether said specific host computer'"'"'s store meets said storage conditions;

d) data item storage code executable to store said data item in said specific host computer'"'"'s store on the execution of said condition interpreter code finding that said specific host computer'"'"'s store meets said storage conditions; and

e) storage condition forwarding code executable, on the execution of said storage condition interpreter code finding that said specific host computer'"'"'s store does not meet said storage conditions, to forward said storage conditions to another of said plurality of host computers.

18. A host computer as in claim 14 wherein the data item is forwarded with said storage condition in step e).

20. A non-transitory computer-readable storage medium storing code executable by at least one computer processor to carry out the method of claim 14.

15. A method of operating a specific host computer configured to be part of a distributed storage network comprising a plurality of interconnected computers including a plurality of host computers, each having a data store for data items, and at least one client computer storing client code including storage initiation code executable to initiate storage of a data item in one or more of said stores and storage condition generation code executable to generate one or more interpretable storage condition indicating a required value of time-varying characteristics of host computer'"'"'s stores suitable for storing said data item, said method comprising operating said specific host computer to:

a) receive said one or more interpretable storage conditions from another of said plurality of host computers;

b) provide host storage characteristic data indicating the value of one or more time-varying characteristics of said specific host computer'"'"'s stores;

c) interpret said one or more interpretable storage conditions in the light of said host storage characteristic data provided by said host computer and thereby to establish whether said specific host computer'"'"'s store meets said storage conditions;

d) store said data item in said specific host computer on said interpretation of said storage conditions finding that said specific host computer'"'"'s store meets said storage conditions; and

e) forward said storage conditions to another of said plurality of host computers, on said interpretation of said storage conditions finding that said specific host computer'"'"'s store does not meet said storage conditions.

19. A method as in claim 15 wherein the storage condition is forwarded with said data item in step e).