Peer-to-peer enterprise storage

• US 7,069,295 B2
• Filed: 02/14/2002
• Issued: 06/27/2006
• Est. Priority Date: 02/14/2001
• Status: Expired due to Term

• Current Assignee: The Escher Group, Ltd.
• Original Assignee: The Escher Group, Ltd.
• Inventors: Ludmann, Sandor, O'Neill, Donal, Zukovsky, Eli, Sutherland, Andrew, Klugerman, Michael Richard
• Primary Examiner(s): BATAILLE, PIERRE MICHE
• Application Number:
  US10/075,710
• Publication Number:
  US 20020114341A1
• Time in Patent Office: 1,594 Days
• Field of Search: 711/4, 711/111, 711/112, 711/154, 711/202, 711/162, 709/213, 709/201, 709/245, 709/250, 709/226, 709/239, 709/203, 709/209, 709/220, 709/228, 709/211, 709/208
• US Class Current: 709/203
• CPC Class Codes: H04L 41/00 Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks

Abstract

A peer-to-peer storage system includes a storage coordinator that centrally manages distributed storage resources in accordance with system policies administered through a central administrative console. The storage resources, or “nodes,” are otherwise unused portions of storage media, e.g., hard disks, that are included in the devices such as personal computers, workstations, laptops, file servers, and so forth, that are connected to a corporate computer network, and are thus otherwise available only individually to the respective devices. The storage coordinator assigns the nodes to various “replication groups” and allocates the storage resources on each of the nodes in a given group to maintaining dynamically replicated versions of the group files. The storage nodes in a given group perform dynamic file replication and synchronization operations by communicating directly, that is, peer-to-peer, using a message-based protocol. The storage coordinator also manages distributed searches of file content on the network by selecting one node from each group to search through the associated group files. The selected nodes report the search results back to the storage coordinator, which organizes the results and provides them to the user. Thereafter, in response to a request for various files by the user, the storage coordinator instructs the nodes that are near neighbors of the user to provide the requested files. The storage coordinator thus ensures that the amount of the network bandwidth consumed by the search operation is minimized.

Claims

1. A distributed network storage system including

a network of devices with dedicated storage media, some or all of the devices including unused storage capacity;

a storage coordinator that manages storage of network files on the unused storage capacity of the dedicated storage media, the storage coordinator designating selected groups of nodes within the plurality of nodes and directing the nodes in a given group to communicate peer-to-peer to replicate associated group files and to store the replicated files on the storage media utilizing the otherwise unused storage capacity at the respective nodes;

an administrative console that administers policies set by a system administrator, the administrative console providing policies to the storage coordinator and setting policies that determine a predetermined minimum number of storage nodes in the group; and

the storage coordinator designating the groups in accordance with the policies provided by the administrative console, the storage coordinator selecting at least the predetermined minimum number of nodes for each of the respective groups.

2. The storage system of claim 1 wherein

the administrative console provides to the storage coordinator policies that determine the locations of at least one of the nodes in a group relative to the other nodes in the group, and

the storage coordinator selects the nodes for the respective groups in accordance with the applicable policies concerning location.

3. The storage system of claim 1 in which the storage coordinator is a member of a cluster of storage coordinators that communicate peer-to-peer and share the managing of the file storage on the plurality of file storage nodes.

4. The storage system of claim 1 further including

a plurality of remote file storage nodes that communicate peer-to-peer over the network;

a remote storage coordinator that manages file storage on the plurality of remote file storage nodes, the storage coordinator designating selected groups of nodes within the plurality of remote file storage nodes and directing the nodes in a given group to communicate peer-to-peer to replicate associated group files; and

the administrative console providing policies to the remote storage coordinator that govern the operations of the remote storage coordinator.

5. The system of claim 4 wherein the storage coordinator and the remote storage coordinator respectively designate groups that include both file storage nodes and remote file storage nodes.

6. The system of claim 1 wherein the storage coordinator manages distributed searches of files stored in the system by designating a selected node from each group to search through the respective group files, the storage coordinator accumulating the search results from the selected nodes and providing the results to a requesting node.

7. The system of claim 6 wherein the storage coordinator further designates selected nodes that are near neighbors of the requesting node to supply to the requesting node one or more files requested from the search results.

8. The system of claim 1 wherein

the administrative console provides policies for access to various types of files;

and

the storage coordinator creates different types of storage lockers for files associated with different access policies and assigns all or portions of a given storage locker to one or more of the selected groups of nodes.

9. The storage system of claim 8 wherein the administrative console provides policies for the different types of lockers, and the storage coordinator manages the respective locker in accordance with the policies.

10. The storage system of claim 8 wherein the storage coordinator maintains file allocation tables for the respective lockers.

11. The storage system of claim 10 wherein the nodes compress the files before replicating the files.

12. The storage system of claim 10 wherein the nodes provide entries for the respective file allocation tables, the entries including links to the physical location of the respective files.

13. The storage system of claim 12 wherein a given table entry includes a file Id that consists of a storage group Id, a node Id and an associated message number.

14. The storage system of claim 1 wherein the administrative console provides to the storage coordinator replication operation policies that relate to one or more of time constraints, interval constraints, and bandwidth constraints, and

the storage coordinator manages the replication operations in accordance with the provided policies.

15. The storage system of claim 14 wherein a given node performs the replication operation by segmenting a given file into segments and sending a series of numbered messages that contain file segments to the other nodes in the associated group.

16. A distributed network storage system including

a plurality of file storage nodes that are distributed on and communicate peer-to-peer over the network;

a storage coordinator that manages file storage on the plurality of files storage nodes, the storage coordinator designating selected groups of nodes within the plurality of file storage nodes and directing the nodes in a given group to communicate peer-to-peer to replicate associated group files;

a plurality of remote file storage nodes that communicate peer-to-peer over the network;

a remote storage coordinator that manages file storage on the plurality of remote file storage nodes, the storage coordinator designating selected groups of nodes within the plurality of remote file storage nodes and directing the nodes in a given group to communicate peer-to-peer to replicate associated group files;

an administrative console that administers policies set by a system administrator;

the administrative console providing policies to the storage coordinator;

the storage coordinator designating the groups in accordance with the policies provided by the administrative console; and

the administrative console providing policies to the remote storage coordinator that govern the operations of the remote storage coordinator.

17. The system of claim 16 wherein the nodes designated as members of a group reserve storage capacity to store the associated group files.

18. The storage system of claim 16 wherein

the administrative console sets policies that determine a predetermined minimum number of storage nodes in the group;

and

the storage coordinator selects at least the predetermined minimum number of nodes for each of the respective groups.

19. The storage system of claim 16 wherein

the administrative console provides to the storage coordinator policies that determine the locations of at least one of the nodes in a group relative to the other nodes in the group, and

the storage coordinator selects the nodes for the respective groups in accordance with the applicable policies concerning location.

20. The storage system of claim 16 in which the storage coordinator is a member of a cluster of storage coordinators that communicate peer-to-peer and share the managing of the file storage on the plurality of file storage nodes.

21. The system of claim 16 wherein the storage coordinator and the remote storage coordinator respectively designate groups that include both file storage nodes and remote file storage nodes.

22. The system of claim 16 wherein the storage coordinator manages distributed searches of files stored in the system by designating a selected node from each group to search through the respective group files, the storage coordinator accumulating the search results from the selected nodes and providing the results to a requesting node.

23. The system of claim 22 wherein the storage coordinator further designates selected nodes that are near neighbors of the requesting node to supply to the requesting node one or more files requested from the search results.

24. The system of claim 16 wherein

the administrative console provides policies for access to various types of files;

and

the storage coordinator creates different types of storage lockers for files associated with different access policies and assigns all or portions of a given storage locker to one or more of the selected groups of nodes.

25. The storage system of claim 24 wherein the administrative console provides policies for the different types of lockers, and the storage coordinator manages the respective locker in accordance with the policies.

26. The storage system of claim 24 wherein the storage coordinator maintains file allocation tables for the respective lockers.

27. The storage system of claim 26 wherein the nodes provide entries for the respective file allocation tables, the entries including links to the physical location of the respective files.

28. The storage system of claim 27 wherein a given table entry includes a file Id that consists of a storage group Id, a node Id and an associated message number.

29. The storage system of claim 26 wherein the nodes compress the files before replicating the files.

30. The storage system of claim 29 wherein the nodes encrypt the files before compressing the files.

31. The storage system of claim 16 wherein the administrative console provides to the storage coordinator replication operation policies that relate to one or more of time constraints, interval constraints, and bandwidth constraints, and

the storage coordinator manages the replication operations in accordance with the provided policies.

32. The storage system of claim 31 wherein a given node performs the replication operation by segmenting a given file into segments and sending a series of numbered messages that contain file segments to the other nodes in the associated group.