Managed peer-to-peer applications, systems and methods for distributed data access and storage

• US 20050120082A1
• Filed: 11/13/2004
• Published: 06/02/2005
• Est. Priority Date: 12/02/1999
• Status: Active Grant

• Current Assignee: Western Digital Technologies Incorporated (Western Digital Corporation)
• Original Assignee: Western Digital Technologies Incorporated (Western Digital Corporation)
• Inventors: Rizal, Dharmarus, Hesselink, Lambertus, Bjornson, Eric S.
• Granted Patent: US 7,546,353 B2
• Time in Patent Office: Days
• US Class Current: 709/203
• CPC Class Codes: H04L 63/0272 Virtual private networks
• CPC Class Codes: H04L 63/04 for providing a confidential data exchange among entities communicating through data packet networks
• CPC Class Codes: H04L 63/08 for authentication of entities cryptographic mechanisms or cryptographic arrangements for entity authentication H04L9/32
• CPC Class Codes: H04L 67/1095 Replication or mirroring of data, e.g. scheduling or transport for data synchronisation between network nodes
• CPC Class Codes: H04L 67/14 Session management for real-time applications in data packet communications networks H04L65/1066
• CPC Class Codes: H04L 67/142 Managing session states for stateless protocols; Signalling session states; State transitions; Keeping-state mechanisms
• CPC Class Codes: H04L 67/568 Storing data temporarily at an intermediate stage, e.g. caching

Abstract

Applications, systems and methods for efficiently accessing data and controlling storage devices among multiple computers connected by a network. Upon receiving a request for access to data originally stored in a remote storage device, determining whether the data is already available and valid in a local storage device. Accessing the data from the local storage device if the data is available and valid. Authenticating a request for a secure connection between a local computer associated with the local storage device and a remote computer associated with the remote storage device. Securely connecting the local computer with the remote computer. Requesting the data from the remote storage device, over the network, if the data is not locally available and valid. Receiving data over the network from the remote storage device, and storing the data in the local storage device for direct local access thereto.

Claims

1. A method for efficiently accessing data and controlling storage devices among multiple computers connected by a wide area network, said method comprising:

upon receiving a request for access to data originally stored in a remote storage device, determining whether said data is already available and valid in a local storage device;

accessing said data from the local storage device if said data is available and valid;

authenticating a request for a secure connection between a local computer associated with said local storage device and a remote computer associated with said remote storage device;

securely connecting said local computer with said remote computer;

requesting said data from the remote storage device, over the wide area network, if said data is not available and valid;

receiving data over the wide area network from the remote storage device; and

storing said data in the local storage device for direct local access thereto.

2. The method of claim 1, wherein said determining is carried out in cache memory of the local storage device.

3. The method of claim 1, wherein said requesting is processed in cache memory of the remote storage device.

4. The method of claim 1, wherein said local computer is connectable to the wide area network through a first firewall element, said first firewall element adapted to protect said local computer from hostile intrusion from the wide area network, and wherein said remote computer is connectable to the wide area network through a second firewall element, said second firewall element adapted to protect said second computer from hostile intrusion from the wide area network.

5. The method of claim 1, further comprising establishing an active subscription period, wherein said data is already available and valid if the local storage device is actively subscribed to the remote storage device, and wherein, if said data is not already available and valid in the local storage device, the remote storage device actively subscribes the local storage device in response to said requesting.

6. The method of claim 5, wherein said active subscription is timed and monitored via a timestamp stored by both the local storage device and the remote storage device.

7. The method of claim 1, wherein said data is file overhead information and, upon receiving said data, said data is stored in cache memory of the local storage device.

8. The method of claim 7, wherein said file overhead information characterizes a requested directory stored on the remote storage device.

9. The method of claim 8, wherein file overhead information characterizing additional subdirectories or other files are received in addition to the requested data, based on at least one of user specifications, structures of the directory characterized by the requested data, and probabilistic analysis of directory-browsing patterns.

10. The method of claim 1, further comprising modifying said data on said local storage device and sending the modifications to the remote storage device, wherein said data is updated with the modifications in the cache memory of the remote storage device.

11. The method of claim 10, further comprising sending the modifications from the cache memory of the remote storage device, over the wide area network, to at least one additional storage device actively subscribed to the remote storage device, wherein said data is updated with the modifications in cache memory of the at least one additional storage device.

12. The method of claim 1, further comprising listening to file access events from an operating system locally connected to said remote storage device, and, upon detection of modification to said data, sending the modification, over the wide area network, to all storage devices actively subscribed to said data.

13. The method of claim 1, wherein said data is file data, and said requesting includes sending identifiers of any versions of said data which are locally stored in the local storage device.

14. The method of claim 13, wherein said identifiers of any versions are sent as Delta files.

15. The method of claim 13, further comprising determining whether to send said data, or differential data to update a locally stored version of said data, based upon minimizing bandwidth requirements, and sending said data or said differential data to the local storage device.

16. The method of claim 15, further comprising temporally compressing said differential data prior to said sending.

17. The method of claim 15, further comprising spatially compressing said data or said differential data prior to said sending.

18. The method of claim 15, further comprising encrypting said data or said differential data prior to said sending.

19. The method of claim 15, wherein an official reference file of said file data is maintained in cache memory of the remote storage device, and a version number is maintained with the official reference file to a current status of the file data.

20. The method of claim 19, wherein, upon receiving said data or said differential data, a current version of said file data is made available and stored in cache memory of said local storage device.

21. The method of claim 20, further comprising monitoring an active subscription period based on time stamp information received with said data or said differential data.

22. The method of claim 21, further comprising monitoring a version of said file data that is actively subscribed to by the local storage device.

23. The method of claim 22, further comprising sending updates of said file data from the remote storage device to all the local storage device, while the locally storage device is actively subscribed to said file data, over the wide area network.

24. The method of claim 22, further comprising modifying said file data on the local storage device and sending the modifications to the remote storage device, wherein said file data is updated with the modifications in the cache memory of the remote storage device.

25. The method of claim 24, wherein said modifications are sent as a Delta file.

26. The method of claim 24, further comprising assigning a new version number to the updated file data.

27. The method of claim 24, further comprising sending the modifications from the cache memory of the remote storage device, over the wide area network, to at least one additional storage device actively subscribed to the remote storage device, wherein said file data is updated with the modifications in cache memory of the at least one additional storage device.

28. The method of claim 23, including listening to file access events from an operating system locally connected to said remote storage device, and, upon detection of modification to said file data, sending the modification, over the wide area network, to all storage devices actively subscribed to said file data.

29. The method of claim 13, further comprising controlling access, in the cache memory of the local storage device, to said file data by local applications.

30. The method of claim 13, further comprising prioritizing an order in which of portions of said file data are received.

31. The method of claim 25, further comprising creating an Inverse Delta file relative to said Delta file, and storing the Inverse Delta file in the cache memories of both the local storage device and the remote storage device.

32. The method of claim 31, further comprising restoring a previous version of said file data by applying said Inverse Delta file to a current version of said file data.

33. A process for efficiently accessing and controlling data of devices over a wide area network, wherein at least first and second devices are securely connected to one another over the wide area network, at least one of said devices being connectable to the wide area network through a firewall element, said firewall element adapted to protect said device from hostile intrusion from the wide area network, said process comprising:

maintaining version numbers for various versions of a file data as it is modified;

calculating a Delta file characterizing the differences in data contained different versions as the file data is modified;

comparing said version numbers between a first version of said file data at a first location from which said file data is requested , and a second version of said file data at a second location from which said file data is to be sent to said first location; and

securely transmitting the differences in data between the first and second version, from the second location to the first location, across the wide area network, rather than the entire file data, to reduce bandwidth requirements for the transmission.

34. The process of claim 33, wherein at least said first and second devices are connectable to the wide area network through first and second firewall elements, respectively, said first firewall element adapted to protect said first device from hostile intrusion from the wide area network, and said second firewall element adapted to protect said second device from hostile intrusion from the wide area network.

35. The process of claim 33, further comprising calculating an Inverse Delta file for each said Delta file, wherein said Inverse Delta file facilitates reversion to an earlier version number of said file data.