Methods and apparatus for high-speed access to and sharing of storage devices on a networked digital data processing system

• US 7,275,059 B2
• Filed: 10/21/2003
• Issued: 09/25/2007
• Est. Priority Date: 12/31/1997
• Status: Expired due to Term

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Stakutis, Christopher J., Stearns, Kevin M.
• Primary Examiner(s): Gaffin; Jeffrey
• Assistant Examiner(s): MAHMOUDI, HASSAN
• Application Number:
  US10/691,134
• Publication Number:
  US 20050251516A1
• Time in Patent Office: 1,435 Days
• Field of Search: 707/10, 707/104.1, 707/2, 707/1, 705/77, 709/221, 709/227
• US Class Current: 709/203
• CPC Class Codes: G06F 16/1824 implemented using Network-attached Storage [NAS] architecture distributed or networked storage systems G06F3/067; protocols for distributed storage of data in a network H04L67/1097
• CPC Class Codes: G06F 2003/0697 device management, e.g. handlers, drivers, I/O schedulers
• CPC Class Codes: G06F 3/0601 Interfaces specially adapted for storage systems
• CPC Class Codes: H04L 67/1097 for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
• CPC Class Codes: Y10S 707/922 Communications
• CPC Class Codes: Y10S 707/959 Network
• CPC Class Codes: Y10S 707/99931 Database or file accessing
• CPC Class Codes: Y10S 707/99932 Access augmentation or optimizing
• CPC Class Codes: Y10S 707/99945 Object-oriented database structure processing

Abstract

A digital data processing system with improved access to information stored on a peripheral device is provided. A bypass mechanism, which executes on at least a first node (e.g., a client node), intercedes in the response to at least selected input/output, or access, requests generated by that node. The bypass transfers data designated by such requests between the first node and a peripheral device (e.g., a disk drive) over a third communications pathway, in lieu of transferring that data via a second node (e.g., a server node) and a first communications pathway (e.g., a network) between the first and second node and a second communications pathway between the second node and peripheral device. Such transfers by the bypass, however, are made using the administrative information maintained by the file system relating to storage of such data on the peripheral device.

Claims

1. A digital data processing method comprising

responding to a request for access to a peripheral device by at least initiating transfer of data designated by that request over a communications pathway that does not include a node that controls access to the peripheral device;

the initiating step including at least initiating transfer of the data using administrative information obtained from the node pertaining to storage of data on the peripheral device;

wherein responding to the request comprises a bypass, interceding in response to the request for access to the peripheral device applied thereby to the node that controls such access to the peripheral device.

2. A digital data processing method comprising

responding to a request (“

first access request”

) by a first node for access to a peripheral device by at least initiating transfer of data designated by that request between the first node and the peripheral device over a communications pathway that does not include a second node that controls access by at least the first node to the peripheral device;

the initiating step including at least initiating transfer of the data using administrative information obtained from the second node pertaining to storage of data on the peripheral device;

wherein responding to the request comprises a bypass, interceding in response to the request for access by the first node to the peripheral device applied thereby to the second node that controls such access to the peripheral device.

3. The method of claim 2, wherein the first node is a client node and the second node is a server node.

4. The method of claim 2, wherein the initiating step includes at least initiating transfer of the data designated by the first access request between the first node and the peripheral device over a communications pathway that differs from that over which a file system executing on at least one of the first and second nodes would transfer data in response to the first access request.

5. The method of claim 4, wherein the initiating step includes at least initiating transfer of the data designated by the first access request to physical storage locations on the peripheral device determined from the administrative information.

6. The method of claim 5, comprising obtaining as administrative information a map indicative of physical locations at which the data are stored on the peripheral device.

7. The method of claim 6, wherein the responding step comprises obtaining the map by generating and applying to the file system a second access request.

8. The method of claim 7, wherein the second access request is for access to a logical unit to which access is controlled by the second node.

9. The method of claim 8, wherein the second request is for access to a logical unit other than a file designated in the first access request.

10. The method of claim 9, wherein the second access request is a request to write a file.

11. The method of claim 2, wherein the initiating step includes at least initiating transfer of the data designated by the first access request between the first node and the peripheral device via a directly attached disk connect.

12. The method of claim 2, wherein the initiating step includes at least initiating transfer of the data designated by the first access request between the first node and the peripheral device via fibre channel.

13. The method of claim 2, wherein the initiating step includes at least initiating transfer of the data designated by the request via a direct connection between the first node and the peripheral device, wherein the direct connection comprises any of a fibre channel, a firewire bus, a serial storage architecture (SSA) bus, a high-speed Ethernet bus, a high performance parallel interface (HPPI) bus, and other high-speed peripheral device bus.

14. A digital data processing method accessing a peripheral device, the method comprising

intercepting, with a filter driver executing on a first node, a request (“

first access request”

) by that node for access to the peripheral device,

at least initiating transfer of the data designated by that request between the first node and the peripheral device using file mapping obtained from a second node;

wherein the initiating step includes at least initiating transfer of data designated by the first access request between the first node and the peripheral device over a communications pathway that differs from that over which a file system executing on at least one of the first and second nodes would transfer data in response to the first access request.

15. The method of claim 14, comprising obtaining the file mapping by sending a request (“

second access request”

) to the second node for access to a logical unit other than a file designated in the first access request.

16. The method of claim 15, wherein the logical unit is a file that resides on a peripheral device local to the first node.

17. The method of claim 15, wherein the second access request is a request to write a file.

18. The method of claim 15, comprising generating and applying to the file system a third access request, the third request designating the logical unit designated by the second access request.

19. The method of claim 14, wherein the first node is a client node and the second node is a server node.

20. The method of claim 14, wherein the initiating step includes at least initiating transfer of data designated by the first access request between the first node and the peripheral device via a directly attached disk connect.

21. The method of claim 14, wherein the initiating step includes at least initiating transfer of data designated by the request via a direct connection between the first node and the peripheral device, wherein the direct connection comprises any of a fibre channel, a firewire bus, a serial storage architecture (SSA) bus, a high-speed Ethernet bus, a high performance parallel interface (HPPI) bus, and other high-speed peripheral device bus.

22. A digital data processing method of accessing a peripheral device, the method comprising

responding to a request (“

first access request”

) by a first node for access to the peripheral device by bypassing, at least in part, a file system that would otherwise respond to the first access request by transferring data designed thereby the between the first node and the peripheral device over a communications pathway that includes a second node that controls access by the first node and one or more other nodes to the peripheral device;

the responding step including at least initiating transfer of data designated by the first access request between the first node and the peripheral device over a communications pathway that does not include the second node;

the initiating step including at least initiating transfer of the data using administrative information obtained from the second node pertaining to storage of data on the peripheral device.

23. The method of claim 22, wherein the initiating step includes at least initiating transfer of the data designated by the first access request to physical storage locations on the peripheral device determined from the administrative information.

24. The method of claim 23, wherein the responding step comprises obtaining as administrative information a map indicative of physical locations at which the data are stored on the peripheral device.

25. A bypass for use in a first node to improve access to information stored on a peripheral device, the bypass comprising

a first filter driver executing within and coupled to a file system of the first node, the filter driver responding to a request (“

first access request”

) generated within the first node for access to the peripheral device by at least initiating transfer of data designated by that request between the first node and the peripheral device using administrative information obtained from a second node that controls access by the first node and one or more other nodes to the peripheral device,

the filter driver at least initiating the transfer via a communications pathway that does not include the second node;

wherein responding to the request comprises a bypass, interceding in response to the request for access by the first node to the peripheral device applied thereby to the second node that controls access to the peripheral device.

26. The bypass of claim 25, wherein the first filter driver wherein obtains as administrative information a map indicative of physical locations at which the data are stored on the peripheral device.

27. The bypass of claim 25, comprising a second filter driver executing within and coupled to a file system of the second node.

28. The bypass of claim 27, wherein the second filter driver generates the map in response to a further access request generated by the first filter driver.

29. The bypass of claim 25, wherein the first filter driver obtains the map by generating a request (“

second access request”

) to the second node for access to a logical unit other than a file designated in the first access request.

30. The bypass of claim 29, wherein the logical unit is a file that resides on a peripheral device local to the first node.

31. The bypass of claim 30, wherein the second access request is a request to write a file.

32. The bypass of claim 25, wherein the first filter driver selectively issues a request to the file system of the first node to create a mapped device corresponding to the peripheral device.

33. The bypass of claim 32, wherein the first filter driver compares information regarding a network volume being mounted to local volumes to which the first filter driver has access to determine whether a communications pathway exists for transfer of data between the first node and the peripheral device that does not include the second node.

34. The bypass of claim 33, wherein the communications pathway over which the first filter driver transfers data designated by the first access request differs from that over which a file system executing on at least one of the first node and the second node would transfer data in response to the first access request.

35. The bypass of claim 33, wherein the communications pathway over which the first filter driver transfers data designated by the first access request is a direct connection.

36. The bypass of claim 35, wherein communications pathway over which the first filter driver transfers data designated by the first access request comprises a fibre channel.

37. The bypass of claim 35, communications pathway over which the first filter driver transfers data designated by the first access request comprises any of a fibre channel, a firewire bus, a serial storage architecture (SSA) bus, high-speed Ethernet bus, high performance parallel interface (HPPI) bus, and other high-speed peripheral device bus.