Apparatus and method for hardware implementation or acceleration of operating system functions

• US 6,826,615 B2
• Filed: 06/12/2001
• Issued: 11/30/2004
• Est. Priority Date: 10/14/1999
• Status: Expired due to Term

• Current Assignee: Hitachi Vantara, LLC (Hitachi, Ltd.)
• Original Assignee: Bluearc UK Ltd. (Hitachi, Ltd.)
• Inventors: Meyer, Jonathan, Barrall, Geoffrey S., Cooper, Michael, Willis, Trevor, Aston, Christopher J., Winfield, John, Benham, Simon
• Primary Examiner(s): EL HADY, NABIL M
• Application Number:
  US09/879,798
• Publication Number:
  US 20020065924A1
• Time in Patent Office: 1,267 Days
• Field of Search: 709/226, 709/227, 709/228, 709/229, 709/213, 709/214, 709/216
• US Class Current: 709/227
• CPC Class Codes: G06F 16/183 Provision of network file services by network file servers, e.g. by using NFS, CIFS network file access protocols H04L67/1097
• CPC Class Codes: H04L 67/00 Network arrangements or protocols for supporting network services or applications user-to-user messaging H04L51/00; network arrangements, protocols or services for supporting real-time applications in data packet communications networks H04L65/00
• CPC Class Codes: H04L 67/01 Protocols
• CPC Class Codes: H04L 69/08 Protocols for interworking; Protocol conversion
• CPC Class Codes: H04L 69/12 Protocol engines
• CPC Class Codes: H04L 69/329 in the application layer [OSI layer 7]
• CPC Class Codes: H04L 9/40 Network security protocols

Abstract

An apparatus in one embodiment handles service requests over a network, wherein the network utilizes a protocol. In this aspect, the apparatus includes: a network subsystem for receiving and transmitting network service requests using the network protocol; and a service subsystem, coupled to the network subsystem, for satisfying the network service requests. At least one of the network subsystem and the service subsystem is hardware-implemented; the other of the network subsystem and the service subsystem may optionally be hardware-accelerated. A variety of related embodiments are also provided, including file servers and web servers.

Claims

1. Apparatus for handling service requests over a network, wherein the network utilizes a protocol, the apparatus comprising:

a network subsystem for receiving and transmitting network service requests using the network protocol; and

a service subsystem, coupled to the network subsystem, for satisfying a first predetermined set of the network service requests;

wherein the network subsystem and the service subsystem are interconnected by a dedicated fast communication interface for forwarding at least one of the first predetermined set of service requests to the service subsystem, and wherein the service subsystem includes dedicated hardware that operates outside the immediate control of a software program, the dedicated hardware including specialized circuitry for performing at least one major subsystem function.

6. Apparatus according to any of claims 1, 2, 3, 4, or 5, wherein the service requests include one of reading and writing data to long-term electronic storage.

7. Apparatus according to claim 6, wherein the long-term storage is network disk storage accessible to computers over the network.

8. Apparatus according to claim 6, wherein the long-term storage is local disk storage that is accessible to a local computer but not to any other computers over the network.

9. Apparatus according to claim 6, wherein the long-term storage is associated with the provision of E-Mail service over the network.

10. Apparatus according to claim 6, wherein the long-term storage provides access to web pages over the network.

11. Apparatus according to any of claims 1, 3, or 5, wherein the service requests may involve access of data in a storage system, and the service subsystem also includes a module for managing storage of the data in the storage system, the module including hardware that operates outside the immediate control of a software program.

12. Apparatus according to claim 11, such apparatus being a file server, wherein the data in the storage system are arranged in files, the service requests may involve requests for files in the storage system, and the service subsystem also includes a module for managing a file system associated with the storage system, the module including hardware that operates outside the immediate control of a software program.

13. Apparatus according to claim 12, wherein the protocol includes a file system protocol, and the file system protocol defining operations including file read and file write.

14. Apparatus according to claim 11, such apparatus being a web server, wherein the data in the storage system may include web pages, and the service requests may involve requests for web pages in the storage system.

15. Apparatus according to any of claims 1, 2, 3, 4, or 5, wherein the protocol includes IP.

16. Apparatus according to claim 11, wherein the storage system has a storage protocol and the service subsystem includes a module for interfacing with the storage system, the module including hardware that operates outside the immediate control of a software program.

29. Apparatus according to any of claims 1, 3, or 5, wherein the service subsystem includes dedicated hardware for performing a predetermined set of major subsystem functions.

30. Apparatus according to claim 29, wherein the dedicated hardware includes at least one integrated circuit.

31. Apparatus according to claim 30, wherein the at least one integrated circuit includes a field programmable gate array.

32. Apparatus according to claim 29, wherein the dedicated hardware includes a dedicated memory.

33. Apparatus according to claim 29, wherein the service subsystem further includes a processor in communication with the dedicated hardware, the processor running a software program, the dedicated hardware operating outside the immediate control of the software program.

34. Apparatus according to claim 33, wherein the service subsystem further includes a memory coupled to the processor but not to the dedicated hardware.

35. Apparatus according to claim 33, wherein the dedicated hardware directs the first predetermined set of service requests to the processor for processing by the software program.

36. Apparatus according to claim 33, wherein the dedicated hardware services at least one of the first determined set of service request without directing the service request to the processor.

37. Apparatus according to any of claims 1, 2, 3, 4, or 5, wherein the network subsystem and the service subsystem are further interconnected by a processor-mediated slow communication interface.

38. Apparatus according to claim 37, wherein the fast communication interface includes:

a first unidirectional communication path from the network subsystem to the service subsystem; and

a second unidirectional communication path from the service subsystem to the network subsystem.

43. Apparatus according to any of claims 1, 3, or 5, wherein the service subsystem comprises a service module that receives network service requests from the network subsystem and fulfills such service requests and in doing so may issue data storage access requests;

a file system module, coupled to the service module, that receives data storage access requests from the service module and fulfills such storage access requests and in doing so may issue storage arrangement access requests;

a storage module, coupled to the file system module, that receives storage arrangement access requests from the file system module and controls a storage arrangement to fulfill such storage arrangement access requests;

wherein at least one of the modules includes hardware that operates outside the immediate control of a software program.

44. Apparatus according to claim 43, wherein the service module includes:

a receive control engine that receives network service requests, determines whether such requests are appropriate, and if so, responds if information is available, and otherwise issues a data storage access request; and

a transmit control engine that generates network service responses based on instructions from the receive control engine, and, in the event that there is a data storage access response to the data storage access request, processes the data storage access response;

wherein at least one of the engines includes hardware that operates outside the immediate control of a software program.

45. Apparatus according to claim 44, wherein the service module includes:

an authentication engine that determines whether a network request received by the receiver has been issued from a source having authority to issue the request.

46. Apparatus according to claim 45, wherein the authentication engine determines whether a network request received by the receiver has been issued from a source having authority to perform the operation requested.

47. Apparatus according to claim 43, wherein the file system module includes:

a receiver that receives and interprets such data storage access requests and in doing so may issue storage device access requests;

a transmitter, coupled to the receiver, that constructs and issues data storage access responses, wherein such responses include information when appropriate based on responses to the storage device access requests;

wherein at least one of the receiver and the transmitter includes hardware that operates outside the immediate control of a software program.

48. Apparatus according to claim 47, wherein the storage device access requests are consistent with the protocol used by a storage device to which the module may be coupled.

49. Apparatus according to claim 48, wherein the protocol is at least one of:

NTFS;

HPFS;

FAT;

FAT16; and

FAT32.

50. Apparatus according to claim 48, further comprising a file table cache, coupled to the receiver, that stores a table defining the physical location of files in a storage device to which the module may be coupled.

51. Apparatus according to claim 50, wherein the protocol does not require files to be placed in consecutive physical locations in a storage device.

52. Apparatus according to claim 43, wherein the storage module includes:

a storage device request interface that receives such storage device access requests and translates them into a format suitable for the storage device controller; and

a storage device acknowledge interface that takes the responses from the storage device controller and translates such responses into a format suitable for the request source;

wherein at least one of the storage device request interface and the storage device acknowledge interface includes hardware that operates outside the immediate control of a software program.

53. Apparatus according to claim 52, wherein the storage module further includes:

a cache controller that maintains a local copy of a portion of data contained on the storage device to allow fast-read access to the portion of data.

54. Apparatus according to claim 52, wherein the storage device request interface and the storage device acknowledge interface are coupled to a port permitting communication with the storage device controller over a fiber-optic channel.

55. Apparatus according to claim 52, wherein the storage device request interface and the storage device acknowledge interface are coupled to a port permitting communication with the storage device controller utilizing a SCSI-related protocol.

56. Apparatus according to any of claims 1, 2, 3, 4 or 5, wherein the service subsystem is integrated directly in the motherboard of a computer.

57. Apparatus according to any of claims 1, 2, 3, 4, or 5, wherein the service subsystem is integrated into an adapter card that may be plugged into a computer.

58. Apparatus according to any of claims 1, 2, 3, 4, or 5, wherein the first predetermined set of network service requests include at least one of:

CIFS requests;

SMB requests;

HTTP requests;

NFS requests;

FTP requests; and

SMTP requests.

59. Apparatus according to any of claims 1, 3, or 5, wherein the service subsystem comprises:

a service receive block, coupled to a storage arrangement, that processes a storage access request from the network subsystem, generates where necessary an access to the storage arrangement, and causes the generation of a response;

a file table cache, coupled to the receive block, that stores a table defining the physical location of files in the storage arrangement; and

a service transmit block, coupled to the service receive block, for transmitting the response to the network subsystem;

wherein at least one of the service receive block and the service transmit block includes hardware that operates outside the immediate control of a software program.

60. Apparatus according to claim 59, wherein the service subsystem further includes:

response information memory, coupled to each of the service receive block and the service transmit block, which memory stores information present in a header associated the request, which information is used by the service transmit block in constructing the response.

61. Apparatus according to claim 59, wherein the storage access request is a network request.

62. Apparatus according to claim 59, wherein the storage access request is a generated by a local processor to which the line is coupled.

72. Apparatus according to any of claims 1, 2, 3, 4, 5, 63, or 66, wherein the hardware performs a plurality of subsystem functions.

73. Apparatus according to any of claims 1, 3 or 5 wherein the service subsystem is hardware-implemented so as to include dedicated hardware that operates outside the immediate control of a software program and performs at least one major subsystem function.

75. Apparatus according to any of claims 1, 3, or 5, wherein the service subsystem dedicated hardware includes:

a receiver that receives service requests for data access from the network subsystem over the dedicated fast communication interface and transfers corresponding storage access requests to a storage interface; and

a transmitter that receives storage access responses from the storage interface and transfers, over the dedicated fast communication interface, corresponding service responses to the network subsystem.

76. Apparatus according to any of claims 1, 2, 3, 4, 5, 63, or 66, wherein the at least one subsystem function performed by the hardware includes data passing.

2. Apparatus for handling service requests over a network, wherein the network utilizes a protocol, the apparatus comprising:

a network subsystem for receiving and transmitting network service requests using the network protocol; and

a service subsystem, coupled to the network subsystem, for satisfying a first predetermined set of the network service requests;

wherein the network subsystem and the service subsystem are interconnected by a dedicated fast communication interface for forwarding at least one of the first predetermined set of service requests to the service subsystem, and wherein the network subsystem includes dedicated hardware that operates outside the immediate control of a software program, the dedicated hardware including specialized circuitry for performing at least one major subsystem function.

17. Apparatus according to any of claims 2, 3, or 4, wherein the network subsystem includes dedicated hardware for performing a predetermined set of major subsystem functions.

18. Apparatus according to claim 17, wherein the dedicated hardware includes at least one integrated circuit.

19. Apparatus according to claim 18, wherein the at least one integrated circuit includes a field programmable gate array.

20. Apparatus according to claim 17, wherein the dedicated hardware includes a dedicated memory.

21. Apparatus according to claim 17, wherein the network subsystem further includes a processor in communication with the dedicated hardware, the processor running a software program for performing a predetermined set of minor subsystem functions, the dedicated hardware operating outside the immediate control of the software program.

22. Apparatus according to claim 21, wherein the network subsystem further includes a memory coupled to the processor but not to the dedicated hardware.

23. Apparatus according to claim 21, wherein the dedicated hardware directs the first predetermined set of service requests to the service subsystem and directs a second predetermined set of service requests to the processor for processing by the software program.

24. Apparatus according to claim 21, wherein the predetermined set of minor subsystem functions includes:

processing non-TCP/IP formatted data.

25. Apparatus according to claim 21, wherein the predetermined set of minor subsystem functions includes:

establishing a TCP/IP connection; and

configuring a TCP/IP connection table for use by the hardware when forwarding data.

26. Apparatus according to claim 25, wherein information contained in the connection table associates an established TCP/IP connection with a destination for the data.

27. Apparatus according to claim 26, wherein the destination may be one of the network subsystem processor and the service subsystem.

28. Apparatus according to claim 21, wherein the at least one subsystem function performed by the network subsystem hardware includes forwarding the first predetermined set of network service requests to the service subsystem without involving the network subsystem processor.

39. Apparatus according to any of claims 2, 3, or 4, wherein the network subsystem dedicated hardware includes:

a receiver that interprets network service requests received from a network interface in accordance with the protocol and transfers, over the dedicated fast communication interface, corresponding service requests for data access to the service subsystem; and

a transmitter that forms network service responses based on service responses received from the service subsystem over the dedicated fast communication interface and transfers the service responses to the network interface.

40. Apparatus according to any of claims 2, 3, or 4, wherein the network subsystem comprises:

a receiver that receives encapsulated data from the network and de-encapsulates such data in accordance with the protocol; and

a transmitter that encapsulates data in accordance with the protocol and transmits the encapsulated data over the network;

wherein at least one of the receiver and the transmitter includes hardware that operates outside the immediate control of a software program.

41. Apparatus according to claim 40, wherein the service requests are received over the network in packets, each packet having a protocol header, and wherein the network subsystem further includes:

a connection identifier that determines a unique connection from information contained within the protocol header of each packet received by the receiver.

42. Apparatus according to claim 41, wherein the network subsystem further includes:

a memory region, associated with the network connection, that stores the state of the connection.

74. Apparatus according to any of claims 2, 3, or 4, wherein the at least one major subsystem function performed by the network subsystem dedicated hardware includes:

receiving network service requests from a network interface and transferring, over the dedicated fast communication interface, corresponding service requests for data access to the service subsystem; and

receiving service responses from the service subsystem over the dedicated fast communication interface and transferring corresponding network service responses to the network interface.

77. Apparatus according to any of claims 2, 3, or 4, wherein the at least one subsystem function performed by the network subsystem hardware includes IP processing.

78. Apparatus according to claim 77, wherein the IP processing may include reassembly of fragmented IP packets.

3. Apparatus for handling service requests over a network, wherein the network utilizes a protocol, the apparatus comprising:

a network subsystem for receiving and transmitting network service requests using the network protocol, and

a service subsystem, coupled to the network subsystem, for satisfying a first predetermined set of the network service re quests;

wherein the network subsystem and the service subsystem are interconnected by a dedicated fast communication interface for forwarding at least one of the first predetermined set of service requests to the service subsystem, and wherein each of the network subsystem and the service subsystem includes dedicated hardware that operate outside the immediate control of a software program, the dedicated hardware including specialized circuitry for performing at least one major subsystem function.

4. Apparatus for handling service requests over a network, wherein the network utilizes a protocol, the apparatus comprising:

a network subsystem for receiving and transmitting network service requests using the network protocol; and

a hardware-accelerated service subsystem, coupled to the network subsystem, for satisfying a first predetermined set of the network service requests;

wherein the network subsystem and the service subsystem are interconnected by a dedicated fast communication interface for forwarding at least one of the first predetermined set of service requests to the service subsystem, and wherein the network subsystem includes dedicated hardware that operates outside the immediate control of a software program, the dedicated hardware including specialized circuitry for performing at least one major subsystem function.

5. Apparatus for handling service requests over a network, wherein the network utilizes a protocol, the apparatus comprising:

a hardware-accelerated network subsystem for receiving and transmitting network service requests using the network protocol; and

a service subsystem, coupled to the network subsystem, for satisfying a first predetermined set of the network service requests;

wherein the network subsystem and the service subsystem are interconnected by a dedicated fast communication interface for forwarding at least one of the first predetermined set of service requests to the service subsystem, and wherein the service subsystem includes dedicated hardware that operates outside the immediate control of a software program, the dedicated hardware including specialized circuitry for performing at least one major subsystem function.

63. Scalable apparatus for handling service requests over a A network, wherein the network utilizes a protocol, the apparatus comprising:

a first plurality of network subsystems for receiving and transmitting network service requests using the network protocol;

a second plurality of service subsystems, for satisfying a first predetermined set of the network service requests;

wherein the network subsystems and the service subsystems are interconnected by a dedicated fast communication interface for forwarding at least one of the first predetermined set of service requests to one of the plurality of service subsystems, and wherein at least one of the network subsystems and the service subsystems includes dedicated hardware that operates outside the immediate control of a software program, the dedicated hardware including specialized circuitry for performing at least one major subsystem function.

64. Apparatus according to claim 63, wherein the dedicated fast communication interface includes a switch.

65. Apparatus according to claim 63, wherein the dedicated fast communication interface includes a bus.

66. A scalable service subsystem for interfacing a storage arrangement with a network over which a storage access request is generated, the subsystem comprising:

a first plurality of service modules that receive network service requests and fulfill such service requests and in doing so issue data storage access requests;

a second plurality of file system modules that receive data storage access requests and fulfill such storage access requests and in doing so issue storage arrangement access requests;

wherein the service modules and the file system modules are interconnected by a dedicated fast communication interface for forwarding the data storage access requests to the file system modules, and wherein at least one of the service modules and the file system modules includes dedicated hardware that operates outside the immediate control of a software program, the dedicated hardware including specialized circuitry for performing at least one major subsystem function.

67. A scalable service subsystem according to claim 66, wherein the dedicated fast communication interface includes a switch.

68. A scalable service subsystem according to claim 66, wherein the dedicated fast communication interface includes a bus.

69. A scalable service subsystem according to claim 66, further comprising:

a third plurality of storage modules that receive storage arrangement access requests and control the storage arrangement to fulfill such storage arrangement access requests;

wherein the file system modules and the storage modules are interconnected by a second dedicated fast communication interface for forwarding the storage arrangement access requests to the storage modules, and wherein at least one of the storage modules includes dedicated hardware that operates outside the immediate control of a software program, the dedicated hardware including specialized circuitry for performing at least one major subsystem function.

70. A scalable service subsystem according to claim 69, wherein the second dedicated fast communication interface includes a switch.

71. A scalable service subsystem according to claim 69, wherein the second dedicated fast communication interface includes a bus.