System and method for filtering information in a data storage system

• US 7,809,868 B1
• Filed: 04/23/2007
• Issued: 10/05/2010
• Est. Priority Date: 04/23/2007
• Status: Active Grant

• Current Assignee: Network Appliance Incorporated (NetApp, Inc.)
• Original Assignee: Network Appliance Incorporated (NetApp, Inc.)
• Inventors: Mu, Paul Yuedong
• Primary Examiner(s): Sorrell; Eron J
• Application Number:
  US11/789,073
• Time in Patent Office: 1,261 Days
• Field of Search: None
• US Class Current: 710/74
• CPC Class Codes: G06F 11/1435 using file system or storage system metadata
• CPC Class Codes: G06F 11/1451 by selection of backup contents
• CPC Class Codes: G06F 16/1734 Details of monitoring file system events, e.g. by the use of hooks, filter drivers, logs
• CPC Class Codes: G06F 3/0604 Improving or facilitating administration, e.g. storage management
• CPC Class Codes: G06F 3/0643 Management of files
• CPC Class Codes: G06F 3/0661 Format or protocol conversion arrangements
• CPC Class Codes: G06F 3/0683 Plurality of storage devices

Abstract

A storage system filter provides protocol aware filter operations that avoid I/O blocking or calling thread holding. A filter framework includes a filter controller that handles request and response calls to filters that are registered with the filter framework. Filters may be loaded and unloaded in a consistent state, and the filter framework provides services for the filters for common functions. Filters may operate in a user mode or a kernel mode and may be invoked in a synchronous, an asynchronous, or an asynchronous release mode. Filter registration may include registration for I/O resources, and may include tagging of I/O requests and responses to contribute to preventing conflicts.

Claims

1. A filter system for a data storage system having a storage device being accessible to a client interface, the filter system comprising:

a filter controller interposed between the client interface and the storage device and operable to receive an incoming request having protocol information from the client interface and provide an outgoing request to the storage device, the filter controller being further operable to receive an incoming response from the storage device and provide an outgoing response having protocol information to the client interface;

a plurality of filters coupled to the filter controller and being responsive to the incoming request and the outgoing response to modify information related to the incoming request and the outgoing response, under control of the filter controller; and

the filter controller being operative to select a filter of the plurality of filters based on the protocol information and to pass the protocol information to the filter, whereby the filter is further responsive to the protocol information, and wherein the filter is further selected by evaluating a logical expression created from data in an I/O map and an event map, wherein the I/O map is configured to hold identifiers for the plurality of filters and I/O operations for which the plurality of filters are registered, and wherein the event map is configured to hold the identifiers for the plurality of filters and characteristics of the plurality of filters.

2. The filter system according to claim 1, further comprising a filter loader for loading and unloading filters in a consistent state.

3. The filter system according to claim 2, further comprising an indicator for each filter coupled to the filter controller, the indicator being operable to indicate when a given filter is ready to be unloaded.

4. The filter system according to claim 2, further comprising an I/O buffer coupled to the filter controller for storing I/O operations to permit filter I/O operations to be suspended during filter loading or unloading.

5. The filter system according to claim 1, further comprising a filter registry in the filter controller and being operable to store information about calls to a filter to provide a structured filter call mechanism.

6. The filter system according to claim 5, further comprising filter I/O tags registered with the filter registry for identifying filter I/O with an associated filter.

7. The filter system according to claim 5, further comprising an event map coupled to the filter controller and operable to contribute to determining when a filter is called in accordance with filter characteristics.

8. The filter system according to claim 5, further comprising an I/O map data structure coupled to the filter controller and operable to store indications of I/O events that prompt filter calls.

9. The filter system according to claim 1, wherein the filter controller is operable to invoke the filter in a synchronous mode, an asynchronous mode or an asynchronous release mode.

10. The filter system according to claim 1, wherein the filter is a user mode filter.

11. The filter system according to claim 1, wherein the filter is located in a storage media that is physically separate from the data storage system.

12. The filter system according to claim 1, wherein the filter controller is configurable to be coupled to a plurality of selectable points in a data path between the client interface and the storage device for capturing request or response information related to operation of a filter.

13. The filter system according to claim 1, wherein the filter is a kernel mode filter that is compiled from a single source and is independent of the points at which the filter is coupled to the data path.

14. The filter system according to claim 1, wherein the filter is configured and arranged with the filter controller to permit the filter controller to invoke the filter and continue processing requests from the client interface or responses from the storage device.

15. The filter system according to claim 1, wherein the filter is responsive to requests or responses related to directory, file or block accesses.

16. A method for filtering information in a data storage system having a storage device being accessible to a client interface, the method comprising:

capturing, by a storage server, a request from the client interface and a response from the storage device;

providing protocol information from the captured request and response to a plurality of filters;

selecting a filter of the plurality of filters by evaluating a logical expression created from data in an I/O map and an event map, wherein the I/O map is configured to hold identifiers for the plurality of filters and I/O operations for which the plurality of filters are registered, and wherein the event map is configured to hold the identifiers for the plurality of filters and characteristics of the plurality of filters

performing filtering operations with the filter of the plurality of filters selected based on the protocol information and by evaluating the logical expression, in response to the captured request and response to selectively modify information related to the captured request and response; and

selectively forwarding the captured request and response to the storage device and client interface, respectively, depending upon a result of the filtering operations.

17. The method according to claim 16, further comprising providing a status indication based on the filtering operations to contribute to determining the selective forwarding of requests or responses.

18. The method according to claim 16, further comprising loading a filter into a memory to permit access to the filter for performing the selective modification of information.

19. The method according to claim 18, further comprising indicating when the filter is ready to be unloaded.

20. The method according to claim 19, further comprising unloading the filter from the memory when the filter is indicated as being ready to be unloaded.

21. The method according to claim 20, further comprising storing I/O operations related to performing filtering operations in an I/O buffer.

22. The method according to claim 21, further comprising suspending I/O operations during filter loading or unloading.

23. The method according to claim 16, further comprising invoking filter request or response handlers based on the captured requests or responses.

24. The method according to claim 16, further comprising registering a filter with a registry data structure to define characteristics of the filtering operations of the filter.

25. The method according to claim 24, further comprising registering an I/O operation with the registry data structure related to the filtering operations.

26. The method according to claim 25, further comprising tagging the registered I/O operation with a tag associated with the filter, the tag contributing to identifying the registered I/O operation with the filter.

27. The method according to claim 25, further comprising determining if the registered filter should be called upon an occurrence of the registered I/O operation, based on the defined characteristics.

28. The method according to claim 16, further comprising performing filtering operations in a synchronous mode, an asynchronous mode or an asynchronous release mode.

29. The method according to claim 16, further comprising performing filtering operations in a user mode.

30. The method according to claim 16, further comprising performing filtering operations in a remote user mode.

31. The method according to claim 16, further comprising providing a plurality of selectable points in a data path between the client interface and the storage device for capturing requests or responses for performing filtering operations.

32. The method according to claim 31, further comprising compiling a filter from a single source such that the filter is independent of the selectable points for capturing requests or responses.

33. The method according to claim 16, further comprising continuing processing of requests from the client interface or responses from the storage device while performing filtering operations.

34. The method according to claim 16, further comprising performing filtering operations responsive to requests or responses related to directory, file or block accesses.

35. A filter system for a data storage system having an input/output (I/O) interface and a storage media, comprising:

a filter controller interposed between the I/O interface and the storage media for processing requests and responses to and from the I/O interface and the storage media;

a plurality of filters coupled to the filter controller and being responsive to a request and response to modify information related to the request and response, under control of the filter controller; and

a filter invocation mechanism for invoking a filter of the plurality of filters under control of the filter controller based on protocol information in the request and response and being operable to permit the filter controller to invoke the filter and continue processing other requests and responses while the filter responds to the request and response, and wherein the filter is further invoked by evaluating a logical expression created from data in an I/O map and an event map, wherein the I/O map is configured to hold identifiers for the plurality of filters and I/O operations for which the plurality of filters are registered, and wherein the event map is configured to hold the identifiers for the plurality of filters and characteristics of the plurality of filters.

36. A filter system for a file storage operating system having an input/output (I/O) interface and a storage media, the filter system comprising:

a filter controller interposed between the I/O interface and the storage media for processing requests and responses between the I/O interface and the storage media;

a plurality of filters coupled to the filter controller and being responsive to a request and response to modify information related to the request and response, under control of the filter controller, the filter controller to select a filter of the plurality of filters based on protocol information in the request and response, and wherein the filter is further selected by evaluating a logical expression created from data in an I/O map and an event map, wherein the I/O map is configured to hold identifiers for the plurality of filters and I/O operations for which the plurality of filters are registered, and wherein the event map is configured to hold the identifiers for the plurality of filters and characteristics of the plurality of filters;

a filter loader for loading and unloading the plurality of filters in the filter system; and

an I/O buffer coupled to the filter controller for storing I/O operations to permit filter I/O operations to be suspended during filter loading and unloading.

37. A file operating system having a filter system for a storage device being accessible to a client interface, the file operating system comprising:

filter invocation means for performing a call to a filter of a plurality of filters based on protocol information being transferred between the client interface and the storage device;

filtering means for filtering the information under control of the filter invocation means to permit or prevent processing of the information transferred between the client interface and the storage device during filtering processing, wherein the filtering means is selected from a plurality of filters by evaluating a logical expression created from data in an I/O map and an event map, wherein the I/O map is configured to hold identifiers for the plurality of filters and I/O operations for which the plurality of filters are registered, and wherein the event map is configured to hold the identifiers for the plurality of filters and characteristics of the plurality of filters; and

block processing means responsive to the filtering means for processing blocks of data in the file operating system to filter blocks transferred between the client interface and the storage device.

38. A computer-program product comprising:

a computer-readable medium having computer program code embodied thereon for filtering information in a data storage system having a storage device being accessible to a client interface, the computer program code adapted to;

capture a request from the client interface and a response from the storage device;

provide protocol information from the captured request and response to a plurality of filters;

perform filtering operations with a filter of the plurality of filters selected based on the protocol information, in response to the captured request and response to selectively modify information related to the captured request and response, and wherein the filter is further selected by evaluating a logical expression created from data in an I/O map and an event map, wherein the I/O map is configured to hold identifiers for the plurality of filters and I/O operations for which the plurality of filters are registered, and wherein the event map is configured to hold the identifiers for the plurality of filters and characteristics of the plurality of filters; and

selectively forward the captured request and response to the storage device and client interface, respectively, depending upon a result of the filtering operations.