Apparatus and method for high performance data content processing

• US 20060080467A1
• Filed: 08/26/2004
• Published: 04/13/2006
• Est. Priority Date: 08/26/2004
• Status: Abandoned Application

• Current Assignee: Intel Corporation
• Original Assignee: Sensory Networks, Inc. (Intel Corporation)
• Inventors: Gould, Stephen, Peltzer, Ernest, Barrie, Robert Matthew, Marks, Kellie, Clift, Sean
• Application Number:
  US10/927,967
• Publication Number:
  US 20060080467A1
• Time in Patent Office: Days
• US Class Current: 709/250
• CPC Class Codes: G06F 2209/509 Offload
• CPC Class Codes: G06F 9/5005 to service a request

Abstract

Incoming data streams are processed at relatively high speed for decoding, content inspection and classification. A multitude of processing channels process multiple data streams concurrently so as to allows networking based host systems to provide the data streams—as the packets carrying these data streams are received from the network—without requiring the data streams to be buffered. Moreover, host systems processing stored content, such as email messages and computer files, can process more than one stream at once and thereby make better utilization of the host system'"'"'s CPU. Processing bottlenecks are alleviated by offloading the tasks of data extraction, inspection and classification from the host CPU. A content processing system which so processes the incoming data streams, is readily extensible to accommodate and perform additional data processing algorithms. The content processing system is configurable to enable additional data processing algorithms to be performed in parallel or in series.

Claims

1. A system configured to process content data received via a network or filesystem, the system comprising:

a host interface configured to establish communication between the system and a host external to the system;

a plurality of content processing channels each configured to perform one or more processing algorithms on the data received from the host interface;

a context manager configured to store and retrieve the context of data received from the plurality of content processing channels; and

at least one bus having a plurality of bus lines, the plurality of bus lines coupling the context manager to the plurality of content processing channels, the plurality of bus lines further coupling the host interface to the plurality of content processing channels.

2. The system of claim 1 wherein each of the plurality of channels is configured to perform one or more processing algorithms selected from the group consisting of literal string matching, regular expression matching, pattern matching, MIME message decoding, HTTP decoding, XML decoding, content decoding, decompression, decryption, hashing, and classification.

3. The system of claim 1 wherein the host interface is further configured to receive commands from the host.

4. The system of claim 1 wherein the host interface is further configured to send responses to the host.

5. The system of claim 1 wherein each of the plurality of content processing channels is configured on-the-fly.

6. The system of claim 1 wherein the plurality of content processing channels are configured to perform the processing algorithms in parallel.

7. The system of claim 1 wherein the plurality of content processing channels are configured to perform the processing algorithms in series.

8. The system of claim 1 wherein each of the plurality of content processing channels is adapted to be reprogrammed to perform different processing algorithms.

9. The system of claim 1 wherein data communicated between the host and the system via the host interface is quantized into discrete packets

10. A method of processing content of data received via a network, the method comprising:

receiving the data from a host via a host interface;

performing one or more processing algorithms on the data using a plurality of content processing channels;

storing the context received from the plurality of content processing channels;

retrieving the context received from the plurality of content processing channels.

11. The method of claim 10 wherein each processing algorithm is selected from the group consisting of literal string matching, regular expression matching, pattern matching, MIME message decoding, HTTP decoding, XML decoding, content decoding, decompression, decryption, hashing, and classification.

12. The method of claim 10 further comprising:

receiving commands from the host.

13. The method of claim 10 further comprising:

sending responses to the host.

14. The method of claim 10 further comprising:

configuring each of the plurality of content processing channels on-the-fly.

15. The method of claim 10 wherein the plurality of content processing channels perform one or more processing algorithms in parallel.

16. The method of claim 10 wherein the plurality of content processing channels perform one or more processing algorithms in series.

17. The method of claim 10 wherein each of the plurality of content processing channels is adapted to be reprogrammed to perform different processing algorithms.