Stream processing node

• US 20020087709A1
• Filed: 11/29/2001
• Published: 07/04/2002
• Est. Priority Date: 12/29/2000
• Status: Active Grant

• Current Assignee: Avaya Incorporated
• Original Assignee: Avaya Incorporated
• Inventors: Pillar, John F., Kerr, Gordon, Lengacher, Allen W.
• Granted Patent: US 7,882,257 B2
• Time in Patent Office: Days
• US Class Current: 709/231
• CPC Class Codes: H04L 67/561 Adding application-functional data or data for application control, e.g. adding metadata
• CPC Class Codes: H04L 67/563 Data redirection of data network streams
• CPC Class Codes: H04L 67/63 Routing a service request depending on the request content or context
• CPC Class Codes: H04L 69/329 in the application layer [OSI layer 7]
• CPC Class Codes: H04L 9/40 Network security protocols

Abstract

In a stream processing node, a producer of properly ordered portions of a data stream, hereinafter referred to as substreams, is coupled to a stream fabric that is further coupled to a series of potential consumers for the data stream, one of the potential consumers being a content processing element. The producer outputs the substreams to a stream queue that is associated with the data stream within the stream fabric. Subsequently, a portion of the data within the stream queue is copied and analysed by the content processing element which determines what further actions are to be taken with respect to the data within the particular stream queue. These actions could include copying a further portion of the data within the stream queue to the content processing element for further analysis; redirecting the data within the stream queue to another consumer of the data stream, such as another processing element or an interface with a packet switched network; modifying a portion of the data within the stream queue; and/or transferring a portion of the data within the stream queue to another stream queue.

Claims

1. An apparatus for processing data streams comprising:

at least one producer of properly ordered substreams of a data stream;

a plurality of potential consumers of a data stream; and

a stream fabric, coupled to the producer and the potential consumers, that operates to receive the substreams from the producer, store the substreams within a stream queue associated with the data stream and output at least a portion of the data within the stream queue to a consumer of the stream queue, the consumer being one of the plurality of potential consumers.

2. An apparatus according to claim 1, wherein the stream fabric operating to output at least a portion of the data within the stream queue to a consumer of the stream queue comprises reading a consumer attribute for the stream queue to determine an assigned consumer of the stream queue and outputting a portion of the data within the stream queue to the assigned consumer.

3. An apparatus according to claim 1, wherein the stream fabric operating to output at least a portion of the data within the stream queue to a consumer of the stream queue comprises selecting one of the potential consumers as a consumer for the stream queue based upon a predetermined criteria and outputting a portion of the data within the stream queue to the selected consumer.

4. An apparatus according to claim 3, wherein the predetermined criteria comprises a round robin system.

5. An apparatus according to claim 3, wherein the predetermined criteria comprises a determination of a least burdened potential consumer.

6. An apparatus according to claim 1, wherein the stream fabric further operates to receive a control signal associated with the stream queue from the consumer of the stream queue.

7. An apparatus according to claim 6, wherein the control signal comprises an indication of at least one consumer attribute for the stream queue.

8. An apparatus according to claim 7, wherein the consumer attribute comprises the potential consumer that is assigned as the consumer of the stream queue.

9. An apparatus according to claim 7, wherein the consumer attribute comprises the number of bytes of the data within the stream queue that are to be output to the consumer of the stream queue.

10. An apparatus according to claim 6, wherein the control signal comprises an indication of at least one attribute associated with the producer of the stream queue.

11. An apparatus according to claim 6, wherein the control signal comprises an instruction to copy at least a portion of the data within the stream queue to the consumer of the stream queue.

12. An apparatus according to claim 6, wherein the control signal comprises an instruction to forward at least a portion of the data within the stream queue to the consumer of the stream queue and to subsequently delete the portion of the data within the stream queue.

13. An apparatus according to claim 6, wherein the control signal comprises an instruction to transfer at least a portion of the data within the stream queue to another stream queue within the stream fabric.

14. An apparatus according to claim 1, wherein the producer is an Input/Output (I/O) element arranged to be coupled to a packet switched network.

15. An apparatus according to claim 14, wherein the I/O element operates to receive a flow of data packets, each of the data packets representing at least one segmented portion of the data stream;

to terminate the layer 4 protocol within the received data packets; and

to output properly ordered substreams of the data stream to the stream queue associated with the data stream.

16. An apparatus according to claim 15, wherein the I/O element operating to terminate the layer 4 protocol within the received data packets comprises removing the packet overhead from the received data packets, reordering the data within the received data packets into the proper order if necessary and requesting retransmission of any lost packets if necessary.

17. An apparatus according to claim 1, wherein the consumer of the stream queue is a processing element.

18. An apparatus according to claim 17, wherein the consumer of the stream queue is a content processing element that operates to receive the data output from the stream queue, process contents of the data received from the stream queue and transmit at least one control signal to the stream fabric in response to the processing of the contents of the data.

19. An apparatus according to claim 18, wherein the at least one control signal comprises an instruction to change a consumer attribute of the stream queue such that the consumer of the stream queue is changed to another one of the potential consumers.

20. An apparatus according to claim 19, wherein the other one of the potential consumers comprises an application processing element that operates to process the contents of the data received from the stream queue.

21. An apparatus according to claim 20, wherein the application processing element comprises an decryption processing element that operates to decrypt the data received from the stream queue and output the decrypted data to a second stream queue within the stream fabric.

22. An apparatus according to claim 19, wherein the other one of the potential consumers comprises an Input/Output (I/O) element coupled to a packet switched network, the I/O element operating to output the data within the stream queue to the packet switched network.

23. An apparatus according to claim 22, wherein, prior to the content processing element operating to transmit the control signal to the stream fabric, the content processing element further operates to add a flow context identifier to the stream queue associated with the data stream, the flow context identifier being used by the I/O element to select a flow within the packet switched network to output the data within the stream queue on.

24. An apparatus according to claim 18, wherein the stream fabric comprises a plurality of stream queues and the content processing element is set as a default initial consumer of each of the stream queues within the stream fabric.

25. An apparatus according to claim 1, wherein the producer and one of the potential consumers are the same component.

27. An apparatus according to claim 26 further comprising at least one consumer of a data stream;

and

wherein the at least one control signal comprises an instruction for the stream fabric to forward further data from the stream queue to the consumer.

28. An apparatus according to claim 27, wherein the consumer comprises an application processing element that operates to process the contents of the data received from the stream queue.

29. An apparatus according to claim 27, wherein the consumer comprises an Input/Output (I/O) element coupled to a packet switched network, the I/O element operating to output the data within the stream queue to the packet switched network.

26. An apparatus for processing streams of data comprising:

at least one producer of properly ordered substreams of a data stream;

a content processing element; and

a stream fabric, coupled to the producer and the content processing element, that operates to receive the substreams from the producer, store the substreams within a stream queue associated with the data stream and copy at least a portion of the data within the stream queue to the content processing element;

wherein the content processing element operates to receive the data output from the stream queue, process contents of the data received from the stream queue and transmit at least one control signal to the stream fabric in response to the processing of the contents of the data.

30. A stream switch for directing, within a packet switched network, a data stream, the stream switch comprising:

an interface, arranged to be coupled to the packet switched network, that operates to receive and process a flow of data packets from the packet switched network, each of the data packets representing at least one segmented portion of the data stream, and to output properly ordered substreams of the data stream;

a stream fabric that operates to receive the substreams from the interface and store the substreams within a stream queue associated with the data stream; and

a content processing element that operates to receive a copy of at least a portion of the data within the stream queue, process contents of the data received from the stream queue and instruct the stream fabric to direct the data within the stream queue to a selected flow of packets within the packet switched network, via the interface, in response to the processing of the contents of the data.

31. An apparatus for processing data streams comprising:

production means for producing properly ordered substreams of a data stream;

a plurality of consumption means for consuming a data stream;

storage means for storing the substreams; and

output means for outputting at least a portion of the data within the storage means to one of the consumption means.

32. A method of processing a data stream comprising:

producing properly ordered substreams of a data stream;

storing the substreams within a stream queue associated with the data stream; and

outputting at least a portion of the data within the stream queue to a consumer of the stream queue, the consumer being one of a plurality of potential consumers.

33. A method according to claim 32, wherein the producing properly order substreams of a data stream comprises receiving a flow of data packets, each of the data packets representing at least one segmented portion of the data stream;

and terminating the layer 4 protocol within the received data packets.

34. A method according to claim 33, wherein the terminating the layer 4 protocol within the received data packets comprises removing the packet overhead from the received data packets, reordering the data within the received data packets into the proper order if necessary and requesting retransmission of any lost packets if necessary.

35. A method according to claim 32, wherein the outputting at least a portion of the data within the stream queue to a consumer of the stream queue comprises processing contents of at least a portion of the data within the stream queue, determining which of the potential consumers to select as the consumer for the stream queue based upon the contents of the at least a portion of the data within the stream queue and outputting at least a portion of the data within the stream queue to the selected consumer.

36. A method according to claim 35 further comprising processing the data received from the stream queue at the selected consumer of the stream queue.

37. A method according to claim 36, wherein the processing the data received from the stream queue comprises decrypting the data received from the stream queue and storing the decrypted data within a second stream queue.

38. A method according to claim 36, wherein the processing the data received from the stream queue comprises outputting the data received from the stream queue to a packet switched network.

39. A method of processing a data stream comprising:

producing properly ordered substreams of a data stream;

storing the substreams within a stream queue associated with the data stream;

processing contents within at least a portion of the data within the stream queue to determine one of a plurality of potential consumers to select as a consumer of the stream queue; and

outputting at least a portion of the data within the stream queue to the selected consumer of the stream queue.