Scalable storage and processing of hierarchical documents
First Claim
1. A method for processing a data stream embodying a hierarchically structured document, said method comprising:
- partitioning said data stream into fixed length segments utilizing said hierarchical structure to determine a length of each fixed length segment; and
processing said fixed length segments in a pipeline fashion.
2 Assignments
0 Petitions
Accused Products
Abstract
Large messages in the form of hierarchically structured documents are processed in a streaming fashion using the ultimate consumer read requests as the driving force for the processing. The messages are partitioned into fixed length segments. The segments are processed in pipeline fashion. This processing chain includes simulating random access of hierarchical documents using stream transformations, mapping streams to a transport'"'"'s native capabilities, composing streams into chains and using pipeline processing on the chains, staging fragments into a database and routing messages when complete messages have been formed, and providing tools to allow the end user to inspect partial messages.
-
Citations
61 Claims
-
1. A method for processing a data stream embodying a hierarchically structured document, said method comprising:
-
partitioning said data stream into fixed length segments utilizing said hierarchical structure to determine a length of each fixed length segment; and
processing said fixed length segments in a pipeline fashion. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 20, 21, 22, 23, 24, 25, 26, 27)
-
-
19. A method in accordance 18, wherein:
-
said data stream comprises a sequence of nodes;
a node is one of a container node and a value node;
each token is indicative of at least one of a container node and a value node;
a value node comprises a value associated with said document; and
a container node comprises at least one of attributes of said document; and
an ordered set of at least one of a container node and a value node.
-
-
28. A computer-readable medium having computer-executable instructions for processing a data stream embodying a hierarchically structured document by performing acts comprising:
-
partitioning said data stream into fixed length segments utilizing said hierarchical structure to determine a length of each fixed length segment; and
processing said fixed length segments in a pipeline fashion. - View Dependent Claims (29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54)
-
-
55. A system for processing a data stream embodying a hierarchically structured document, said system comprising:
-
a receive pipeline for;
receiving said data stream;
partitioning said data stream into fixed length segments utilizing said hierarchical structure to determine a length of each fixed length segment;
processing said fixed length segments in a pipeline fashion; and
providing said processed fixed length segments to a storage medium;
said storage medium coupled to said receiving pipeline and coupled to a transmit pipeline; and
said transmit pipeline for;
receiving processed data from said storage medium;
processing fixed length segments in a pipeline fashion. - View Dependent Claims (56, 57, 58, 59, 60, 61)
-
Specification