Method and apparatus for storing data as objects, constructing customized data retrieval and data processing requests, and performing householding queries
First Claim
1. A method of storing data in a data store for subsequent search and retrieval by an end user, comprising:
- receiving input data to be stored for subsequent search and retrieval;
processing the received input data by transforming the input data into an indexed and compressed universal data object; and
storing the indexed and compressed universal data object in a data store for subsequent search and retrieval by an end user.
1 Assignment
0 Petitions
Accused Products
Abstract
Compressed data objects are stored in a remote data store and are accessible to end users for data retrieval and processing. The remote data store is optimized for efficient data storage and retrieval with processes for capturing data profile statistics and creating an index of compressed data. Descriptive information about data objects and processing logic is displayed and made available for viewing and access by end users having a client application which manipulates the descriptive information to create a customized data retrieval and processing request. An end user can add descriptive information about its own data to the request and attach its own compressed data to the request that will be included in data retrieval and processing. Descriptive information representing data and logic stored in multiple remote data stores can be integrated into one request. The request can be submitted to several data stores in succession for automated data retrieval and processing without jeopardizing request security. A final, customized request object, thus, may contain descriptive information identifying data, descriptive information identifying logic to be executed on the data, and compressed end user data. The final request is submitted to the appropriate data store(s) and/or vendor(s) for automated processing in accordance with the customized instructions, and the data result set is returned in a format specified by the end user. The contents of the object data store and the request can be processed substantially in compressed form. Householding capability and security features are available. End users can customize their householding parameters, including end user specifications to improve flexibility, speed, and efficiency of the householding process.
89 Citations
19 Claims
-
1. A method of storing data in a data store for subsequent search and retrieval by an end user, comprising:
-
receiving input data to be stored for subsequent search and retrieval;
processing the received input data by transforming the input data into an indexed and compressed universal data object; and
storing the indexed and compressed universal data object in a data store for subsequent search and retrieval by an end user. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10)
-
-
11. A database comprising compressed universal data objects stored in a data store and accessible to end users for data retrieval and processing;
-
wherein the data store is optimized for efficient data storage and retrieval with processes for generating data profile statistics and automatically creating an index of compressed data;
wherein descriptive information about universal data objects and processing logic is displayed and made available for viewing and access by end users having access to a client application;
wherein the client application manipulates the descriptive information to create a customized data retrieval and processing request;
wherein an end user can add descriptive information about its own data to the request and attach its own compressed data to the request so that it will be included in data retrieval and processing;
wherein descriptive information representing data and logic stored in multiple remote data stores can be integrated into one request;
wherein the request can be submitted to several data stores in succession for automated data retrieval and processing without jeopardizing request security;
wherein a final, customized request object may contain;
(i) descriptive information identifying data;
(ii) descriptive information identifying logic to be executed on the data; and
(iii) compressed end user data;
wherein the final request is submitted to the appropriate data store(s) and/or vendor(s) for automated processing in accordance with the customized instructions, and the data result set is returned in a format specified by the end user;
wherein the contents of the object data store and the request can be processed substantially entirely in compressed form;
wherein a householding process capability and security features may be included;
wherein end users can customize householding parameters, including end-user specifications to improve the speed and efficiency of the householding process. - View Dependent Claims (12, 13, 14)
-
-
15. A method of performing householding queries by comparing input data with reference lists to produce data output, comprising:
-
building input patterns from data input submitted by an end user;
displaying the input patterns for viewing by an end user utilizing a graphical user interface;
allowing the end user to construct an output table containing output table symbols;
mapping the input patterns to the output table symbols;
mapping output table symbols to a reference list;
generating search patterns derived from the mapping of input patterns to the output table symbols that are mapped to the reference list; and
using the search patterns to parse the data input against the reference lists to produce data output. - View Dependent Claims (16, 19)
-
-
17. The method of building the parsing table(s) claimed in 16 wherein the invention uses the end user search pattern information to construct indices on the parsing table.
-
18. The method of using execution tables claimed in 16, wherein the first execution table performs a structural search comprising:
-
analyzing the search pattern generate for a given input pattern and identifies the output table symbol for which an exact match is required most frequently in the same search pattern position;
prioritizing the search patterns to eliminate the largest number of non matching records;
selecting key field(s) from the end user'"'"'s search pattern that will be used in the search process that will eliminate the maximum number of search patterns that will not match the parsing table;
matching data from the parsing table index that matches the search pattern of the key field(s) parameter;
moving the matched data into a virtual memory table so that the successive execution table can retrieve data for next key field(s) without losing the location of the matched data for the previous key field(s); and
storing the frequency of matches to the key field(s) search in a virtual memory table.
-
Specification