Method and System for Information Modeling and Applications Thereof

• US 20120233128A1
• Filed: 03/10/2011
• Published: 09/13/2012
• Est. Priority Date: 03/10/2011
• Status: Active Grant

• Current Assignee: TextWise Company, LLC
• Original Assignee: TextWise Company, LLC
• Inventors: Solmer, Robert
• Granted Patent: US 8,539,000 B2
• Time in Patent Office: Days
• US Class Current: 707/661
• CPC Class Codes: G06F 16/212 with details for data modelling support
• CPC Class Codes: G06F 16/28 Databases characterised by their database models, e.g. relational or object models
• CPC Class Codes: G06F 16/288 Entity relationship models
• CPC Class Codes: G06F 16/316 Indexing structures
• CPC Class Codes: G06V 30/40 Document-oriented image-based pattern recognition

Abstract

Method, system, and programs for an information model to be used in representing data. The information model includes a plurality of features, one or more information allocation models, and a configuration that associates an information allocation model with each of the features, where an information allocation model is to be used to allocate a portion of information contained in the data to each of the features and the total amount of information allocated to the features equals a total amount of information contained in the data.

Claims

1. A method, implemented on a machine having at least one processor, storage, and a communication platform connected to a network for constructing an information model to be used to represent data, comprising the steps of:

determining a plurality of feature sets appropriate for the data;

determining, with respect to the data, one or more features for each of the plurality of feature sets;

specifying a plurality of information allocation models;

associating an information allocation model with each of the features from each of the feature sets, where the information allocation model associated with the feature is to be used to allocate a portion of information contained in the data to the feature;

storing an information model that comprises the features of the plurality of feature sets and configuration associating the information allocation models to the features,

wherein and the total amount of information allocated to the features equals a total amount of information contained in the data.

2. The method of claim 1, wherein the data corresponds to one or more documents.

3. The method of claim 2, wherein

the plurality of feature sets is determined based on a language model established based on a corpus;

and

each feature set characterizes the data in terms of one aspect of the data.

4. The method of claim 2, wherein the plurality of feature sets includes at least one of uni-gram, bi-gram, topic, and document style.

5. A method, implemented on a machine having at least one processor, storage, and a communication platform connected to a network for archiving data based on an information model, comprising the steps of:

obtaining data via the communication platform;

accessing an information model specifying a plurality of features, one or more information allocation models, and configuration associating the information allocation models to the features;

processing, by a feature-specific processing unit, the data with respect to the plurality of features;

allocating, by an information allocation determiner based on the information allocation models, a portion of information that the data contains to each of the plurality of features based on the processed data, where the total amount of information allocated to the features equals a total amount of information contained in the data;

constructing, by an information representation constructor, an information representation of the data based on the allocated information amount to each feature; and

archiving, by a data archiving unit, the data based on the information representation of the data.

6. The method of claim 5, further comprising:

generating an index for the archived data based on the information representation of the data; and

storing the index of the data for future access of the archived data.

7. A method, implemented on a machine having at least one processor, storage, and a communication platform connected to a network for information search and retrieval based on an information model, comprising the steps of:

obtaining a query via the communication platform;

accessing an information model comprising a plurality of features, one or more information allocation models, and configuration associating the information allocation models to the features;

processing, by a feature-specific processing unit, the query with respect to the plurality of features;

allocating, by an information allocation determiner, a portion of information that the query contains to each of the plurality of features based on the processed data, where the total amount of information allocated to the features equals a total amount of information contained in the query;

constructing, by an information representation constructor, an information representation of the query based on the allocated information amount to each feature;

accessing, by a data retrieval unit, an archive to search for similar archived data based on the information representation of the query;

selecting, by a query response generator, a query response from the similar archived data; and

returning the query response as a response to the query.

8. The method of claim 7, wherein the step of searching for similar data comprises:

building an index of the query based on the information representation of the query;

sending the index of the query to an data archiving indexing mechanism for accessing archived data that have similar index values; and

receiving, from an information representation based data archive, the similar archived data obtained based on the index of the query.

9. The method of claim 7, further comprising archiving data prior to receiving the query, wherein the step of archiving data comprises:

obtaining data via a communication platform;

accessing an information model comprising a plurality of features, one or more information allocation models, and configuration associating the information allocation models to the features;

processing the data with respect to the plurality of features;

allocating, based on the information allocation models, a portion of information that the data contains to each of the plurality of features based on the processed data, where the total amount of information allocated to the features equals a total amount of information contained in the data;

constructing an information representation of the data based on the allocated information amount to each feature; and

archiving the data based on the information representation of the data.

10. A machine-readable medium, having information stored thereon for constructing an information model to be used to represent data, wherein the information, when read by the machine, causes the machine to perform the following:

providing a plurality of feature sets appropriate for the data;

providing, with respect to the data, one or more features for each of the plurality of feature sets;

determining one or more information allocation models;

associating an information allocation model with each feature where the information allocation model associated with the feature is to be used to allocate a portion of information contained in the data to the feature;

storing an information model that comprises the features of the plurality of feature sets and configuration associating the information allocation models to the features,

wherein and the total amount of information allocated to the features equals a total amount of information contained in the data.

11. The medium of claim 10, wherein the data corresponds to one or more documents.

12. The medium of claim 11, wherein

the plurality of feature sets is determined based on a language model established based on a corpus;

and

each feature set characterizes the data in terms of one aspect of the data.

13. The medium of claim 11, wherein the plurality of feature sets includes at least one of uni-gram, bi-gram, topic, and document style.

16. A machine-readable medium having information recorded thereon for archiving data based on an information model, wherein the information, when read by the machine, causes the machine to perform the following:

obtaining data via a communication platform;

accessing an information model comprising a plurality of features, one or more information allocation models, and configuration associating the information allocation models to the features;

processing the data with respect to the plurality of features;

allocating, based on the information allocation models, a portion of information that the data contains to each of the plurality of features based on the processed data, where the total amount of information allocated to the features equals a total amount of information contained in the data;

constructing an information representation of the data based on the allocated information amount to each feature; and

archiving the data based on the information representation of the data.

17. The medium of claim 16, wherein the information, when read by the machine, further causes the machine to perform:

generating an index for the archived data based on the information representation of the data; and

storing the index of the data for future access of the archived data.

18. A machine-readable medium having information for information search and retrieval based on an information model, wherein the information, when read by the machine, causes the machine to perform the following:

obtaining a query via a communication platform;

accessing an information model comprising a plurality of features, one or more information allocation models, and configuration associating the information allocation models to the features;

processing the query with respect to the plurality of features;

allocating a portion of information that the query contains to each of the plurality of features based on the processed data, where the total amount of information allocated to the features equals a total amount of information contained in the data;

constructing an information representation of the query based on the allocated information amount to each feature;

accessing an archive to search for similar archived data based on the information representation of the query;

selecting a query response from the similar archived data; and

returning the query response as a response to the query.

19. The medium of claim 18, wherein the step of searching for similar data comprises:

building an index of the query based on the information representation of the query;

sending the index of the query to an data archiving indexing mechanism for accessing archived data that have similar index values; and

receiving, from an information representation based data archive, the similar archived data obtained based on the index of the query.

20. The medium of claim 18, further comprising archiving data prior to receiving the query, wherein the step of archiving data comprises:

obtaining data via a communication platform;

accessing an information model comprising a plurality of features, one or more information allocation models, and configuration associating the information allocation models to the features;

processing the data with respect to the plurality of features;

allocating, based on the information allocation models, a portion of information that the data contains to each of the plurality of features based on the processed data, wherein the total amount of information allocated to the features equals a total amount of information contained in the data;

constructing an information representation of the data based on the allocated information amount to each feature; and

archiving the data based on the information representation of the data.

21. An information model to be used in representing data, comprising:

a plurality of features; and

one or more information allocation models; and

a configuration associating an information allocation model with each of the features,

where an information allocation model is to be used to allocate a portion of information contained in the data to each of the features, wherein

the total amount of information allocated to the features equals a total amount of information contained in the data.

22. The system of claim 21, wherein the data corresponds to one or more documents.

23. The system of claim 22, wherein

the plurality of feature sets is determined based on a language model established based on a corpus;

and

each feature set characterizes the data in terms of one aspect of the data.

24. The system of claim 22, wherein the plurality of feature sets includes at least one of uni-gram, bi-gram, topic, and document style.

25. A system for archiving data based on an information model, comprising:

a communication platform through which data is obtained;

an information model accessing unit configured for accessing an information model comprising a plurality of features, one or more information allocation models, and configuration associating the information allocation models to the features;

a feature-specific processing unit configured for processing the data with respect to the plurality of features;

an information allocation determiner configured for allocating a portion of information that the data contains to each of the plurality of features based on the processed data, where the total amount of information allocated to the features equals a total amount of information contained in the data;

an information representation constructor configured for constructing an information representation of the data based on the allocated information amount to each feature; and

a data archiving unit configured for archiving the data based on the information representation of the data.

26. The system of claim 25, further comprising:

an information model based indexing unit configured for generating an index for the archived data based on the information representation of the data, storing the index of the data for future access of the archived data, and facilitating index-based data retrieval.

27. A system for information search and retrieval based on an information model, comprising the steps of:

a communication platform configured for obtaining a query;

an information model accessing unit configured for accessing an information model comprising a plurality of features, one or more information allocation models, and configuration associating the information allocation models to the features;

a feature-specific processing unit configured for processing the query with respect to the plurality of features;

an information allocation determiner configured for allocating a portion of information that the query contains to each of the plurality of features based on the processed data, where the total amount of information allocated to the features equals a total amount of information contained in the data;

a query information representation generator configured for constructing an information representation of the query based on the allocated information amount to each feature;

a data retrieval unit configured for accessing an archive and searching for similar archived data based on the information representation of the query;

a query response generator configured for returning a query response selected from the similar archived data and returning the query response as a response to the query.

28. The system of claim 27, further comprising a data archiving indexing unit configured for:

building an index of the query based on the information representation of the query; and

sending the index to an information representation based data archive to search for archived data that have similar index values.