SYSTEMS AND METHODS FOR SUBTEXT SEARCHING DATA USING SYNONYM-ENRICHED PREDICATIVE PHRASES AND SUBSTITUTED PRONOUNS

• US 20120150894A1
• Filed: 02/14/2012
• Published: 06/14/2012
• Est. Priority Date: 03/03/2009
• Status: Active Grant

• Current Assignee: Ilya Geller
• Original Assignee: Ilya Geller
• Inventors: GELLER, Ilya
• Granted Patent: US 8,516,013 B2
• Time in Patent Office: Days
• US Class Current: 707/758
• CPC Class Codes: G06F 40/237 Lexical tools
• CPC Class Codes: G06F 40/289 Phrasal analysis, e.g. finite state techniques or chunking

Abstract

A method and system for automatically, without the necessity of user intervention, creating subtext from textual information regarding text and/or images and/or symbols, etc. and using the subtext to associate by sense passages of the textual information with each other and/or with passages related to search queries.

Claims

1. A method of automatically creating subtext and using subtext to associate textual information regarding text and/or images by sense thereof, said method being carried out by a programmed computer system and comprising the following steps that the computer system need not execute in the stated order:

(a) receiving textual information into computer storage and dividing the textual information into passages;

(b) extracting predicative phrases from a passage of said textual information;

(c) deleting lexical noise from the passage;

(d) extracting nouns from the predicative phrases;

(e) creating one or more clusters of synonyms for said nouns;

(f) creating subtext comprising an enhanced set of predicative phrases for said passage from said nouns and said one or more clusters of synonyms;

(g) subjecting each of a sequence of other passages of the received textual information to steps (b) through (f) to thereby create respective subtext for the respective passages;

(h) testing respective subtexts for compatibility in accordance with a selected compatibility relationship; and

(i) associating passages with each other based on results of said testing for compatibility of their respective subtexts.

2. The method of claim 1 said testing for compatibility comprises selecting a compatibility threshold.

3. The method of claim 1 in which at least one of the passages comprises a search query.

4. The method of claim 1 in which step (d) further comprises extracting other parts of speech, including one or more of verbs, adjectives,idiomatic expressions, and proverbs from the predicative phrases, step (e) further includes creating one or more clusters of synonyms for said other parts of speech, and step (e) further comprises creating subtext comprising an enhanced set of predicative phrases for said passage from said other parts of speech and clusters of synonym thereof.

5. The method of claim 4 in which said creating one or more clusters of synonyms of nouns and other parts of speech comprises accessing compilations of synonyms by using the extracted nouns and other parts of speech as search terms.

6. The method of claim 1 in which said extracting of predicative phrases further comprises assigning thereto information regarding frequency of occurrence of the respective predicative phrases.

7. The method of claim 1 in which said associating comprises associating passages with each other based on whether said testing for compatibility determines a compatibility value that meets a selected threshold.

8. The method of claim 1 in which said creating one or more clusters of synonyms comprises accessing compilations of synonyms by using the extracted nouns as search terms.

10. The computer system of claim 8 said facility configured to test respective subtexts for compatibility is further configured to select a compatibility threshold and use said threshold to determine whether the tested subtexts are compatible.

9. A computer system programmed and configured to automatically create subtext and use subtext to associate textual information regarding text and/or images by sense thereof, comprising:

(a) a computer implemented facility configured to receive textual information into computer storage and divide the textual information into passages;

(b) a computer implemented facility configured to extract predicative phrases from a passage of said textual information;

(c) a computer implemented facility configured to delete lexical noise from the passage;

(d) a computer implemented facility configured to extract nouns from the predicative phrases;

(e) a computer implemented facility configured to create one or more clusters of synonyms for said nouns;

(f) a computer implemented facility configured to create subtext comprising an enhanced set of predicative phrases for said passage from said nouns and said one or more clusters of synonyms;

(g) a computer implemented facility configured to subject each of a sequence of other passages of the received textual information to the facilities (b) through (f) to thereby create respective subtext for the respective passages;

(h) a computer implemented facility configured to test respective subtexts for compatibility with each other in accordance with a selected compatibility relationship; and

(i) a computer implemented facility configured to associate passages with each other based on results of said testing for compatibility of their respective subtexts.

11. The computer system of claim 9 in which at least one of the passages comprises a search query and wherein the system further comprises a search facility using said query to find passages compatible therewith by sense.

12. The computer system of claim 9 in which facility (d) further includes a facility configured to extract parts of speech other than nouns from the predicative phases, facility (e) further includes a facility creating one or more clusters of synonyms for said other parts of speech, and facility (f) further includes a facility creating subtext comprising an enhanced set of predicative phrases for said passage from said other parts of speech and clusters of synonym thereof.

13. The computer system of claim 9 in which said facility configured to extract predicative phrases is further configured to assign to the predicative phrases information regarding frequency of occurrence of the respective predicative phrases.

14. The computer system of claim 9 in which said facility configured to extract predicative phrases is further configured to assign to the subtexts information regarding the date of their origin.

15. The computer system of claim 9 in which said facility configured to associate passages is further configured to associate said passages based at least in part on whether said testing for compatibility determines a compatibility value that meets a selected threshold.

16. A computer program stored in a non-transitory form in a computer-readable medium and executable in a computer system to cause the system to automatically create subtext and use subtext to associate textual information regarding text and/or images by sense thereof by carrying out a process comprising:

the following steps that need not be executed in the stated order

(a) receiving textual information into computer storage and dividing the textual information into passages;

(b) extracting predicative phrases from a passage of said textual information;

(c) deleting lexical noise from the passage;

(d) extracting nouns from the predicative phrases;

(e) creating one or more clusters of synonyms for said nouns;

(f) creating subtext comprising an enhanced set of predicative phrases for said passage from said nouns and said one or more clusters of synonyms;

(g) subjecting each of a sequence of other passages of the received textual information to steps (b) through (f) to thereby create respective subtext for the respective passages;

(h) testing respective subtexts for compatibility in accordance with a selected compatibility relationship; and

(i) associating passages with each other based on results of said testing for compatibility of their respective subtexts.

17. The computer program of claim 16 further comprising instructions stored in non-transitory form in said computer-readable medium that, when executed in said computer system, cause the system to further include in step (d) extracting other parts of speech, from the predicative phrases, to further include in step (e) creating one or more clusters of synonyms for said other parts of speech, and to further include in step (e) creating subtext comprising an enhanced set of predicative phrases for said passage from said other parts of speech and clusters of synonym thereof.