METHOD AND SYSTEM FOR SEMANTIC SEARCHING OF NATURAL LANGUAGE TEXTS

• US 20110270607A1
• Filed: 06/30/2011
• Published: 11/03/2011
• Est. Priority Date: 10/10/2006
• Status: Active Grant

• Current Assignee: ABBYY Production LLC (ABBYY Software)
• Original Assignee: ABBYY InfoPoisk LLC
• Inventors: Zuev, Konstantin
• Granted Patent: US 9,069,750 B2
• Time in Patent Office: Days
• US Class Current: 704/9
• CPC Class Codes: G06F 16/3344 using natural language analysis
• CPC Class Codes: G06F 40/237 Lexical tools
• CPC Class Codes: G06F 40/30 Semantic analysis

Abstract

A method and system comprising an automated analysis of at least one corpus of natural language text is disclosed. For each sentence of a corpus, the analysis includes performing a syntactic analysis using linguistic descriptions to generate at least one syntactic structure for the sentence, building a semantic structure for the sentence, associating each generated syntactic and semantic structure with the sentence, and saving each generated syntactic and semantic structure. For each corpus text that was preliminary analyzed, performing an indexing operation to index lexical meanings and values of linguistic parameters of each syntactic structure and each semantic structure associated with sentences in the corpus text. A semantic search as disclosed herein includes at least one automatic preliminary analyzed corpus of sentences comprising searched values of linguistic, syntactic and semantic parameters. Due to deep semantic analysis of one or more corpora, the search may be executed in various languages, in resources of various languages, and in text corpora of various languages, regardless of the language of the query.

Claims

1. A computer-implemented method for facilitating a semantic search based on one or more previously analyzed and indexed corpuses of natural language texts, the method comprising:

identifying on one or more previously analyzed and indexed corpuses of natural language texts, each corpus including a plurality of sentences and indexes of their syntactic and semantic structures where indexes of said syntactic and semantic structures include indexes of meanings of linguistic categories (“

parameters”

) of the sentences and of their lexical units and their relations;

creating a query for searching sentences satisfying the query;

searching for sentences of the previously analyzed and indexed corpuses satisfying the query;

displaying the sentences satisfying the query.

2. The method of claim 1, wherein the analyzing of each corpus of natural language texts comprises:

generating, based at least in part on the syntactic analysis, at least one syntactic structure for each sentence;

building a semantic structure for each sentence of the corpora of natural language texts;

associating each generated syntactic structure and the built semantic structure with a respective sentence.

3. The method of claim 2, wherein indexing each corpus of natural language texts comprises:

creating an index for each meaning of linguistic parameters of generated syntactic structures;

creating an index for each meaning of parameters of semantic structures;

storing each generated syntactic structure and the semantic structure for each sentence of the corpora of natural language texts; and

storing each created index.

4. The method of claim 3, wherein indexing each corpus of natural language texts further comprises:

creating indexes for two or more combinations of meanings of linguistic parameters of generated syntactic structures;

creating indexes for two or more combinations of meanings of parameters of semantic structures; and

storing each created index.

5. The method of claim 2, wherein the performing the syntactic analysis includes resolving an ambiguity of lexical unit meanings within at least one of the sentences of the corpora of text.

6. The computer-implemented method of claim 2, wherein the building the semantic structure includes encoding the language-specific properties of the sentence and of its lexical units and their relations by means of language-independent parameters.

7. The method of claim 1, wherein the query for searching is expressed in a specific query language.

8. The method of claim 1, wherein the query for searching is expressed in a natural language.

9. The method of claim 1, wherein the query for searching is expressed in terms of requested parameters, a part of which may be indefinite, or may be defined by means of one or more variables, or may be defined as a range of meanings of these variables.

10. The method of claim 1, wherein the query for searching is expressed in a natural language with requested parameters, a part of which may be not defined, or may be defined by means of variables, or may be defined as a range of meanings of these variables.

11. The method of claim 8, wherein the query for searching is represented in a natural language sentence with lacunas, where said lacunas may be covered during searching, at least, with one or more separate words, one or more word combinations, a phrase, a group of words represented by a bound constituent (substructure), or one or more embedded clauses.

12. The method of claim 9, wherein said requested parameters represent, at least, relationships, non-tree links, lexical classes, semantic classes, words or words combinations by grammatical properties, lexical properties, syntactical or semantic properties, relations by syntactical properties, or clauses by any (lexical, syntactical, semantic) properties.

13. The method of claim 10, wherein said requested parameters represent properties of searched nodes of syntactic or semantic structures, including grammatical values, classes with all descendants (superclasses), and semantemes.

14. The method of claim 9, wherein said requested parameters represent properties of relationships including surface or deep slots with or without checking a parent relationship, an anaphoric relationship or any quantity of nodes and relationships with said properties.

15. The method of claim 1, wherein displaying the sentences satisfying the query includes sorting a query result by frequency.

16. One or more computer-readable media having computer-executable instructions, which when executed perform steps, comprising:

identifying one or more previously analyzed and indexed corpuses of natural language texts, each corpus including a plurality of sentences and indexes of their syntactic and semantic structures where indexes of said syntactic and semantic structures include indexes of meanings of linguistic parameters of the sentences and of their lexical units and their relations;

creating a query for searching sentences satisfying the query;

searching for sentences of the previously analyzed and indexed corpuses satisfying the query;

displaying the sentences satisfying the query.

17. The one or more computer-readable media of claim 16, wherein the analyzing of each corpus of natural language texts comprises:

generating, based at least in part on the syntactic analysis, at least one syntactic structure for each sentence;

building a semantic structure for each sentence of the corpora of natural language texts;

associating each generated syntactic structure and the built semantic structure with a respective sentence.

18. The one or more computer-readable media of claim 16, wherein indexing each corpus of natural language texts comprises:

creating an index for each meaning of linguistic parameters of generated syntactic structures;

creating an index for each meaning of parameters of semantic structures;

storing each generated syntactic structure and the semantic structure for each sentence of the corpora of natural language texts; and

storing each created index.

19. The one or more computer-readable media of claim 17, wherein indexing each corpus of natural language texts further comprises:

creating indexes for two or more combinations of meanings of linguistic parameters of generated syntactic structures;

creating indexes for two or more combinations of meanings of parameters of semantic structures; and

storing each created index.

20. The one or more computer-readable media of claim 17, wherein the performing the syntactic analysis includes resolving an ambiguity of lexical unit meanings within at least one of the sentences of the corpora of text.

21. The one or more computer-readable media of claim 17, wherein the building the semantic structure includes encoding the language-specific properties of the sentence and of its lexical units and their relations by means of language-independent parameters.

22. The one or more computer-readable media of claim 16, wherein the query for searching is expressed in a specific query language.

23. The one or more computer-readable media of claim 16, wherein the query for searching is expressed in a natural language.

24. The one or more computer-readable media of claim 16, wherein the query for searching is expressed in terms of one or more requested parameters, one or more of which may be indefinite, or may be defined by means of one or more variables, or may be defined as a range of meanings of these variables.

25. The one or more computer-readable media of claim 16, wherein the query for searching is expressed in a natural language with requested parameters, a part of which may be indefinite, or may be defined by means of variables, or may be defined as a range of meanings of these variables.

26. The one or more computer-readable media of claim 16, wherein the query for searching is represented in a natural language sentence with one or more lacunas, where said lacunas may be covered during searching, at least, with one or more separate words, one or more word combinations, a phrase, a group of words represented by a bound constituent (substructure), or one or more embedded clauses.

27. The one or more computer-readable media of claim 16, wherein said requested parameters represent, at least one of the following:

a relationships, a non-tree link, a lexical class, a semantic class, one or more word or word combinations of grammatical properties, one or more word or word combinations of lexical properties, one or more word or word combinations of syntactical or semantic properties, one or more relationships represented by one or more syntactical properties, or clauses of a (lexical, syntactical, or semantic) property.

28. The one or more computer-readable media of claim 16, wherein said requested parameters represent properties of searched nodes of syntactic or semantic structures, including grammatical values, classes with all descendant (superclass), semantemes (for example, “

time”

regardless of a form of its expression).

29. The one or more computer-readable media of claim 16, wherein said requested parameters represent properties of relationships including surface or deep slots with or without checking a parent relationship, an anaphoric relationship or any quantity of nodes and relationships with said properties.

30. The one or more computer-readable media of claim 16, wherein displaying the sentences satisfying the query includes sorting a query result by frequency.