Memory system for storing and retrieving experience and knowledge with natural language

• US 5,715,468 A
• Filed: 09/30/1994
• Issued: 02/03/1998
• Est. Priority Date: 09/30/1994
• Status: Expired due to Term

• Current Assignee: RPX Corporation
• Original Assignee: Robert Lucius Budzinski
• Inventors: Budzinski, Robert Lucius
• Primary Examiner(s): Hayes, Gail O.
• Assistant Examiner(s): Poinvil, Frantzy
• Application Number:
  US08/315,691
• Time in Patent Office: 1,222 Days
• Field of Search: 364/419.08, 364/200.75, 395/759, 395/751, 395/752, 395/757, 395/761
• US Class Current: 704/9
• CPC Class Codes: G06F 16/313 Selection or weighting of terms for indexing
• CPC Class Codes: G06F 16/3334 Selection or weighting of terms from queries, including natural language queries
• CPC Class Codes: G06F 16/3344 using natural language analysis
• CPC Class Codes: G06F 16/36 Creation of semantic tools, e.g. ontology or thesauri
• CPC Class Codes: G06F 40/20 Natural language analysis semantic analysis of natural language G06F40/30
• CPC Class Codes: G06F 40/242 Dictionaries

Abstract

A memory system for storing and retrieving experience and knowledge with natural language. The primary components of this memory system include syntactic processes, function word processes, morphology processes, ellipsis processes, concrete and abstract noun word sense number processes, verb word sense number processes, adjective word sense number processes, purpose identification processes, plausibility and expectedness processes, communication processes, context storage processes, and text generation processes. The syntactic processes include word isolation, dictionary look up, and parsing. The function word processes select and evaluate functions associated with function words which are certain: adjectives, nouns, verbs, adverbs, pronouns, prepositions, conjunctions, and interjections. Morphology processes replace morphological words with phrases or clauses composed of function words arid state representation words. Certain nouns, verbs, and adjectives are state representation words. Selecting the word sense number of a state representation word selects the state representation of such a word. Experience and knowledge are stored as clause implying word sense numbers organized into paths in a directed graph.

Claims

1. A method of processing natural language, which comprises steps

providing electronically encoded data which is representative of said natural language,

providing a dictionary data base wherein said dictionary data base contains a plurality of entries which are comprised of one or more of syntax usage data, associated word sense numbers having associated state representation data and/or function codes,

lexically processing said electronically encoded data to access said dictionary data base,

providing a grammar specification,

utilizing said syntax usage data which are from entries of said dictionary data base and which are associated with words of said natural language with reference to said grammar specification to produce output data representative of a grammatical parse of said natural language, said output data including selected syntax usage.

2. A method of processing as defined in claim 1, which comprises steps of accessing said one or more word sense numbers in said dictionary data base and that are associated with said selected syntax usage data from said grammar specification for said natural language word with one or more word sense numbers.

3. A method of processing as defined in claim 1, which comprises steps of accessing said one or more function codes in said dictionary data base and that are associated with said selected syntax usage data from said grammar specification for said natural language words with one or more function codes.

4. A method of processing as defined in claim 1, which comprises steps

lexically processing said electronically encoded data to access said dictionary data base such that an indication of any natural language word with one or more prefixes and/or one or more suffixes is provided,

providing morphological realizations which are associated with said one or more prefixes and/or one or more suffixes,

morphologically processing said natural language word with one or more prefixes and/or one or more suffixes and said morphological realizations into one or more alternative partitions comprising one or more word sense numbers and/or one or more function codes.

5. A method of processing as defined in claim 1, which comprises steps

utilizing said syntax usage data which are from said dictionary data base entry and which are associated with said natural language word with reference to said grammar specification to produce output data representative of a grammatical parse of said natural language, said output data including an indication of any ellipsis,

elliptically processing said natural language clause or phrase to select a replacement of one or more ellipted words.

6. A method of processing as defined in claim 1, which comprises function word processing steps of said one or more natural language words with one or more function codes.

7. A method of processing as defined in claim 1, which comprises word sense number selection processing steps of said one or more natural language words with one or more word sense numbers.

8. A method of processing as defined in claim 1, which comprises steps of processing the context of said natural language such that data related to said natural language, including word sense numbers, is updated and stored.

9. A method of processing as defined in claim 1, which comprises steps

providing purpose relations such that said purpose relation is a concept that labels one clause or more than one related clause,

purpose relation identification processing of one or more clause implying word sense numbers from said natural language such that each of said one or more clause implying word sense numbers has one or more purpose relations identified for each.

10. A method of processing as defined in claim 1, which comprises steps

providing an experience and knowledge data base wherein said experience and knowledge data base is comprised of directed graphs comprised of nodes with associated clause implying word sense numbers organized into paths of said nodes such that said nodes have access conditions which determine the zero or more next said nodes on the zero or more said paths that are accessible,

purpose path identification processing to find zero or more said paths between said nodes with reference to said experience and knowledge data base such that said access conditions of said nodes on said found paths are met.

11. A method of processing as defined in claim 1, which comprises steps

providing an experience and knowledge data base wherein said experience and knowledge data base is comprised of directed graphs comprised of nodes with associated clause implying word sense numbers organized into paths of said nodes,

providing optional check requirements,

purpose path identification processing to find zero or more said paths between said nodes with reference to said experience and knowledge data base such that said clause implying word sense numbers of said nodes on said found paths meet optional check requirements.

12. A method of processing as defined in claim 1, which comprises steps

providing an experience and knowledge data base wherein said experience and knowledge data base is comprised of directed graphs comprised of nodes with associated clause implying word sense numbers organized into paths of said nodes such that said nodes have access conditions which determine the zero or more next said nodes on the zero or more said paths that are accessible, said nodes having optional related data,

purpose path identification processing to find zero or more said paths between said nodes with reference to said experience and knowledge data base such that said access conditions of said nodes on said found paths are met.

13. A method of processing as defined in claim 1, which comprises steps

providing an experience and knowledge data base wherein said experience and knowledge data base is comprised of directed graphs comprised of nodes with associated clause implying word sense numbers organized into paths of said nodes such that said nodes have access conditions which determine the zero or more next said nodes on the zero or more said paths that are accessible, wherein said access conditions classify an object,

purpose path identification processing to find zero or more said paths between said nodes with reference to said experience and knowledge data base such that said access conditions of said nodes on said found paths are met.

14. A method of processing as defined in claim 1, which comprises steps

providing an experience and knowledge data base wherein said experience and knowledge data base is comprised of directed graphs comprised of nodes with associated clause implying word sense numbers organized into paths of said nodes such that said nodes have access conditions which determine the zero or more next said nodes on the zero or more said paths that are accessible, said nodes having optional related data, wherein said optional related data designates a process,

purpose path identification processing to find zero or more said paths between said nodes with reference to said experience and knowledge data base such that said access conditions of said nodes on said found paths are met.

15. A method of processing as defined in claim 1, which comprises communication processing steps such that a communication is generated such that said communication contains one or more word sense numbers and/or one or more function codes.

16. A method of processing as defined in claim 1, which comprises natural language generation processing steps such that outgoing natural language is generated from one or more word sense numbers and/or one or more function codes.

17. A method of processing as defined in claim 1, which comprises processing steps that determine a word sense number to be modified in a data base with one or more word sense numbers.

18. A method of processing as defined in claim 1, which comprises processing steps that modify a data base with one or more word sense numbers.

19. A method of processing as defined in claim 1, which comprises processing steps that modify a data base which is accessed with one or more word sense numbers.

20. A method of processing as defined in claim 1, which comprises processing steps that initiate processes specified or implied from processing of natural language.

21. A method of processing as defined in claim 1, which comprises processing steps that determine the expectedness of natural language.

22. A method of processing as defined in claim 1, which comprises processing steps that determine the plausibility of natural language.

23. A method of processing as defined in claim 1, which comprises steps

lexically processing said electronically encoded data to access said dictionary data base such that an indication of any natural language word with one or more grammar anomalies is provided,

providing grammar anomaly realizations which are associated with said one or more grammar anomalies,

processing said natural language word with one or more grammar anomalies and said grammar anomaly realizations into one or more alternative partitions comprising one or more word sense numbers and/or one or more function codes.

24. A method of processing as defined in claim 1, which comprises processing steps that obtain data related to word sense numbers that is determined from forms or processing of natural language.

25. A method of processing as defined in claim 1, which comprises processing steps that translate natural language from one natural language to one or more other natural languages.

26. A method of processing as defined in claim 1, which comprises steps

providing an experience and knowledge data base wherein said experience and knowledge data base is comprised of directed graphs comprised of nodes with associated clause implying word sense numbers organized into paths of said nodes such that said nodes have access conditions which determine the zero or more next said nodes on the zero or more paths that are accessible,

providing said nodes which are not accessible on any existing path connecting said nodes and/or providing said nodes which are not on an existing path connecting said nodes,

processing that determines additional access conditions for said nodes on said existing paths which are not accessible such that one or more said existing paths become accessible and/or determines access conditions for said nodes which are not on an existing path such that one or more additional paths become accessible.

27. A method of processing as defined in claim 1, which comprises steps

utilizing said syntax usage data which are from said dictionary data base entry and which are associated with said natural language word with reference to said grammar specification to produce output data representative of a grammatical parse of said natural language, said output data including an indication of morphological words with no prefixes and no suffixes,

providing morphological realizations which are associated with morphological words with no prefixes and no suffixes,

morphologically processing said natural language word with no prefixes and no suffixes and said morphological realizations into one or more alternative partitions comprising one or more word sense numbers and/or one or more function codes.

28. A method of processing as defined in claim 1, which comprises processing steps that obtain data related to function codes that is determined from forms or processing of natural language.

29. A method of processing as defined in claim 1, which comprises processing steps that search for information determined from processing of natural language.

30. A method of processing a natural language clause, which, comprises steps

providing a data associated with clause implying word sense numbers base of purpose relation data such that said purpose relation is a concept that labels one clause implying word sense number or more than one related clause implying word sense number,

providing natural language clauses with associated said clause implying word sense numbers,

purpose relation identification processing of said clause implying word sense numbers from said natural language and said purpose relation data associated with said clause implying word sense numbers such that each of said one or more clause implying word sense numbers has zero or more purpose relations which are associated with more than one said clause identified for each.

31. A method of processing experience and knowledge, which comprises steps

providing said experience and knowledge data base which is comprised of directed graphs comprised of nodes with associated clause implying word sense numbers organized into paths of said nodes such that said nodes have access conditions which determine the zero or more next said nodes on the zero or more said paths that are accessible,

purpose relation path identification processing to find zero or more said paths between said nodes with reference to said experience and knowledge data base such that said access conditions of said nodes on said found paths are met.

32. A method of processing experience and knowledge, which comprises steps

providing said experience and knowledge data base which is comprised of directed graphs comprised of nodes with associated clause implying word sense numbers organized into paths of said nodes,

providing optional check requirements,

purpose relation path identification processing to find zero or more said paths between said nodes with reference to said experience and knowledge data base such that said clause implying word sense numbers of said nodes on said found paths meet optional check requirements.

33. A method of natural language generation processing, which comprises steps

providing one or more word sense numbers,

providing a dictionary data base wherein said dictionary data base contains a plurality of entries which are comprised of syntax usage data, associated word sense numbers having state representation data and/or function codes,

accessing said natural language word which is associated with said dictionary data base with said word sense number,

providing a grammar specification,

utilizing said syntax usage data and said natural language words which are from said dictionary data base entries and which are associated with said one or more word sense numbers with reference to said grammar specification to generate outgoing natural language.

34. A method of processing natural language, which comprises steps

providing electronically encoded data which is representative of said natural language,

providing a dictionary data base wherein said dictionary data base contains a plurality of entries which are comprised of one or more of syntax usage data, associated word sense numbers and/or function codes,

lexically processing said electronically encoded data to access said dictionary data base such that an indication of any natural language word with one or more prefixes and/or one or more suffixes is provided,

providing a grammar specification,

utilizing said syntax data which are from said dictionary data base entry and which are associated with said natural language word with reference to said grammar specification to produce output data representative of a grammatical parse of said natural language, said output data including selected syntax usage, and indication of any ellipsis and morphological words with no prefixes and no suffixes,

accessing said one or more word sense numbers that are in said dictionary data base and that are associated with said selected syntax usage data from said grammar specification for said natural language word with one or more word sense numbers,

accessing said one or more function codes that are in said dictionary data base and that are associated with said selected syntax usage data from said grammar specification for said natural language word with one or more function codes,

providing morphological realizations which are associated with one or more prefixes and/or one or more suffixes,

morphologically processing said natural language word with one or more prefixes and/or one or more suffixes and said morphological realizations into one or more alternative partitions comprising one or more word sense numbers and/or one or more function codes,

providing morphological realizations which are associated with morphological words with no prefixes and no suffixes,

morphologically processing said natural language word with no prefixes and no suffixes and said morphological realizations into one or more alternative

partitions comprising one or more word sense numbers and/or one or more function codes, elliptically processing said natural language clause or phrase with ellipsis to select a replacement of one or more ellipted words,

function word processing of said one or more natural language words with one or more function codes,

word sense number selection processing of said one or more natural language words with one or more word sense numbers,

processing the context of said natural language such that data related to said natural language, including word sense numbers, is updated and stored,

providing purpose relations such that said purpose relation is a concept that labels one clause or more than one related clause,

purpose relation identification processing of one or more clause implying word sense numbers from said natural language such that each of said one or more clause implying word sense numbers has one or more purpose relations identified for each,

providing an experience and knowledge data base wherein said experience and knowledge data base is comprised of directed graphs comprised of nodes with associated clause implying word sense numbers organized into paths of said nodes such that said nodes have access conditions which determine the zero or more next said nodes on the zero or more said paths that are accessible,

purpose path identification processing to find zero or more said paths between said nodes with reference to said experience and knowledge data base such that said access conditions of said nodes on said found paths are met,

communication processing such that a communication is generated such that said communication contains one or more word sense numbers and/or one or more function codes,

natural language generation processing such that outgoing natural language is generated from one or more word sense numbers, and/or one or more function codes.

35. A method of processing as defined in claim 34, which comprises steps

providing optional check requirements,

purpose path identification processing to find zero or more said paths between said nodes with reference to said experience and knowledge data base such that said clause implying word sense numbers of said nodes on said found paths meet optional check requirements.

36. A method of processing natural language, which comprises steps

providing electronically encoded data which is representative of said natural language,

providing an experience and knowledge data base wherein said experience and knowledge data base is comprised of directed graphs comprised of nodes with associated natural language clauses or equivalent derivations which represent said natural language clauses'"'"' conceptually related natural language clauses wherein said nodes are organized into paths of said nodes such that said nodes have access conditions which determine the zero or more next said nodes on the zero or more said paths that are accessible,

processing said electronically encoded data to identify said natural language clauses,

processing said identified natural language clauses such that said node in said experience and knowledge base which is associated with said conceptually related natural language clause or equivalent derivation which represents said identified natural language clause is selected,

purpose path identification processing for said selected nodes of said identified natural language clauses to find zero or more said paths between said nodes with reference to said experience and knowledge data base such that said access conditions of said nodes on said found paths are met.

37. A method of processing natural language, which comprises steps

providing electronically encoded data which is representative of said natural language,

providing a dictionary data base wherein said dictionary data base contains a plurality of entries which are comprised of one or more of syntax usage data, associated word sense numbers and/or function codes,

lexically processing said electronically encoded data to access said dictionary data base,

providing a grammar specification,

utilizing said syntax usage data which are from said dictionary data base entry and which are associated with said natural language word with reference to said grammar specification to produce output data representative of a grammatical parse of said natural language,

providing an experience and knowledge data base wherein said experience and knowledge data base is comprised of directed graphs comprised of nodes with associated clause implying word sense numbers organized into paths of said nodes,

providing optional check requirements,

purpose path identification processing to find zero or more said paths between said nodes with reference to said experience and knowledge data base such that said clause implying word sense numbers of said nodes on said found paths meet optional check requirements.

38. A method of processing natural language, which comprises steps

providing electronically encoded data which is representative of said natural language,

providing a dictionary data base wherein said dictionary data base contains a plurality of entries which are comprised of one or more of syntax usage data, associated word sense numbers and/or function codes,

processing word sense numbers and function codes,

providing an experience and knowledge data base wherein said experience and knowledge data base is comprised of directed graphs comprised of nodes with associated clause implying word sense numbers organized into paths of said nodes,

providing optional check requirements,

purpose path identification processing to find zero or more said paths between said nodes with reference to said experience and knowledge data base such that said clause implying word sense numbers of said nodes on said found paths meet optional check requirements.

39. A method of processing natural language, which comprises steps

providing a data base of purpose relation data such that said purpose relation is a concept that labels one clause implying word sense number or more than one related clause implying word sense number,

providing natural language with associated said clause implying word sense numbers,

purpose relation identification processing of said one or more clause implying word sense numbers from said natural language such that each of said one or more clause implying word sense numbers has one or more purpose relations identified for each,

providing an experience and knowledge data base wherein said experience and knowledge data base is comprised of directed graphs comprised of nodes with associated clause implying word sense numbers organized into paths of said nodes,

providing optional check requirements,

purpose path identification processing to find zero or more said paths between said nodes with reference to said experience and knowledge data base such that said clause implying word sense numbers of said nodes on said found paths meet optional check requirements.