Method for mining, mapping and managing organizational knowledge from text and conversation

• US 20020116170A1
• Filed: 12/17/2001
• Published: 08/22/2002
• Est. Priority Date: 12/15/2000
• Status: Active Grant

• Current Assignee: Arizona Board of Regents (University of Arizona)
• Original Assignee: Arizona Board of Regents (University of Arizona)
• Inventors: Dooley, Kevin J., Corman, Steven R.
• Granted Patent: US 7,165,023 B2
• Time in Patent Office: Days
• US Class Current: 704/1
• CPC Class Codes: G06F 40/211 Syntactic parsing, e.g. based on context-free grammar [CFG] or unification grammars

Abstract

A network text analysis called center resonance analysis (CRA) is presented which represents texts (or transcribed conversations) as networks of centering words. The networks of centering words are components of utterances or (specifically noun phrases) that authors and/or speakers deploy in a manner that makes their utterances coherent. A CRA network can be derived for any text, and abstractly represents its main concepts, their influence, and their interrelationships.

Claims

1. A method for categorizing text comprising the steps of:

dividing the text into sentences;

parsing the sentences into one or more noun phrases;

converting words in the noun phrases into networks of word relationships; and

analyzing the word relationship networks to determine the influence of each word.

2. The method of claim 1 wherein the step of parsing the sentences into one or more noun phrases comprises the step of substituting disambiguated nouns in place of pronouns which are related to text analysis.

3. The method of claim 1 wherein the step of parsing the sentences into one or more noun phrases further comprises the step of converting plural words to their singular form.

4. The method of claim 1 wherein the step of converting the word or words into networks of relationships comprises the step of linking all sequentially occurring noun phrases within a sentence.

5. The method of claim 4 wherein the step of converting the words into networks of word relationships further comprises the step of linking all possible pairs of words in the noun phrases having three or more words.

6. The method of claim 1 wherein the step of analyzing the word relationship networks to determine the influence of each word comprises the step of determining influence by utilizing between centrality.

7. The method of claim 1 wherein the step of analyzing the word relationship networks to determine the influence of each word comprises the step of determining influence by utilizing the following formula:

36. The method of claim 1 where the step of applying the analyzed network to perform a specific analysis task comprises the step of applying the analyzed network to perform at least one of visualization of the network to understand text, spatial modeling of resonance scores, information retrieval, and thematic analysis of collections.

8. A method for analyzing text comprising the steps of:

dividing the text into sentences;

parsing the sentences into one or more noun phrases;

converting one or more words within each of the noun phrases into networks of relationships between words;

analyzing the networks to determine the influence for each word; and

applying the analyzed networks to perform a specific analysis task.

9. The method of claim 8 wherein the step of parsing the sentences into one or more noun phrases further comprises the step of substituting disambiguated nouns in place of pronouns which are relevant to text analysis.

10. The method of claim 8 wherein the step of parsing the sentences into one or more noun phrases further comprises the step of converting plural words to their singular form.

11. The method of claim 8 wherein the step of converting the word or words into networks of relationships comprises the step of linking all sequentially occurring noun phrases within a sentence.

12. The method of claim 11 wherein the step of converting the words into networks of relationships between words further comprises the step of linking all possible pairs of words in the noun phrases having three or more words.

13. The method of claim 8 wherein the step of analyzing the networks to determine the influence of each word comprises the step of determining influence by utilizing between centrality.

14. The method of claim 8 wherein the step of analyzing the networks to determine the influence of each word comprises the step of determining influence by utilizing the following formula:

15. The method of claim 8 where the step of applying the analyzed network to perform a specific analysis task comprises the step of applying the analyzed network to perform at least one of visualization of the network to understand text, spatial modeling of resonance scores, information retrieval, and thematic analysis of collections.

16. A method for determining resonance based on common words in two sets of text comprising the step of utilizing the following formula:

17. The method of claim 16 further comprising the step of determining standardized resonance based on common words in texts A and B comprising the step of utilizing the following formula:

18. A method for determining pair resonance based on common word pairs in two sets of text comprising the step of utilizing the following formula, where influence is calculated according to claim 14:

19. The method of claim 18 further comprising the step of determining standardized resonance based on common word pairs in texts A and B comprising the step of utilizing the following formula:

20. A method for searching two or more texts utilizing resonance scores obtained in accordance with claim 16.

21. A method for searching two or more texts utilizing resonance scores obtained in accordance with claim 17.

22. A method for searching two or more texts utilizing resonance scores obtained in accordance with claim 18.

23. A method for searching two or more texts utilizing resonance scores obtained in accordance with claim 19.

24. A method for modeling two or more texts utilizing resonance scores obtained in accordance with claim 16.

25. A method for modeling two or more texts utilizing resonance scores obtained in accordance with claim 17.

26. A method for modeling two or more texts utilizing resonance scores obtained in accordance with claim 18.

27. A method for modeling two or more texts utilizing resonance scores obtained in accordance with claim 19.

29. The method of claim 28 wherein the step of compartmentalizing the text into defined units comprises the step of breaking down the text into sentences.

30. The method of claim 28 wherein the step of parsing the units into one or more noun phrases further comprises the step of substituting disambiguated nouns in place of pronouns which are relevant to text analysis.

31. The method of claim 28 wherein the step of parsing the units into one or more noun phrases further comprises the step of converting plural words to their singular form.

32. The method of claim 28 wherein the step of converting the word or words into networks of relationships comprises the step of linking all sequentially occurring noun phrases within a defined unit.

33. The method of claim 32 wherein the step of converting the word or words into networks of relationships further comprises the step of linking all possible pairs of words in those noun phrases having three or more words.

34. The method of claim 28 wherein the step of analyzing the network to determine the structural influence of each word comprises the step of determining structural influence by utilizing betweeness centrality.

35. The method of claim 28 wherein the step of analyzing the network to determine the structural influence of each word comprises the step of determining structural influence by utilizing the following formula:

37. A method for determining resonance based on common words in two sets of text comprising the step of utilizing the following formula:

38. The method of claim 37 further comprising the step of determining standardized resonance based on common words in texts A and B comprising the step of utilizing the following formula:

39. A method for determining pair resonance based on common word pairs in two sets of text comprising the step of utilizing the following formula, where influence is calculated in accordance with claim 35:

40. The method of claim 39 further comprising the step of determining standardized resonance based on common word pairs in texts A and B comprising the step of utilizing the following formula:

41. A method for searching two or more texts utilizing resonance scores obtained in accordance with claim 37.

42. A method for searching two or more texts utilizing resonance scores obtained in accordance with claim 38.

43. A method for searching two or more texts utilizing resonance scores obtained in accordance with claim 39.

44. A method for searching two or more texts utilizing resonance scores obtained in accordance with claim 40.

45. A method for modeling two or more texts utilizing resonance scores obtained in accordance with claim 37.

46. A method for modeling two or more texts utilizing resonance scores obtained in accordance with claim 38.

47. A method for modeling two or more texts utilizing resonance scores obtained in accordance with claim 39.

48. A method for modeling two or more texts utilizing resonance scores obtained in accordance with claim 40.

28. A method for analyzing text comprising the steps of:

a) compartmentalizing the text into defined units;

b) categorizing the defined units by;

parsing the units into one or more noun phrases each comprising one or more words;

converting the word or words into networks of relationships between words;

analyzing the networks of word associations to determine the structural influence of each word; and

c) applying the analyzed network to perform a specific analysis task.