TEXT ANALYSIS TECHNIQUES

• US 20080109454A1
• Filed: 11/03/2006
• Published: 05/08/2008
• Est. Priority Date: 11/03/2006
• Status: Abandoned Application

• Current Assignee: Battelle Memorial Institute
• Original Assignee: Battelle Memorial Institute
• Inventors: Turner, Alan E., Hetzler, Elizabeth G., Tanasse, Theodore E., Havre, Susan L., MacGregor, Margaret, Nancarrow, Catherine, Willse, Alan R., Hope, Lawrence L., Nakamura, Grant C.
• Application Number:
  US11/556,437
• Publication Number:
  US 20080109454A1
• Time in Patent Office: Days
• US Class Current: 707/100
• CPC Class Codes: G06F 16/313 Selection or weighting of terms for indexing

Abstract

One embodiment of the present invention includes means determining a concept representation for a set of text documents based on partial order analysis and modifying this representation if it is determined to be unidentifiable. Furthermore, the embodiment includes means for labeling the representation, mapping documents to it to provide a corresponding document representation, generating a number of document signatures each of a different type, and performing several data processing applications each with a different one of the document signatures of differing types.

Claims

1-40. -40. (canceled)

41. A method, comprising:

identifying a number of events;

providing a visualization of the events with a computer system, the visualization including a number of visualization objects each representing a different one of the events;

positioning each of the visualization objects along a first axis to indicate timing of each of the events relative to one another with a corresponding initiation time and a corresponding termination time of each of the events being represented by an initiation point and termination point of each of the visualization objects along the first axis; and

dimensioning each of the visualization objects between the corresponding initiation point and the corresponding termination point along the first axis to indicate event duration and along a second axis to indicate relative strength of the different one of the events.

42. The method of claim 41, wherein said identifying includes relating each of the events to a combination of terms.

43. The method of claim 42, wherein the visualization objects are each comprised of a number of components, the components each corresponding to one of the terms of the combination for the respective one of the visualization objects.

44. The method of claim 43, wherein the components of the respective one of the visualization objects are each differently colored in the visualization.

45. The method of claim 41, which includes providing graphic user interfacing with the visualization to select a time window for display of event details.

46. The method of claim 45, wherein the event details include a display of the combination of terms for each of the visualization objects included in the time window.

47. The method of claim 41, wherein the events are determined from a set of text documents.

48. The method of claim 47, wherein the events are determined with a concept representation of text documents.

49. A method, comprising:

providing a set of text documents;

evaluating time variation of a number of terms included in the documents;

generating a number of clusters corresponding to the documents with a computer system as a function of the terms; and

identifying a number of events as a function of a time variation of the clusters.

50. The method of claim 49, wherein said evaluating includes:

determining presence of a word in the documents for each of several different segments of a time period; and

establishing a degree of time variation of the word as a function of the one of the segments with a frequency of the word greater than other of the segments and a quantity of the documents including the word.

51. The method of claim 49, wherein said generating is performed with the terms having a selected level of time variation.

52. The method of claim 49, wherein said generating adjusts term weighting in accordance with said evaluating.

53. The method of claim 49, which includes:

displaying the events in a visualization including a number of visualization objects each representative of a different one of the events;

positioning each of the visualization objects along a first axis to indicate timing of each of the events relative to one another with a corresponding initiation time and a corresponding termination time of each of the events being represented by an initiation point and termination point of each of the visualization objects along the first axis; and

dimensioning each of the visualization objects between the corresponding initiation point and the corresponding termination point along the first axis to indicate event duration and along a second axis to indicate relative strength of the different one of the events.

54. The method of claim 49, wherein said generating is performed based on document signatures determined from a concept representation.

55. A method, comprising:

providing a number of textual documents arranged relative to a period of time;

identifying a feature with a time varying distribution among the documents;

evaluating presence of the feature for each of several different segments of the time period; and

detecting an event as a function of the one of the segments with a frequency of the feature greater than other of the segments and a quantity of the documents corresponding to the feature.

56. The method of claim 55, wherein the feature is a term.

57. The method of claim 55, wherein the feature is a document cluster.

58. The method of claim 55, which includes identifying a number of other events.

59. The method of claim 55, which includes providing an event visualization.

60. The method of claim 55, which includes preparing a document signature from a concept representation for event detection processing.