DATA PROCESSING DEVICE, DATA PROCESSING METHOD, AND DATA PROCESSING PROGRAM

• US 20100063795A1
• Filed: 08/02/2006
• Published: 03/11/2010
• Est. Priority Date: 08/04/2005
• Status: Active Grant

• Current Assignee: NEC Corporation
• Original Assignee: NEC Corporation
• Inventors: IKEDA, Takahiro, IKEDA, Yoshihiro, SAKAO, Yousuke, SATOH, Kenji
• Granted Patent: US 8,775,158 B2
• Time in Patent Office: Days
• US Class Current: 704/9
• CPC Class Codes: G06F 16/313 Selection or weighting of terms for indexing
• CPC Class Codes: G06F 40/30 Semantic analysis

Abstract

[PROBLEMS] To provide a data processing device such as a text mining device capable of extracting characteristic structures properly even in case a plurality of words indicating identical contents or a plurality of words semantically associated are contained in input data. [MEANS FOR SOLVING PROBLEMS] Association node extraction unit (22) of a text mining device (10) extracts association nodes containing semantically associated words from a graph obtained as a result of syntax analysis. Association node joint unit (23) transforms the graph by joint of a part of or a whole of the association nodes. Characteristic structure extraction unit (24) extracts a characteristic structure from the graph transformed by the association node joint unit.

Claims

1-16. -16. (canceled)

17. A data processing device generating a graph which expresses an input data structure by a plurality of nodes having a single word as content thereof and by a dependency branch connecting two nodes in a dependent relationship within the plurality of nodes, and extracting a characteristic structure characterizing the input data from the graph, the device comprising:

an association node extraction unit for extracting association nodes, which are nodes semantically associated with each other, from the nodes;

an association node joint unit for transforming the graph by joint of a part of or a whole of the association nodes; and

a characteristic structure extraction unit for extracting the characteristic structure from a transformed graph by the association node joint unit.

18. The data processing device, as claimed in claim 17, wherein

the association node joint unit has a function of categorizing the association nodes into strong association nodes which are in a strong semantic association and weak association nodes which are in a weak semantic association, and a function of joining the strong association nodes into one node.

19. The data processing device, as claimed in claim 18, wherein

the association node joint unit has a function of connecting the weak association nodes by a semantic association branch, and

the characteristic structure extraction unit has a function in which a partial structure of the graph is not extracted as the characteristic structure when the partial structure includes nodes connected by the semantic association branch, in addition, at least one of those nodes is not connected with another node by the dependency branch.

20. The data processing device, as claimed in claim 19, wherein

the association node extraction unit has a function of anaphoric node extraction for extracting anaphoric nodes including a pronoun or a zero pronoun, and an antecedent in an anaphoric relationship, as the association node, and

the association node joint unit has a function of node categorization for categorizing the anaphoric nodes as the strong association node.

21. The data processing device, as claimed in claim 19, wherein

the association node extraction unit has a function of same surface node extraction for extracting same surface nodes including words in the same surface as the association nodes, and

the association node joint unit has a function of node categorization for categorizing the same surface nodes as the weak association nodes.

22. The data processing device, as claimed in claim 19, wherein

the association node extraction unit has a function of synonymous node extraction for extracting synonymous nodes including words regarded as synonyms in a thesaurus as the association nodes, and

the association node joint unit has a function of node categorization for categorizing the synonymous nodes into the weak association nodes.

23. The data processing device, as claimed in claim 19, wherein

the association node extraction unit has a function of designated synonymous node extraction for extracting designated synonymous nodes including synonyms designated by a user as the association nodes, and

the association node joint unit has a function of node categorization for categorizing the designated synonymous nodes as the weak association nodes.

24. The data processing device, as claimed in claim 19, wherein

the association node extraction unit has a function of related word node extraction for extracting related word nodes including words regarded as related words in a thesaurus as the association nodes,

the association node joint unit has a function of node categorization for categorizing the related word nodes into the weak association nodes.

25. The data processing device, as claimed in claim 19, wherein

the association node extraction unit has a function of designated related word node extraction for extracting designated related word nodes including related words designated by a user as the association nodes,

the association node joint unit has a function of node categorization for categorizing the designated related word nodes as the weak association nodes.

26. The data processing device, as claimed in claim 18, comprising:

a semantic association level calculation unit for calculating a semantic association level which indicates strength of semantic association between words included in the association nodes;

wherein

the association node joint unit categorizes the association nodes into the strong association nodes and the weak association nodes based on the semantic association level.

27. The data processing device, as claimed in claim 26, wherein

the association node joint unit categorizes the association nodes, of which the semantic association level is less than a first threshold, as the weak association nodes, and categorizes the association nodes, of which the semantic association level is equal to the first threshold or more, into the strong association node.

28. The data processing device, as claimed in claim 27, wherein

the association node joint unit does not join the association nodes of which the semantic association level is less than a second threshold.

29. A data processing means for generating a graph which expresses an input data structure by a plurality of nodes having a single word as content thereof and by a dependency branch connecting two nodes in a dependent relationship within the plurality of nodes, and extracting a characteristic structure characterizing the input data from the graph, the means comprising:

an association node extraction means for extracting association nodes, which are nodes semantically associated with each other, from the nodes;

an association node joint means for transforming the graph by joint of a part of or a whole of the association nodes; and

a characteristic structure extraction means for extracting the characteristic structure from a transformed graph by the association node joint unit.

30. A data processing method generating a graph which expresses an input data

structure by a plurality of nodes having a single word as content thereof and by a dependency branch which connects two nodes in a dependent relationship within the plurality of nodes, and extracting a characteristic structure characterizing the input data from the graph, the method comprising:

extracting association nodes, which is nodes semantically associated, from the nodes;

transforming the graph by joint of a part of or a whole of the association nodes; and

extracting the characteristic structure from the transformed graph.

31. A data processing program making a computer execute the functions of:

generating a graph which expresses an input data structure by a plurality of nodes having a single word as content thereof and by a dependency branch connecting two nodes in a dependent relationship within the plurality of nodes;

extracting a characteristic structure characterizing the input data from the graph;

association node extraction for extracting association nodes, which are nodes semantically associated, from the nodes;

association node joint for transforming the graph by joint of a part of or a whole of the association nodes; and

characteristic structure extraction for extracting the characteristic structure from the transformed graph.

32. A data processing device,

expressing a dependent relationship between words in a text by a first type of branch;

expressing a relationship of semantic similarity between words by a second type of branch; and

determining a characteristic part of the text by analysis of a graph structure including the first type of branch and the second type of branch, distinguishing the first and the second type of branches.

33. A data processing means for:

expressing a dependent relationship between words in a text by a first type of branch;

expressing a relationship of semantic similarity between words by a second type of branch; and

determining a characteristic part of the text by analysis of a graph structure including the first type of branch and the second type of branch, distinguishing the first and the second type of branches.

34. A data processing method for which a data processing device for determining a characteristic part of a text by analysis of a dependency relationship between words in the text, the method comprising:

determining the characteristic part in the text, when there are a plurality of semantically similar words, by joint of dependency on the plurality of semantically similar words into any of the plurality of words.