Recognizing chemical names in a chinese document

• US 9,575,957 B2
• Filed: 08/30/2012
• Issued: 02/21/2017
• Est. Priority Date: 08/31/2011
• Status: Expired due to Fees

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Chen, Ying, Su, Zhong, Wu, Xian, Zhang, Li
• Primary Examiner(s): Spooner, Lamont
• Application Number:
  US13/598,692
• Publication Number:
  US 20130054226A1
• Time in Patent Office: 1,636 Days
• Field of Search: 704 1- 10
• US Class Current: 1/1
• CPC Class Codes: G06F 40/279 Recognition of textual entities

Abstract

A method and system for recognizing chemical names in a Chinese document. The method includes: receiving a Chinese document including chemical names; recognizing chemical name segments in the document; recognizing non-chemical name segments in the document; and combining the chemical name segments to get chemical names based on the recognized chemical name segments and non-chemical name segments. Specific embodiments of the present invention can effectively recognize chemical names from a chemical document.

Claims

1. A method comprising:

a computer device receiving a Chinese document including chemical names;

the computer device recognizing chemical name segments in said document;

the computer device recognizing non-chemical name segments in said document, wherein the computer device recognizing said non-chemical name segments in said document comprises;

segmenting said document into words;

checking whether each segmented word is in a non-chemical name segment dictionary;

provided that said segmented word is in said non-chemical name segment dictionary, determining said segmented word to be a non-chemical name segment; and

recording position information of said non-chemical name segment; and

the computer device combining said chemical name segments to get said chemical names based on said recognized chemical name segments and non-chemical name segments to recognize said chemical names in Chinese documents, wherein the computer device recognizing said chemical name segments in said document comprises;

segmenting said document into sentences;

matching all of said chemical name segments appearing in sentences of said document based on a chemical name segment dictionary;

recording position information of said chemical name segments; and

reducing said chemical name segments in a same sentence, wherein reducing said chemical name segments in a same sentence is performed according to a principle of matching the most chemical name segments with the least number of chemical name segments; and

wherein the computer device combining said chemical name segments to get said chemical name based on said recognized chemical name segments and non-chemical name segments comprises;

determining adjacent chemical name segments in a same sentence according to said position information of said chemical name segments;

checking whether there are non-chemical name segments between said adjacent chemical name segments based on said position information of said chemical name segments and non-chemical name segments; and

provided that there are no non-chemical name segments between said adjacent chemical name segments, combining said adjacent chemical name segments to get a chemical name.

2. The method according to claim 1, wherein said non-chemical name segments are used as separators in combining said chemical name segments to get said chemical names.

3. The method according to claim 1, further comprising:

the computer device extending towards both sides from positions of said chemical name segments until meeting non-chemical name segments, so as to obtain the chemical names.

4. The method according to claim 1, wherein:

said position information includes the start positions and end positions of one of said chemical name segments and non-chemical name segments in said document.

5. The method according to claim 1, further comprising at least one:

the computer device generating said chemical name segment dictionary from existing Chinese chemical names; and

the computer device forming said non-chemical name segment dictionary based on words with high frequency collected from Chinese documents in non-chemical fields.

6. The method according to claim 5, further comprising:

the computer device generating said chemical name segment dictionary from existing English chemical names.

7. A system comprising:

one or more processors, one or more computer-readable memories and one or more computer-readable, tangible storage devices;

a receiving module configured to receive a Chinese document including chemical names;

a first recognizing module configured to recognize chemical name segments in said document;

a second recognizing module configured to recognize non-chemical name segments in said document, wherein said second recognizing module comprises;

a word-segmenting module configured to segment said document into words;

a first checking module configured to check whether each segmented word is in a non-chemical name segment dictionary;

a first determining module configured to, provided that said segmented word is in said non-chemical name segment dictionary, determine said segmented word to be a non-chemical name segment; and

a second recording module configured to record position information of said non-chemical name segment; and

a combining module configured to combine said chemical name segments to get said chemical names based on said recognized chemical name segments and non-chemical name segments to recognize said chemical names in Chinese documents, wherein said first recognizing module comprises;

a sentence-segmenting module configured to segment said document into sentences;

a matching module configured to match all of said chemical name segments appearing in sentences of said document based on a chemical name segment dictionary;

a matching module configured to record position information of said chemical name segments; and

a reducing module configured to reduce said chemical name segments in a same sentence, wherein reducing said chemical name segments in a same sentence is performed according to a principle of matching the most chemical name segments with the least number of chemical name segments, and wherein said combining module further comprises;

a second determining module configured to determine adjacent chemical name segments in a same sentence according to said position information of said chemical name segments;

a second checking module configured to check whether there are non-chemical name segments between said adjacent chemical name segments based on said position information of said chemical name segments and non-chemical name segments; and

a combination executing module configured to, provided that there are no non-chemical name segments between said adjacent chemical name segments, combine said adjacent chemical name segments to get a chemical name.

8. The system according to claim 7, wherein said non-chemical name segments are used as separators in combining said chemical name segments to get said chemical names.

9. The system according to claim 7, wherein said system further comprises:

additional one or more processors, one or more computer-readable memories and one or more computer-readable, tangible storage devices; and

an extending module configured to extend towards both sides from the position of said chemical name segments until meeting non-chemical name segments, so as to obtain the chemical names.

10. The system according to 11, wherein:

said position information includes the start positions and end positions of one of said chemical name segments and non-chemical name segments in said document.

11. The system according to claim 7, further comprising at least one of:

additional one or more processors, one or more computer-readable memories and one or more computer-readable, tangible storage devices; and

a chemical name segment dictionary generating module configured to generate said chemical name segment dictionary from existing Chinese chemical names;

or

a non-chemical name segment dictionary generating module configured to form said non-chemical name segments dictionary based on words with high frequency collected from Chinese documents in non-chemical fields.

12. The system according to claim 11, wherein said chemical name segment dictionary generating module generates said chemical name segment dictionary from existing English chemical names.