Method and system for searching text portions based upon occurrence in a specific area

• US 20040111404A1
• Filed: 08/28/2003
• Published: 06/10/2004
• Est. Priority Date: 08/29/2002
• Status: Abandoned Application

• Current Assignee: Ricoh Company Limited
• Original Assignee: Ricoh Company Limited
• Inventors: Mano, Hiroko, Itoh, Hideo
• Application Number:
  US10/650,444
• Publication Number:
  US 20040111404A1
• Time in Patent Office: Days
• US Class Current: 707/3
• CPC Class Codes: G06F 40/289 Phrasal analysis, e.g. finite state techniques or chunking
• CPC Class Codes: G06F 40/35 Discourse or dialogue representation

Abstract

A text processor or text processing software determines a significance value of a search word based upon the word occurrence in a specified part of a predetermined text database. After a search request is inputted and parsed, each of the search word candidates is searched in a specified portion of the predetermined text database. For example, a search word candidate is searched only in a near portion or area of the predetermined text database to determine its specific area occurrence value. The above determined specific area occurrence value is used in the subsequent steps or tasks to accomplish a desired task.

Claims

1. A method of processing text data, comprising the steps of:

inputting text data;

parsing the text data into word candidates;

removing predetermined words from the word candidates;

specifying an area of a predetermined text database; and

determining a specific area occurrence value of each of the word candidates in the specified area in the predetermined text database.

2. The method of processing text data according to claim 1 wherein the specified area is a header area.

3. The method of processing text data according to claim 2 wherein the specific area occurrence value is determined according to a following equation:

4. The method of processing text data according to claim 1 wherein the specified area is a summary area.

5. The method of processing text data according to claim 4 wherein the specific area occurrence value is determined according to a following equation:

6. The method of processing text data according to claim 1 wherein the specified area is a combination of a header area and a summary area.

7. The method of processing text data according to claim 6 wherein the specific area occurrence value is determined according to a following equation:

8. The method of processing text data according to claim 6 wherein the specific area occurrence value is determined according to a following equation:

9. The method of processing text data according to claim 1 further comprising an additional step of determining a search word significance value based upon a following equation:

10. The method of processing text data according to claim 1 further comprising an additional step of:

determining a search word significance value based upon a following equation;

$\begin{array}{c}\begin{array}{c}\mathrm{the}<br><br>\text{\hspace{1em}<br><br>}<br><br>\mathrm{search}<br><br>\text{\hspace{1em}<br><br>}<br><br>\mathrm{word}\\ \mathrm{significance}<br><br>\text{\hspace{1em}<br><br>}<br><br>\mathrm{value}\end{array}=<br><br>a<br><br>\text{\hspace{1em}<br><br>}<br><br>\mathrm{corresponding}<br><br>\text{\hspace{1em}<br><br>}<br><br>\mathrm{predetermined}<br><br>\text{\hspace{1em}<br><br>}<br><br>\mathrm{word}\\ <br><br>\mathrm{weight}\times <br><br>\mathrm{the}<br><br>\text{\hspace{1em}<br><br>}<br><br>\mathrm{specific}<br><br>\text{\hspace{1em}<br><br>}<br><br>\mathrm{area}<br><br>\text{\hspace{1em}<br><br>}<br><br>\mathrm{occurrence}<br><br>\text{\hspace{1em}<br><br>}<br><br>\mathrm{value}\times <br><br>\\ <br><br>a<br><br>\text{\hspace{1em}<br><br>}<br><br>\mathrm{number}<br><br>\text{\hspace{1em}<br><br>}<br><br>\mathrm{of}<br><br>\text{\hspace{1em}<br><br>}<br><br>\mathrm{occurrences}<br><br>\text{\hspace{1em}<br><br>}<br><br>\mathrm{of}<br><br>\text{\hspace{1em}<br><br>}<br><br>\mathrm{the}<br><br>\text{\hspace{1em}<br><br>}<br><br>\mathrm{word}\\ <br><br>\mathrm{candidate}<br><br>\text{\hspace{1em}<br><br>}<br><br>\mathrm{within}<br><br>\text{\hspace{1em}<br><br>}<br><br>\mathrm{the}<br><br>\text{\hspace{1em}<br><br>}<br><br>\mathrm{text}<br><br>\text{\hspace{1em}<br><br>}<br><br>\mathrm{data}.\end{array}$

11. The method of processing text data according to claim 1 further comprising additional steps of:

selecting search words from the word candidates based upon the specific area occurrence value; and

extracting sentences from the predetermined text database based upon the selected search words.

12. The method of processing text data according to claim 1 further comprising an additional step of selecting keywords from the word candidates based upon the specific area occurrence value.

13. The method of processing text data according to claim 1 further comprising additional steps of:

selecting keywords from the word candidates based upon the specific area occurrence value; and

generating a summary from the predetermined text database based upon the selected keywords.

14. The method of processing text data according to claim 1 further comprising additional steps of:

selecting classification keywords from the word candidates based upon the specific area occurrence value; and

classifying the predetermined text database based upon the selected classification keywords.

15. The method of processing text data according to claim 1 further comprising additional steps of:

determining a first text database occurrence value of the word candidates in a first text database;

determining a second text database occurrence value of the word candidates in a second text database;

determining a database occurrence value based upon the first text database occurrence value and the second text database occurrence value in a predetermined manner;

selecting search words from the word candidates based upon in part the database occurrence value; and

extracting sentences from a predetermined text database based upon the selected search words.

16. The method of processing text data according to claim 15 wherein the database occurrence value is determined by a following equation:

17. The method of processing text data according to claim 15 wherein the database occurrence value is determined by a following equation:

18. The method of processing text data according to claim 15 further comprising an additional step of determining a search word significance value based upon a following equation:

19. A method of processing text data, comprising the steps of:

inputting text data;

parsing the text data into word candidates;

removing predetermined words from the word candidates;

determining a first text database occurrence value of the word candidates in a first text database;

determining a second text database occurrence value of the word candidates in a second text database;

determining a database occurrence value based upon the first text database occurrence value and the second text database occurrence value in a predetermined manner;

selecting search words from the word candidates based upon in part the database occurrence value; and

extracting sentences from a predetermined text database based upon the selected search words.

20. The method of processing text data according to claim 19 wherein the database occurrence value is determined by a following equation:

21. The method of processing text data according to claim 19 wherein the database occurrence value is determined by a following equation:

22. The method of processing text data according to claim 19 further comprising an additional step of determining a search word significance value based upon a following equation:

23. A computer program for processing text data, performing the tasks of:

inputting text data;

parsing the text data into word candidates;

removing predetermined words from the word candidates;

specifying an area of a predetermined text database; and

determining a specific area occurrence value of each of the word candidates in the specified area in the predetermined text database in a predetermined manner.

24. The computer program for processing text data according to claim 23 wherein the specified area is a header area.

25. The computer program for processing text data according to claim 24 wherein the specific area occurrence value is determined according to a following equation:

26. The computer program for processing text data according to claim 23 wherein the specified area is a summary area.

27. The computer program for processing text data according to claim 26 wherein the specific area occurrence value is determined according to a following equation:

28. The computer program for processing text data according to claim 23 wherein the specified area is a combination of a header area and a summary area.

29. The computer program for processing text data according to claim 28 wherein the specific area occurrence value is determined according to a following equation:

30. The computer program for processing text data according to claim 28 wherein the specific area occurrence value is determined according to a following equation:

31. The computer program for processing text data according to claim 23 further comprising an additional task of determining a search word significance value based upon a following equation:

32. The computer program for processing text data according to claim 23 further performing an additional task of determining a search word significance value based upon a following equation:

33. The computer program for processing text data according to claim 23 further performing additional tasks of:

selecting search words from the word candidates based upon the specific area occurrence value; and

extracting sentences from the predetermined text database based upon the selected search words.

34. The computer program for processing text data according to claim 23 further performing an additional task of selecting keywords from the word candidates based upon the specific area occurrence value.

35. The computer program for processing text data according to claim 23 further performing additional tasks of:

selecting keywords from the word candidates based upon the specific area occurrence value; and

generating a summary from the predetermined text database based upon the selected keywords.

36. The computer program for processing text data according to claim 23 further performing additional tasks of:

selecting classification keywords from the word candidates based upon the specific area occurrence value; and

classifying the predetermined text database based upon the selected classification keywords.

37. The computer program for processing text data according to claim 23 further performing additional task of:

determining a first text database occurrence value of the word candidates in a first text database;

determining a second text database occurrence value of the word candidates in a second text database;

determining a database occurrence value based upon the first text database occurrence value and the second text database occurrence value in a predetermined manner;

selecting search words from the word candidates based upon in part the database occurrence value; and

extracting sentences from the predetermined text database based upon the selected search words.

38. The computer program for processing text data according to claim 37 wherein the database occurrence value is determined by a following equation:

39. The computer program for processing text data according to claim 37 wherein the database occurrence value is determined by a following equation:

40. The computer program for processing text data according to claim 37 further performing an additional task of determining a search word significance value based upon a following equation:

41. A computer program for processing text data, performing the tasks of:

inputting text data;

parsing the text data into word candidates;

removing predetermined words from the word candidates;

determining a first text database occurrence value of the word candidates in a first text database;

determining a second text database occurrence value of the word candidates in a second text database;

determining a database occurrence value based upon the first text database occurrence value and the second text database occurrence value in a predetermined manner;

selecting search words from the word candidates based upon in part the database occurrence value; and

extracting sentences from the predetermined text database based upon the selected search words.

42. The computer program for processing text data according to claim 41 wherein the database occurrence value is determined by a following equation:

43. The computer program for processing text data according to claim 41 wherein the database occurrence value is determined by a following equation:

44. The computer program for processing text data according to claim 41 further comprising an additional step of determining a search word significance value based upon a following equation:

45. A apparatus for processing text data, comprising:

an input unit for inputting text data;

a search word selection unit connected to said input unit for parsing the text data into word candidates, said search word selection unit removing predetermined words from the word candidates;

an area specification unit for specifying an area of a predetermined text database; and

a specific area occurrence determination unit connected to said search word selection unit and said area specification unit for determining a specific area occurrence value of each of the word candidates in the specified area in the predetermined text database.

46. The apparatus for processing text data according to claim 45 wherein the specified area is a header area.

47. The apparatus for processing text data according to claim 46 wherein said specific area occurrence determination unit determines the specific area occurrence value according to a following equation:

48. The apparatus for processing text data according to claim 45 wherein the specified area is a summary area.

49. The apparatus for processing text data according to claim 48 wherein said specific area occurrence determination unit determines the specific area occurrence value according to a following equation:

50. The apparatus for processing text data according to claim 45 wherein the specified area is a combination of a header area and a summary area.

51. The apparatus for processing text data according to claim 50 wherein said specific area occurrence determination unit determines the specific area occurrence value according to a following equation:

52. The apparatus for processing text data according to claim 50 wherein said specific area occurrence determination unit determines the specific area occurrence value according to a following equation:

53. The apparatus for processing text data according to claim 45 wherein said search word selection unit further determines a search word significance value based upon a following equation:

54. The apparatus for processing text data according to claim 45 wherein said search word selection unit further determines a search word significance value based upon a following equation:

55. The apparatus for processing text data according to claim 45 further comprising a text selection unit connected to said specific area occurrence determination unit for selecting search words from the word candidates based upon the specific area occurrence value, said text selection unit extracting sentences from the predetermined text database based upon the selected search words.

56. The apparatus for processing text data according to claim 45 further comprising a keyword extraction unit connected to said specific area occurrence determination unit for selecting keywords from the word candidates based upon the specific area occurrence value.

57. The apparatus for processing text data according to claim 45 further comprising:

a keyword extraction unit connected to said specific area occurrence determination unit for selecting keywords from the word candidates based upon the specific area occurrence value; and

a summary generation unit connected to said keyword extraction unit for generating a summary from the predetermined text database based upon the selected keywords.

58. The apparatus for processing text data according to claim 45 further comprising:

a classification keyword selection unit connected to said specific area occurrence determination unit for selecting classification keywords from the word candidates based upon the specific area occurrence value; and

a classification unit connected to said classification keyword selection unit for classifying the predetermined text database based upon the selected classification keywords.

59. The apparatus for processing text data according to claim 45 further comprising:

a database occurrence determination unit connected to said search word selection unit for determining a first text database occurrence value of the word candidates in a first text database and a second text database occurrence value of the word candidates in a second text database, said database occurrence determination unit further determining a database occurrence value based upon the first text database occurrence value and the second text database occurrence value in a predetermined manner, wherein said search word selection unit selects search words from the word candidates based upon in part the database occurrence value; and

a text selection unit connected to said search word selection unit for extracting sentences from the predetermined text database based upon the selected search words.

60. The apparatus for processing text data according to claim 59 wherein said database occurrence determination unit determines the database occurrence value based upon a following equation:

61. The apparatus for processing text data according to claim 59 wherein said database occurrence determination unit determines the database occurrence value based upon a following equation:

62. The apparatus for processing text data according to claim 45 wherein said search word selection unit further determines a search word significance value based upon a following equation:

63. A apparatus for processing text data, comprising:

an input unit for inputting text data;

a search word selection unit connected to said input unit for parsing the text data into word candidates, said search word selection unit removing predetermined words from the word candidates;

a database occurrence determination unit connected to said search word selection unit for determining a first text database occurrence value of the word candidates in a first text database and a second text database occurrence value of the word candidates in a second text database, said database occurrence determination unit further determining a database occurrence value based upon the first text database occurrence value and the second text database occurrence value in a predetermined manner, wherein said search word selection unit selects search words from the word candidates based upon in part the database occurrence value; and

a text selection unit connected to said search word selection unit for extracting sentences from the predetermined text database based upon the selected search words.

64. The apparatus for processing text data according to claim 63 wherein said database occurrence determination unit determines the database occurrence value based upon a following equation:

65. The apparatus for processing text data according to claim 63 wherein said database occurrence determination unit determines the database occurrence value based upon a following equation:

66. The apparatus for processing text data according to claim 63 wherein said search word selection unit further determines a search word significance value based upon a following equation: