Content information analyzing method and apparatus

• US 7,814,043 B2
• Filed: 02/10/2003
• Issued: 10/12/2010
• Est. Priority Date: 11/26/2001
• Status: Active Grant

• Current Assignee: Fujitsu Limited
• Original Assignee: Fujitsu Limited
• Inventors: Uchino, Kanji
• Primary Examiner(s): Lu; Kuen S
• Application Number:
  US10/360,751
• Publication Number:
  US 20030120649A1
• Time in Patent Office: 2,801 Days
• Field of Search: 707/3, 707/5, 707/10
• US Class Current: 707/748
• CPC Class Codes: G06F 16/30 of unstructured textual data document management systems G06F16/93

Abstract

This invention is to automatically extract noteworthy information from a large amount of information. First, a disclosure unit of an individual opinion such as a statement in a personal Web page or a bulletin board is extracted from collected content information, and information such as URL or statement number for specifying the disclosure unit of the individual opinion is registered. Next, an object such as company name or industry type of the individual opinion is specified. Then, the disclosed contents of the individual opinion are analyzed, so that an evaluation as to the object such as good evaluation or bad evaluation is specified. Besides, the reliability is determined based on referenced degree ranking and based on whether information to indicate the basis of the opinion or the identity of the speaker is included. Thus, the evaluation as to the object as characteristics of the individual opinion can be presented to requesters. Besides, for example, only a bad evaluation can be extracted from evaluations as to the object of the individual opinion. Furthermore, the opinion, which has a high influence degree and is noteworthy, can also be found based on the referenced degree ranking or the reliability.

Claims

1. A computer-implemented content information analyzing method, comprising:

extracting a disclosure unit of an individual opinion from collected content information, and storing information concerning said disclosure unit into a data storage;

specifying an object of said individual opinion, and storing said object of said individual opinion into said data storage;

specifying a category as to said object of said individual opinion, and storing the specified category into said data storage; and

analyzing a disclosed content of said individual opinion based on the specified category as to said individual opinion to specify an evaluation as to said object of said individual opinion, and storing said evaluation into said data storage, and

wherein said specifying a category comprises specifying an industry type of a company, which is an object of said individual opinion, by comparing terms in said disclosure unit of said individual opinion with feature words included in an industry type glossary storing said feature words corresponding to respective industry types.

2. The computer-implemented content information analyzing method as set forth in claim 1, wherein said extracting said disclosure unit of said individual opinion is carried out in descending order of a referenced degree for each said unit of said collected content information.

3. The computer-implemented content information analyzing method as set forth in claim 1, wherein said extracting comprises detecting a group of said disclosure units of said individual opinion by tracing a reference source of said individual opinion.

4. The computer-implemented content information analyzing method as set forth in claim 1, further comprising judging whether information that can be a basis of said individual opinion is included in said disclosure unit of said individual opinion.

5. The computer-implemented content information analyzing method as set forth in claim 1, further comprising specifying a genre of said disclosed content of said individual opinion.

6. The computer-implemented content information analyzing method as set forth in claim 1, further comprising determining reliability of said disclosure unit of said individual opinion.

7. The computer-implemented content information analyzing method as set forth in claim 6, wherein said determining comprises judging whether information indicating an identity of the individual is included in said disclosure unit of said individual opinion.

8. The computer-implemented content information analyzing method as set forth in claim 6, wherein said determining comprises extracting a Uniform Resource Locator (URL), from said disclosure unit of said individual opinion;

and determining said reliability based on a referenced degree of the extracted URL.

9. The computer-implemented content information analyzing method as set forth in claim 1, wherein said specifying an object of said individual opinion comprises specifying an object of said individual opinion by using a dictionary on at least one of a Uniform Resource Locator (URL), a company name, an abbreviation, and an industry type.

10. The computer-implemented content information analyzing method as set forth in claim 9, further comprising registering information concerning an industry type corresponding to a company name into said dictionary by using a URL of said collected content information and a similar URL registered in said dictionary.

11. The computer-implemented content information analyzing method as set forth in claim 9, further comprising registering an abbreviation into said dictionary by using anchored character information on said collected content information and a link destination URL of said collected content information.

12. The computer-implemented content information analyzing method as set forth in claim 9, further comprising registering information concerning an industry type corresponding to a company name into said dictionary by using information of a link topology obtained by analyzing a link relation among said collected content information.

13. The computer-implemented content information analyzing method as set forth in claim 9, further comprising extracting a feature word from said collected content information, specifying an industry type based on the extracted feature word by using a feature word dictionary including feature words as to respective industry types, and registering information concerning an industry type corresponding to a company name into said dictionary.

14. The computer-implemented content information analyzing method as set forth in claim 9, further comprising:

specifying a jump destination URL of a searcher that is registered in said dictionary from a search log for said collected content information; and

adding a search keyword included in said search log to said dictionary.

15. The computer-implemented content information analyzing method as set forth in claim 9, further comprising:

analyzing a plurality of search logs for the content information, each said search log including a search keyword and a jump destination, and specifying a domain to which a personal homepage belongs, based on a number of accesses and a number of kinds of search keywords; and

registering information concerning the specified domain of said company site into said dictionary.

16. The computer-implemented content information analyzing method as set forth in claim 9, further comprising:

analyzing a plurality of search logs for the content information, each said search log including a search keyword and a jump destination, and specifying a domain of a company site based on a number of accesses and a number of kinds of search keywords; and

registering information concerning the specified domain of said company site into said dictionary.

17. The computer-implemented content information analyzing method as set forth in claim 1, further comprising extracting a feature word from said collected content information in which an industry type is specified, and adding the extracted feature word into said industry type glossary correspondingly to said industry type.

18. The computer-implemented content information analyzing method as set forth in claim 1, further comprising identifying, in a search log for said collected content information, a keyword of a search in a state where an industry type is already specified, and registering the identified keyword as a feature word into said industry type glossary.

19. The computer-implemented content information analyzing method as set forth in claim 1, further comprising:

analyzing a plurality of search logs for the content information, each said search log including a search keyword and a jump destination, and specifying a domain to which a personal homepage including an individual opinion belongs based on a number of accesses and a number of kinds of search keywords; and

extracting said personal homepage belonging to said domain as said disclosure unit of said opinion of said individual.

20. The computer-implemented content information analyzing method as set forth in claim 1, further comprising:

analyzing a plurality of search logs for the content information, each said search log including a search keyword and a jump destination URL, and specifying a domain of a site of an individual or a small-scale organization, based on a number of accesses and a number of kinds of search keywords, said site including an individual opinion; and

extracting said site as said disclosure unit of said opinion of said individual.

21. The computer-implemented content information analyzing method as set forth in claim 1, wherein said collected content information includes a web page including a plurality of said disclosure units, and said extracting comprises:

detecting repeated character string pattern data specifying a start or an end of said disclosure unit of said individual opinion in said web page; and

dividing said web page based on said repeated pattern data into said disclosure unit of said individual opinion,

wherein said repeated character string pattern data includes a tag in Hyper Text Markup Language (HTML) source codes of said web page.

22. The computer-implemented content information analyzing method of claim 1, wherein said extracting further comprises:

collecting data of a plurality of web pages;

identifying a type of the collected web page based on at least one of a keyword included in a URL of said web page, data for specifying CGI included in said web page, and data of the HTML source included in said web page; and

storing data of a web page identified to be a specific type as said collected content information, and

wherein said specific type includes a bulletin board and personal homepage including an individual opinion.

23. The computer-implemented content information analyzing method as set forth in claim 1, wherein said collected content information includes a web page including a plurality of said disclosure units, and said extracting comprises:

detecting repeated HTML tag pattern data specifying a start or an end of said disclosure unit of said individual opinion in said web page; and

dividing said web page based on said repeated pattern data into said disclosure units of said individual opinion.

24. A computer-implemented content information analyzing apparatus, comprising:

a data storage;

an extractor that extracts a disclosure unit of an individual opinion from collected content information, and stores information concerning said disclosure unit into said data storage;

a specifying unit that specifies an object of said individual opinion, and stores said object of said individual opinion into said data storage;

a category specifying unit that specifies a category as to said object of said individual opinion, and stores the specified category into said data storage; and

an analyzer that analyzes a disclosed content of said individual opinion based on the specified category as to said individual opinion to specify an evaluation as to said object of said individual opinion, and stores said evaluation into said data storage, and

wherein said category specifying unit specifies an industry type of a company, which is an object of said individual opinion, by comparing terms in said disclosure unit of said individual opinion with feature words included in an industry type glossary storing said feature words corresponding to respective industry types.

25. The computer-implemented content information analyzing apparatus as set forth in claim 24, wherein said extractor extracts said disclosure unit of said individual opinion in descending order of a referenced degree for each said unit of said collected content information.

26. The computer-implemented content information analyzing apparatus as set forth in claim 24, wherein said extractor detects a group of said disclosure units of said individual opinion by tracing a reference source of said individual opinion.

27. The computer-implemented content information analyzing apparatus as set forth in claim 24, further comprising a unit that judges whether information that can be a basis of said individual opinion is included in said disclosure unit of said individual opinion.

28. The computer-implemented content information analyzing apparatus as set forth in claim 24, further comprising a unit that specifies a genre of said disclosed content of said individual opinion.

29. The computer-implemented content information analyzing apparatus as set forth in claim 24, further comprising a determining unit that determines reliability of said disclosure unit of said individual opinion.

30. The computer-implemented content information analyzing apparatus as set forth in claim 29, wherein said determining unit judges whether information indicating an identity of the individual is included in said disclosure unit of said individual opinion.

31. The computer-implemented content information analyzing apparatus as set forth in claim 29, wherein said determining unit extracts a Uniform Resource Locator (URL) from said disclosure unit of said individual opinion, and determines the reliability based on a referenced degree of the extracted URL.

32. The computer-implemented content information analyzing apparatus as set forth in claim 24, wherein said specifying unit specifies an object of said individual opinion by using a dictionary on at least one of a Uniform Resource Locator (URL), a company name, an abbreviation, and an industry type.

33. The computer-implemented content information analyzing apparatus as set forth in claim 32, further comprising a unit that registers information concerning an industry type corresponding to a company name into said dictionary by using a URL of said collected content information and a similar URL registered in said dictionary.

34. The computer-implemented content information analyzing apparatus as set forth in claim 32, further comprising a unit that registers an abbreviation into said dictionary by using anchored character information on said collected content information and a link destination URL of said collected content information.

35. The computer-implemented content information analyzing apparatus as set forth in claim 32, further comprising a unit that registers information concerning an industry type corresponding to a company name into said dictionary by using information of a link topology obtained by analyzing a link relation among said collected content information.

36. The computer-implemented content information analyzing apparatus as set forth in claim 32, further comprising a unit that extracts a feature word from said collected content information, specifies an industry type based on the extracted feature word by using a feature word dictionary including feature words as to respective industry types, and registers information concerning an industry type corresponding to a company name into said dictionary.

37. The computer-implemented content information analyzing apparatus as set forth in claim 32, further comprising:

a unit that specifies a jump destination URL of a searcher that is registered in said dictionary from a search log for said collected content information; and

a unit that adds a search keyword included in said search log to said dictionary.

38. The computer-implemented content information analyzing apparatus as set forth in claim 32, further comprising:

a unit that analyzes a plurality of search logs for the content information, each said search log including a search keyword and a jump destination, and specifies a domain to which a personal homepage belongs, based on a number of accesses and a number of kinds of search keywords; and

a unit that registers information concerning the specified domain of said company site into said dictionary.

39. The computer-implemented content information analyzing apparatus as set forth in claim 32, further comprising:

a unit that analyzes a plurality of search logs for the content information, each said search log including a search keyword and a jump destination, and specifies a domain of a company site based on a number of accesses and a number of kinds of search keywords; and

a unit that registers information concerning the specified domain of said company site into said dictionary.

40. The computer-implemented content information analyzing apparatus as set forth in claim 24, further comprising a unit that extracts a feature word from said collected content information in which an industry type is specified, and adds the extracted feature word into said industry type glossary correspondingly to said industry type.

41. The computer-implemented content information analyzing apparatus as set forth in claim 24, further comprising a unit that identifies, in a search log for said collected content information, a keyword of a search in a state where an industry type is already specified, and registers the identified keyword as a feature word into said industry type glossary.

42. The computer-implemented content information analyzing apparatus as set forth in claim 24, further comprising:

a unit that analyzes a plurality of search logs for the content information, each said search log including a search keyword and a jump destination, and specifies a domain to which site a personal homepage including an individual opinion belongs, based on a number of accesses and a number of kinds of search keywords; and

a unit that extracts said personal homepage belonging to said domain as said disclosure unit of said opinion of said individual.

43. The computer-implemented content information analyzing apparatus as set forth in claim 24, further comprising:

a unit that analyzes a plurality of search logs for the content information, each said search log including a search keyword and a jump destination URL, and specifies a domain of a site of an individual or a small-scale organization, based on a number of accesses and a number of kinds of search keywords, said site including an individual option; and

a unit that extracts said site as said disclosure unit of said opinion of said individual.

44. The computer-implemented content information analyzing apparatus as set forth in claim 24, wherein said collected content information includes a web page including a plurality of said disclosure units, and said extractor detects repeated character string pattern data specifying a start or an end of said disclosure unit of said individual opinion in said web page and divides said web page based on said repeated pattern data into said disclosure unit of said individual opinion, and said repeated character string pattern data includes a tag in Hyper Text Markup Language (HTML) source codes of said web page.

45. The computer-implemented content information analyzing apparatus of claim 24, wherein said extractor further comprises:

a unit that collects data of a plurality of web pages;

a unit that identifies a type of collected web page based on at least one of a keyword included in a URL of a web page, data for specifying CGI included in said web page, and data of the HTML source included in said web page; and

a unit that stores data of a web page identified to be a specific type as said collected content information, and

wherein said specific type includes a bulletin board and a personal homepage including an individual opinion.

46. A computer-readable storage medium storing a computer program for causing a computer to perform a content information analysis, said program comprising:

extracting a disclosure unit of an individual opinion from collected content information, and storing information concerning said disclosure unit into a data storage;

specifying an object of said individual opinion, and storing said object of said individual opinion into said data storage;

specifying a category as to said object of said individual opinion, and storing the specified category into said data storage; and

analyzing a disclosed content of said individual opinion based on the specified category as to said individual opinion to specify an evaluation as to said object of said individual opinion, and storing said evaluation into said data storage, and

wherein said specifying a category comprises specifying and industry type of a company, which is an object of said individual opinion, by comparing terms in said disclosure unit of said individual opinion with feature words included in an industry type glossary storing said feature words corresponding to respective industry industry types.