METHODS AND SYSTEMS FOR ANALYZING READING LOGS AND DOCUMENTS THEREOF

• US 20170169096A1
• Filed: 12/29/2015
• Published: 06/15/2017
• Est. Priority Date: 12/11/2015
• Status: Active Grant

• Current Assignee: Industrial Technology Research Institute
• Original Assignee: Industrial Technology Research Institute
• Inventors: TSAI, Tsung-Lin, LEE, Meng-Yu, LIN, Shun-Chieh
• Granted Patent: US 10,467,255 B2
• Time in Patent Office: Days
• CPC Class Codes: G06F 16/285 Clustering or classification
• CPC Class Codes: G06F 16/35 Clustering; Classification
• CPC Class Codes: G06F 16/93 Document management systems

Abstract

Methods for analyzing reading log and documents corresponding thereof are provided, including: acquiring reading log and documents corresponding thereto, wherein the reading log at least includes reading-related information about the documents within a predetermined period of time, selecting interesting document sets from the documents according to the reading log in each time segment, performing a document content pre-processing on the interesting document sets to determine keyword sets corresponding thereto for each time segment according to the interesting document sets, performing cluster calculation on the keyword sets to obtain topics and calculating cohesion of each topic, deleting topics with insufficient cohesion to obtain multiple high-relevance topics and classifying each high-relevance topic into one of predetermined topic classes according to the respective keyword sets of the high-relevance topics, obtaining reading statistics for each topic class and calculating multiple degrees of interest for each topic class during each time segment.

Claims

1. A method for analyzing reading log and documents corresponding thereto, comprising:

acquiring a reading log and documents corresponding thereto, wherein the reading log at least includes reading-related information about the documents within a predetermined period of time;

selecting a plurality of interesting document sets from the documents in each time segment of the predetermined period of time according to the reading log, each of the interesting document sets corresponding to one of the time segments of the predetermined period of time;

performing a document content pre-processing on the interesting document sets to determine keyword sets corresponding to the interesting document sets;

performing a cluster calculation on the keyword sets to obtain topics and calculating cohesion of each topic;

deleting topics with insufficient cohesion among the topics obtained to obtain a plurality of high-relevance topics and classifying each high-relevance topic into one of a plurality of predetermined topic classes by comparing the respective keyword sets of the high-relevance topics with a plurality of keyword sets of the predetermined topic classes;

obtaining reading statistics for each predetermined topic class and calculating a plurality of degrees of interest for each predetermined topic class during each time segment; and

analyzing a reading trend on each predetermined topic class according to changes in the degrees of interest.

2. The method as claimed in claim 1, wherein the step of selecting the interesting document sets further comprises:

filtering out uninterested reading-related information among the reading-related information about the documents to obtain filtered reading-related information;

calculating an interesting reading time and a number of interesting readings for each document based on the filtered reading-related information; and

determining whether each document belongs to the interesting document sets based on the interesting reading time and the number of interesting readings of the document;

wherein the document is classified to the interesting document sets when the interesting reading time of the document has exceeded a time threshold value and the number of interesting readings of the document has exceeded a frequency threshold value.

3. The method as claimed in claim 1, wherein the document content pre-processing step further comprises the steps of performing the following steps on each document of the interesting document sets:

obtaining a plurality of keywords;

paragraphing the document and calculating a frequency at which the keywords appear in each paragraph to calculate a plurality of importance-weightings corresponding to all of the paragraphs and determining at least one key paragraph according to the importance-weightings; and

generating the set of keywords for the document based on the keywords within the at least one key paragraph.

4. The method as claimed in claim 1, wherein the step of classifying each high-relevance topic into one of the predetermined topic classes further comprises:

when a degree of similarity of keyword sets between a first high-relevance topic of the high-relevance topics and a first predetermined topic class of the predetermined topic classes has exceeded a predetermined threshold degree, classifying the first high-relevance topic corresponding to the keyword set being compared into the first predetermined topic class.

5. The method as claimed in claim 4, further comprising:

automatically updating the keyword set of the first predetermined topic class using the respective keyword set of the first high-relevance topic after classifying the first high-relevance topic into the first predetermined topic classes.

6. The method as claimed in claim 4, further comprising:

after classifying the first high-relevance topic into the first predetermined topic class, comparing the degree of similarity of keyword sets between the first high-relevance topic and a keyword set of a first topic within the first predetermined topic class; and

relating the first high-relevance topic to the first topic when the degree of similarity of keyword sets between the first high-relevance topic and the first topic has exceeded a predetermined threshold degree.

7. The method as claimed in claim 1, wherein the step of determining the reading trend on each predetermined topic class according to changes in the degrees of interest further comprises:

gathering a total number of readings for each predetermined topic class in each time segment;

determining a degree of interest for each predetermined topic class in each time segment according to the total numbers of readings for all of the predetermined topic classes; and

analyzing the reading trend on each predetermined topic class based on the changes in the degrees of interest for each predetermined topic class.

8. The method as claimed in claim 7, wherein the reading trend of each predetermined topic class comprises at least one of:

the trend of going from being interested to being uninterested in the predetermined topic class, the trend of staying interested in the predetermined topic class, and the trend of going from being uninterested to being interested in the predetermined topic class.

9. The method as claimed in claim 8, further comprising:

providing a user interface to graphically show an analysis result of the reading trend in the predetermined period of time;

wherein the reading trend indicates a trend of changing in document interest for each predetermined topic class.

10. A system for analyzing reading log and documents corresponding thereto, comprising:

a reading log extractor, acquiring a reading log and documents corresponding thereto, wherein the reading log at least includes reading-related information about the documents within a predetermined period of time;

an interesting document filter coupled to the reading log extractor, selecting a plurality of interesting document sets from the documents in each time segment of the predetermined period of time according to the reading log, each of the interesting document sets corresponding to one of the time segments of the predetermined period of time;

a document pre-processor coupled to the interesting document filter, performing a document content pre-processing on the interesting document sets to determine keyword sets corresponding to the interesting document sets;

a topic cluster generator coupled to the document pre-processor, performing a cluster calculation on the keyword sets to obtain topics, calculating cohesion of each topic and deleting topics with insufficient cohesion among the topics obtained to obtain a plurality of high-relevance topics;

a topic classifier and combiner coupled to the topic cluster generator, classifying each high-relevance topic into one of a plurality of predetermined topic classes by comparing the respective keyword sets of the high-relevance topics with a plurality of keyword sets of the predetermined topic classes;

a degree of interest normalizer coupled to the topic classifier and combiner, obtaining reading statistics for each predetermined topic class and calculating a plurality of degrees of interest for each predetermined topic class during each time segment; and

a reading trend analyzer coupled to the degree of interest normalizer, analyzing a reading trend on each predetermined topic class according to changes in the degrees of interest.

11. The system as claimed in claim 10, wherein the interesting document filter further filters out uninterested reading-related information among the reading-related information about the documents to obtain filtered reading-related information, calculates an interesting reading time and a number of interesting readings for each document based on the filtered reading-related information and determines whether each document belongs to the interesting document sets based on the interesting reading time and the number of interesting readings of the document, wherein a document is classified to the interesting document sets when the interesting reading time of the document has exceeded a time threshold value and the number of interesting readings of the document has exceeded a frequency threshold value.

12. The system as claimed in claim 10, wherein for each document of the interesting document sets, the document pre-processor further obtains a plurality of keywords, paragraphs the document and calculates a frequency at which the keywords appear in each paragraph to calculate a plurality of importance-weightings corresponding to all of the paragraphs and determines at least one key paragraph according to the importance-weightings, and generates the set of keywords for the document based on the keywords within the at least one key paragraph.

13. The system as claimed in claim 10, wherein the topic classifier and combiner further classifies a first high-relevance topic of the high-relevance topics corresponding to the keyword set being compared into a first predetermined topic class of the predetermined topic classes when a degree of similarity of keyword sets between the first high-relevance topic and the first predetermined topic class has exceeded a predetermined threshold degree.

14. The system as claimed in claim 13, wherein the topic classifier and combiner further automatically updates the keyword set of the first predetermined topic class using the respective keyword set of the first high-relevance topic after classifying the first high-relevance topic into the first predetermined topic classes.

15. The system as claimed in claim 13, wherein the topic classifier and combiner further computes the degree of similarity of keyword sets between the first high-relevance topic and a keyword set of a first topic within the first predetermined topic class after classifying the first high-relevance topic into the first predetermined topic class and relates the first high-relevance topic to the first topic when the degree of similarity of keyword sets between the first high-relevance topic and the first topic has exceeded a predetermined threshold degree.

16. The system as claimed in claim 13, wherein the degree of interest normalizer further gathers a total number of readings for each predetermined topic class in each time segment, determines a degree of interest for each predetermined topic class in each time segment according to the total numbers of readings for all of the predetermined topic classes, and analyzes the reading trend on each predetermined topic class based on the changes in the degrees of interest for each predetermined topic class.

17. The system as claimed in claim 16, wherein the reading trend of each predetermined topic class comprises at least one of:

the trend of going from being interested to being uninterested in the predetermined topic class, the trend of staying interested in the predetermined topic class, and the trend of going from being uninterested to being interested in the predetermined topic class.

18. The system as claimed in claim 10, wherein the reading trend analyzer further provides a user interface to graphically show an analysis result of the reading trend in the predetermined period of time, wherein the reading trend indicates a trend of changing in document interest for each predetermined topic class.