System and method for identifying segments in a web resource

• US 7,853,871 B2
• Filed: 06/10/2005
• Issued: 12/14/2010
• Est. Priority Date: 06/10/2005
• Status: Active Grant

• Current Assignee: III Holdings 3, LLC (Intellectual Ventures LLC)
• Original Assignee: Nokia Corporation
• Inventors: Katta, Robert, Simons, Kevin, Abou-Rizk, Mitri, Papp, William
• Primary Examiner(s): NGUYEN, CHAU T
• Application Number:
  US11/149,724
• Publication Number:
  US 20060282758A1
• Time in Patent Office: 2,013 Days
• Field of Search: 715/200, 715/204, 715206-207, 715/210, 715226-227, 715/229, 715/234, 715/236, 715/238, 715242-243, 715/247, 715/251, 715255-256, 715/267, 715/277
• US Class Current: 715/238
• CPC Class Codes: G06F 16/9577 Optimising the visualization of content, e.g. distillation of HTML documents

Abstract

A robust, lightweight, bottom-up segmentation method for Internet content. According to the present invention, individual segments are created based upon weights assigned according to document structure and markup elements and semantics. Smaller segments are then merged into larger segments by determining which portions of the content page are related to each other. The remaining segments are then intelligently divided based upon device constraints.

Claims

1. A method comprising:

grouping, by a processor, items on a content page into segments in response to weightings of individual nodes associated with respective items being within a predetermined threshold difference of an average weighting for a respective segment;

merging smaller segments into larger segments based upon predefined criteria, the smaller segments and the larger segments being segments formed by the grouping of the items,

wherein merging the smaller segments into the larger segments includes merging a first segment into a second segment when the second segment neighbors the first segment either above, below, to the left, or the right of the first segment, and the first segment and the second segment are either left or top aligned; and

dividing segments formed by the grouping of items that fail to meet predefined constraints into sub-segments, until the sub-segments meet the predefined constraints.

2. The method of claim 1, wherein the predefined constraints comprise constraints within an electronic device that is being used to display the content page.

3. The method of claim 2, wherein the predefined constraints include the size of the screen on the electronic device.

4. The method of claim 1, wherein the weight of each node is equal to the sum of its own weight and the combined total weight of its parent nodes going back to a root node.

5. The method of claim 1, wherein nodes with similar weights are placed within the same segment.

6. The method of claim 1, wherein, if a node is not included in an existing segment, then a new segment is created to hold the node.

7. The method of claim 1, wherein the merging of smaller segments into larger segments includes merging segments that possess similar shapes.

8. The method of claim 1, wherein the merging of smaller segments into larger segments includes:

identifying an image in the content page;

detecting text existing below the image; and

merging the segments containing the image and the detected text.

9. The method of claim 1, wherein the merging of smaller segments into larger segments includes:

identifying an aligned list of items; and

merging each of the segments containing at least one of the aligned list of items into the same segment.

10. The method of claim 1, wherein each of the segments is assigned an index value based upon underlying content for that particular segment, and wherein the index value for a segment remains constant despite minor modifications in the underlying content.

11. The method of claim 1, wherein the merging of smaller segments into larger segments includes merging segments that share similar backgrounds.

12. The method of claim 1 wherein the merging of smaller segments into larger segments includes the use of cascading style sheets.

13. The method of claim 1, wherein items are not grouped into segments until the entire content page has been downloaded from a remote location.

14. The method of claim 1, wherein items are grouped into segments at the same time as the entire content page is being downloaded from a remote location.

15. The method of claim 1, further comprising, upon receiving a search request from a user, using a search algorithm to provide to the user only segments and sub- segments that contain information relevant to the search request.

16. A computer program product comprising a computer-readable memory, the computer-readable memory having executable computer code stored thereon, the computer code comprising:

computer code for grouping items on a content page into segments in response to weightings of individual nodes associated with respective items being within a predetermined threshold difference of an average weighting for a respective segment;

computer code for merging smaller segments into larger segments based upon predefined criteria, the smaller segments and the larger segments being segments formed by the grouping of the items,

wherein the computer code for merging the smaller segments into the larger segments includes merging a first segment into a second segment when the second segment neighbors the first segment either above, below, to the left, or the right of the first segment, and the first segment and the second segment are either left or top aligned; and

computer code for dividing segments formed by the grouping of items that fail to meet predefined constraints into sub-segments, until the sub-segments meet the predefined device constraints.

17. The computer program product of claim 16, wherein the weight of each node is equal to the sum of its own weight and the combined total weight of its parent nodes going back to a root node.

18. The computer program product of claim 16, wherein the weight of a segment is based upon the relationship between nodes within the segment, and wherein closely related nodes possess a higher weight than less closely related nodes.

19. The computer program product of claim 16, further comprising computer code for, upon receiving a search request from a user, using a search algorithm to provide to the user only segments and sub-segments that contain information relevant to the search request.

20. An apparatus comprising at least one processor and at least one memory including computer program code, the at least one memory and the computer program code configured to, with the at least one processor, cause the apparatus at least to perform:

grouping items on a content page into segments in response to weightings of individual nodes associated with respective items being within a predetermined threshold difference of an average weighting for a respective segment;

merging smaller segments into larger segments based upon predefined criteria, the smaller segments and the larger segments being segments formed by the grouping of the items,

wherein the computer code for merging the smaller segments into the larger segments includes computer code for merging a first segment into a second segment when the second segment neighbors the first segment either above, below, to the left, or the right of the first segment, and the first segment and the second segment are either left or top aligned; and

dividing segments formed by the grouping of items that fail to meet predefined constraints into sub-segments until the sub- segments meet the predefined constraints.

21. The apparatus of claim 20, wherein the weight of each node is equal to the sum of its own weight and the combined total weight of its parent nodes going back to a root node.

22. The apparatus of claim 20, wherein the apparatus is further caused to perform, upon receiving a search request from a user, using a search algorithm to provide to the user only segments and sub-segments that contain information relevant to the search request.

23. A system comprising:

a communications device configured to transmit a content page; and

an electronic device in communication with the communications device the electronic device including a processor and a memory operatively connected to the processor, the memory comprising;

computer code for grouping items on a content page received from the remote terminal into segments in response to weightings of individual nodes associated with respective items being within a predetermined threshold difference of an average weighting for a respective segment;

computer code for merging smaller segments into larger segments based upon predefined criteria, the smaller segments and the larger segments being segments formed by the grouping of the items,

wherein the computer code for merging the smaller segments into the larger segments includes computer code for merging a first segment into a second segment when the second segment neighbors the first segment either above, below, to the left, or the right of the first segment, and the first segment and the second segment are either left or top aligned; and

computer code for dividing segments formed by the grouping of items that fail to meet predefined constraints into sub-segments until the sub-segments meet the predefined device constraints.