SYSTEM AND METHOD FOR CONTENT SELECTION FOR WEB PAGE INDEXING

• US 20100287462A1
• Filed: 05/05/2009
• Published: 11/11/2010
• Est. Priority Date: 05/05/2009
• Status: Active Grant

• Current Assignee: Oracle America, Inc. (Oracle Corporation)
• Original Assignee: Paul A. Lipari, Suboti, LLC
• Inventors: Hauser, Robert R.
• Granted Patent: US 10,303,722 B2
• Time in Patent Office: Days
• US Class Current: 715/241
• CPC Class Codes: G06F 16/81 Indexing, e.g. XML tags; Data structures therefor; Storage structures
• CPC Class Codes: G06F 16/951 Indexing; Web crawling techniques

Abstract

An indexing system for documents such as web pages divides a document into elements, such as document object model elements. User attention data from prior interactions with the document are analyzed to determine those elements of a document that satisfy a threshold requirement of user attention. Elements meeting the user attention threshold requirement are added to a set of indexable content for the document. Furthermore, document sections are determined based on attention data and each section is indexed separately. Indexing is per section and based only on the indexable content, thereby enhancing the index relevance, increasing the efficiency of search engines and reducing spamdexing.

Claims

1. A method for indexing a document comprising:

selecting indexable content of the document; and

indexing the indexable content;

wherein selecting the indexable content comprises;

dividing the document into a plurality of document elements;

determining an attention history for a plurality of the document elements; and

determining one or more document elements that meet an attention history requirement.

2. The method according to claim 1 wherein determining an attention history comprises retrieving an attention history from an interaction data store.

3. The method according to claim 1 wherein the attention history comprises interaction data that associates a document element with attention that the document element received from a user during an interaction with the document.

4. The method according to claim 1 wherein the attention history requirement comprises that a document element has at least one associated attention event.

5. The method according to claim 1 wherein the attention history requirement comprises that a document element has at least a threshold number of associated attention events.

6. The method according to claim 1 wherein the document elements comprise document object model elements of a web page.

7. The method according to claim 6 comprising:

selecting a document object model element;

determining if interaction data exists for the selected document object model element;

adding the selected document object model element to the indexable content if interaction data for the selected document object model element exists.

8. The method according to claim 7 wherein the selected document object model element is added to the indexable content if the amount of interaction data for the selected document object model element satisfies a threshold requirement.

9. The method according to claim 6 comprising:

dividing the document into a plurality of document sections, each section containing at least one document object model element; and

determining the indexable content for each document section.

10. The method according to claim 9 comprising individually indexing each document section.

11. The method according to claim 10 comprising individually storing an index for each document section.

12. The method according to claim 9 comprising retrieving section analysis data in respect of the document from a database.

13. A system for indexing web pages comprising:

a content selection module that processes interaction data for a web page to select indexable content of the web page; and

an indexing module that indexes the indexable content of the web page.

14. The system according to claim 13 comprising an interaction data store that stores interaction data for a plurality of web pages.

15. The system according to claim 13 wherein the content selection module adds content of the web page to the indexable content if the interaction data comprises a plurality of attention events associated with the content and if the number of attention events are above a threshold number.

16. The system according to claim 15 wherein the interaction data comprises at least one association between a document object model element of the web page and one or more attention events generated by a human user during an interaction with the web page.

17. The system according to claim 16 wherein the one or more attention events indicate a region of the web page of interest of a human user during an interaction with the web page.

18. A computer-readable medium comprising computer-executable instructions for execution by a processor, that, when executed, cause the processor to:

determine interaction data for a web page;

determine a document object model element of the web page associated with the interaction data; and

add the document object model element to a set of indexable content for the web page.

19. The computer readable medium according to claim 18 comprising instructions that, when executed, cause the processor to provide the set of indexable content to a second processor.

20. The computer readable medium according to claim 19 comprising instructions that, when executed, cause the second processor to:

receive the indexable content;

index the indexable content;

store the index in a web page index.