System and method for extracting content for submission to a search engine

• US 7,809,710 B2
• Filed: 08/14/2002
• Issued: 10/05/2010
• Est. Priority Date: 08/14/2001
• Status: Expired due to Fees

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Quigo Technologies, Inc. (Apollo Global Management, Inc.)
• Inventors: Itzhak, Oded, Galai, Yaron
• Primary Examiner(s): Colbert; Ella
• Application Number:
  US10/486,196
• Publication Number:
  US 20040177015A1
• Time in Patent Office: 2,974 Days
• Field of Search: 707/1, 707 3- 6, 707/10, 707/709, 707/804, 707/810, 715/1, 715/234, 715/236, 715/239, 715/256, 715/500, 715/501.1, 715/753, 715/733, 715/810, 715/835
• US Class Current: 707/709
• CPC Class Codes: G06F 16/211 Schema design and management
• CPC Class Codes: G06F 16/81 Indexing, e.g. XML tags; Data structures therefor; Storage structures
• CPC Class Codes: G06F 16/951 Indexing; Web crawling techniques
• CPC Class Codes: G06Q 10/06 Resources, workflows, human or project management; Enterprise or organisation planning; Enterprise or organisation modelling
• CPC Class Codes: G06Q 10/107 Computer-aided management of electronic mailing [e-mailing]
• CPC Class Codes: G06Q 30/02 Marketing; Price estimation or determination; Fundraising
• CPC Class Codes: G06Q 40/00 Finance; Insurance; Tax strategies; Processing of corporate or income taxes

Abstract

A system and a method for automatically submitting Web pages to a search engine, which is preferably used for submitting dynamic Web pages, but may optionally be used for any type of Web page. The present invention features a gateway server for providing these Web pages to the search engine, either directly or optionally through an autonomous software search program. Optionally and more preferably, the gateway server modifies the Web page before serving it to the autonomous software search program and/or search engine.

Claims

1. A method of extracting a content from a Web page, wherein the extracted content is sufficient for a search engine to index said Web page, said method comprising:

identifying by a server a template of the Web page, wherein said template includes a non-essential code;

extracting by said server a content, other than the identified template from said Web page;

separating, by said server, a link from the content of the Web page; and

,

providing by said server said extracted content for receipt by said search engine.

2. A method of extracting a content from a Web page, wherein the extracted content is sufficient for a search engine to index said Web page, said method comprising:

identifying by a server a template of the Web page, wherein said template includes a non-essential code;

extracting by said server a content, other than the identified template from said Web page;

producing a set of instructions for removing the template from the Web page; and

,

providing by said server said extracted content for receipt by said search engine.

3. The method of claim 2, further comprising extracting a field of data from the Web page and associating the field with an attribute defined by an information schema.

4. The method of claim 2 further comprising receiving by said search engine said extracted content for indexing.