Method and system for extracting web data

• US 20070033189A1
• Filed: 09/08/2006
• Published: 02/08/2007
• Est. Priority Date: 08/05/2005
• Status: Abandoned Application

• Current Assignee: Buzzmetrics, Ltd. (Nielsen Holdings plc)
• Original Assignee: Buzzmetrics, Ltd. (Nielsen Holdings plc)
• Inventors: Schler, Jonathan, Tenne, David, Levy, Ori, Navot, Akiva
• Application Number:
  US11/517,418
• Publication Number:
  US 20070033189A1
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 16/38 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G06F 16/383 using metadata automatically derived from the content
• CPC Class Codes: G06F 16/951 Indexing; Web crawling techniques
• CPC Class Codes: G06Q 90/00 Systems or methods specially adapted for administrative, commercial, financial, managerial or supervisory purposes, not involving significant data processing
• CPC Class Codes: G06Q 99/00 Subject matter not provided for in other groups of this subclass
• CPC Class Codes: Y10S 707/99933 Query processing, i.e. searching

Abstract

An apparatus for providing an analysis of attitudes expressed in web content, comprising: a collector for collecting attitude-data in relation to a predetermined subject from one or more pre-selected web site, the attitude-data containing attitudes in relation to the predetermined subject; a processor, associated with the collector, for processing the attitude data so as to generate an attitude analysis; and an outputter, associated with the processor, for outputting the attitude analysis, thereby to provide an indication of attitudes being expressed in the web content in relation to the predetermined subject.

Claims

1. Apparatus for crawling web content to provide data for attitude analysis of attitudes expressed in said web content in relation to a predetermined subject, the apparatus comprising a crawler, configured to crawl a plurality of pre-selected web sites, for collecting attitude-data from said web sites, said attitude data comprising attitudes relating to said predetermined subject, said crawler being further configured to provide said attitude data to a predetermined location for said attitude analysis.

2. The apparatus of claim 1, further comprising a policy definer, operable for defining specific guidelines with respect to crawling said pre-selected web sites.

3. The apparatus of claim 1, wherein said crawler is further configured for downloading of relevant pages of the pre-selected web site according to a predetermined schedule.

4. The apparatus of claim 1, wherein said crawler is further configured to use a script in a change query language, for said collecting.