Method and apparatus of indexing web pages of a web site for geographical searchine based on user location

• US 7,231,405 B2
• Filed: 01/10/2005
• Issued: 06/12/2007
• Est. Priority Date: 05/08/2004
• Status: Expired due to Fees

• Current Assignee: Local.com
• Original Assignee: DOUG Norman Interchange Corporation
• Inventors: Xia, Xiongwu
• Primary Examiner(s): Le; Uyen
• Application Number:
  US11/032,385
• Publication Number:
  US 20050262062A1
• Time in Patent Office: 883 Days
• Field of Search: 707 1- 3, 707/7, 707/102, 707/104.1, 715/513, 709/217
• US Class Current: 1/1
• CPC Class Codes: G06F 16/22 Indexing; Data structures therefor; Storage structures
• CPC Class Codes: G06F 16/29 Geographical information databases
• CPC Class Codes: G06F 16/9537 Spatial or temporal dependent retrieval, e.g. spatiotemporal queries
• CPC Class Codes: Y10S 707/99933 Query processing, i.e. searching
• CPC Class Codes: Y10S 707/99937 Sorting
• CPC Class Codes: Y10S 707/99945 Object-oriented database structure processing
• CPC Class Codes: Y10S 707/99948 Application of database or data structure, e.g. distributed, multimedia, or image

Abstract

A local search engine geographically indexes information for searching by identifying a geocoded web page of a web site and identifying at least one geocodable web page of the web site. The system identifies a geocode contained within content of the geocoded web page of the web site. The geocode indicates a physical location of an entity associated with the web site. The system indexes content of the geocoded web page and content of the geocodable web page. The indexing including associating the geocode contained within content of the geocoded web page to the indexed content of the geocoded web page and the geocodable web page to allow geographical searching of the content of the web pages.

Claims

1. A method for geographically indexing information, the method comprising:

identifying a geocoded web page of a web site;

identifying a aeocode contained within content of the geocoded web page of the web site, the geocode indicating a physical location of an entity associated with the web site;

identifying at least one geocodable web page of the web site, the geocodable web page does not contain the geocode;

indexing content of the geocoded web page and content of the at least one geocodable web page, the indexing including associating the geocode contained within content of the geocoded web page to the indexed content of the geocoded web page and to indexed content of the at least one geocodable web page to allow geographical searching of the content of the geocoded web page and the at least one geocodable web page relative to the geocode.

2. The method of claim 1 wherein identifying a geocoded web page of a web site comprises:

traversing links originating from a seed web page to identify new web pages of the web site, the web pages of the web site including the geocoded web page and the at least one geocodable web page; and

stripping the content of web pages of the web site to a format containing only text content.

3. The method of claim 2 wherein identifying a geocode contained within content of the geocoded web page of the web site comprises:

for at least one web page within the web site, identifying that at least one web page as the geocoded web page if the text content of that web page contains at least one of;

i) a geocode in a complete form within the text content of the web page; and

ii) at least a portion of the geocode within the text content of the identified web page, and if at least a portion of the geocode within the text content of the identified web page is present, performing a secondary lookup operation to identify remaining content of the geocode; and

associating the geocode of the geocoded web page to the content of the geocoded web page.

4. The method of claim 3 wherein identifying at least one geocodable web page of the web site comprises:

associating the geocode of the geocoded web page to all of the at least one geocodable web pages of the web site that do not contain addressing information that can be geocoded, such that all web pages of the web site that do not contain addressing information that can be geocoded can be searched geographically.

5. The method of claim 4 wherein the geocode of the geocoded web page is a major geocode and wherein the method further comprises:

identifying a web page of the web site containing addressing information indicating a minor geocode, which is a geocode other than the major geocode;

associating the major geocode to the web page of the web site containing a minor geocode; and

associating the minor geocode only to the web page of the web site containing addressing information indicating a minor geocode, such that the web page of the web site containing the minor geocode is searchable using the major and minor geocodes.

6. The method of claim 3 wherein:

the geocoded web page is at least one of;

i) a home page of the web site;

ii) a contact page of the web site;

iii) a direction page of the web site;

iv) an about page of the web site;

v) a help page of the web site; and

vi) a page of the web site that is no deeper than a predetermined number of links below the home page of the web site; and

wherein the geocode contains a complete physical address of the entity associated with the web site.

7. The method of claim 6 comprising:

identifying the geocode using the secondary lookup operation including at least one of;

i) a table lookup to find missing portions of the geocode; and

ii) a manual lookup allowing a person to supply missing portions of the geocode.

8. The method of claim 1 comprising:

sorting the content of the geocoded and that at least one geocodable web pages based on the geocode to associate the content of the geocoded and geocodable web pages to a folder representing a geographic region that is inclusive of the geocode, the folder being selected from a plurality of folders each representing a respective geographic region that is different from the geographic region of other folders.

9. The method of claim 8 wherein sorting the content comprises:

segmenting a large geographical region into a plurality of smaller geographical regions that collectively represent the large geographical region;

creating a different respective folder to represent each respective smaller geographical region of the plurality of smaller geographical regions that collectively represent the large geographical region;

identifying the folder representing a geographic region that is inclusive of the geocode; and

associating the content of the geocoded and that at least one geocodable web pages to the identified folder.

10. The method of claim 8 comprising:

performing georanking of content of the web pages associated with the folder by analyzing link popularity of links contained within content of other web pages associated with the folder that reference those web pages.

11. The method of claim 10 wherein performing georanking of content of the web pages comprises:

identifying links in content of web pages associated with the folder; and

for each identified link, adjusting a georank of a web page referenced by that identified link if the web page identified by that link has a geocode associated with the same folder associated with the web page from which the link was identified.

12. The method of claim 11 comprising:

identifying a weighting factor for each of the web pages within the folder that links to a particular web page in the folder, the weighting factor being dependent on an estimation of the physical distances between the linking web pages; and

adjusting the georank of the web pages being linked to based on the identified weighting factor.

13. The method of claim 10 wherein indexing content of the geocoded web page and content of the at least one geocodable web page comprises:

generating an inverted index of content within the folder that includes the content of the geocoded web page and content of the at least one geocodable web page, the inverted index including the geocode and georank for all content indexed and associated with the geocoded and geocodable web pages in the folder.

14. The method of claim 13 wherein generating an inverted index of content within the folder that includes the content of the geocoded web page and content of the at least one geocodable web page comprises:

for each web page in each folder;

producing a searchable content index of content of the geocoded and at least one geocodable web pages;

deriving at least one specific geographic reference based on the geocode;

storing the at least one specific geographic reference in relation to the indexed content for each web page within the searchable content index for that folder; and

indexing and storing a unique document identifier associated with each web page within the searchable content index for that folder.

15. The method of claim 14 wherein deriving at least one specific geographic reference from the geocode comprises:

looking up a zip code corresponding to the at least one specific geographic reference; and

generating at least one Mercator value corresponding to the at least one specific geographic reference; and

wherein indexing and storing a unique document identifier associated with each web page comprises;

generating the respective unique document identifier for each web page based on a uniform resource locator associated with each web page.

16. The method of claim 14 comprising:

receiving a user query including at least one keyword and a location;

using the location to identify a folder in which to search content of web pages indexed with that folder;

for all indexed web page content in the searchable content index that has a corresponding specific geographic reference within the set of nearby specific geographic references, identifying matching web pages that contain content matching the at least one keyword;

using the location to identify a set of nearby specific geographic references indexed within the folder that are within a proximity to the location; and

providing an indication of the identified web pages to a computer system from which the user query was received.

17. The method of claim 16 wherein identifying web pages that contain content matching the at least one keyword comprises:

ordering the matching web pages based on the specific geographic reference of each matching web page in relation to proximity to the location received in the user query;

ordering the matching web pages based on the keyword matching scores; and

ordering the matching web pages based on the georank of the matched web pages.

18. The method of claim 16 wherein using the location to identify a set of nearby specific geographic references indexed within the folder that are within a proximity to the location comprises:

identifying a Mercator value of the zip code from the location in the user query and generating the maximum and minimal Mercator values for the query;

identifying Mercator values of matching web pages in the folder that contain content matching the at least one keyword; and

filtering out the matching web pages that are out of range based on the Mercator values of the zip code and of the matching web pages in the folder that contain content matching the at least one keyword.

19. The method of claim 16 wherein using the location to identify a set of nearby specific geographic references indexed within the folder that are within a proximity to the location comprises:

identifying a zip code associated with the location received in the user query;

identifying a list of nearby zip codes within a predetermined proximity to the zip code associated with the location received in the user query; and

wherein identifying matching web pages that contain content matching the at least one keyword comprises;

identifying matches between the at least one keyword and indexed content of web pages for which the geocode of each matching web page corresponds to a zip code within the list of nearby zip codes within a predetermined proximity to the zip code associated with the location received in the user query.

20. The method of claim 1 further comprising:

allowing geographical searching of the content of the geocoded web page and the at least one geocodable web page relative to the geocode by processing a user query that includes a location against the indexed content of the geocoded web page and content of the at least one geocodable web page to identify web pages within a predetermined proximity to the location specified in the user query that contain content matching the user query.

21. The method of claim 20 wherein processing a user query that includes a location against the indexed content of the geocoded web page and content of the at least one geocodable web page comprises:

receiving a user query including at least one keyword and a location;

using the location to identify a folder in which to search content of web pages indexed with that folder, the folder selected from a plurality of folders that each contain location indexed web page content for web pages associated with a specific geographic region;

for all indexed web page content in a searchable content index of the folder that has a corresponding specific geographic reference within the set of nearby specific geographic references, identifying matching web pages in that folder that contain content matching the at least one keyword of the user query;

using the location to identify a set of nearby specific geographic references indexed within the folder that are within a proximity to the location; and

providing an indication of the identified web pages to a computer system from which the user query was received.

22. The method of claim 21 wherein receiving a user query is performed by a main dispatcher computer in a cluster of computers, other computers in the cluster each being assigned a portion of folders containing geographically indexed content of web pages and a portion of the index associated with those folders containing the geographically indexed content;

the main dispatcher computer forwarding the user query to a computer in the cluster that is responsible for searching the geographic region associated with the location specified in the user query.

23. A method for geographically indexing and searching information, the method comprising:

crawling web pages over a computer network and storing the web pages in a repository;

extracting geographical information from certain of the web pages in the repository and associating geocodes, based on the extracted geographical information, with the web pages that do not contain geographical information;

sorting the web pages according to the geographical information and storing the web pages within folders, each folder containing web pages from a specific geographical region;

assigning georanking scores for web pages based on link popularity within a geographical region represented by the folder containing the web pages;

generating an inverted index of the sorted identified web pages and storing geocodes and georanking scores in the inverted index; and

allowing geographical searching of the index over a network to identify web pages having content of interest to a user and located nearest to a user defined location.