Updating taxonomy based on webpage

• US 9,135,361 B1
• Filed: 12/27/2013
• Issued: 09/15/2015
• Est. Priority Date: 05/05/2010
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google Inc. (Alphabet Inc.)
• Inventors: Juang, Philo, Testa, Christopher, Mote, Nicolaus
• Primary Examiner(s): HO, BINH VAN
• Application Number:
  US14/142,404
• Time in Patent Office: 627 Days
• Field of Search: 707/738
• US Class Current: 1/1
• CPC Class Codes: G06F 16/38 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G06F 16/9535 Search customisation based on user profiles and personalisation
• CPC Class Codes: G06F 16/986 Document structures and storage, e.g. HTML extensions

Abstract

According to an example implementation, a computer-implemented method may include extracting, by a computing device, structured content from a website, determining a recent taxonomy by applying category rules to the structured content, the recent taxonomy including multiple categories and a new category, and updating a stored taxonomy based on the determined recent taxonomy by adding the new category to the stored taxonomy.

Claims

1. A computer-implemented method comprising:

extracting, by a computing device, structured content from a web page;

determining multiple subcategories of a known category by applying category rules to the structured content from the web page, the category rules being customized for a known structure of the web page, the multiple subcategories including multiple known subcategories of the known category and a new subcategory, the new subcategory being based on a new item within the known structure of the web page; and

updating a stored taxonomy by adding the new subcategory to the stored taxonomy.

2. The method of claim 1, wherein the stored taxonomy did not include the new subcategory before the updating.

3. The method of claim 1, wherein the stored taxonomy included the known category and the multiple known subcategories before the updating.

4. The method of claim 1, wherein the extracting structured content from the web page comprises crawling a website that includes the web page.

5. The method of claim 1, wherein the extracting structured content from the web page comprises periodically extracting structured content from the web page.

6. The method of claim 1, wherein the determining the multiple subcategories includes determining that the new subcategory is a subcategory of the known category by determining that the new item, object, or option is new based on comparing data from the structured content to previously stored and classified data, the previously stored and classified data being associated with the known category.

7. The method of claim 1, wherein the category rules are customized based on the stored taxonomy and a stored version of the web page.

8. The method of claim 1, further comprising storing data files based on the updated stored taxonomy.

9. The method of claim 1, further comprising generating a key for accessing data files based on the updated stored taxonomy.

10. The method of claim 1, further comprising presenting advertisements to a user based on the updated stored taxonomy.

11. The method of claim 1, further comprising:

presenting the new subcategory to an administrator based on the stored taxonomy not including the new subcategory,

wherein the updating the stored taxonomy comprises updating the stored taxonomy in response to the administrator accepting the new subcategory.

12. The method of claim 11, wherein the extracting, determining, and presenting are performed automatically and without human intervention.

13. The computer-implemented method of claim 1, wherein the determining includes determining multiple subcategories of the known category by applying category rules to the structured content including hyper text markup language (HTML) tags in the web page, the category rules being customized for the HTML tags of the web page, the multiple subcategories including multiple known subcategories of the known category and a new subcategory.

14. The computer-implemented method of claim 1, wherein the structure of the web page includes a specified format of the web page.

15. The computer-implemented method of claim 1, wherein the page includes a single web page.

16. A non-transitory computer-readable storage medium including executable code tangibly embodied thereon, the executable code being configured to, when executed by at least one processor, cause a data processing apparatus to:

extract structured content from a website associated with a stored taxonomy;

determine a recent taxonomy by applying category rules to the structured content, the category rules being customized for a known structure of a page of the website and dictating that items within an area of the website are subcategories of a known category, the recent taxonomy including multiple known subcategories of the known category and a new subcategory of the known category, the new subcategory being based on a new object within the known structure of the page; and

update the stored taxonomy based on the determined recent taxonomy by adding the new subcategory of the known category to the stored taxonomy.

17. A non-transitory computer-readable storage medium comprising instructions stored thereon that, when executed by at least one processor, are configured to cause a computing device to at least:

extract, by a computing device, structured content from a web page, the web page being associated with a known category;

determine multiple subcategories of the known category by applying category rules to the structured content from the web page, the category rules being customized for a known structure of the web page, the multiple subcategories including multiple known subcategories of the known category and a new subcategory, the new subcategory being based on a new item within the known structure of the web page; and

update a stored taxonomy by adding the new subcategory to the stored taxonomy.

18. A computer-implemented method comprising:

extracting, by a computing device, structured content from a web page;

determining multiple subcategories of a known category by applying category rules to the structured content from the web page, the category rules being customized for a known structure of the web page, the multiple subcategories including multiple known subcategories of the known category and a new subcategory, the new subcategory being based on a new object within the known structure of the web page; and

updating a stored taxonomy by adding the new subcategory to the stored taxonomy.

19. A computer-implemented method comprising:

extracting, by a computing device, structured content from a web page;

determining multiple subcategories of a known category by applying category rules to the structured content from the web page, the category rules being customized for a known structure of the web page, the multiple subcategories including multiple known subcategories of the known category and a new subcategory, the new subcategory being based on a new option within the known structure of the web page; and

updating a stored taxonomy by adding the new subcategory to the stored taxonomy.