Automatic mapping of a location identifier pattern of an object to a semantic type using object metadata

• US 9,613,149 B2
• Filed: 04/18/2012
• Issued: 04/04/2017
• Est. Priority Date: 04/15/2009
• Status: Expired due to Fees

• Current Assignee: Fiver LLC
• Original Assignee: VCVC III LLC (Vulcan, Inc.)
• Inventors: Spivack, Nova T., White, Scott, Wissner, James M.
• Primary Examiner(s): Stevens, Robert
• Application Number:
  US13/450,416
• Publication Number:
  US 20120203734A1
• Time in Patent Office: 1,812 Days
• Field of Search: 707705, 707602, 707748
• CPC Class Codes: G06F 16/3334 Selection or weighting of terms from queries, including natural language queries
• CPC Class Codes: G06F 16/3337 Translation of the query language, e.g. Chinese to English
• CPC Class Codes: G06F 16/337 Profile generation, learning or modification
• CPC Class Codes: G06F 16/81 Indexing, e.g. XML tags; Data structures therefor; Storage structures
• CPC Class Codes: G06F 16/86 Mapping to a database
• CPC Class Codes: G06F 16/9535 Search customisation based on user profiles and personalisation
• CPC Class Codes: G06F 16/9537 Spatial or temporal dependent retrieval, e.g. spatiotemporal queries
• CPC Class Codes: G06F 16/955 using information identifiers, e.g. uniform resource locators [URL]
• CPC Class Codes: G06F 16/986 Document structures and storage, e.g. HTML extensions
• CPC Class Codes: G06F 40/143 Markup, e.g. Standard Generalized Markup Language [SGML] or Document Type Definition [DTD]
• CPC Class Codes: G06F 40/186 Templates
• CPC Class Codes: G06F 40/30 Semantic analysis

Abstract

Systems and methods for automatic mapping of a location identifier pattern of an object to a semantic type using object metadata are disclosed. In one aspect, embodiments of the present disclosure include a method, which may be implemented on a system, of identifying a set of tags associated with a website that is hosted by a web server. The method further includes, detecting a web page in the website in which a tag of the set of tags is identified, extracting a pattern from a Universal Resource Locator (URL) of the web page, and/or storing the pattern in a database embodied in a machine-readable storage medium as being mapped to the semantic type. The tag corresponds to a semantic type with which the content embodied in the web page has a semantic relationship and the pattern corresponds to the semantic type with which the content embodied in the web page has a semantic relationship.

Claims

1. A method performed by a computer system having a processor of automatically mapping a pattern related to a location identifier of an object having content in the Web to a semantic type using metadata associated with the object, the method, comprising:

collecting the metadata from, one or more of, a plurality of content sources hosted by host servers and the object itself, wherein each of the plurality of content sources includes at least a portion of the object or a reference to the object associated with the location identifier;

creating, by a processor, the pattern from the location identifier of the object in the Web,

wherein the pattern is not identical to the location identifier and is used to search for other location identifiers of objects in the Web,

wherein the metadata corresponds to the semantic type with which the content of the object has a semantic relationship, the metadata having an associated weighting; and

storing, by the processor, the pattern in a database embodied in a machine-readable storage medium as being mapped to the semantic type;

receiving via a user interface a search query associated with the semantic type;

mapping the search query into the pattern stored in the database based on the semantic type; and

performing a search for the other location identifiers matching the pattern for locating other objects or other objects including content embodied therein, that have the semantic relationship to the semantic type.

2. The method of claim 1,

wherein, the pattern created from the location identifier has a trustworthiness rating that corresponds to the associated weighting of the metadata.

3. The method of claim 1, wherein, the metadata is collected from web content including one or more of, bookmarked content and blog articles.

4. The method of claim 1, wherein, the metadata is collected from a social networking site.

5. The method of claim 1, wherein, the metadata is collected from analyzing user behavior.

6. The method of claim 1, wherein, the metadata includes user-generated or user-identified metadata.

7. The method of claim 6, wherein, the user-generated or user-identified metadata includes one or more tags.

8. The method of claim 6, wherein, the user-generated or user-identified metadata includes user reviews or user annotation.

9. The method of claim 1, further comprising,

analyzing multiple tags identified from the plurality of content sources;

selecting a subset of the multiple tags for use in identifying a set of semantic types with which the object or the content embodied therein has a semantic relationship.

10. The method of claim 9, further comprising,

identifying the set of semantic types, each of which corresponds to one or more of the subset of the multiple tags;

and updating the mapping stored in the machine-readable storage medium to include each of the set of semantic types.

11. The method of claim 10, further comprising, indexing the location identifier as being mapped to each of the set of semantic types.

12. The method of claim 9, further comprising, assigning weights to each of the multiple tags.

13. The method of claim 12, wherein, the subset of the multiple tags is selected based on the weights assigned to each of the multiple tags.

14. The method of claim 9, wherein, a weight for a particular tag of the multiple tags is assigned based on a rating of a user who identified the particular tag.

15. The method of claim 14, wherein, the rating of the user is determined based on an interest of the user.

16. The method of claim 14, wherein, the rating of the user is determined based on one or more of, social endorsement of the user by other users, expertise of the user, and reliability of the user.

17. The method of claim 14, wherein, the rating of the user is determined based on similarity of tags identified by the user compared to tags identified by other users for a same set of content.

18. The method of claim 9, wherein, each of the subset of the multiple tags is selected when a usage frequency of the tag exceeds a threshold value.

19. The method of claim 18, wherein, the usage frequency of the particular tag is a number of times or a percentage of times the object or the content embodied in the object has been associated with a particular tag.

20. The method of claim 1,

wherein, the object is a web page;

wherein, the location identifier is a Universal Resource Locator (URL).

21. The method of claim 20, further comprising,

identifying a second URL having a same domain as the location identifier;

wherein, the second URL links to a second web page having content embodied therein that is also associated with the metadata;

extracting the pattern by comparing the URL with the second URL.

22. The method of claim 1, wherein, the object is visually sorted in a search results page according to the semantic relationship with the semantic type.

23. The method of claim 1, wherein, the semantic relationship specifies a type of thing or concept that the content embodied in the object is relevant to.

24. The method of claim 23, wherein, the semantic relationship includes, an “

is-a”

relationship.

25. The method of claim 1, wherein, the semantic relationship specifies a type of format that the content embodied in the object is of.

26. The method of claim 25, wherein, the semantic relationship includes, a “

has-format”

relationship.

27. The method of claim 1, wherein, the semantic relationship specifies a type of audience that the content embodied in the object is intended for.

28. The method of claim 27, wherein, the semantic relationship includes, a “

has-audience”

relationship.

29. The method of claim 1, wherein, the semantic relationship specifies a language that the content embodied in the object is in.

30. The method of claim 29, wherein, the semantic relationship includes, an “

of-language”

relationship.

31. The method of claim 1, wherein, the semantic relationship specifies a set of semantic tags that the content embodied in the object is relevant to.

32. The method of claim 1, wherein, the semantic relationship specifies a web site where the object is from.

33. The method of claim 32, wherein, the semantic relationship includes, a “

has-domain”

relationship.

34. The method of claim 1, wherein, the semantic relationship specifies popularity of the content embodied in the object.

35. A method for automatically mapping a pattern related to a Universal Resource Locator (URL) of a web page in a website to a semantic type, the method, comprising:

detecting, by a processor, a web page with which a tag is associated,

wherein the tag corresponds to a semantic type with which the content embodied in the web page has a semantic relationship;

extracting a pattern from a URL of the web page, wherein the pattern is not identical to the URL and is used to search for other URLs of web pages;

storing an association of the pattern with the semantic type in a database;

receiving via a user interface a search query associated with the semantic type;

mapping the search query into the pattern stored in the database based on the semantic type; and

performing a search for other location identifiers matching the pattern for locating other web pages or other web pages including content embodied therein, that have the semantic relationship to the semantic type.

36. The method of claim 35, wherein, the semantic relationship specifies a type of thing or concept that the content embodied in the web page is relevant to.

37. The method of claim 35, wherein, the semantic relationship specifies a type of format that the content embodied in the web page is of.

38. The method of claim 35, wherein, the semantic relationship specifies a type of audience that the content embodied in the web page is intended for.

39. The method of claim 35, wherein, the semantic relationship specifies a language that the content embodied in the web page is in.

40. The method of claim 35, wherein, the semantic relationship specifies a set of tags that the content embodied in the web page is relevant to.

41. The method of claim 40, further comprising:

for each of the set of tags, identifying at least one web page in the website with which the tag is associated;

determining a set of semantic types each of which corresponds to each of the set of tags;

extracting a set of patterns from URLs of each of the at least one web page; and

storing each of the set of patterns in a machine-readable storage medium as being mapped to each of the set of semantic types.

42. The method of claim 35, wherein, the semantic relationship specifies a domain where the web page is from.

43. The method of claim 35, further comprising, in response to receiving a user request, sorting the web page in a search results page such that the web page visually appears to be associated with the semantic type.

44. The method of claim 35, wherein, the tag has an associated weight value.

45. The method of claim 44, further comprising, rating trustworthiness of the pattern extracted from the URL based on the associated weight value of the tag that is identified in the web page having the URL.

46. A method for automatically mapping patterns of Universal Resource Locators (URLs) of web pages on a website to one or more semantic types, the method, comprising:

identifying a first web page and a second web page in the web site;

retrieving a first URL of the first web page and a second URL of the second web page;

storing the first and second URLs in memory for analysis;

comparing URL segments in the first and second URLs and corresponding values in each field;

extracting a first pattern from the first URL;

using a key field from the URL segments in the first URL, identifying a first semantic type with which content embodied in the first web page has a first type of semantic relationship;

storing the first pattern in a database embodied in a machine-readable storage medium as being mapped to the first semantic type;

receiving via a user interface a search query associated with the first semantic type;

mapping the search query into the first pattern stored in the database based on the first semantic type; and

performing a search for other location identifiers matching the first pattern for locating other web pages or other web pages including content embodied therein, that have the first type of semantic relationship to the first semantic type.

47. The method of claim 46,

further comprising, determining a template structure of the first web page based on the comparison;

wherein, the key field determines a layout of the template structure;

wherein, the first semantic type is identified from the layout of the template structure.

48. The method of claim 47, further comprising,

identifying, from one or more of, the URL segments, another key field, a corresponding layout, and a corresponding semantic type,

wherein, the content embodied in the first web page has another type of semantic relationship with the another semantic type.

49. The method of claim 46, further comprising,

identifying, using a tag associated with the first web page, a second semantic type,

wherein, the content embodied in the first web page has a second type of semantic relationship with the second semantic type.

50. The method of claim 46, further comprising:

using the first pattern, extracting a value from a key field of the URL segments in the second URL;

identifying, based on the value in the key field, a second semantic type with which content embodied in the second web page has the first type of semantic relationship.

51. The method of claim 46, wherein, the first and second web pages are item detail pages.

52. The method of claim 46, wherein, the web site is selected from a set of candidate web sites.

53. The method of claim 52, wherein, the web site is selected from the set of candidate web sites based on user behavior related to the web site.

54. The method of claim 53, wherein, the user behavior includes, one or more of, a number of user visits and a number of bookmarks of web pages in the web site.

55. The method of claim 53, wherein, the user behavior includes, one or more of, a number of shares with other users and a number of mentions via a social networking utility.

56. A method for mapping patterns of location identifiers of web pages to a semantic type using a tag, the method, comprising:

selecting the tag from multiple tags associated with an initial content source;

identifying a set of search results of a search query comprising the tag using a search engine;

creating a set of patterns from each of a set of location identifiers corresponding to the set of search results;

associating the set of patterns with a semantic type corresponding to the tag; and

storing the association in a database on a machine-readable storage medium;

receiving via a user interface a search query associated with the semantic type;

mapping the search query into the pattern stored in the database based on the semantic type; and

performing a search for other location identifiers matching the pattern for locating other web pages or other web pages including content embodied therein, that have a semantic relationship to the semantic type.

57. The method of claim 56, wherein, the set of search results is selected from a larger pool of search results identified using the search query.

58. The method of claim 56, wherein, the tag is selected in response to determining that the location identifier of the initial content source includes a segment having the tag.

59. The method of claim 56, wherein, the tag is selected in response to determining that the initial content source includes text comprising the tag.

60. The method of claim 56, wherein, the tag is selected in response to determining that XHTML or HTML of the initial content source includes text comprising the tag.

61. A system for automatically mapping a pattern related to a Universal Resource Locator (URL) of a web page in a website to a semantic type, the system having a processor and comprising:

a metadata identifier module to cause the processor to identify a set of tags associated with a website that is hosted by a web server;

an object finder module to cause the processor to detect a web page in the website in which a tag of the set of tags is identified;

a type detection module to cause the processor to determine a semantic type with which the tag corresponds,

wherein, the content embodied in the web page has a semantic relationship with the semantic type that corresponds to the tag;

an extraction module to cause the processor to extract a pattern from a URL of the web page,

wherein the pattern is not identical to the URL and is used to search for other URLs;

storing an association of the pattern with the semantic type in a database;

receiving via a user interface a search query associated with the semantic type;

mapping the search query into the pattern stored in the database based on the semantic type; and

performing a search for other location identifiers matching the pattern for locating other web pages or other web pages including content embodied therein, that have the semantic relationship to the semantic type.

62. The system of claim 61, further comprising,

a weighting module to cause the processor to assign a weight to each of the set of tags,

wherein the pattern extracted from the URL has a trustworthiness rating that corresponds to the associated weighting of the tag.

63. The system of claim 61, further comprising,

a metadata analyzer to cause the processor to analyze the set of tags;

and

a metadata filter module to cause the processor to extract the tag from the set of tags for use in determining the semantic type with which the pattern extracted from the URL is associated.

64. A non-transitory machine-readable storage medium having stored thereon a set of instructions which when executed perform a method for automatically mapping a pattern related to a location identifier of an object having content in the Web to a semantic type using metadata associated with the object, comprising:

collecting the metadata from one or more of a plurality of content sources hosted by host servers and the object itself,

wherein each of the plurality of content sources includes at least a portion of the object or a reference to the object associated with the location identifier, and

wherein the metadata corresponds to the semantic type with which the object or content embodied therein has a semantic relationship;

extracting the pattern from the location identifier of the object,

wherein the pattern is not identical to the location identifier and is used to search for other location identifiers of objects in the Web;

storing in a database embodied in a machine-readable storage medium a mapping from the pattern to the semantic type;

receiving via a user interface a search query associated with the semantic type;

mapping the search query into the pattern stored in the database based on the semantic type; and

performing a search for other location identifiers matching the pattern for locating other web pages or other web pages including content embodied therein, that have a semantic relationship to the semantic type.

65. The non-transitory machine-readable storage medium of claim 64,

wherein, the metadata has an associated weighting;

wherein, the pattern extracted from the location identifier has a trustworthiness rating that corresponds to the associated weighting of the metadata.