Method and apparatus for semantic search of schema repositories

• US 20070185868A1
• Filed: 02/08/2006
• Published: 08/09/2007
• Est. Priority Date: 02/08/2006
• Status: Abandoned Application

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Shah, Gauri, Yan, Lingling, Syeda-Mahmood, Tanveer, Roth, Mary, Urban, Willi
• Application Number:
  US11/349,081
• Publication Number:
  US 20070185868A1
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 16/80 of semi-structured data, e.g. markup language structured data such as SGML, XML or HTML content-based retrieval of web data G06F16/95
• CPC Class Codes: G06F 16/81 Indexing, e.g. XML tags; Data structures therefor; Storage structures

Abstract

Mechanisms for searching XML repositories for semantically related schemas from a variety of structured metadata sources, including web services, XSD documents and relational tables, in databases and Internet applications. A search is formulated as a problem of computing a maximum matching in pairwise bipartite graphs formed from query and repository schemas. The edges of such a bipartite graph capture the semantic similarity between corresponding attributes of the schema based on their name and type semantics. Tight upper and lower bounds are also derived on the maximum matching that can be used for fast ranking of matchings whilst still maintaining specified levels of precision and recall. Schema indexing is performed by ‘attribute hashing’, in which matching schemas of a database are found by indexing using query attributes, performing lower bound computations for maximum matching and recording peaks in the resulting histogram of hits.

Claims

1. A method of finding repository schema similar to a query schema in repositories of metadata via semantic search, comprising the steps of:

parsing said query schema to extract query words;

parsing at least one of said repository schema to extract repository words;

determining a match if a given proportion of said query words match a said repository word;

retaining each said repository schema in which at least one said match is found as a retained repository schema;

establishing a semantic matching for each said retained repository schema in which a given proportion of said query words matches a said repository word;

ranking each said semantic matching to determine a rank of said semantic matching; and

returning each said retained repository schema as a candidate if said rank of said semantic matching is greater than a predetermined value.

2. The method according to claim 1, wherein:

said step of ranking each said semantic matching further comprises the steps of;

finding a lower bound on said matching; and

ranking each said semantic matching based on said lower bound of said matching.

3. The method according to claim 2, further comprising the steps of:

generating a histogram of frequency of occurrence of said query words in each said retained repository schema; and

discarding said retained repository schema unless said retained repository schema corresponds to a maxima in said histogram.

4. The method according to claim 1, further comprising the steps of:

creating a hash table; and

indexing said hash table for each said query word.

5. The method according to claim 1, wherein:

said given proportion is substantially two thirds.

6. The method according to claim 1, further comprising, before said step of determining a match, the steps of:

tokenizing said query words;

tokenizing said repository words; and

extracting synonyms from said repository words by employing a thesaurus to expand said repository words.

7. The method according to claim 6, further comprising, the step of:

tagging parts of speech in said query words and said repository words.

8. A computer readable medium having computer executable instructions for performing steps to find repository schema similar to a query schema in repositories of metadata via semantic search, comprising:

computer readable program code parsing said query schema to extract query words;

computer readable program code parsing at least one of said repository schema to extract repository words;

computer readable program code determining a match if a given proportion of said query words match a said repository word;

computer readable program code retaining each said repository schema in which at least one said match is found as a retained repository schema;

computer readable program code establishing a semantic matching for each said retained repository schema in which a given proportion of said query words matches a said repository word;

computer readable program code ranking each said semantic matching to determine a rank of said semantic matching; and

computer readable program code returning each said retained repository schema as a candidate if said rank of said semantic matching is greater than a predetermined value.

9. The computer readable medium according to claim 8, wherein:

said computer readable program code ranking each said semantic matching further comprises;

computer readable program code finding a lower bound on said matching; and

computer readable program code ranking each said semantic matching based on said lower bound of said matching.

10. The computer readable medium according to claim 9, further comprising:

computer readable program code generating a histogram of frequency of occurrence of said query words in each said retained repository schema; and

computer readable program code discarding said retained repository schema unless said retained repository schema corresponds to a maxima in said histogram.

11. The computer readable medium according to claim 8, further comprising:

computer readable program code creating a hash table; and

computer readable program code indexing said hash table for each said query word.

12. The computer readable medium according to claim 8, wherein:

said given proportion is substantially two thirds.

13. The computer readable medium according to claim 8, further comprising:

computer readable program code tokenizing said query words;

computer readable program code tokenizing said repository words; and

computer readable program code extracting synonyms from said repository words by employing a thesaurus to expand said repository words.

14. The computer readable medium according to claim 13, further comprising:

computer readable program code tagging parts of speech in said query words and said repository words.

15. An apparatus for finding repository schema similar to a query schema in repositories of metadata via semantic search, comprising:

means for parsing said query schema to extract query words;

means for parsing at least one of said repository schema to extract repository words;

means for determining a match if a given proportion of said query words match a said repository word;

means for retaining each said repository schema in which at least one said match is found as a retained repository schema;

means for establishing a semantic matching for each said retained repository schema in which a given proportion of said query words matches a said repository word;

means for ranking each said semantic matching to determine a rank of said semantic matching; and

means for returning each said retained repository schema as a candidate if said rank of said semantic matching is greater than a predetermined value.

16. The apparatus according to claim 15, wherein:

said means for ranking each said semantic matching further comprises;

means for finding a lower bound on said matching; and

means for ranking each said semantic matching based on said lower bound of said matching.

17. The apparatus according to claim 16, further comprising:

means for generating a histogram of frequency of occurrence of said query words in each said retained repository schema; and

computer readable program code discarding said retained repository schema unless said retained repository schema corresponds to a maxima in said histogram.

18. The apparatus according to claim 15, further comprising:

means for creating a hash table; and

means for indexing said hash table for each said query word.

19. The apparatus according to claim 15, wherein:

said given proportion is substantially two thirds.

20. The apparatus according to claim 15, further comprising:

means for tokenizing said query words;

means for tokenizing said repository words; and

means for extracting synonyms from said repository words by employing a thesaurus to expand said repository words.

21. The apparatus according to claim 20, further comprising:

means for tagging parts of speech in said query words and said repository words.