System and method for metadata search

• US 9,275,144 B2
• Filed: 09/25/2009
• Issued: 03/01/2016
• Est. Priority Date: 09/27/2008
• Status: Expired due to Fees

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Pan, Yue, Xie, Guo Tong, Yuan, Ni
• Primary Examiner(s): Yen, Syling
• Application Number:
  US12/567,213
• Publication Number:
  US 20100106729A1
• Time in Patent Office: 2,349 Days
• Field of Search: 707/707
• US Class Current: 1/1
• CPC Class Codes: G06F 16/951 Indexing; Web crawling techniques

Abstract

A system, a method, and a computer readable article of manufacture for metadata searching. The system includes: a receiving module for receiving a search query with respect to a plurality of metadata resources; a query module for parsing the search query and searching related metadata resources and the structural information among the related metadata resources according to the parsing of the search query; and an output module for outputting the search results so as to realize a fuzzy structural search with respect to the plurality of metadata resources. The method includes the steps of: receiving a search query that does not designate complete structural information of the metadata resources; parsing the search query and searching related metadata resources to form search results that include the complete structural information; and outputting the search results.

Claims

1. A system for metadata searching, the system comprising:

a memory;

a processor;

a receiving module configured for receiving a search query with respect to a plurality of metadata resources, wherein each of the plurality of metadata resources comprises data describing a set of other data, and wherein each of the plurality of metadata resources comprises structural information comprising at least relationship path information between the metadata resource and at least one other of the plurality of metadata resources, wherein the search query comprises at least one keyword associated with textual information in each of the plurality of metadata resources without designating all structural information among the plurality of metadata resources;

a query module configured for

parsing the search query;

identifying a set of related metadata resources within the plurality of metadata resources based on at least the relationship path information within the structural information of each of the plurality of metadata resources;

searching, based on the parsing, each of the set of related metadata resources based on the textual information and the structural information of each of the set of related metadata resources; and

forming, based on the searching, a set of search results comprising, the search results comprising at least one of the set of related metadata resources comprising textual information satisfying the at least one keyword, and complete structural information between the at least one of the set of related metadata resources and at least one other of the set of related metadata resources; and

an output module configured for outputting the search results so as to realize a fuzzy structural search with respect to the plurality of metadata resources, the fuzzy structural search utilizing the search query, which is absent at least a designation of the relationship path information among the plurality of metadata resources, to obtain the set of search results, which comprises the complete structural information between the at least one of the set of related metadata resources and at least one of the set of related metadata resources.

2. The system according to claim 1, further comprising:

an indexer module configured for indexing the plurality of metadata resources, wherein the indexing generates

text indexes with respect to the textual information in the plurality of metadata resources, and

structure indexes storing information on relationship paths between pairs of metadata resources in the plurality of metadata resources;

wherein the searching is based on the text indexes and the structure indexes.

3. The system according to claim 2, wherein the text indexes store a mapping between at least a portion of one or more text segments in the plurality of metadata resources and each corresponding metadata resource in the plurality of metadata resources, and attributes to which the one or more text segments belong to within each corresponding metadata resource, wherein the text indexes further store type information of each of the plurality of metadata resources.

4. The system according to claim 2, wherein the structure indexes are implemented by a two-level hash table, wherein entries in a first level hash table are identifiers of metadata resources at end nodes of the relationship paths, and wherein entries in a second level hash table are identifiers of metadata resources at start nodes of the relationship paths and information on the relationship paths.

5. The system according to claim 2, wherein the relationship paths comprise:

direct relationship paths between pairs of metadata resources;

relationship paths including an equivalence relationship between pairs of metadata resources; and

relationship paths including a containment relationship between pairs of metadata resources.

6. The system of claim 1, wherein a type of the search query is at least one of:

a first query type designating a group of keywords to obtain metadata resources comprising text segments including the designated group of keywords;

a second query type designating a group of keywords to obtain metadata resources that have relationship paths to metadata resources comprising text segments including the designated group of keywords;

a third query type designating a group of keywords and a type of metadata resources, to obtain metadata resources comprising text segments including the designated group of keywords and that are of the designated;

a fourth query type designating a group of keywords and a type of metadata resources to obtain metadata resources comprising the designated type and having relationship paths to metadata resources comprising text segments including the designated group of keywords; and

a fifth query type designating a first group of keywords, a second group of keywords, and a relationship to obtain a first set of metadata resources, the first set of metadata resources having relationship paths to a second metadata resources and the relationship paths comprising the designated relationship, wherein the first set of metadata resources comprises at least one of the first group of keywords and relationship paths to metadata resources comprising the first group of keywords, and wherein the second set of metadata resources comprises at least one of the second group of keywords and relationship paths to metadata resources comprising the second group of keywords.

7. The system of claim 6, wherein a search query of the second query type searches

metadata resources S of which the text segments include the designated group of keywords,

metadata resources S′

having direct relationship paths to any one of the metadata resources in S, and

metadata resources having relationship paths comprising at least one of an equivalence relationship and a containment relationship to any one of the metadata resources in S′

; and

wherein a search query of the fourth query type is for searching

metadata resources S comprising a type that is the designated type and the text segments of which include the designated group of keywords,

metadata resources S′

comprising a type that is the designated type and having direct relationship paths to any one of the metadata resources in S, and

metadata resources comprising a type that is the designated type and having relationship paths comprising at least one of an equivalence relationship and a containment relationship to any one of the metadata resources in S′

.

8. The system of claim 1, wherein the output module is further configured for:

displaying the search results, wherein the displaying comprises at least one of

displaying at least a portion of the at least one of the set of related metadata resources comprising the textual information; and

displaying a link to the at least one of the set of related metadata resources, and wherein the displaying further comprises at least one of

displaying a set of relationship paths, based on the complete structural information, between the at least one of the set of related metadata resources and at least one of the set of related metadata resources; and

displaying a selectable link configured to display the set of relationship paths when selected.

9. The system of claim 1, wherein the output module is further configured for:

sorting the at least one of the set of related metadata resources and the at least one other of the set of related metadata resources, the sorting being performed according to a measurement based on keyword matching and a measurement of a set of relationship paths between the at least one of the set of related metadata resources and the at least one other of the set of related metadata resources.

10. A method implemented on an electronic data processing system for performing a metadata resources search, the method comprising:

receiving a search query with respect to a plurality of metadata resources, wherein each of the plurality of metadata resources comprises data describing a set of other data, and wherein each of the plurality of metadata resources comprises structural information comprising at least relationship path information between the metadata resource and at least one other of the plurality of metadata resources, wherein the search query comprises at least one keyword associated with textual information in each of the plurality of metadata resources without designating all structural information among the plurality of metadata resources;

parsing the search query;

identifying a set of related metadata resources within the plurality of metadata resources based on at least the relationship path information within the structural information of each of the plurality of metadata resources;

searching, based on the parsing, each of the set of related metadata resources based on the textual information and the structural information of each of the set of related metadata resources;

forming, based on the searching, a set of search results comprising, the search results comprising at least one of the set of related metadata resources comprising textual information satisfying the at least one keyword, and complete structural information between the at least one of the set of related metadata resources and at least one other of the set of related metadata resources; and

outputting the search results so as to realize a fuzzy structural search with respect to the plurality of metadata resources, the fuzzy structural search utilizing the search query, which is absent at least a designation of the relationship path information among the plurality of metadata resources, to obtain the set of search results, which comprises the complete structural information between the at least one of the set of related metadata resources and at least one of the set of related metadata resources.

11. The method of claim 10, further comprising:

indexing the plurality of metadata resources, wherein the indexing generates

text indexes with respect the textual information in the plurality of metadata resources, and

structure indexes storing information on relationship paths between pairs of metadata resources in the plurality of metadata resources;

wherein the searching is based on the text indexes and the structure indexes.

12. The method of claim 11, wherein the text indexes store a mapping between at least a portion of one or more text segments in the plurality of metadata resources and each corresponding metadata resource in the plurality of metadata resources, and attributes to which the one or more text segments belong to within each corresponding metadata resource, wherein the text indexes further store type information of each of the plurality of metadata resources.

13. The method of claim 11, wherein the structure indexes are implemented by a two-level hash table, where entries in a first level hash table are the identifiers of metadata resources at end nodes of the relationship paths, and wherein entries in a second level hash table are the identifiers of metadata resources at start nodes of the relationship paths and information on the relationship paths.

14. The method of claim 11, wherein the relationship paths comprise:

direct relationship paths between pairs of metadata resources;

relationship paths including an equivalence relationship between pairs of metadata resources; and

relationship paths including a containment relationship between pairs of metadata resources.

15. The method of claim 10, wherein a type of the search query is at least one of:

a first query type designating a group of keywords to obtain metadata resources comprising text segments including the designated group of keywords;

a second query type designating a group of keywords to obtain metadata resources that have relationship paths to metadata resources comprising text segments including the designated group of keywords;

a third query type designating a group of keywords and a type of metadata resources, to obtain metadata resources comprising text segments including the designated group of keywords and that are of the designated;

a fourth query type designating a group of keywords and a type of metadata resources to obtain metadata resources comprising the designated type and having relationship paths to metadata resources comprising text segments including the designated group of keywords; and

a fifth query type designating a first group of keywords, a second group of keywords, and a relationship to obtain a first set of metadata resources, the first set of metadata resources having relationship paths to a second metadata resources and the relationship paths comprising the designated relationship, wherein the first set of metadata resources comprises at least one of the first group of keywords and relationship paths to metadata resources comprising the first group of keywords, and wherein the second set of metadata resources comprises at least one of the second group of keywords and relationship paths to metadata resources comprising the second group of keywords.

16. The method of claim 15, wherein a search query of the second query type searches

metadata resources S of which the text segments include the designated group of keywords,

metadata resources S′

having direct relationship paths to any one of the metadata resources in S, and

metadata resources having relationship paths comprising at least one of an equivalence relationship and a containment relationship to any one of the metadata resources in S′

; and

wherein a search query of the fourth query type is for searching

metadata resources S comprising a type that is the designated type and the text segments of which include the designated group of keywords,

metadata resources S′

comprising a type that is the designated type and having direct relationship paths to any one of the metadata resources in S, and

metadata resources comprising a type that is the designated type and having relationship paths comprising at least one of an equivalence relationship and a containment relationship to any one of the metadata resources in S′

.

17. The method of claim 10, wherein the outputting comprises:

displaying the search results, wherein the displaying comprises at least one of

displaying at least a portion of the at least one of the set of related metadata resources comprising the textual information; and

displaying a link to the at least one of the set of related metadata resources, and wherein the displaying further comprises at least one of

displaying a set of relationship paths, based on the complete structural information, between the at least one of the set of related metadata resources and at least one of the set of related metadata resources; and

displaying a selectable link configured to display the set of relationship paths when selected.

18. The method of claim 10, wherein the outputting comprises:

sorting the at least one of the set of related metadata resources and the at least one other of the set of related metadata, the sorting being performed according to a measurement based on keyword matching and a measurement based on a set of relationship paths between the at least one of the set of related metadata resources and the at least one other of the set of related metadata resources.

19. A non-transitory computer program product embodying computer readable instructions which, when executed by a computer, cause it to carry out a method comprising:

receiving a search query with respect to a plurality of metadata resources, wherein each of the plurality of metadata resources comprises data describing a set of other data, and wherein each of the plurality of metadata resources comprises structural information comprising at least relationship path information between the metadata resource and at least one other of the plurality of metadata resources, wherein the search query comprises at least one keyword associated with textual information in each of the plurality of metadata resources without designating all structural information among the plurality of metadata resources;

parsing the search query;

identifying a set of related metadata resources within the plurality of metadata resources based on at least the relationship path information within the structural information of each of the plurality of metadata resources;

searching, based on the parsing, each of the set of related metadata resources based on the textual information and the structural information of each of the set of related metadata resources;

forming, based on the searching, a set of search results comprising, the search results comprising at least one of the set of related metadata resources comprising textual information satisfying the at least one keyword, and complete structural information between the at least one other of the set of related metadata resources and at least one of the set of related metadata resources; and

outputting the search results so as to realize a fuzzy structural search with respect to the plurality of metadata resources, the fuzzy structural search utilizing the search query, which is absent at least a designation of the relationship path information among the plurality of metadata resources, to obtain the set of search results, which comprises the complete structural information between the at least one of the set of related metadata resources and at least one of the set of related metadata resources.