Indexing and searching of information including handler chaining

• US 7,725,454 B2
• Filed: 07/20/2007
• Issued: 05/25/2010
• Est. Priority Date: 07/20/2007
• Status: Expired due to Fees

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Kamani, Prashant, Fisher, Daniel D.
• Primary Examiner(s): Fleurantin; Jean B.
• Assistant Examiner(s): MYINT, DENNIS Y
• Application Number:
  US11/880,281
• Publication Number:
  US 20090024587A1
• Time in Patent Office: 1,040 Days
• Field of Search: 707/3, 707/201
• US Class Current: 707/711
• CPC Class Codes: G06F 16/31 Indexing; Data structures therefor; Storage structures
• CPC Class Codes: G06F 16/33 Querying
• CPC Class Codes: G06F 16/951 Indexing; Web crawling techniques

Abstract

Embodiments are provided to manage information associated with a number of disparate information sources. In an embodiment, a system includes a data structure having a uniform metadata representation and a metadata handler for interacting with the data structure. The data structure can be associated with an underlying file or some other type of information source. In one embodiment, a number of handlers can be chained together to extract and return information according to a desired mode of operation. The embodiments provide extensibility and can be tailored according to a desired implementation. Other embodiments and implementations are available.

Claims

1. A computer readable medium including executable instructions which, when executed, manage information by:

creating a plurality of information sources, each information source comprising a metadata definition document (MDD) having a uniform representation of metadata and including full-text search data (FTSData), wherein each information source can be linked to an underlying information source having a representative file format and used to provide additional content for use in searching and indexing operations;

using a schema to define the MDD for each information source, the schema including a FTSData element to specify FTSData, asset and content elements to identify a linked underlying information source, and a queries element to identify query to underlying information source mappings;

calling an intermediate handler to extract metadata and FTSData from the plurality of information sources, the intermediate handler to return the metadata and FTSData from each information source based in part on operating modes including;

a first operating mode to append FTSData of each information source with FTSData of a corresponding linked underlying information source and provide a union of metadata from each information source and the corresponding linked underlying information source, including ignoring the metadata of linked underlying information sources for conflicts of first metadata types;

a second operating mode to append FTSData of each information source with FTSData of the corresponding linked underlying information source and provide a union of metadata from each information source and the corresponding linked underlying information source, including ignoring the metadata of the information sources for conflicts of the first metadata types;

a third operating mode to return FTSData of each information source and provide a union of metadata from each information source and the corresponding linked underlying information source, including ignoring the metadata of the linked underlying information sources for conflicts of the first metadata types and second metadata types; and

,

a fourth operating mode to return FTSData of each linked underlying information source and provide a union of metadata from each information source and the corresponding linked underlying information source, including ignoring the metadata of the information sources for conflicts of the first metadata types and the second metadata types;

invoking a registered handler to extract metadata and other information from each linked underlying information source; and

,

using the metadata and FTSData as part of the indexing and searching operations.

2. The computer-readable medium of claim 1, wherein the instructions, when executed, manage information by searching against the FTSData as part of a full-text search.

3. The computer-readable medium of claim 1, wherein the instructions, when executed, manage information by defining MDD file that includes the metadata and FTSData to be associated with each linked underlying information source.

4. The computer-readable medium of claim 1, wherein the instructions, when executed, manage information by defining a MDD file that is associated with a new type of underlying information source.

5. The computer-readable medium of claim 1, wherein the instructions, when executed, manage information by chaining a plurality of handlers to create a chain of handlers, wherein the chain of handlers operate to extract metadata and FTSData from a plurality of MDD files and underlying information sources.

6. The computer-readable medium of claim 5, wherein the instructions, when executed, manage information by chaining a plurality of IFilters to create a chain of IFilters, wherein the chain of IFilters can operate to extract the metadata and the FTSData.

7. The computer-readable medium of claim 1, wherein the instructions, when executed, manage information by extracting the metadata and FTSData from each information source and the corresponding linked underlying information source according to a defined mode of operation.

8. The computer-readable medium of claim 7, wherein the instructions, when executed, manage information by using a setting to define the mode of operation before extracting the metadata and FTSData.

9. The computer-readable medium of claim 7, wherein the instructions, when executed, manage information by returning the metadata and FTSData from each information source and the corresponding linked underlying information source according to an append with MDD priority mode of operation.

10. The computer-readable medium of claim 7, wherein the instructions, when executed, manage information by returning the metadata and FTSData from each information source and the corresponding linked underlying information source according to an append with content priority mode of operation.

11. The computer-readable medium of claim 7, wherein the instructions, when executed, manage information by returning the metadata and FTSData from each information source and the corresponding linked underlying information source according to an overwrite with MDD priority mode of operation.

12. The computer-readable medium of claim 7, wherein the instructions, when executed, manage information by returning the metadata and FTSData from each information source and the corresponding linked underlying information source according to an overwrite with content priority mode of operation.

13. The computer-readable medium of claim 7, wherein the instructions, when executed, manage information by returning the metadata and FTSData from each information source and the corresponding linked underlying information source according to a chain for FTSData only mode of operation.

14. The computer-readable medium of claim 7, wherein the instructions, when executed, manage information by returning the metadata and FTSData from each information source and the corresponding linked underlying information source according to a fine-granularity mode of operation.

15. A system to manage information comprising:

a plurality of information sources, each information source comprising a MDD that includes a uniform representation of metadata and being defined using a schema that includes a FTSData element to specify FTSData, asset and content elements to identify a linked underlying information source, and a queries element to identify query to underlying information source mappings, wherein the plurality of information sources include FTSData and are linked to underlying information sources;

an intermediate handler configured to filter metadata from the plurality of information sources and return the metadata and FTSData from each information source based in part on operating modes that include;

a first operating mode to append FTSData of each information source with FTSData of a corresponding linked underlying information source and provide a union of metadata from each information source and the corresponding linked underlying information source, wherein the intermediate handler operates as part of the first operating mode to ignore the metadata of linked underlying information sources for conflicts of first metadata types;

a second operating mode to append FTSData of each information source with FTSData of the corresponding linked underlying information source and provide a union of metadata from each information source and the corresponding linked underlying information source, wherein the intermediate handler operates as part of the second operating mode to ignore the metadata of the information sources for conflicts of the first metadata types;

a third operating mode to return FTSData of each information source and provide a union of metadata from each information source and the corresponding linked underlying information source, wherein the intermediate handler operates as part of the third operating mode to ignore metadata of the linked underlying information sources for conflicts of the first metadata types and second metadata types; and

,

a fourth operating mode to return FTSData of each linked underlying information source and provide a union of metadata from each information source and the corresponding linked underlying information source, wherein the intermediate handler operates to ignore metadata of the information sources for conflicts of the first metadata types and the second metadata types;

a chained handler configured to filter metadata from the underlying information source, wherein the intermediate handler can call on the chained handler to filter the metadata; and

,

an indexer to index the extracted metadata and any existing FTSData against the information source.

16. The system of claim 15, wherein the intermediate handler is further configured to filter FTSData from a MDD file.

17. The system of claim 15, wherein system can be configured to return metadata and FTSData based in part of a mode of operation setting.

18. A method of managing information comprising:

defining a data structure including a uniform representation of metadata, wherein the data structure can include an element defining free-form text that can be used to provide additional details about the data structure;

creating a plurality of information sources based in part on the data structure, each information source comprising a MDD having the uniform representation of metadata and including full-text search data (FTSData), wherein the each information source can be linked to an underlying information source having a representative file format;

extracting the metadata and free-form text from each information source by invoking a metadata handler to extract the metadata and free-form text, the metadata handler to return the metadata and FTSData from each information source based in part on operating modes that include;

a first operating mode to append FTSData of each information source with FTSData of a corresponding linked underlying information source and provide a union of metadata from each information source and the corresponding linked underlying information source, wherein the metadata handler operates as part of the first operating mode to ignore the metadata of linked underlying information sources for conflicts of first metadata types;

a second operating mode to append FTSData of each information source with FTSData of the corresponding linked underlying information source and provide a union of metadata from each information source and the corresponding linked underlying information source, wherein the metadata handler operates as part of the second operating mode to ignore the metadata of the information sources for conflicts of the first metadata types;

a third operating mode to return FTSData of each information source and provide a union of metadata from each information source and the corresponding linked underlying information source, wherein the metadata handler operates as part of the third operating mode to ignore metadata of the linked underlying information sources for conflicts of the first metadata types and second metadata types; and

,

a fourth operating mode to return FTSData of each linked underlying information source and provide a union of metadata from each information source and the corresponding linked underlying information source, wherein the metadata handler operates as part of the fourth operating mode to ignore metadata of the information sources for conflicts of the first metadata types and the second metadata types;

chaining a second handler that is configured to extract underlying metadata from a corresponding linked underlying information source; and

,

performing an indexing operation by using the extracted metadata and free-form text to index against the data structure.

19. The method of claim 18, further comprising returning a search result associated with the data structure using the extracted metadata and free-form text as defined by the element.

20. The method of claim 18, further comprising setting a mode of operation and returning metadata and free-form text to an index component based in part on the mode of operation.