Methods and systems for enhancing metadata

• US 10,210,184 B2
• Filed: 03/27/2015
• Issued: 02/19/2019
• Est. Priority Date: 11/21/2000
• Status: Expired due to Fees

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: Abajian, Aram Christian, Alexander, Robin Andrew, Lee, Scott Chao-Chueh, Dahl, Austin David, Derosa, John Anthony, Porter, Charles A., Rehm, Eric Carl, Kolar, Jennifer Lynn, Sudanagunta, Srinivasan
• Primary Examiner(s): Vy, Hung T
• Application Number:
  US14/670,561
• Publication Number:
  US 20150199445A1
• Time in Patent Office: 1,425 Days
• Field of Search: 707711, 380 44, 380 30, 709246, 709217, 709223
• CPC Class Codes: G06F 16/27 Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
• CPC Class Codes: G06F 16/41 Indexing; Data structures therefor; Storage structures
• CPC Class Codes: G06F 16/4387 by the use of playlists
• CPC Class Codes: G06F 16/48 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G06F 16/907 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G06F 16/908 using metadata automatically derived from the content
• CPC Class Codes: G06F 16/951 Indexing; Web crawling techniques
• CPC Class Codes: G06F 16/9535 Search customisation based on user profiles and personalisation
• CPC Class Codes: G06F 16/9538 Presentation of query results
• CPC Class Codes: G06F 16/955 using information identifiers, e.g. uniform resource locators [URL]
• CPC Class Codes: G06F 40/205 Parsing
• CPC Class Codes: Y10S 707/913 Multimedia
• CPC Class Codes: Y10S 707/923 Intellectual property
• CPC Class Codes: Y10S 707/959 Network
• CPC Class Codes: Y10S 707/99933 Query processing, i.e. searching
• CPC Class Codes: Y10S 707/99934 Query formulation, input preparation, or translation
• CPC Class Codes: Y10S 707/99935 Query augmenting and refining, e.g. inexact access
• CPC Class Codes: Y10S 707/99943 Generating database or data structure, e.g. via user interface
• CPC Class Codes: Y10S 707/99945 Object-oriented database structure processing
• CPC Class Codes: Y10S 707/99948 Application of database or data structure, e.g. distributed, multimedia, or image

Abstract

A method and system for utilizing metadata to search for media, such as multimedia and streaming media, includes searching for the media, receiving results, extracting metadata associated with the media, enhancing the extracted metadata, and grouping the search results in accordance with attributes of the enhanced metadata. Enhancing and grouping include adding related metadata to the database of metadata, iteratively using metadata to search for more media related data, removing duplicate URLs, collapsing URLs that are variants of each other, and masking out superfluous terms from URLs. The resultant metadata and media files are available to users and search engines.

Claims

1. A system for enhancing metadata, the system comprising:

a metadata obtaining section that obtains metadata of a file that includes media; and

a digital storage storing processing instructions;

one or more processing sections that execute the processing instructions so as to implement functions of an extraction agent that;

separates noisy items of the metadata into keywords,

performs, using separated noisy items of the metadata, a full-text query against the potential ground truth database,

calculates a score quantifying a degree of similarity between the separated noisy items of metadata and potential ground truth data, and

qualifies the potential ground truth database, based on a comparison of the calculated score to a threshold score, as a ground truth database;

identifies, in the ground truth database, valid metadata that at least partially matches the obtained metadata; and

modifies the obtained metadata using at least a portion of the valid metadata so as to generate enhanced metadata, by

comparing contents in the obtained metadata with corresponding contents in the valid metadata,

identifying contents in the valid metadata that are not in the obtained metadata, and

adding the identified contents in the valid metadata to the obtained metadata.

2. The system of claim 1, wherein the metadata obtaining section obtains the obtained metadata from a source other than the ground truth database.

3. The system of claim 1, wherein the metadata obtaining section obtains at least some of the obtained metadata using a spider.

4. The system of claim 1, wherein the metadata obtaining section parses and indexes into metadata fields the obtained metadata, and wherein the extraction agent identifies valid metadata via a field-by-field comparison of the metadata fields.

5. The system of claim 1, wherein the extraction agent identifies the valid metadata by:

calculating a score based on a degree of similarity between the obtained metadata and the valid metadata; and

determining that the valid metadata at least partially matches the obtained metadata based at least in part on the calculated score.

6. A method of enhancing metadata, the method comprising:

separating noisy items of the metadata into keywords,

performing, using separated noisy items of the metadata, a full-text query against the potential ground truth database,

calculating a score quantifying a degree of similarity between the separated noisy items of metadata and potential ground truth data, and

qualifying the potential ground truth database, based on a comparison of the calculated score to a threshold score, as a ground truth database;

identifying, in the ground truth database, valid metadata that at least partially matches obtained metadata of a file that includes media; and

modifying the obtained metadata using at least a portion of the valid metadata so as to generate enhanced metadata, by

comparing contents in the obtained metadata with corresponding contents in the valid metadata,

identifying contents in the valid metadata that are not in the obtained metadata, and

adding the identified contents in the valid metadata to the obtained metadata.

7. The method of claim 6, wherein the obtained metadata is obtained from a source other than the ground truth database.

8. The method of claim 6, wherein the obtained metadata is at least partially obtained using a spider.

9. The method of claim 6, further comprising parsing and indexing into metadata fields the obtained metadata, and wherein the identifying the valid metadata includes a field-by-field comparison of the metadata fields.

10. The system of method 6, wherein the identifying valid metadata includes:

calculating a score based on a degree of similarity between the obtained metadata and the valid metadata; and

determining whether the valid metadata at least partially matches the obtained metadata based at least in part on the calculated score.

11. A device for enhancing metadata, the device comprising:

a metadata obtainer that obtains metadata of a file that includes media;

a digital storage that stores processing instructions; and

one or more hardware processors that execute the processing instructions so as to provide functions of an extractor that;

separates noisy items of the metadata into keywords,

performs, using separated noisy items of the metadata, a full-text query against the potential ground truth database,

calculates a score quantifying a degree of similarity between the separated noisy items of metadata and potential ground truth data, and

qualifies the potential ground truth database, based on a comparison of the calculated score to a threshold score, as a ground truth database;

identifies, in the ground truth database, valid metadata that at least partially matches the obtained metadata; and

enhances the obtained metadata using at least a portion of the valid metadata so as to generate enhanced metadata, by

comparing contents in the obtained metadata with corresponding contents in the valid metadata,

identifying contents in the valid metadata that are not in the obtained metadata, and

adding the identified contents in the valid metadata to the obtained metadata.

12. The system of claim 11, wherein the metadata obtainer obtains the metadata of a file from a source other than the ground truth database.

13. The system of claim 11, wherein the metadata obtainer obtains at least some of the metadata of the file using a spider.

14. The system of claim 11, wherein the metadata obtainer parses and indexes into metadata fields the metadata of the file that includes media, and wherein the extraction agent identifies the valid metadata via a field-by-field comparison of the metadata fields.

15. The system of claim 11, wherein the extractor identifies the valid metadata by:

calculating a score based on a degree of similarity between the metadata of the file that includes media and the valid metadata; and

determining that the valid metadata at least partially matches the metadata of the file that includes media based at least in part on the calculated score.

16. A device for enhancing metadata, the device comprising:

a metadata obtainer that obtains metadata of a file that includes media;

a digital storage that stores processing instructions;

one or more hardware processors that execute the processing instructions so as to provide functions of a potential ground truth database qualifier that

separates noisy items of the metadata into keywords,

performing, using separated noisy items of the metadata, a full-text query against the potential ground truth database,

calculating a score quantifying a degree of similarity between the separated noisy items of metadata and potential ground truth data, and

qualifying the potential ground truth database, based on a comparison of the calculated score to a threshold score, as a ground truth database; and

one or more hardware processors that execute the processing instructions so as to provide functions of an extractor that;

identifies, in the ground truth database, valid metadata that at least partially matches the obtained metadata; and

enhances the obtained metadata using at least a portion of the valid metadata so as to generate enhanced metadata, by

comparing contents in the obtained metadata with corresponding contents in the valid metadata,

identifying contents in the valid metadata that do not match contents in the obtained metadata, and

replacing the non-matching contents in the obtained metadata with the identified contents in the valid metadata.