Methods, computer readable mediums and systems for linking related data from at least two data sources based upon a scoring algorithm

• US 20060089948A1
• Filed: 10/21/2004
• Published: 04/27/2006
• Est. Priority Date: 10/21/2004
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Picker, Saar, Deeds, Paul
• Granted Patent: US 7,644,077 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: H04H 60/72 using electronic programme guides [EPG] focusing on identifying broadcast space time H04H60/39 ; menu type display of EPG in television receivers H04N21/47
• CPC Class Codes: H04H 60/73 using meta-information
• CPC Class Codes: H04N 21/4622 Retrieving content or additional data from different sources, e.g. from a broadcast channel and the Internet web site content organization and management for information retrieval from the Internet G06F16/958; transmission by internet of broadcast information H04H60/82; stock exchange data over packet-switching network H04L12/1804; push services including data channel over packet-switching network H04L12/1859
• CPC Class Codes: H04N 21/4722 for requesting additional data associated with the content
• CPC Class Codes: H04N 21/8133 specifically related to the content, e.g. biography of the actors in a movie, detailed information about an article seen in a video program
• CPC Class Codes: H04N 21/84 Generation or processing of descriptive data, e.g. content descriptors systems specially adapted for using meta-information in broadcast systems H04H60/73
• CPC Class Codes: H04N 21/8586 by using a URL processing chained hypermedia data for information retrieval G06F16/94; information retrieval from the Internet by using URLs G06F16/955; URL in broadcast information H04H20/93; Web-based protocols H04L67/02
• CPC Class Codes: H04N 7/17318 Direct or substantially direct transmission and handling of requests

Abstract

A method for linking related data, such as metadata, from at least two data sources. The method includes formatting items of data of the data sources according to attributes. The method also executes a scoring algorithm for one or more of the attributes to generate a score for one or more sets of the formatted items of data, each of the sets includes an item of data from one data source and an item of data from another data source. Finally the method identifies related items of data of the separate data sources based upon the generated scores to facilitate linking related data of the two data sources. The method may also provide a link between data items of the data sources.

Claims

1. A method for linking related data from at least two data sources, said method comprising:

formatting items of data of a first data source according to attributes;

formatting items of data of a second data source according to said attributes;

executing a scoring algorithm for one or more of the attributes to generate a score for one or more sets of the formatted items of data, each of said sets comprising an item of data from the first data source and an item of data from the second data source; and

identifying related items of data of the first and second data sources based upon the generated scores.

2. The method as set forth in claim 1 further comprising providing a link between data items of the first data source and data items of the second data source identified as being related.

3. The method as set forth in claim 2 wherein said providing a link is in response to receiving an item selection from a user.

4. The method as set forth in claim 2 wherein said link is accessible via at least one of a web browser, a media player, a handheld electronic device, or a personal computer.

5. The method as set forth in claim 1 wherein a first attribute of said one or more of the attributes of a first data item of the first data source comprises a first string and a corresponding first attribute of a first data item of the second data source comprises a second string, and

wherein said executing the scoring algorithm for said first attributes comprises performing a string comparison between the first string and the second string and scoring the comparison of the first attribute of the first data item of the first data source and the corresponding first attribute of the first data item of the second data source according to said scoring algorithm.

6. The method as set forth in claim 5 wherein a second attribute of said one or more of the attributes of the first data item of the first data source comprises a third string and a corresponding second attribute of the first data item of the second data source comprises a fourth string, and

wherein said executing the scoring algorithm for said second attributes comprises performing a string comparison between the third string and the fourth string and scoring the comparison of the second attribute of the first data item of the first data source and the corresponding second attribute of the first data item of the second data source according to said scoring algorithm.

7. The method as set forth in claim 6 wherein said executing the scoring algorithm comprises combining the score from the string comparison between the first string and the second string and from the string comparison between the third string and the fourth string to produce a total match score for said first data items.

8. The method as set forth in claim 7 wherein said executing the scoring algorithm further comprises

weighting the score for said first attribute of the first data items before said combining, and

weighting the score for said second attribute of the first data items before said combining.

9. The method as set forth in claim 7 wherein the first attribute of a second data item of the second data source comprises a fifth string, and

wherein executing the scoring algorithm for said first attributes further comprises performing a string comparison between the first string and the fifth string and scoring the comparison of the first attribute of the first data item of the first data source and a corresponding first attribute of the second data item of the second data source according to said scoring algorithm.

10. The method as set forth in claim 9 wherein the second attribute of the second data item of the second data source comprises a sixth string, and

wherein executing the scoring algorithm for said second attributes further comprises performing a string comparison between the third string and the sixth string and scoring the comparison of the second attribute of the first data item of the first data source and a corresponding second attribute of the second data item of the second data source according to said scoring algorithm.

11. The method as set forth in claim 10 wherein said executing the scoring algorithm comprises

combining the score from the string comparison between the first string and the fifth string and from the string comparison between the third string and the sixth string to produce a total match score for said first data item of the first data source and the second data item of the second data source.

12. The method as set forth in claim 11 wherein said executing the scoring algorithm further comprises

weighting the score for said first attribute of the first and second data items of the first and second data sources, respectively, before said combining, and

weighting the score for said second attribute of the first and second data items of the first and second data sources, respectively, before said combining.

13. The method as set forth in claim 11 wherein said identifying related items of data of the first and second data sources based upon the generated scores further comprises,

linking the first data item of the first data source with the first data item of the second data source when the total match score for the first data items of each of the first and second data sources is greater than the total match score for the first and second data items of the first and second data sources, respectively, and the total match score for the first data items is greater than a threshold matching criterion, and

linking the first data item of the first data source with the second data item of the second data source when the total match score for the first and second data items of the first and second data sources, respectively, is greater than the total match score for first data items of each of the first and second data sources and the total match score for the first and second data items of the first and second data sources, respectively, is greater than a threshold matching criterion.

14. The method as set forth in claim 11 wherein said identifying related items of data of the first and second data sources based upon the generated scores further comprises,

linking the first data item of the first data source with the first data item of the second data source when the total match score for the first data items is greater than the total match score for the first data item of the first data source and any other data item of the second data source and the total match score for the first data items is greater than a threshold matching criterion.

15. The method as set forth in claim 5 wherein said scoring the comparison comprises,

assigning a high score when the string comparison between the first string and the second string yields an exact match,

assigning a neutral score less than said high score when at least one of said first string and said second string contains no value,

assigning a low score less than said neutral score when the string comparison between the first string and the second string yields a partial match, and

assigning a zero score when none of the high score, the neutral score, and the low score is assigned.

16. The method as set forth in claim 1 wherein said identifying related items of data of the first and second data sources based upon the generated scores further comprises,

linking a data item of the first data source with a data item of the second data source when a total match score for said data items is greater than any total match score for the data item of the first data source and any other data item of the second data source and the total match score for said data items is greater than a threshold matching criterion.

17. The method as set forth in claim 1 wherein said executing comprises generating a score for each set of data items comprising an item of data from said first data source and an item of data from said second data source.

18. The method as set forth in claim 17 wherein said executing comprises aggregating said sets of data comprising an item of data from said first data source and an item of data from said second data source for at least two of said attributes to generate a total match score for each of said sets.

19. The method as set forth in claim 1 further comprising formatting items of data of a third data source according to said attributes;

wherein said executing further comprises executing a scoring algorithm for one or more of the attributes to generate a score for sets of data comprising an item of data from one of said data sources and an item of data from another of said data sources; and

wherein said identifying related items further comprises identifying related items of data of the first, second, and third data sources based upon the generated scores.

20. The method as set forth in claim 19 wherein said identifying related items of data of the first and second data sources based upon the generated scores further comprises,

linking a data item of the first data source with a data item of the second data source when a total match score for said data items is greater than any total match score for the data item of the first data source and any other data item of the second data source and the total match score for said data items of the first and second data sources is greater than a threshold matching criterion, and

linking the data item of the first data source with a data item of the third data source when a total match score for said data items is greater than any total match score for the data item of the first data source and any other data item of the third data source and the total match score for said data items of the first and third data sources is greater than a threshold matching criterion.

21. The method as set forth in claim 19 wherein said executing comprises generating a score for each set of data comprising an item of data from said first data source and an item of data from said second data source, and

generating a score for each set of data comprising an item of data from said second data source and an item of data from said third data source.

22. The method as set forth in claim 19 wherein said executing comprises generating a score for each set of data comprising an item of data from said first data source and an item of data from said second data source, and

generating a score for each set of data comprising an item of data from said first data source and an item of data from said third data source.

23. The method as set forth in claim 22 wherein said first data source comprises a canonical source.

24. The method as set forth in claim 1 further comprising executing a preliminary matching algorithm for one or two high-cardinality attributes to generate a preliminary score for sets of data comprising an item of data from the first data source and an item of data from the second data source;

identifying clearly unrelated sets of data of the first and second data sources based upon the generated preliminary scores; and

excluding said clearly unrelated sets of data from said executing said scoring algorithm.

25. The method as set forth in claim 1 wherein said data sources comprise property data associated with media files.

26. The method as set forth in claim 1 wherein the data is data relating to at least one of video files, audio files, movies, music, executable files, and document files.

27. The method as set forth in claim 26 wherein when said data relates to movies said attributes are at least two of movie title, movie run time, Motion Picture Association of America (MPAA) rating, movie genre, releasing studio, cast listing, cast member, release date, release year, and director.

28. The method as set forth in claim 1 wherein said formatting comprises parsing items of data into data strings having a pre-defined format.

29. The method as set forth in claim 1 wherein said first and second data sources are at least one of a database file, an xml document, and a delimited text file.

30. One or more computer-readable media having computer-executable components for linking related data from at least two sources of data, said components comprising:

an attribute component for formatting items of data of a first data source according to a plurality of predetermined attributes, said attribute component further formatting items of data of a second data source according to said attributes;

an engine component for executing a scoring algorithm for one or more of the attributes for generating a score for sets of data, said sets of data each comprising an item of data of the first data source formatted by the attribute component and an item of data from the second data source formatted by the attribute component; and

a filter component identifying related items of data formatted by the attribute component based upon the scores generated by the engine component.

31. The one or more computer-readable media set forth in claim 30 further comprising an aggregation component for generating a total match score for each set of data comprising an item of data from said first data source and an item of data from said second data source by combining said scores for each of said attributes generated by the engine component for each of said sets.

32. The one or more computer-readable media set forth in claim 31 wherein said filter component links a data item of the first data source formatted by the attribute component with a data item of the second data source formatted by the attribute component when said total match score generated by said aggregation component for said data items is greater than any total match score for the data item of the first data source and any other data item of the second data source and the total match score for said data items is greater than a threshold matching criterion.

33. A system for linking related data from at least two sources of data, said system comprising:

a first data feed;

a second data feed;

a processor for receiving said first and second data feeds, wherein the processor is configured to;

format items of data of the first data feed according to attributes,

format items of data of the second data feed according to said attributes,

execute a scoring algorithm for one or more of the attributes to generate a score for one or more sets of the formatted items of data, each of said sets comprising an item of data from the first data feed and an item of data from the second data feed, and

identify related items of data of the first and second data feeds based upon the generated scores.

34. The system as set forth in claim 33 wherein said system comprises a data service for providing a data link between a data item of the first data feed and a data item of the second data feed identified as being related.

35. The system as set forth in claim 34 wherein said data service is a web service.

36. The system as set forth in claim 34 wherein said data service provides a data link between a data item of the first data feed and a data item of the second data feed when a total match score for said data items is greater than any total match score for the data item of the first data feed and any other data item of the second data feed and the total match score for said data items is greater than a threshold matching criterion.

37. A method for establishing a link between related metadata from at least two sources of metadata, said metadata including property data associated with a media file accessible by a client, comprising:

formatting items of data of a first metadata source according to attributes;

formatting items of data of a second metadata source according to said attributes;

executing a scoring algorithm for one or more of the attributes to generate a score for one or more sets of the formatted items of data, each of said sets comprising an item of data from the first data source and an item of data from the second data source;

identifying related items of data of the first and second data sources based upon the generated scores;

establishing at least one link between data items of the first metadata source related to data items of the second metadata source identified as being related; and

generating a user interface displaying the established link.

38. The method as set forth in claim 37 further comprising determining that a media file associated with an item of data located in one of said metadata sources is accessed by said client and presenting a link associated with said item of data to said client.