Unordered matching of audio fingerprints

• US 10,146,866 B2
• Filed: 09/30/2016
• Issued: 12/04/2018
• Est. Priority Date: 05/06/2013
• Status: Active Grant

• Current Assignee: iHeartMedia Management Services, Inc. (iHeartMedia, Inc.)
• Original Assignee: iHeartMedia Management Services, Inc. (iHeartMedia, Inc.)
• Inventors: Anniballi, Dyon
• Primary Examiner(s): King, Simon
• Application Number:
  US15/282,691
• Publication Number:
  US 20170024468A1
• Time in Patent Office: 795 Days
• CPC Class Codes: G06F 16/638 Presentation of query results
• CPC Class Codes: G06F 16/683 using metadata automatically derived from the content

Abstract

A method includes determining, at a processor of a device, an unordered match between a set of consecutive portions of a first audio fingerprint and a set of non-consecutive portions of a second audio fingerprint. The method also includes, in response to determining that a length of the unordered match satisfies a length criterion, outputting an indicator that the first audio fingerprint matches the second audio fingerprint.

Claims

1. A method comprising:

computing match scores for each portion of multiple portions of a first audio fingerprint, the match scores for a particular portion based on a comparison of the particular portion with each of multiple portions of a second audio fingerprint;

identifying a highest score of the match scores for each portion of the multiple portions of the first audio fingerprint;

generating a list of runs that includes alternating below-threshold runs and above-threshold runs, wherein each below-threshold run corresponds to a sequence of one or more of the multiple portions of the first audio fingerprint that have a highest score that is less than a similarity threshold, and wherein each above-threshold run corresponds to a sequence of one or more of the multiple portions of the first audio fingerprint that have a highest score that is greater than or equal to the similarity threshold;

determining, at a processor of a device, an unordered match between a set of consecutive portions of the first audio fingerprint and a set of non-consecutive portions of the second audio fingerprint, wherein the unordered match is determined based on a longest above-threshold run in the list of runs corresponding to the set of consecutive portions of the first audio fingerprint and to the set of non-consecutive portions of the second audio fingerprint; and

in response to determining that a length of the unordered match satisfies a length criterion, outputting an indicator that the first audio fingerprint matches the second audio fingerprint.

2. The method of claim 1, wherein determining the unordered match includes determining that at least one match score corresponding to each of the set of consecutive portions of the first audio fingerprint and a corresponding portion of the set of non-consecutive portions of the second audio fingerprint satisfies the similarity threshold.

3. The method of claim 2, further comprising, prior to determining the unordered match:

determining that a number of portions of the first audio fingerprint have a highest match score corresponding to a first particular portion of the second audio fingerprint; and

in response to determining that the number of portions exceeds a threshold, removing a particular match score corresponding to the first particular portion from the match scores.

4. The method of claim 1, wherein the length criterion is user-configurable.

5. The method of claim 1, further comprising receiving the first audio fingerprint from a listening device, wherein the indicator includes data indicating a station associated with the second audio fingerprint, a timestamp corresponding to the first audio fingerprint, a user identifier associated with the listening device, or a combination thereof.

6. The method of claim 5, wherein the listening device comprises a microphone, a mobile device, a personal media monitor, or any combination thereof.

7. The method of claim 1, further comprising:

receiving the second audio fingerprint from a field recorder; and

storing the second audio fingerprint.

8. The method of claim 1, further comprising selecting a probe from the second audio fingerprint, wherein the match scores are computed in response to determining that the probe substantially matches at least one portion of the first audio fingerprint.

9. The method of claim 8, wherein the probe comprises sixteen audio samples that are each one tenth of a second in length.

10. The method of claim 8, further comprising, prior to determining the unordered match:

determining an average score based at least in part on first scores associated with a first below-threshold run and second scores associated with a second above-threshold run, wherein the second above-threshold run is adjacent to the first below-threshold run; and

replacing at least the first below-threshold run and the second above-threshold run with an aggregate run, wherein the aggregate run is assigned the average score.

11. The method of claim 10, wherein the average score is greater than or equal to the similarity threshold.

12. The method of claim 1, further comprising applying a positional penalty to the highest score of the match scores for a first portion of the first audio fingerprint in response to determining that the highest scores for a first set of consecutive portions of the first audio fingerprint correspond to a first set of non-consecutive portions of the second audio fingerprint, wherein the first set of consecutive portions of the first audio fingerprint includes the first portion of the first audio fingerprint.

13. The method of claim 1, further comprising replacing a below-threshold run in the list of runs with an aggregate of the below-threshold run and neighboring above-threshold runs in response to determining that the aggregate has an average match score that is greater than or equal to the similarity threshold.

14. The method of claim 1, further comprising replacing an above-threshold run in the list of runs with an aggregate of the above-threshold run and neighboring below-threshold runs in response to determining that the aggregate has an average match score that is less than the similarity threshold.

15. The method of claim 1, further comprising, in response to determining that the length of the unordered match satisfies the length criterion, updating a count indicating a number of times media content has been played over a time period, wherein the second audio fingerprint represents the media content.

16. An apparatus comprising:

a processor configured to;

compute match scores for each portion of multiple portions of a first audio fingerprint, the match scores for a particular portion based on a comparison of the particular portion with each of multiple portions of a second audio fingerprint;

identify a highest score of the match scores for each portion of the multiple portions of the first audio fingerprint;

generate a list of runs that includes alternating below-threshold runs and above-threshold runs, wherein each below-threshold run corresponds to a sequence of one or more of the multiple portions of the first audio fingerprint that have a highest score that is less than a similarity threshold, and wherein each above-threshold run corresponds to a sequence of one or more of the multiple portions of the first audio fingerprint that have a highest score that is greater than or equal to the similarity threshold;

determine an unordered match between a set of consecutive portions of the first audio fingerprint and a set of non-consecutive portions of the second audio fingerprint, wherein the unordered match is determined based on a longest above-threshold run in the list of runs corresponding to the set of consecutive portions of the first audio fingerprint and to the set of non-consecutive portions of the second audio fingerprint; and

in response to determining that a length of the unordered match satisfies a length criterion, generate an indicator that the first audio fingerprint matches the second audio fingerprint.

17. The apparatus of claim 16, wherein the length criterion is based at least in part on a programming element represented by the second audio fingerprint, wherein the programming element comprises an advertisement programming element or a song programming element.

18. A computer-readable storage device storing instructions that, when executed by a computer, cause the computer to perform operations comprising:

computing match scores for each portion of multiple portions of a first audio fingerprint, the match scores for a particular portion based on a comparison of the particular portion with each of multiple portions of a second audio fingerprint;

identifying a highest score of the match scores for each portion of the multiple portions of the first audio fingerprint;

generating a list of runs that includes alternating below-threshold runs and above-threshold runs, wherein each below-threshold run corresponds to a sequence of one or more of the multiple portions of the first audio fingerprint that have a highest score that is less than a similarity threshold, and wherein each above-threshold run corresponds to a sequence of one or more of the multiple portions of the first audio fingerprint that have a highest score that is greater than or equal to the similarity threshold;

determining an unordered match between a set of consecutive portions of the first audio fingerprint and a set of non-consecutive portions of the second audio fingerprint, wherein the unordered match is determined based on a longest above-threshold run in the list of runs corresponding to the set of consecutive portions of the first audio fingerprint and to the set of non-consecutive portions of the second audio fingerprint; and

in response to determining that a length of the unordered match satisfies a length criterion, outputting an indicator that the first audio fingerprint matches the second audio fingerprint.

19. The computer-readable storage device of claim 18, wherein the length criterion is based at least in part on a station associated with the second audio fingerprint, and wherein the station comprises a radio station, a television channel, or an Internet media source.

20. The computer-readable storage device of claim 18, wherein the operations further comprise:

in response to determining that a first station is associated with the second audio fingerprint, setting the length criterion to indicate a first length; and

in response to determining that a second station is associated with the second audio fingerprint, setting the length criterion to indicate a second length.