Unordered matching of audio fingerprints

• US 10,459,973 B2
• Filed: 07/17/2018
• Issued: 10/29/2019
• Est. Priority Date: 05/06/2013
• Status: Active Grant

• Current Assignee: iHeartMedia Management Services, Inc. (iHeartMedia, Inc.)
• Original Assignee: iHeartMedia Management Services, Inc. (iHeartMedia, Inc.)
• Inventors: Anniballi, Dyon
• Primary Examiner(s): King, Simon
• Application Number:
  US16/037,372
• Publication Number:
  US 20180322192A1
• Time in Patent Office: 469 Days
• CPC Class Codes: G06F 16/638 Presentation of query results
• CPC Class Codes: G06F 16/683 using metadata automatically derived from the content

Abstract

A method includes determining, at a processor of a device, an unordered match between a set of consecutive portions of a first audio fingerprint and a set of non-consecutive portions of a second audio fingerprint. The method also includes setting, based at least in part on a station associated with the second audio fingerprint, a length criterion to indicate a first length or a second length. The method further includes, in response to determining that a length of the unordered match satisfies a length criterion, outputting an indicator that the first audio fingerprint matches the second audio fingerprint.

Claims

1. A method comprising:

determining, at a processor of a device, an unordered match between a set of consecutive portions of a first audio fingerprint and a set of non-consecutive portions of a second audio fingerprint;

setting, based at least in part on a media source associated with the second audio fingerprint, a length criterion to indicate a first length or a second length; and

in response to determining that a length of the unordered match satisfies the length criterion, outputting an indicator that the first audio fingerprint matches the second audio fingerprint.

2. The method of claim 1, further comprising, for each portion of multiple portions of the first audio fingerprint, generating multiple corresponding match scores based on comparing the portion to each of multiple portions of the second audio fingerprint, wherein determining the unordered match includes determining that at least one match score corresponding to each of the set of consecutive portions of the first audio fingerprint and a corresponding portion of the set of non-consecutive portions of the second audio fingerprint satisfies a similarity threshold.

3. The method of claim 2, further comprising, prior to determining the unordered match:

determining that a number of portions of the first audio fingerprint have a highest match score corresponding to a particular portion of the second audio fingerprint; and

in response to determining that the number of portions exceeds a threshold, removing a particular match score corresponding to the particular portion of the second audio fingerprint from the match scores.

4. The method of claim 1, wherein the length criterion is user-configurable.

5. The method of claim 1, further comprising receiving the first audio fingerprint from a listening device, wherein the indicator includes data indicating the media source associated with the second audio fingerprint, a timestamp corresponding to the first audio fingerprint, a user identifier associated with the listening device, or a combination thereof.

6. The method of claim 5, wherein the listening device comprises a microphone, a mobile device, a personal media monitor, or any combination thereof.

7. The method of claim 1, further comprising:

receiving the second audio fingerprint from a field recorder; and

storing the second audio fingerprint.

8. The method of claim 1, further comprising:

selecting a probe from the second audio fingerprint; and

in response to determining that the probe substantially matches at least one portion of the first audio fingerprint, generating match scores based on multiple portions of the first audio fingerprint and multiple portions of the second audio fingerprint,

wherein the unordered match is determined based on the match scores.

9. The method of claim 8, wherein the probe comprises sixteen audio samples that are each one tenth of a second in length.

10. The method of claim 8, further comprising:

computing match scores for each portion of multiple portions of the first audio fingerprint, the match scores for a particular portion based on a comparison of the particular portion with each of multiple portions of the second audio fingerprint;

identifying a highest score of the match scores for each portion of the multiple portions of the first audio fingerprint; and

generating a list of runs based on the identified highest score for each portion of the multiple portions of the first audio fingerprint,

wherein the unordered match is determined based on the list of runs.

11. The method of claim 10, further comprising, prior to generating the list of runs, applying a positional penalty to a highest score of the match scores for at least one portion of the first audio fingerprint in response to determining that the highest scores of the match scores for a first set of consecutive portions of the first audio fingerprint correspond to a first set of non-consecutive portions of the second audio fingerprint, wherein the first set of consecutive portions include the at least one portion of the first audio fingerprint.

12. The method of claim 10, wherein:

the list of runs includes alternating below-threshold runs and above-threshold runs,

each below-threshold run corresponds to a sequence of one or more of the multiple portions of the first audio fingerprint that have a highest score that is less than a similarity threshold, and

each above-threshold run corresponds to a sequence of one or more of the multiple portions of the first audio fingerprint that have a highest score that is greater than or equal to the similarity threshold, wherein the unordered match is based on determining that a longest above-threshold run in the list of runs corresponds to the set of consecutive portions of the first audio fingerprint and to the set of non-consecutive portions of the second audio fingerprint.

13. The method of claim 12, further comprising replacing a below-threshold run in the list of runs with an aggregate of the below-threshold run and neighboring above-threshold runs in response to determining that the aggregate has an average match score that is greater than or equal to the similarity threshold.

14. The method of claim 12, further comprising replacing an above-threshold run in the list of runs with an aggregate of the above-threshold run and neighboring below-threshold runs in response to determining that the aggregate has an average match score that is less than the similarity threshold.

15. The method of claim 1, further comprising, in response to determining that the length of the unordered match satisfies the length criterion, updating a count indicating a number of times media content has been played over a time period, wherein the second audio fingerprint represents the media content.

16. An apparatus comprising:

a communication interface configured to receive a first audio fingerprint from a listening device; and

a processor configured to;

determine an unordered match between a set of consecutive portions of the first audio fingerprint and a set of non-consecutive portions of a second audio fingerprint;

set, based at least in part on a media source associated with the second audio fingerprint, a length criterion to indicate a first length or a second length; and

in response to determining that a length of the unordered match satisfies a length criterion, generate an indicator that the first audio fingerprint matches the second audio fingerprint.

17. The apparatus of claim 16, wherein the length criterion is based at least in part on a programming element represented by the second audio fingerprint, wherein the programming element comprises an advertisement programming element or a song programming element.

18. A computer-readable storage device storing instructions that, when executed by a computer, cause the computer to perform operations comprising:

determining an unordered match between a set of consecutive portions of a first audio fingerprint and a set of non-consecutive portions of a second audio fingerprint;

setting, based at least in part on a media source associated with the second audio fingerprint, a length criterion to indicate a first length or a second length; and

in response to determining that a length of the unordered match satisfies a length criterion, outputting an indicator that the first audio fingerprint matches the second audio fingerprint.

19. The computer-readable storage device of claim 18, wherein the length criterion is set to indicate the first length in response to determining that a first media source is associated with the second audio fingerprint, and wherein the first media source comprises a radio station, a television channel, or an Internet media source.

20. The computer-readable storage device of claim 18, wherein the length criterion is set to indicate the second length in response to determining that a second media source is associated with the second audio fingerprint.