Methods and apparatus for audio recognition

• US 8,352,259 B2
• Filed: 06/20/2009
• Issued: 01/08/2013
• Est. Priority Date: 12/30/2004
• Status: Active Grant

• Current Assignee: Rovi Technologies Corporation (Adeia Inc.)
• Original Assignee: Rovi Technologies Corporation (Adeia Inc.)
• Inventors: Bogdanov, Vladimir Askold
• Primary Examiner(s): Opsasnick, Michael N
• Application Number:
  US12/488,518
• Publication Number:
  US 20090259690A1
• Time in Patent Office: 1,298 Days
• Field of Search: 704/231, 704/273, 704/274
• US Class Current: 704/231
• CPC Class Codes: G10L 25/48 specially adapted for particular use

Abstract

Frequencies from a set of audio source files are extracted and measured across the set to determine a range of each of the frequencies. Stable frequencies of the frequencies are detected based on each range and used to create a stable frequency family. An unknown recording is mapped to the stable frequency family to form an audio fingerprint.

Claims

1. An apparatus for generating an audio fingerprint, comprising:

a processor operable to;

extract a plurality of frequencies from two or more audio source files included in a set of audio source files, wherein the two or more audio source files are encoded in different formats;

measure, across the two or more audio source files, a range of variation of each of the plurality of frequencies, the range of variation of a respective frequency being a range of variation of values for the frequency measured from among the two or more audio source files;

for each of the plurality of frequencies, compare the range of variation to a corresponding threshold to determine whether the range of variation is less than the corresponding threshold;

identify a plurality of stable frequencies from among the plurality of frequencies extracted from two or more audio source files, an extracted frequency being identified as a stable frequency if the respective range of variation is determined to be less than the corresponding threshold;

identify harmonically related stable frequencies from among the identified plurality of stable frequencies, each group of harmonically related stable frequencies forming a stable frequency family;

map sample points of an unknown recording to at least a portion of at least one stable frequency family;

generate fingerprint data by analyzing the mapped sample points of the unknown recording; and

form the audio fingerprint from the generated fingerprint data.

2. The apparatus according to claim 1, wherein the plurality of stable frequencies include at least one set of harmonically related frequencies and the processor is further operable to select a representative frequency of each set of harmonically related frequencies to form the stable frequency family.

3. The apparatus according to claim 1, wherein two or more of the audio source files are recorded on different physical media.

4. The apparatus according to claim 1, wherein the range is an audio amplitude range.

5. The apparatus according to claim 1, wherein the processor is further operable to assign a unique identifier to each of the audio source files and associate the audio fingerprint to a corresponding unique identifier.

6. The apparatus according to claim 4, further comprising:

a database operable to store metadata associated with the unique identifier; and

a user interface, in communication with the database, operable to present the metadata.

19. The apparatus according to claim 1, wherein the two or more audio source files included in the set of audio source files are encodings of a same audio recording, and wherein each range of variation represents a variation of the respective frequency measured from among the two or more audio source files of the same audio recording.

7. A method for generating an audio fingerprint, comprising:

extracting, using an audio processor, a plurality of frequencies from two or more audio source files include in a set of audio source files, wherein the two or more audio source files are encoded in different formats;

measuring, across the two or more audio source files, a range of variation of each of the plurality of frequencies, the range of variation of a respective frequency being a range of variation of values for the frequency measured from among the two or more audio source files;

for each of the plurality of frequencies, comparing the range to a corresponding threshold to determine whether the range of variation is less than the corresponding threshold;

identifying a plurality of stable frequencies from among the plurality of frequencies extracted from two or more audio source files, an extracted frequency being identified as a stable frequency if the respective range of variation is determined to be less than the corresponding threshold;

identifying harmonically related stable frequencies from among the identified plurality of stable frequencies, each group of harmonically related stable frequencies forming a stable frequency family;

mapping sample points of an unknown recording to at least a portion of at least one stable frequency family;

generating fingerprint data by analyzing the mapped sample points of the unknown recording; and

forming the audio fingerprint from the generated fingerprint data.

8. The method according to claim 7, wherein the plurality of stable frequencies include at least one set of harmonically related frequencies, the method further comprising:

selecting a representative frequency of each set of harmonically related frequencies to form the stable frequency family.

9. The method according to claim 7, wherein two or more of the audio source files are recorded on different physical media.

10. The method according to claim 7, wherein the range is an audio amplitude range.

11. The method according to claim 7, further comprising:

assigning a unique identifier to each of the audio source files; and

associating the audio fingerprint to a corresponding unique identifier.

12. The method according to claim 11, further comprising:

storing metadata associated with the unique identifier; and

presenting the metadata on a user interface.

20. The method according to claim 7, wherein the two or more audio source files included in the set of audio source files are encodings of a same audio recording, and wherein each range of variation represents a variation of the respective frequency measured from among the two or more audio source files of the same audio recording.

13. A non-transitory computer-readable medium having stored thereon sequences of instructions, the sequences of instructions including instructions which when executed by a computer system causes the computer system to perform:

extracting, using an audio processor, a plurality of frequencies from two or more audio source files included in a set of audio source files, wherein the two or more of the audio source files are encoded in different formats;

measuring, across the two or more audio source files, a range of variation of each of the plurality of frequencies, the range of variation of a respective frequency being a range of variation of values for the frequency measured from among the two or more audio source files;

for each of the plurality of frequencies, comparing the range of variation to a corresponding threshold to determine whether the range of variation is less than the corresponding threshold

identifying a plurality of stable frequencies from among the plurality of frequencies extracted from two or more audio source files, an extracted frequency being identified as a stable frequency if the respective range of variation is determined to be less than the corresponding threshold;

identifying harmonically related stable frequencies from among the identified plurality of stable frequencies, each group of harmonically related stable frequencies forming a stable frequency family;

mapping sample points of an unknown recording to at least a portion of at least one stable frequency family

generating fingerprint data by analyzing the mapped sample points of the unknown recording; and

forming the audio fingerprint from the generated fingerprint data.

14. The non-transitory computer-readable medium of claim 13, further storing a sequence of instructions which when executed by a computer system causes the computer system to perform:

selecting a representative frequency of each set of harmonically related frequencies to form the stable frequency family, wherein the plurality of stable frequencies include at least one set of harmonically related frequencies.

15. The non-transitory computer-readable medium of claim 13, wherein two or more of the audio source files are recorded on different physical media.

16. The non-transitory computer-readable medium of claim 13, wherein the range is an audio amplitude range.

17. The non-transitory computer-readable medium of claim 13, further storing a sequence of instructions which when executed by a computer system causes the computer system to perform:

assigning a unique identifier to each of the audio source files; and

associating the audio fingerprint to a corresponding unique identifier.

18. The non-transitory computer-readable medium of claim 17, further storing a sequence of instructions which when executed by the computer system causes the computer system to perform:

storing metadata associated with the unique identifier; and

presenting the metadata on a user interface.