Method and device for producing a fingerprint and method and method and device for identifying an audio signal

• US 20040172411A1
• Filed: 01/08/2004
• Published: 09/02/2004
• Est. Priority Date: 07/10/2001
• Status: Active Grant

• Current Assignee: M2Any GmbH
• Original Assignee: M2Any GmbH
• Inventors: Allamanche, Eric, Kastner, Thorsten, Hellmuth, Oliver, Cremer, Markus, Herre, Jurgen
• Granted Patent: US 7,460,994 B2
• Time in Patent Office: Days
• US Class Current: 707/104.1
• CPC Class Codes: G06F 16/683 using metadata automatically derived from the content
• CPC Class Codes: G06F 2218/08 Feature extraction
• CPC Class Codes: G11B 27/11 by using information not detectable on the record carrier
• CPC Class Codes: G11B 27/28 by using information signals recorded by the same method as the main recording G11B27/22 takes precedence

Abstract

For producing a fingerprint of an audio signal, use is made of information defining a plurality of predetermined fingerprint modi, all of the fingerprint modi relating to the same type of fingerprint, the fingerprint modi, however, providing different fingerprints differing from each other with regard to their data volume, on the one hand, and to their characterizing strength for characterizing the audio signal, on the other hand, the fingerprint modi being predetermined such that a fingerprint in accordance with a fingerprint modus having a first characterizing strength is convertible to a fingerprint in accordance with a fingerprint modus having a second characterizing strength, without using the audio signal. A predetermined fingerprint modus of the plurality of predetermined fingerprint modi is set and subsequently used for computing a fingerprint using the audio signal. The convertibility feature of the fingerprints having been produced by the different fingerprint modi enables setting a flexible compromise between the data volume and the characterizing strength for certain applications without having to re-generate a fingerprint database with each change of the fingerprint modus. Fingerprint representations scaled with regard to time or frequency may readily be converted to a different fingerprint modus.

Claims

1. A method for producing a fingerprint of an audio signal using information defining a plurality of predetermined fingerprint modi, all of the fingerprint modi relating to the same type of fingerprint, the fingerprint modi, however, providing different fingerprints differing from each other with regard to their data volume, on the one hand, and to their characterizing strength for characterizing the audio signal, on the other hand, the fingerprint modi being predetermined such that a fingerprint in accordance with a fingerprint modus having a first characterizing strength is convertible to a fingerprint in accordance with a fingerprint modus having a second characterizing strength, without using the audio signal, the method comprising:

setting a predetermined fingerprint modus of the plurality of predetermined fingerprint modi; and

computing, a fingerprint in accordance with the set predetermined fingerprint modus.

2. The method as claimed in claim 1, wherein the fingerprint in accordance with a fingerprint modus having higher characterizing strength is convertible to a fingerprint in accordance with a fingerprint modus having lower characterizing strength.

3. The method as claimed in claim 1, further comprising:

transferring or storing the produced fingerprint via a transmission channel having a limited transmission capacity or on a storage medium having a limited storage capacity, respectively,

wherein in the step of setting a fingerprint modus, the predetermined fingerprint modus is set depending on the transmission channel or the storage capacity, respectively.

4. The method as claimed in claim 1, wherein the type of fingerprint relates to the tonality properties of the audio signal.

5. The method as claimed in claim 1, wherein the audio signal may be subdivided into a predetermined number of predefined frequency bands,

wherein each fingerprint modus includes the production of fingerprint information per predefined frequency band, the fingerprint modi differing with regard to the number of items of fingerprint information, so that a first fingerprint modus includes, as a fingerprint, separately for each frequency band, a first number of items of fingerprint information for a first number of frequency bands, and a second fingerprint modus includes, as a fingerprint, separately for each frequency band, a second number of items of fingerprint information for a second number of frequency bands, the first number differing from the second number, and the predefined frequency bands being the same for all fingerprint modi.

6. The method as claimed in claim 5, wherein the subdivision of the audio signal into the predefined frequency bands comprises, at least partially, logarithmic band partitioning.

7. The method as claimed in claim 5, wherein two frequency bands mutually adjacent in terms of frequency have an overlap area, spectral components in the overlap area belonging to both adjacent frequency bands.

8. The method as claimed in claim 5,

wherein the frequency band including the lowest frequency is contained in all fingerprint modi, the fingerprint modi differing in the number of higher frequencies of subsequent frequency bands.

9. The method as claimed in claim 1,

wherein the audio signal may be subdivided into blocks successive in time and having a predetermined length,

wherein in the production of a fingerprint, fingerprint information per block are determined, the fingerprint modi differing in the number of blocks represented by fingerprint information, and the length of the blocks being the same for all fingerprint modi.

10. The method as claimed in claim 9, wherein a first fingerprint modus includes the mean value and/or the variance of a first predefined number of blocks are included as fingerprint information, and a second fingerprint modus includes the mean value and/or the variance of a second predefined number of blocks, the ratio of the first predefined number to the second predefined number being an integral one.

11. A method of characterizing an audio signal, comprising:

producing a fingerprint of the audio signal using information defining a plurality of predetermined fingerprint modi, all of the fingerprint modi relating to the same type of fingerprint, the fingerprint modi, however, providing different fingerprints differing from each other with regard to their data volume, on the one hand, and to their characterizing strength for characterizing the audio signal, on the other hand, the fingerprint modi being predetermined such that a fingerprint in accordance with a fingerprint modus having a first characterizing strength is convertible to a fingerprint in accordance with a fingerprint modus having a second characterizing strength, without using the audio signal, the method comprising;

setting a predetermined fingerprint modus of the plurality of predetermined fingerprint modi; and

computing a fingerprint in accordance with the set predetermined fingerprint modus;

comparing the computed fingerprint with a plurality of stored fingerprints representing known audio signals to characterize the audio signal, the stored fingerprints having been produced in accordance with one of the plurality of fingerprint modi, the step of comparing comprising;

examining whether the search fingerprint and the database fingerprint have been produced in accordance with different fingerprint modi;

converting the search fingerprint and/or the database fingerprint so that the fingerprints to be compared exist in accordance with the same fingerprint modus; and

performing the comparison using the fingerprints existing in the same fingerprint modus.

12. The method as claimed in claim 11, wherein each fingerprint modus includes the production of fingerprint information per predefined frequency band, the fingerprint modi differing with regard to the number of items of fingerprint information, so that a first fingerprint modus includes, as a fingerprint, separately for each frequency band, a first number of items of fingerprint information for a first number of frequency bands, and a second fingerprint modus includes, as a fingerprint, separately for each frequency band, a second number of items of fingerprint information for a second number of frequency bands, the first number differing from the second number,

wherein the step of converting comprises suppressing fingerprint information for sub-bands.

13. The method as claimed in claim 11,

wherein the audio signal may be subdivided into blocks successive in time and having a predetermined length,

wherein in the production of a fingerprint, fingerprint information per block are determined, the fingerprint modi differing in the number of blocks represented by fingerprint information, and the length of the blocks being the same for all fingerprint modi, and

wherein the step of converting comprises the step of combining the fingerprint information of blocks successive in time.

14. The method as claimed in claim 13,

wherein the fingerprint information includes a mean value and/or a variance, and

wherein an integer ratio exists between the blocks combined in the search fingerprint and the blocks combined in the database fingerprint.

15. A fingerprint representation for an audio signal, with a fingerprint, the fingerprint being configured in accordance with one of a plurality of predetermined fingerprint modi, all of the fingerprint modi relating to the same type of fingerprint, the fingerprint modi, however, providing different fingerprints differing from each other with regard to their data volume, on the one hand, and to their characterizing strength for characterizing the audio signal, on the other hand, the fingerprint modi being predetermined such that a fingerprint in accordance with a fingerprint modus having a first characterizing strength is convertible to a fingerprint in accordance with a fingerprint modus having a second characterizing strength, without using the audio signal.

16. The fingerprint representation as claimed in claim 15, further comprising an indicator indicating the fingerprint modus underlying the fingerprint.

17. An apparatus for producing a fingerprint of an audio signal using information defining a plurality of predetermined fingerprint modi, all of the fingerprint modi relating to the same type of fingerprint, the fingerprint modi, however, providing different fingerprints differing from each other with regard to their data volume, on the one hand, and to their characterizing strength for characterizing the audio signal, on the other hand, the fingerprint modi being predetermined such that a fingerprint in accordance with a fingerprint modus having a first characterizing strength is convertible to a fingerprint in accordance with a fingerprint modus having a second characterizing strength, without using the audio signal, the apparatus comprising:

means for setting a predetermined fingerprint modus of the plurality of predetermined fingerprint modi; and

means for computing a fingerprint in accordance with the set predetermined fingerprint modus.

18. An apparatus for characterizing an audio signal, comprising:

means for producing a search fingerprint of the audio signal using information defining a plurality of predetermined fingerprint modi, all of the fingerprint modi relating to the same type of fingerprint, the fingerprint modi, however, providing different fingerprints differing from each other with regard to their data volume, on the one hand, and to their characterizing strength for characterizing the audio signal, on the other hand, the fingerprint modi being predetermined such that a fingerprint in accordance with a fingerprint modus having a first characterizing strength is convertible to a fingerprint in accordance with a fingerprint modus having a second characterizing strength, without using the audio signal, the means comprising;

means for setting a predetermined fingerprint modus of the plurality of predetermined fingerprint modi; and

means for computing a fingerprint in accordance with the set predetermined fingerprint modus;

means for comparing the computed fingerprint with a plurality of stored fingerprints representing known audio signals to characterize the audio signal, the stored fingerprints having been produced in accordance with one of the plurality of fingerprint modi, the means comprising;

means for examining whether the search fingerprint and the database fingerprint have been produced in accordance with different fingerprint modi;

means for converting the search fingerprint and/or the database fingerprint so that the fingerprints to be compared exist in accordance with the same fingerprint modus; and

means for performing the comparison using the fingerprints existing in the same fingerprint modus.