Method and device for extracting a signal identifier, method and device for creating a database from signal identifiers and method and device for referencing a search time signal

• US 20040158437A1
• Filed: 03/02/2004
• Published: 08/12/2004
• Est. Priority Date: 04/10/2001
• Status: Abandoned Application

• Current Assignee: Fraunhofer Gesellschaft Zur Foerderung Der Angewandten Forsching E.V.
• Original Assignee: Fraunhofer Gesellschaft Zur Foerderung Der Angewandten Forsching E.V.
• Inventors: Richter, Christian, Katai, Andras, Hirsch, Wolfgang, Kaufmann, Matthias, Klefenz, Frank, Uhle, Christian, Brandenburg, Karlheinz
• Application Number:
  US10/473,801
• Publication Number:
  US 20040158437A1
• Time in Patent Office: Days
• US Class Current: 702/189
• CPC Class Codes: G10H 1/0008 Associated control or indicating means
• CPC Class Codes: G10H 2240/135 Library retrieval index, i.e. using an indexing scheme to efficiently retrieve a music piece
• CPC Class Codes: G10H 2250/011 Genetic algorithms, i.e. using computational steps analogous to biological selection, recombination and mutation on an initial population of, e.g. sounds, pieces, melodies or loops to compose or otherwise generate, e.g. evolutionary music or sound synthesis

Abstract

In a method of extracting a signal identifier from a time signal, the temporal occurrence of signal edges in the time signal is detected (12), wherein a signal edge has a specified temporal length. In addition, the temporal interval between two selected detected signal edges is determined (14). From the temporal interval determined, a frequency value is calculated (16), the frequency value being associated with a time of occurrence of the frequency value in the time signal so as to obtain a coordinate tuple from the frequency value and the time of occurrence for this frequency value. A signal identifier is created from a plurality of coordinate tuples (18), each coordinate tuple including a frequency value and a time of occurrence, which is why the signal identifier includes a sequence of signal identifier values reproducing the temporal form of the time signal. The extracted signal identifier is based on signal edges of the time signal and thus reproduces the temporal form of the time signal. The signal identifier is therefore characteristic of the time signal, on the one hand, and robust towards changes in the time signal, on the other hand.

Claims

1. Method for extracting a signal identifier from a time signal having a harmonic portion, the method comprising:

detecting (12) the temporal occurrence of signal edges in the time signal;

determining (14) a temporal interval between two selected detected signal edges;

calculating (16) a frequency value from the temporal interval determined, and associating the frequency value with a time of occurrence of the frequency value in the time signal to obtain a coordinate tuple from the frequency value and the time of occurrence for this frequency value; and

creating (18) the signal identifier from a plurality of coordinate tuples, each coordinate tuple including a frequency value and a time of occurrence, whereby the signal identifier includes a sequence of signal-identifier values which reflects the temporal form of the time signal.

2. Method as claimed in claim 1, wherein in the step of detecting (12), a signal-flank is detected as a signal-flank only if same has, over its specified temporal length, an amplitude larger than a predetermined amplitude threshold value.

3. Method as claimed in claim 1 or 2,

wherein in the step of detecting (12), a signal-flank is detected as a signal-flank only if its specified temporal length is longer than a minimum cut-off length and shorter than a maximum cut-off length.

4. Method as claimed in claim 3, wherein the time signal is an audio signal, and wherein the minimum temporal cut-off length is specified by means of a maximum audible cut-off frequency, and the maximum temporal cut-off length is specified by means of a minimum audible cut-off frequency.

5. Method as claimed in claim 3, wherein the time signal is an audio signal, and wherein the minimum temporal cut-off length is specified by means of a maximum tone frequency that may be created by an instrument, and the maximum temporal cut-off length is specified by means of a minimum tone frequency which may be created by an instrument.

6. Method as claimed in any one of the previous claims, wherein the step of creating (18) the signal identifier comprises:

eliminating (18a) coordinate tuples spaced apart by more than a predetermined threshold distance from an adjacent coordinate tuple in a frequency-time diagram so as to determine clusters of coordinate tuples.

7. Method as claimed in claim 5 or 6, wherein the step of creating (18) comprises:

grouping (18b) coordinate tuples in successive temporal intervals into blocks of coordinate tuples.

8. Method as claimed in claim 7, wherein the successive temporal intervals have a fixed and/or a variable length.

9. Method as claimed in claim 7 or 8, wherein the step of creating (18) the signal identifier comprises:

averaging (18c) the frequency values of coordinate tuples in the temporal intervals to obtain a sequence of averaged frequency values for a sequence of temporal intervals, the sequence of averaged frequency values representing a feature vector.

10. Method as claimed in claim 9, wherein step (18) of creating the signal identifier comprises:

quantizing (18e) the feature vector to obtain a quantized feature vector.

11. Method as claimed in claim 10, wherein the step of quantizing (18e) is performed using non-equidistantly distributed raster points, distances between two adjacent raster points being determined in accordance with a tone-frequency scale.

12. Method as claimed in any one of the previous claims, wherein in step (12) of detecting signal edges, a Hough transformation is employed.

13. Method for creating a database (40) from reference signal identifiers for a plurality of time signals, comprising:

extracting a first signal identifier for a first time signal by the method as claimed in any one of claims 1 to 12;

extracting a second signal identifier for a second time signal by means of a method as claimed in any one of claims 1 to 12; and

storing the extracted first signal identifier in association with the first time signal in the database (40); and

storing the extracted second signal identifier in association with the second time signal in the database (40).

14. Method of referencing a search time signal using a database (40), the database comprising reference signal identifiers of a plurality of database time signals, a reference signal identifier of a database time signal having been determined by a method as claimed in any one of claims 1 to 12, the method comprising:

providing at least one portion of a search time signal (41);

extracting (43) a search signal identifier from the search time signal by a method as claimed in any one of claims 1 to 12; and

comparing (46) the search signal identifier with the plurality of reference signal identifiers, and, in response to the step of comparing, making a statement about the search time signal with regard to the plurality of database time signals.

15. Method as claimed in claim 14, wherein in the step of making a statement, a search time signal is identified as a reference time signal if the search signal identifier matches at least a portion of a reference signal identifier.

16. Method as claimed in claim 14, wherein in the step of making a statement, a similarity between a search time signal and a database time signal is established if the search signal identifier and/or at least a portion of database signal identifier may be made to match by means of a reproducible manipulation.

17. Method as claimed in any one of claims 14 to 16,

wherein the database signal identifier comprises a sequence of database signal identifier values reproducing the temporal form of the database time signal,

wherein the search signal identifier comprises a search sequence of search signal identifier values reproducing the temporal form of the search time signal,

wherein the length of the database sequence is longer than the length of the search sequence, and

wherein the search sequence is sequentially compared to the database sequence.

18. Method as claimed in claim 17, wherein during the sequential comparing of the search sequence with the database sequence, a correction of the values of the search and/or the database signal identifier is performed by a replace, insert or delete operation of at least one value of the search and/or the database signal identifier to determine a similarity of the search time signal and the database time signal.

19. Method as claimed in any one of claims 14 to 18,

wherein the step of comparing (46) is performed using a DNA sequencing algorithm and/or using the Boyer-Moore algorithm.

21. Apparatus for creating a database (40) from reference signal identifiers for a plurality of time signals, comprising:

means for extracting a first signal identifier for a first time signal by the method as claimed in any one of claims 1 to 12;

means for extracting a second signal identifier for a second time signal by means of a method as claimed in any one of claims 1 to 12; and

means for storing the extracted first signal identifier in association with the first time signal in the database (40); and

means for storing the extracted second signal identifier in association with the second time signal in the database (40).

22. Apparatus for referencing a search time signal using a database (40), the database comprising reference signal identifiers of a plurality of database time signals, a reference signal identifier of a database time signal having been determined by a method as claimed in any one of claims 1 to 12, the apparatus comprising:

means for providing at least one portion of a search time signal (41);

means for extracting (43) a search signal identifier by a method as claimed in any one of claims 1 to 12; and

means for comparing (46) the search signal identifier with the plurality of reference signal identifiers, and, in response to the step of comparing, making a statement about the search time signal with regard to the plurality of database time signals.

20. Apparatus for extracting a signal identifier from a time signal having a harmonic portion, the apparatus comprising:

means for detecting (12) the temporal occurrence of signal edges in the time signal;

means for determining (14) a temporal interval between two selected detected signal edges;

means for calculating (16) a frequency value from the temporal interval determined, and for associating the frequency value with a time of occurrence of the frequency value in the time signal to obtain a coordinate tuple from the frequency value and the time of occurrence for this frequency value; and

means for creating (18) the signal identifier from a plurality of coordinate tuples, each coordinate tuple including a frequency value and a time of occurrence, whereby the signal identifier includes a sequence of signal-identifier values which reflects the temporal form of the time signal.