Device and method for analyzing an information signal

• US 20060064299A1
• Filed: 09/13/2005
• Published: 03/23/2006
• Est. Priority Date: 03/21/2003
• Status: Abandoned Application

• Current Assignee: Gracenote, Inc. (RR Donnelley & Sons Company)
• Original Assignee: Fraunhofer Gesellschaft Zur Foerderung Der Angewandten Forsching E.V.
• Inventors: Sporer, Thomas, Dittmar, Christian, Uhle, Christian
• Application Number:
  US11/225,557
• Publication Number:
  US 20060064299A1
• Time in Patent Office: Days
• US Class Current: 704/212
• CPC Class Codes: G06F 18/21342 using statistical independence, i.e. minimising mutual information or maximising non-gaussianity
• CPC Class Codes: G06F 18/21347 using domain transformations
• CPC Class Codes: G10H 1/40 Rhythm
• CPC Class Codes: G10H 2210/056 for extraction or identification of individual instrumental parts, e.g. melody, chords, bass; Identification or separation of instrumental parts by their characteristic voices or timbres
• CPC Class Codes: G10L 21/0272 Voice signal separating

Abstract

For analyzing an information signal consisting of a superposition of partial signals, wherein a partial signal originates from an individual source, the information signal is first decomposed into several component signals. Then one or more features are calculated for each component signal, wherein the feature(s) is/are defined so that it/they provide(s) a statement on an information content of the component signal. Finally, an association of the component signals with at least two subspaces is performed on the basis of the features calculated for the component signals. By feature extraction on the component signal level, an efficient subspace decomposition which is meaningful with respect to a present audio scene is achieved.

Claims

1. A device for analyzing an information signal, wherein the information signal is an audio signal consisting of a superposition of partial signals, wherein the partial signals originate from individual sources together forming the audio signal, wherein the device includes:

a unit for decomposing the information signal into several component signals;

a unit for calculating a feature for each individual component signal, wherein the feature is defined so that it is correlated with one source characteristic for one subspace and with another source characteristic for another subspace, wherein one or more individual sources are associated with each subspace, and wherein the one or more individual sources associated with the one subspace differ from the one or more individual sources associated with the other subspace; and

a unit for associating the component signals with at least two subspaces on the basis of the features for the component signals, so that the one subspace includes component signals corresponding to the one or more individual sources associated with the one subspace, and that the other subspace includes component signals corresponding to the one or more individual sources associated with the other subspace.

2. The device according to claim 1, further comprising:

a unit for reconstructing the component signals associated with a subspace to obtain a reconstructed information signal, wherein the reconstructed information signal is based on a partial signal of an individual source or on a superposition of partial signals of a group of individual sources.

3. The device according to claim 1, wherein the unit for decomposing comprises a time-frequency conversion unit to obtain a sequence of short-time spectra from the information signal.

4. The device according to claim 3, wherein the unit for decomposing is further designed to calculate a sequence of short-time magnitude spectra as sequence of short-time spectra.

5. The device according to claim 3, wherein the unit for decomposing is designed to perform a singular value decomposition with the sequence of short-time spectra to obtain singular values indicating the component signals.

6. The device according to claim 5, wherein the unit for decomposing is further designed to select a number of singular values from all obtained singular values whose magnitude is larger than a threshold value.

7. The device according to claim 6, wherein the number of selected singular values is larger than a number of individual sources expected for the information signal.

8. The device according to claim 1, wherein the unit for decomposing is designed to determine a component signal as a static amplitude spectrum and an associated time-variable amplitude envelope.

9. The device according to claim 1, wherein the unit for calculating is designed to calculate a plurality of different features for a component signal.

10. The device according to claim 9, wherein the unit for associating is designed to perform a multistage association, wherein a more reliable feature is usable in a first stage of the association, and wherein a less reliable feature is usable in a second, downstream stage.

11. The device according to claim 1, wherein the feature is a quantitative feature, wherein the unit for associating is designed to operate on the basis of a quantity of the feature.

12. The device according to claim 1, wherein the unit for associating is designed to operate using a predetermined threshold, wherein an association of a component signal with a subspace is based on whether the feature for the component signal is larger or smaller than the predetermined threshold.

13. The device according to claim 1, wherein the unit for calculating is designed to calculate a feature which is meaningful with respect to an association of an individual source with a type of sound generators.

14. The device according to claim 13, wherein the information signal includes a music signal and the unit for calculating is designed to use a feature which is meaningful with respect to a type of music instruments.

15. The device according to claim 1, wherein the individual sources include non-percussive and percussive individual sources, wherein the unit for calculating is designed to use a feature as feature that is correlated with a percussiveness of a component signal, so that component signals found percussive are associated with a first subspace by the unit for associating, and that component signals found non-percussive are associatable into a second subspace.

16. The device according to claim 1, wherein the component signal is an amplitude envelope, wherein the unit for calculating is designed to use a percussiveness of a component signal as feature, wherein the unit for calculating comprises:

a unit for providing a model time curve for a maximum in a component signal;

a unit for processing the component signal such that a model signal is arranged at each maximum on the basis of the model time curve, so that the result is a model signal associated with the component signal; and

a unit for calculating a similarity between the model signal and the component signal to obtain a similarity measure which is usable as feature by the unit for associating.

17. The device according to claim 1, wherein the component signal is an amplitude spectrum, wherein the unit for calculating is designed to use a noise-likeness as feature, wherein the unit for calculating comprises:

a unit for determining local maxima in a component signal;

a unit for processing the component signal such that a Gaussian-shaped impulse is associated with each maximum to obtain a model waveform for the component signal; and

a unit for determining a similarity between the spectrum of the component signal and the model signal giving a noise-likeness of the component signal.

18. The device according to claim 1, wherein the unit for calculating is designed to calculate a spectral dissonance measure as feature for a static spectrum of a component signal.

19. The device according to claim 1,

wherein the unit for calculating is designed to calculate a spectral flatness measure of a static amplitude spectrum of a component signal as feature.

20. The device according to claim 1, wherein the unit for calculating is designed to calculate a third order cumulant for a static amplitude spectrum of a component signal converted to the time domain as feature.

21. The device according to claim 1, wherein a multistage decision is performable by the unit for associating, wherein a first decision stage is based on a feature of noise-likeness, and a downstream decision stage is based on a feature of spectral dissonance, percussiveness, third order cumulant or spectral flatness measure.

22. The device according to claim 2, wherein the unit for reconstructing is further designed to re-add phase information removed in a decomposition of the information signal to obtain a reconstructed information signal for a subspace.

23. The device according to claim 1, wherein the unit for associating is designed to associate a component signal with one of more than two subspaces on the basis of one or more features of the same.

24. The device according to claim 2, further including a unit for extracting a feature from a reconstructed information signal which is generatable from a superposition of component signals in a subspace.

25. The device according to claim 1, further comprising a unit for pre-processing the information signal to selectively increase a partial signal in the information signal with respect to its energy.

26. The device according to claim 1, wherein the unit for decomposing is further designed to post-process the component signals prior to the feature extraction to reduce artifacts in a component signal coming from other partial signals.

27. A method for analyzing an information signal, wherein the information signal is an audio signal consisting of a superposition of partial signals, wherein the partial signals originate from individual sources together forming the audio signal, the method comprising:

decomposing the information signal into several component signals;

calculating a feature for each individual component signal, wherein the feature is defined so that it is correlated with one source characteristic for one subspace and with another source characteristic for another subspace, wherein one or more individual sources are associated with each subspace, and wherein the one or more individual sources associated with the one subspace differ from the one or more individual sources associated with the other subspace; and

associating the component signals with at least two subspaces on the basis of the features for the component signals, so that the one subspace includes component signals corresponding to the one or more individual sources associated with the one subspace, and that the other subspace includes component signals corresponding to the one or more individual sources associated with the other subspace.

28. A computer program with a program code for performing a method for analyzing an information signal, when the program runs on a computer, wherein the information signal is an audio signal consisting of a superposition of partial signals, wherein the partial signals originate from individual sources together forming the audio signal, the method comprising the steps of decomposing the information signal into several component signals;

calculating a feature for each individual component signal, wherein the feature is defined so that it is correlated with one source characteristic for one subspace and with another source characteristic for another subspace, wherein one or more individual sources are associated with each subspace, and wherein the one or more individual sources associated with the one subspace differ from the one or more individual sources associated with the other subspace; and

associating the component signals with at least two subspaces on the basis of the features for the component signals, so that the one subspace includes component signals corresponding to the one or more individual sources associated with the one subspace, and that the other subspace includes component signals corresponding to the one or more individual sources associated with the other subspace.