Sound signal analysis apparatus, sound signal analysis method and sound signal analysis program

• US 9,087,501 B2
• Filed: 03/13/2014
• Issued: 07/21/2015
• Est. Priority Date: 03/14/2013
• Status: Active Grant

• Current Assignee: Yamaha Corporation
• Original Assignee: Yamaha Corporation
• Inventors: Maezawa, Akira
• Primary Examiner(s): WARREN, DAVID S
• Application Number:
  US14/207,816
• Publication Number:
  US 20140260911A1
• Time in Patent Office: 495 Days
• Field of Search: 846/12, 846/36, 846/52
• US Class Current: 1/1
• CPC Class Codes: G10H 1/00 Details of electrophonic musical instruments
• CPC Class Codes: G10H 1/40 Rhythm
• CPC Class Codes: G10H 2210/046 for differentiation between music and non-music signals, based on the identification of musical parameters, e.g. based on tempo detection
• CPC Class Codes: G10H 2210/061 for extraction of musical phrases, isolation of musically relevant segments, e.g. musical thumbnail generation, or for temporal structure analysis of a musical piece, e.g. determination of the movement sequence of a musical work
• CPC Class Codes: G10H 2210/076 for extraction of timing, tempo; Beat detection
• CPC Class Codes: G10H 2210/101 Music Composition or musical creation; Tools or processes therefor
• CPC Class Codes: G10H 2210/375 Tempo or beat alterations; Music timing control
• CPC Class Codes: G10H 2250/015 Markov chains, e.g. hidden Markov models [HMM], for musical processing, e.g. musical analysis or musical composition
• CPC Class Codes: G10H 7/00 Instruments in which the tones are synthesised from a data store, e.g. computer organs
• CPC Class Codes: G10H 7/002 using a common processing for different operations or calculations, and a set of microinstructions (programme) to control the sequence thereof

Abstract

A sound signal analysis apparatus 10 includes sound signal input portion for inputting a sound signal indicative of a musical piece, tempo detection portion for detecting a tempo of each of sections of the musical piece by use of the input sound signal, judgment portion for judging stability of the tempo, and control portion for controlling a certain target in accordance with a result judged by the judgment portion.

Claims

1. A sound signal analysis apparatus comprising:

at least one non-transitory memory device;

at least one processor;

a sound signal input portion for inputting a sound signal indicative of a musical piece;

a tempo detection portion for detecting a tempo of each of sections of the musical piece by use of the input sound signal;

a judgment portion for judging stability of the tempo; and

a control portion for controlling a certain target in accordance with a result judged by the judgment portion,

wherein the tempo detection portion has;

a feature value calculation portion for calculating a first feature value indicative of a feature relating to existence of a beat and a second feature value indicative of a feature relating to tempo for each of the sections of the musical piece; and

an estimation portion for concurrently estimating a beat position and a change in tempo in the musical piece by selecting, from among a plurality of probability models described as sequences of states classified according to a combination of a physical quantity relating to existence of a beat in each of the sections and a physical quantity relating to tempo in each of the sections, a probability model whose sequence of observation likelihoods each indicative of a probability of concurrent observation of the first feature value and the second feature value in the each section satisfies a certain criterion,

wherein the sound signal input portion, the tempo detection portion, the judgment portion, and the control portion are implemented at least in part by the at least one processor executing at least one program recorded on the at least one non-transitory memory device.

2. The sound signal analysis apparatus according to claim 1,

wherein the estimation portion concurrently estimates a beat position and a change in tempo in the musical piece by selecting a probability model of the most likely sequence of observation likelihoods from among the plurality of probability models.

3. The sound signal analysis apparatus according to claim 1,

wherein the estimation portion has first probability output portion for outputting, as a probability of observation of the first feature value, a probability calculated by assigning the first feature value as a probability variable of a probability distribution function defined according to the physical quantity relating to existence of beat.

4. The sound signal analysis apparatus according to claim 3,

wherein as a probability of observation of the first feature value, the first probability output portion outputs a probability calculated by assigning the first feature value as a probability variable of any one of normal distribution, gamma distribution and Poisson distribution defined according to the physical quantity relating to existence of beat.

5. The sound signal analysis apparatus according to claim 1,

wherein the estimation portion has second probability output portion for outputting, as a probability of observation of the second feature value, goodness of fit of the second feature value to a plurality of templates provided according to the physical quantity relating to tempo.

6. The sound signal analysis apparatus according to claim 1,

wherein the estimation portion has second probability output portion for outputting, as a probability of observation of the second feature value, a probability calculated by assigning the second feature value as a probability variable of probability distribution function defined according to the physical quantity relating to tempo.

7. The sound signal analysis apparatus according to claim 6,

wherein as a probability of observation of the second feature value, the second probability output portion outputs a probability calculated by assigning the first feature value as a probability variable of any one of multinomial distribution, Dirichlet distribution, multidimensional normal distribution, and multidimensional Poisson distribution defined according to the physical quantity relating to existence of beat.

8. The sound signal analysis apparatus according to claim 1,

wherein the judgment portion calculates likelihoods of the respective states in the respective sections in accordance with the first feature value and the second feature value observed from the top of the musical piece to the respective sections, and judges stability of tempo in the respective sections in accordance with the distribution of likelihoods of the respective states in the respective sections.

9. The sound signal analysis apparatus according to claim 1, wherein the judgment portion judges that the tempo is stable if an amount of change in tempo between the sections falls within a predetermined range, while the judgment portion judges that the tempo is unstable if the amount of change in tempo between the sections is outside the predetermined range.

10. The sound signal analysis apparatus according to claim 1,

wherein the control portion makes the target operate in a predetermined first mode in the section where the tempo is stable, while the control portion makes the target operate in a predetermined second mode in the section where the tempo is unstable.

11. A sound signal analysis method comprising:

inputting a sound signal indicative of a musical piece;

detecting a tempo of each of sections of the musical piece by use of the input sound signal;

judging a stability of the tempo; and

controlling a certain target in accordance with the judged stability of the tempo,

wherein detecting the tempo includes;

calculating a first feature value indicative of a feature relating to existence of a beat and a second feature value indicative of a feature relating to tempo for each of the sections of the musical piece; and

concurrently estimating a beat position and a change in tempo in the musical piece by selecting, from among a plurality of probability models described as sequences of states classified according to a combination of a physical quantity relating to existence of a beat in each of the sections and a physical quantity relating to tempo in each of the sections, a probability model whose sequence of observation likelihoods each indicative of a probability of concurrent observation of the first feature value and the second feature value in the each section satisfies a certain criterion.

12. A non-transitory computer readable storage medium storing a sound signal analysis program configured to cause a computer to execute a sound signal analysis method comprising:

inputting a sound signal indicative of a musical piece;

detecting a tempo of each of sections of the musical piece by use of the input sound signal;

judging a stability of the tempo; and

controlling a certain target in accordance with the judged stability of the tempo,

wherein detecting the tempo includes;

calculating a first feature value indicative of a feature relating to existence of a beat and a second feature value indicative of a feature relating to tempo for each of the sections of the musical piece; and

concurrently estimating a beat position and a change in tempo in the musical piece by selecting, from among a plurality of probability models described as sequences of states classified according to a combination of a physical quantity relating to existence of a beat in each of the sections and a physical quantity relating to tempo in each of the sections, a probability model whose sequence of observation likelihoods each indicative of a probability of concurrent observation of the first feature value and the second feature value in the each section satisfies a certain criterion.

13. An apparatus comprising:

at least one non-transitory memory device;

at least one processor;

an interface circuit configured to communicate with an external apparatus;

musical piece data indicative of a musical piece stored on the at least one non-transitory memory device;

a sound signal input unit configured to input a sound signal indicative of the musical piece;

a tempo detection unit configured to detect a tempo of each of sections of the musical piece by use of the input sound signal;

a judgment unit configured to judge a stability of the tempo; and

a control unit configured to control the external apparatus in accordance with a result judged by the judgment unit,

wherein the sound signal input unit, the tempo detection unit, the judgment unit, and the control unit are implemented at least in part by the at least one processor executing at least one program recorded on the at least one non-transitory memory device.

14. The apparatus according to claim 13, wherein the judgment unit is configured to determine that the tempo is stable if an amount of change in tempo between adjacent sections is less than a threshold value and to determine that the tempo is unstable if the amount of change in tempo between the adjacent sections exceeds the threshold value.

15. The apparatus according to claim 13, wherein the control unit causes the external apparatus to operate in a first mode in the section where the tempo is stable and to operate in a second mode in the section where the tempo is unstable.

16. The apparatus according to claim 13, wherein the sections of the musical piece are sequentially recorded in successive addresses of the at least one non-transitory memory device.