Method for processing music to match runners tempo

• US 9,269,341 B1
• Filed: 06/30/2014
• Issued: 02/23/2016
• Est. Priority Date: 06/30/2013
• Status: Expired due to Fees

• Current Assignee: Second Wind Technologies Incorporated
• Original Assignee: Second Wind Technologies Incorporated
• Inventors: Lemnitsky, Pavel A., Shapranov, Vladimir V., Vitman, Denis
• Primary Examiner(s): Donels, Jeffrey
• Application Number:
  US14/318,839
• Time in Patent Office: 603 Days
• Field of Search: 482 3- 9, 482/900, 482/901, 846/12, 700/94
• US Class Current: 1/1
• CPC Class Codes: G10H 1/40 Rhythm
• CPC Class Codes: G10H 2210/076 for extraction of timing, tempo; Beat detection tempo display G10H2220/081; tempo control G10H2210/375
• CPC Class Codes: G10H 2210/385 Speed change, i.e. variations from preestablished tempo, tempo change, e.g. faster or slower, accelerando or ritardando, without change in pitch with repetitive changes in pitch, e.g. scratch DJ effects G10H2210/241
• CPC Class Codes: G10H 2220/351 Environmental parameters, e.g. temperature, ambient light, atmospheric pressure, humidity, used as input for musical purposes
• CPC Class Codes: G10H 2220/355 Geolocation input, i.e. control of musical parameters based on location or geographic position, e.g. provided by GPS, WiFi network location databases or mobile phone base station position databases
• CPC Class Codes: G10H 2220/395 Acceleration sensing or accelerometer use, e.g. 3D movement computation by integration of accelerometer data, angle sensing with respect to the vertical, i.e. gravity sensing. conductor baton movement sensing G10H2220/206, angle sensing without reference to gravity G10H2220/391; player body joint angle sensing G10H2220/321
• CPC Class Codes: G10H 2240/131 Library retrieval, i.e. searching a database or selecting a specific musical piece, segment, pattern, rule or parameter set

Abstract

A method for adjusting a rhythm of music to match a running rhythm of a person'"'"'s steps. Even if a running rhythm changes during the same run, the rhythm of the music is changed without changing the sound and the key or the pitch of the music. A music file is converted into a universal PCM format and the fingerprint function is calculated. Repeating patterns are detected in the fingerprint function. Music tempo is estimated using data about repeating patterns. Runner'"'"'s steps are analyzed using an accelerometer. Then, a special coefficient is calculated in order to either speed up or slow down the music for matching it to the rhythm of the runner'"'"'s steps.

Claims

1. A method for matching a tempo of music to a runner'"'"'s rhythm, the method comprising:

loading a music file into a mobile device;

attaching a mobile device to a person;

converting the music file into a universal PCM format;

splitting the music file into a set of overlapping windows;

applying a Discrete Fourier Transformation for each window;

calculating an energy of a high frequency portion within each Fourier spectrum;

using the calculated energy as the fingerprint at a corresponding offset from the beginning of the music file;

locating repeating patterns in different parts of the fingerprint using autocorrelation function;

using a frequency of the patterns repetition as a possible tempo value at the corresponding offset in the music file;

defining a main music rhythm using statistical analysis of possible tempo values;

detecting a rhythm of person'"'"'s steps using autocorrelation analysis of accelerometer and/or gyroscope data;

calculating a music adjustment coefficient K by dividing the music rhythm by the movement rhythm;

applying the music adjustment coefficient K to the music file; and

playing back the music file using a tempo adjusted by the music adjustment coefficient K.

2. The method of claim 1, wherein the music rhythm is stored in a database.

3. The method of claim 1, wherein a fingerprint is calculated for each frame of the Fourier spectrum prior to the determining of the peaks of the autocorrelation function.

4. The method of claim 1, wherein the tempo of the music is sped up by the application of the K, if the K>

=1.

5. The method of claim 1, wherein the tempo of the music is slowed down by the application of the K, if the K<

1.

6. A system for matching a tempo of music to a runner'"'"'s rhythm, the system comprising:

a mobile device configured to receive a music file;

an accelerometer integrated in the mobile device, the accelerometer configured to detect a rhythm or person'"'"'s steps;

a music processing module executed on the mobile device; and

a play back module integrated into a module device,

wherein;

the mobile device receives the music file and provides it to the music processing module;

the music processing module acquires the rhythm data from the accelerometer;

the music processing module calculates a music adjustment coefficient based on the rhythm data and applies it to the music file; and

the play back module plays the adjusted music file,

wherein the music processing module is configured to perform the following steps;

converting the music file into a universal format;

applying a Discrete Fourier Transformation to the music file;

calculating a Fourier spectrum for the music file;

calculating an average amplitude for a high frequency portion within each Fourier spectrum and using it as a fingerprint;

composing a fingerprint function from the music file;

determining repeating patterns in the fingerprint function;

calculating a rhythm of the song for each moment of time from the interval of repeating patterns in the fingerprint function;

defining a main music rhythm based on statistical analysis of rhythm values of different parts of the music file;

determining repeating patterns in real-time data received from accelerometer or gyroscope using autocorrelation function; and

calculating a person'"'"'s step interval from repeating patterns interval.

7. The system of claim 6, wherein the music processing module calculates the music adjustment coefficient by dividing a music rhythm by the movement rhythm.

8. The system of claim 6, wherein a user-defined movement rhythm is used for calculation of the music adjustment coefficient.

9. The system of claim 6, wherein the music processing module handles any of detected exceptions:

sharp changes in a music tempo; and

abrupt changes in a movement rhythm.

10. The system of claim 9, wherein the music processing module applies the music adjustment coefficient regardless of the detected exceptions.