Automatic recognition and matching of tempo and phase of pieces of music, and an interactive music player

• US 8,680,388 B2
• Filed: 09/24/2009
• Issued: 03/25/2014
• Est. Priority Date: 01/13/2001
• Status: Expired due to Fees

• Current Assignee: Native Instruments GmbH (Soundwide GmbH)
• Original Assignee: Native Instruments GmbH (Soundwide GmbH)
• Inventors: Becker, Friedemann, Holl, Thomas, Kurz, Michael, Diepstraten, Toine, Haver, Daniel
• Primary Examiner(s): FLETCHER, MARLON T
• Application Number:
  US12/565,766
• Publication Number:
  US 20100011941A1
• Time in Patent Office: 1,643 Days
• Field of Search: None
• US Class Current: 84/625
• CPC Class Codes: G10H 1/00 Details of electrophonic musical instruments
• CPC Class Codes: G10H 2210/076 for extraction of timing, tempo; Beat detection
• CPC Class Codes: G10H 2240/061 MP3, i.e. MPEG-1 or MPEG-2 Audio Layer III, lossy audio compression
• CPC Class Codes: G10H 2240/325 Synchronizing two or more audio tracks or files according to musical features or musical timings

Abstract

A method of matching the tempo and phase in pieces of music which allows the conjunction of the pieces of music to form a continuous stream of music. The interactive music player which digitally executes the method of matching the tempo and phase in pieces of music is also disclosed.

Claims

1. A method for playback of digital content data, the method comprising:

providing in a first data region a control file (MIX_DATA) with digital control data for controlling a digital content data player, the digital control data representing information for controlling at least one of a mixing procedure of one or more individual pieces of content data (TR1, . . . , TRn) and an interactive intervention into the one or more individual pieces of content data (TR1, . . . , TRn) via signal processing means and being recorded during at least one of a previous mixing procedure or a previous interactive intervention, wherein

the control data (MIX_DATA) in the first data region refer to the content data (CONTENT_DATA) in a second data region, the second data region comprising the content data (CONTENT_DATA) subdivided in the one or more individual pieces of content data (TR1, . . . , TRn),

determining by means of the control data with reference to the one or more individual pieces of content data (TR1, . . . , TRn), in which manner the digital content data player plays back a defined part of the one or more individual pieces of content data (TR1, . . . , TRn), and playing back the content data (TR1, . . . , TRn) with at least one of a tempo and a phase which is different from the tempo and the phase with which the content data (TR1, . . . , TRn) has been recorded by modifying according to the control data (MIX_DATA)during play back the properties with which the content data (TR1, . . . , TRn) has been recorded.

2. The method according to claim 1, wherein

at least one of the control file (MIX_DATA) and the content data (CONTENT_DATA) are provided on a CD, a DVD, a SC memory card or a hard disc.

3. The method according to claim 1, wherein

the first and second data region is provided on one single storage medium.

4. The method according to claim 1, wherein

the content data are at least one of audio, video, multimedia and entertainment data.

5. The method according to claim 1, wherein

the one or more individual pieces of content data are at least one of pieces of music, of video, of multimedia and of entertainment content.

6. The method according to claim 1, wherein

the control data with reference to the one or more individual pieces of content data (TR1, . . . , TRn) determine, in which sequence the digital content data player plays a defined part of the one or more individual pieces of content data (TR1, . . . , TRn).

7. The method according to claim 1, further comprising providing content data in real-time for at least two individual pieces of content data from a data source with only one reader unit, wherein the data source supplies content data at a faster reading rate than the relevant playback rate, in that a relevant buffer memory (P1 . . . Pn) is provided for each individual piece of content data (TR1, . . . , TRn) to be played, and that the faster reading rate is used in order to fill the relevant buffer memory (P1 . . . Pn) with associated content data in such a manner, that content data are always available in time before and after a current playback position (A1 . . . An) of the relevant piece of content data.

8. The method according to claim 7, where the buffer memory (P1 . . . Pn) is a ring buffer.

9. The method according to claim 7, where the status of each buffer memory (P1 . . . Pn) is monitored to determine whether sufficient data are available, and when the level falls below a predetermined threshold value, a central instance (S), which is not coupled to the playback of the one or more individual pieces of content data (TR1, . . . , TRn), in order to provide the necessary content data and automatically requests the required regions of content data from the data source and fills up the associated buffer memory (P1 . . . Pn) with the data obtained, wherein data which are not longer needed are over-written.

10. The method according to claim 9, where over-writing is performed during the filling up of a buffer memory (P1 . . . Pn).

11. The method according to claim 1, wherein the digital control data (MIX_DATA) in the first data region represent at least one of mixing procedures for pieces of content data and interactive interventions into pieces of content data using signal processing means to provide a new work with the content data (CONTENT_DATA) from pieces of content data in the second data region.

12. The method according to claim 11, wherein the digital control data (MIX_DATA) in the first data region represent at least one of the following procedures for creating a new work from the content data in the second region by at least one of:

controlling playback position, playback start and playback stop time;

controlling playback speed; and

controlling playback volume and other signal processing means applied to the content data.

13. The method according to claim 1, wherein the central instance places requests received in parallel into an order to be worked through sequentially.

14. The method according to claim 1, wherein the control data with reference to the one or more individual pieces of content data (TR1, . . . , TRn) determine, to which point of time the digital content data player plays a defined part of the one or more individual pieces of content data (TR1, . . . , TRn).

15. The method according to claim 1, wherein the digital content data player is a music player, a video player or a multimedia player.

16. A digital content data player

(a) with means for accessing in a first data region a control file (MIX_DATA) with digital control data for controlling the digital content data player, wherein the digital control data represent information for controlling at least one of a mixing procedure of one or more individual pieces of content data (TR1, . . . , TRn) and an interactive intervention into the one or more individual pieces of content data (TR1, . . . , TRn) via signal processing means, the digital control data being recorded during at least one of a previous mixing procedure or a previous interactive intervention, and

(b) with means for accessing in a second data region the content data (CONTENT_DATA) subdivided in the one or more individual pieces of content data (TR1, . . . , TRn), wherein

(c) the control data (MIX_DATA) in the first data region refer to the content data (CONTENT_DATA) in the second data region and wherein the control data with reference to the one or more individual pieces of content data (TR1, . . . , TRn) determine, in which manner the digital content data player plays a defined part of the one or more individual pieces of content data (TR1, . . . , TRn), wherein the content data (TR1, . . . , TRn) are played back with at least one of a tempo and a phase which is different from the tempo and the phase with which the content data (TR1, . . . , TRn) has been recorded by modifying according to the control data (MIX_DATA) during play back the properties with which the content data (TR1, . . . , TRn) has been recorded.

17. The digital content data player according to claim 16, wherein the digital content data player is a music player, a video player or a multimedia player.

18. A data structure, which comprises

(a) a first data region with a control file (MIX_DATA) with digital control data for controlling a digital content data player, wherein the digital control data represent information for controlling at least one of a mixing procedure of one or more individual pieces of content data (TR1, . . . , TRn) and an interactive intervention into the one or more individual pieces of content data (TR1, . . . , TRn) via signal processing means, the digital control data being recorded during at least one of a previous mixing procedure or a previous interactive intervention, and

(b) a second data region with the content data (CONTENT_DATA) subdivided in the one or more individual pieces of content data (TR1, . . . , TRn), wherein

(c) the control data (MIX_DATA) in the first data region refer to content data (CONTENT_DATA) in the second data region and wherein the control data with reference to the one or more individual pieces of content data (TR1, . . . , TRn) determine, in which manner the digital content data player plays back a defined part of the one or more individual pieces of content data (TR1, . . . , TRn), wherein the content data (TR1, . . . , TRn) are played back with at least one of a tempo and a phase which is different from the tempo and the phase with which the content data (TR1, . . . , TRn) has been recorded by modifying according to the control data (MIX_DATA) during play back the properties with which the content data (TR1, . . . , TRn) has been recorded.

19. The data structure according to claim 18, wherein

at least one of the control file (MIX_DATA) and the content data (CONTENT_DATA) are provided on a CD, a DVD, a SC memory card or a hard disc.

20. The data structure according to claim 18, which can be directly loaded into an internal memory of a computer and which comprises software sections (PRG_DATA), with which the computer assumes the functions of a digital content data player, with which, in dependence upon the control data (MIX_DATA) in the first data region, a work represented by the content data (CONTENT_DATA) can be played, when the software product (PRG_DATA) is run on the computer.

21. The data structure according to claim 18, further comprising a time sequence of control data, a time sequence of playback positions in a data source and intervals with status information for at least a part of control elements providing new starting points for playback.

22. The data structure according to claim 18, wherein

the content data are at least one of audio, video, multimedia and entertainment data.

23. The data structure according to claim 18, wherein

the one or more individual pieces of content data are at least one of pieces of music, of video, of multimedia and of entertainment content.

24. The data structure according to claim 18, wherein the digital content data player is a music player, a video player or a multimedia player.

25. A data medium, which comprises

(a) a first data region with a control file (MIX_DATA) with digital control data for controlling a digital content data player, wherein the digital control data represent information for controlling at least one of a mixing procedure of one or more individual pieces of content data (TR1, . . . , TRn) and an interactive intervention into the one or more individual pieces of content data (TR1, . . . , TRn) via signal processing means, the digital control data being recorded during at least one of a previous mixing procedure or a previous interactive intervention, and

(b) a second data region with the content data (CONTENT_DATA) subdivided in the one or more individual pieces of content data (TR1, . . . , TRn), wherein

(c) the control data (MIX_DATA) in the first data region refer to content data (CONTENT_DATA) in the second data region and wherein the control data with reference to the one or more individual pieces of content data (TR1, . . . , TRn) determine, in which manner the digital content data player plays a defined part of the one or more individual pieces of content data (TR1, . . . , TRn), wherein the content data (TR1, . . . , TRn) are played back with at least one of a tempo and a phase which is different from the tempo and the phase with which the content data (TR1, . . . , TRn) has been recorded by modifying according to the control data (MIX_DATA) during play back the properties with which the content data (TR1, . . . , TRn) has been recorded.

26. The data medium according to claim 25, wherein the digital control data (MIX_DATA) in the first data region represent at least one of mixing procedures for the one or more individual pieces of content data and interactive interventions into the one or more individual pieces of content data using signal processing means to provide a new work with the control data (CONTENT_DATA) from the one or more individual pieces of content data in the second data region.

27. The data medium according to claim 25, wherein the digital control data (MIX_DATA) in the first data region represent at least one of the following procedures for creating a new work from the content data in the second region by at least one of:

controlling playback position, playback start and playback stop time;

controlling playback speed; and

controlling playback volume and other signal processing means applied to the content data.

28. The data medium according to claim 25, wherein stored digital control data (MIX_DATA) in the first data region have a format which provides information for identifying the processed one or more individual pieces of content data (TRI, . . . , TRn) in the second data region and a relevant time sequence of playback positions and status information for the control elements of the digital content data player allocated to the processed one or more individual pieces of content data.

29. The data medium according to claim 25, wherein a data structure (PRG_DATA) can be directly loaded into an internal memory of a computer and which comprises software sections (PRG_DATA), with which the computer assumes the functions of the digital content data player, with which, in dependence upon the control data (MIX_DATA) in the first data region of the data medium, which refer to the control data (CONTENT_DATA) in the second data region of the data medium, a work represented by the control data (CONTENT_DATA) can be played, when the software product (PRG_DATA) is run on the computer.

30. The data medium according to claim 25, wherein

the data medium is realized as a CD, a DVD, a SC memory card or a hard disc.

31. The data medium according to claim 25, wherein

the content data are at least one of audio, video, multimedia and entertainment data.

32. The data medium according to claim 25, wherein

the one or more individual pieces of content data are at least one of pieces of music, of video, of multimedia and of entertainment content.

33. The data medium according to claim 25, wherein the digital content data player is a music player, a video player or a multimedia player.

34. A method for playback of digital content data, the method comprising:

providing in a first data region a control file (MIX_DATA) with digital control data for controlling a digital content data player, wherein

the control data (MIX_DATA) in the first data region refer to content data (CONTENT_DATA) in a second data region, the second data region comprising content data (CONTENT_DATA) subdivided in one or more individual pieces of content data (TR1, . . . , TRn), and wherein the control data with reference to the one or more individual pieces of content data (TR1, . . . , TRn) determine, in which manner the digital content data player plays a defined part of the one or more individual pieces of content data (TR1, . . . , TRn);

the method further comprising providing content data in real-time for at least two individual pieces of content data from a data source with only one reader unit, wherein the data source supplies content data at a faster reading rate than the relevant playback rate, in that a relevant buffer memory (P1 . . . Pn) is provided for each individual piece of content data (TR1, . . . , TRn) to be played, and that the faster reading rate is used in order to fill the relevant buffer memory (P1 . . . Pn) with associated content data in such a manner, that content data are always available in time before and after a current playback position (A1 . . . An) of the relevant piece of content data.

35. The method according to claim 34, where the buffer memory (P1 . . . Pn) is a ring buffer.

36. The method according to claim 34, where the status of each buffer memory (P1 . . . Pn) is monitored to determine whether sufficient data are available, and when the level falls below a predetermined threshold value, a central instance (S), which is not coupled to the playback of the one or more individual pieces of content data (TR1, . . . , TRn), in order to provide the necessary content data and automatically requests the required regions of content data from the data source and fills up the associated buffer memory (P1 . . . Pn) with the data obtained, wherein data which are not longer needed are over-written.

37. The method according to claim 36, where over-writing is performed during the filling up of a buffer memory (P1 . . . Pn).