Systems and methods for the creation and playback of animated, interpretive, musical notation and audio synchronized with the recorded performance of an original artist

• US 10,056,062 B2
• Filed: 09/20/2016
• Issued: 08/21/2018
• Est. Priority Date: 09/19/2002
• Status: Active Grant

• Current Assignee: Fiver LLC
• Original Assignee: Fiver LLC
• Inventors: Reynolds, Brian, Hudak, William B.
• Primary Examiner(s): FLETCHER, MARLON T
• Application Number:
  US15/270,701
• Publication Number:
  US 20170011725A1
• Time in Patent Office: 700 Days
• CPC Class Codes: G09B 15/00 Teaching music metronomes G04F5/02
• CPC Class Codes: G09B 15/02 Boards or like means for providing an indication of notes
• CPC Class Codes: G10H 1/0008 Associated control or indicating means
• CPC Class Codes: G10H 1/368 displaying animated or moving pictures synchronized with the music or audio part
• CPC Class Codes: G10H 2210/381 Manual tempo setting or adjustment tempo setting by interpretation of conducting movements G10H2220/206
• CPC Class Codes: G10H 2220/015 Musical staff, tablature or score displays, e.g. for score reading during a performance. graphical musical score editing G10H2220/121; musical score displays resulting from a transcription G10H2210/086
• CPC Class Codes: G10H 2220/101 for graphical creation, edition or control of musical data or parameters
• CPC Class Codes: G10H 2240/056 MIDI or other note-oriented file format

Abstract

A music application guides a user with some musical experience through the steps of creating and editing a musical enhancement file that enhances and plays in synchronicity with an audio signal of an original artist'"'"'s recorded performance. This enables others, perhaps with lesser musical ability than the original artist, to play-along with the original artist by following melodic, chordal, rhythmic, and verbal prompts. The music application accounts for differences in the timing of the performance from a standard tempo by guiding the user through the process of creating a tempo map for the performance and by associating the tempo map with MIDI information of the enhancement file. Enhancements may contain MIDI information, audio signal information, and/or video signal information which may be played back in synchronicity with the recorded performance to provide an aural and visual aid to others playing-along who may have less musical experience.

Claims

1. A method comprising:

receiving performance audio data representing a recorded performance of a musical performer;

determining, by a processor, a timing track representing playback characteristics of the recorded performance represented by the performance audio data;

determining, by the processor, a map representing a timing relationship between the audio data representing the recorded performance and the timing track representing the playback characteristics; and

prompting play along with the performance audio based on the map representing the timing relationship between the audio data representing the recorded performance and the timing track representing the playback characteristics, wherein prompting play along with the performance audio includes repeating a portion of the performance audio for play along, wherein repeating the portion of the performance audio for play along includes playing back the portion with different audio characteristics in comparison with a portion of the performance audio that is not repeated for play along.

2. The method of claim 1, wherein the playback characteristics include a tempo of the recorded performance represented by the performance audio data.

3. The method of claim 1, wherein the map represents adjustments to the timing relationship between the audio data and the timing track.

4. The method of claim 1, wherein the timing relationship corresponds to a number of beats per measure of the timing track.

5. The method of claim 1, wherein prompting play along with the performance audio includes playback of aural and visual components of the recorded performance.

6. An electronic device, comprising:

one or more processors; and

memory storing instructions, wherein the processor is configured to execute the instructions such that the processor and memory are configured to;

receive performance audio data representing a recorded performance of a musical performer;

determine a timing track representing playback characteristics of the recorded performance represented by the performance audio data;

determine a map representing a timing relationship between the audio data representing the recorded performance and the timing track representing the playback characteristics; and

prompt play along with the performance audio based on the map representing the timing relationship between the audio data representing the recorded performance and the timing track representing the playback characteristics, wherein prompting play along with the performance audio includes repeating a portion of the performance audio for play along, wherein repeating the portion of the performance audio for play along includes playing back the portion with different audio characteristics in comparison with a portion of the performance audio that is not repeated for play along.

7. The electronic device of claim 6, wherein the playback characteristics include a tempo of the recorded performance represented by the performance audio data.

8. The electronic device of claim 6, wherein the map represents adjustments to the timing relationship between the audio data and the timing track.

9. The electronic device of claim 6, wherein the timing relationship corresponds to a number of beats per measure of the timing track.

10. The electronic device of claim 6, wherein prompting play along with the performance audio includes playback of aural and visual components of the recorded performance.

11. A computer program product, comprising one or more non-transitory computer-readable media having computer program instructions stored therein, the computer program instructions being configured such that, when executed by one or more computing devices, the computer program instructions cause the one or more computing devices to:

receive performance audio data representing a recorded performance of a musical performer;

determine a timing track representing playback characteristics of the recorded performance represented by the performance audio data;

determine a map representing a timing relationship between the audio data representing the recorded performance and the timing track representing the playback characteristics; and

prompt play along with the performance audio based on the map representing the timing relationship between the audio data representing the recorded performance and the timing track representing the playback characteristics, wherein prompting play along with the performance audio includes repeating a portion of the performance audio for play along, wherein repeating the portion of the performance audio for play along includes playing back the portion with different audio characteristics in comparison with a portion of the performance audio that is not repeated for play along.

12. The computer program product of claim 11, wherein the playback characteristics include a tempo of the recorded performance represented by the performance audio data.

13. The computer program product of claim 11, wherein the map represents adjustments to the timing relationship between the audio data and the timing track.

14. The computer program product of claim 11, wherein the timing relationship corresponds to a number of beats per measure of the timing track.

15. The computer program product of claim 11, wherein prompting play along with the performance audio includes playback of aural and visual components of the recorded performance.