Systems and methods for the creation and playback of animated, interpretive, musical notation and audio synchronized with the recorded performance of an original artist

• US 8,633,368 B2
• Filed: 03/13/2009
• Issued: 01/21/2014
• Est. Priority Date: 09/19/2002
• Status: Expired due to Fees

• Current Assignee: Fiver LLC
• Original Assignee: Family Systems, Ltd.
• Inventors: Hudak, William B., Reynolds, Brian
• Primary Examiner(s): FLETCHER, MARLON T
• Application Number:
  US12/404,155
• Publication Number:
  US 20090173215A1
• Time in Patent Office: 1,775 Days
• Field of Search: None
• US Class Current: 84/610
• CPC Class Codes: G09B 15/00 Teaching music metronomes G04F5/02
• CPC Class Codes: G09B 15/02 Boards or like means for providing an indication of notes
• CPC Class Codes: G10H 1/0008 Associated control or indicating means
• CPC Class Codes: G10H 1/368 displaying animated or moving pictures synchronized with the music or audio part
• CPC Class Codes: G10H 2210/381 Manual tempo setting or adjustment
• CPC Class Codes: G10H 2220/015 Musical staff, tablature or score displays, e.g. for score reading during a performance
• CPC Class Codes: G10H 2220/101 for graphical creation, edition or control of musical data or parameters
• CPC Class Codes: G10H 2240/056 MIDI or other note-oriented file format

Abstract

A music application guides a user with some musical experience through the steps of creating and editing a musical enhancement file that enhances and plays in synchronicity with an audio signal of an original artist'"'"'s recorded performance. This enables others, perhaps with lesser musical ability than the original artist, to play-along with the original artist by following melodic, chordal, rhythmic, and verbal prompts. The music application accounts for differences in the timing of the performance from a standard tempo by guiding the user through the process of creating a tempo map for the performance and by associating the tempo map with MIDI information of the enhancement file. Enhancements may contain MIDI information, audio signal information, and/or video signal information which may be played back in synchronicity with the recorded performance to provide an aural and visual aid to others playing-along who may have less musical experience.

Claims

1. A system for enhancing a recorded performance so that a user may more easily accompany the recorded performance, the system being configured to:

generate enhancement data by automatic analysis of audio content associated with the recorded performance, wherein the enhancement data is temporally associated with the audio content of the recorded performance, and comprises at least one of a visual or aural representation of at least one form of musical notation of the music associated with the recorded performance;

synchronize the presentation of the enhancement data with the recorded performance; and

prompt a user to play along with the recorded performance by playing the synchronized presentation comprising the recorded performance with the synchronized enhancement data.

2. The system of claim 1, wherein the at least one of the visual or aural representation comprises at least one visual or aural chord representation of the music associated with the recorded performance.

3. The system of claim 2, wherein the chord representation comprises at least one of chord tablature, chord shape, chord symbols, alphanumeric representations, or visual representations of chord fingering of the music associated with the recorded performance.

4. The system of claim 1, wherein the system is further configured to retrieve the synchronized presentation from a computer network.

5. The system of claim 2, wherein the chord representation comprises an audio representation of at least one chord of the music associated with the recorded performance.

6. The system of claim 1, wherein the synchronized presentation further comprises the presentation of lyrical data.

7. The system of claim 6, wherein the lyrical data is audible.

8. The system of claim 6, wherein the lyrical data is visual.

9. The system of claim 1, wherein the synchronized presentation further comprises the presentation of melodic data.

10. The system of claim 9, wherein the melodic data is audible.

11. The system of claim 9, wherein the melodic data is visual.

12. The system of claim 2, wherein the chord representation is synchronously highlighted and aligned with at least one note on at least one of musical stave, piano roll, tablature, or alphanumeric representation that represents a melodic component of the recorded performance.

13. The system of claim 2, wherein the system is further configured to adjust the chord representation based on at least one of chord shape, chord fingering, alternative tuning, or musical instrument.

14. The system of claim 2, wherein the system is further configured to synchronize the at least one chord representation to a time relative to the start of the recorded performance.

15. The system of claim 1, wherein the system is further configured to:

store information in accordance with the tempo of the contents of the recorded performance in a tempo track; and

synchronize the at least one chord representation to a time relative to a musical beat of the tempo track.

16. The system of claim 1, wherein the recorded performance is an audio signal.

17. The system of claim 1, wherein the recorded performance is an audio/video signal.

18. The system of claim 1, wherein at least a portion of the synchronized presentation comprises MIDI information.

19. The system of claim 1, wherein at least a portion of the synchronized presentation comprises audio.

20. The system of claim 1, wherein at least a portion of the synchronized presentation comprises audio/video.

21. The system of claim 1, wherein the system is further configured to prompt the user to play along with the recorded performance by using a musical input device.

22. The system of claim 21, wherein the system is further configured to use a time-stable pitch variation of the synchronized presentation to prompt the user to play-along with the recorded performance.

23. The system of claim 22, wherein the pitch of the time-stable pitch variation is selected by the user.

24. The system of claim 22, wherein the system is further configured to apply a time-stable pitch variation to the recorded performance that is the same as the time-stable pitch variation of the synchronized presentation.

25. The system of claim 21, wherein the system is further configured to use a pitch-stable speed variation of the synchronized presentation to prompt the user to play along with the recorded performance.

26. The system of claim 25, wherein the speed of the pitch-stable speed variation is selected by the user.

27. The system of claim 25, wherein the system is further configured to apply a pitch-stable speed variation to the recorded performance that is the same as the pitch-stable speed variation of the synchronized enhancement.

28. The system of claim 1, wherein the system is further configured to provide the user with the opportunity to navigate to at least one of a moment of the recorded performance or element of the synchronized enhancement data.

29. The system of claim 28, wherein the system is further configured to repeat a portion of the synchronized enhancement data at least one of before or after the at least one moment or element.

30. A method for enhancing a recorded performance so that a user may more easily accompany the recorded performance, the method comprising:

generating enhancement data by automatic analysis of audio content associated with the recorded performance, wherein the enhancement data is temporally associated with the audio content of the recorded performance, and comprises at least one of a visual or aural representation of at least one form of musical notation of the music associated with the recorded performance;

synchronizing the presentation of the enhancement data with the recorded performance; and

prompting a user to play along with the recorded performance by playing the synchronized presentation comprising the recorded performance with the synchronized enhancement data.