System for mixing a video track with variable tempo music

• US 10,192,460 B2
• Filed: 03/01/2017
• Issued: 01/29/2019
• Est. Priority Date: 02/20/2008
• Status: Active Grant

• Current Assignee: Jammit, Inc.
• Original Assignee: Jammit, Inc.
• Inventors: Humphrey, Scott
• Primary Examiner(s): Qin, Jianchun
• Application Number:
  US15/446,428
• Publication Number:
  US 20180018898A1
• Time in Patent Office: 699 Days
• Field of Search: 84609
• CPC Class Codes: G06Q 50/00 Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism healthcare informatics G16H
• CPC Class Codes: G09B 15/00 Teaching music metronomes G04F5/02
• CPC Class Codes: G10H 1/0041 in coded form
• CPC Class Codes: G10H 1/0066 using a MIDI interface
• CPC Class Codes: G10H 2210/056 for extraction or identification of individual instrumental parts, e.g. melody, chords, bass; Identification or separation of instrumental parts by their characteristic voices or timbres
• CPC Class Codes: G10H 2210/061 for extraction of musical phrases, isolation of musically relevant segments, e.g. musical thumbnail generation, or for temporal structure analysis of a musical piece, e.g. determination of the movement sequence of a musical work
• CPC Class Codes: G10H 2210/385 Speed change, i.e. variations from preestablished tempo, tempo change, e.g. faster or slower, accelerando or ritardando, without change in pitch with repetitive changes in pitch, e.g. scratch DJ effects G10H2210/241
• CPC Class Codes: G10H 2220/015 Musical staff, tablature or score displays, e.g. for score reading during a performance. graphical musical score editing G10H2220/121; musical score displays resulting from a transcription G10H2210/086
• CPC Class Codes: G10H 2220/091 Graphical user interface [GUI] specifically adapted for electrophonic musical instruments, e.g. interactive musical displays, musical instrument icons or menus; Details of user interactions therewith GUI in general G06F3/048
• CPC Class Codes: G10H 2220/135 Musical aspects of games or videogames; Musical instrument-shaped game input interfaces game background music G10H2210/026; musical game scoring or performance evaluation G10H2210/091
• CPC Class Codes: G10H 2240/005 Data structures for use in electrophonic musical devices; Data structures including musical parameters derived from musical analysis audio retrieval G06F16/60

Abstract

The teachings described herein are generally directed to a system, method, and apparatus for separating and mixing tracks within music. The system can have a video that is synchronized with the variations in the musical tempo through a variable timing reference track designed and provided for a user of the preselected piece of music that was prerecorded, wherein the designing of the variable timing reference track includes creating a tempo map having variable tempos, rhythms, and beats using notes from the preselected piece of music.

Claims

1. A system for a user to view a video that is synchronized to a prerecorded variable tempo music, the system comprising:

a processor and a memory on a non-transitory computer readable medium, the memory including

a multi-track digital audio file of a preselected piece of music having a plurality of audio tracks that include an isolated instrument audio track containing only audio from the isolated instrument, and an emulation audio track consisting of the multi-track digital audio file having the isolated instrument audio track removed; and

,

a variable timing reference track designed and provided for a user for the preselected piece of music, wherein the preselected piece of music was prerecorded, and the designing of the variable timing reference track includes creating a tempo map having variable tempos, rhythms, and beats using notes from the preselected piece of music;

a transformation module on a non-transitory computer readable storage medium and in operable communication with the processor for transforming the multi-track digital audio file to include a variable gain ratio of (i) the isolated instrument audio track to (ii) an emulation audio track, wherein the emulation audio track represents a subtraction of the isolated instrument audio track from the plurality of audio tracks, and the gain ratio is selected by the user;

an emulation module on a non-transitory computer readable storage medium and in operable communication with the processor for emulating the isolated instrument audio track with a preselected musical instrument under a guidance of the variable timing reference track; and

,

a video display module on a non-transitory computer readable storage medium and in operable communication with the processor for viewing a digital video that is synchronized to the variations in the musical tempo using the variable timing reference track.

2. The system of claim 1 further comprising:

an integration engine on a non-transitory computer readable storage medium and in operable communication with the processor for combining the emulated instrument audio track with the isolated instrument audio track, the emulation audio track, the variable timing reference track, or a combination thereof, to transform the multi-track digital audio file into the audio file that is synchronized with the digital video using the variations in the musical tempo through the variable timing reference track.

3. The system of claim 2, wherein the system is on a handheld device.

4. The system of claim 3, wherein the device is a cellular device.

5. The system of claim 3, wherein the device is a video gaming console.

6. The system of claim 1, wherein the system includes notes configured as MIDI notes that were manually created using transients.

7. The system of claim 1, wherein the digital video includes music transcription and tablature data, wherein the music transcription and tablature data is synchronized to the preselected piece of music through the variable timing reference track.

8. The system of claim 1, wherein the multi-track digital audio file of the preselected piece of music is an original, multi-track recording or a re-creation of the original, multi-track recording.

9. The system of claim 1, wherein the digital video further comprises one or more bars of the isolated instrument audio track selected to enable the user to focus on emulating a section of the preselected piece of music.

10. The system of claim 1 including a transport state selection, wherein the digital video includes a looping page showing a bar or bars of the preselected piece of music for repeated playback, wherein the bar or bars are selected by the user for the repeated playback through the transport state selection, the transport state selection configured to indicate a position in the piece of music according to the variable timing reference track.

11. The system of claim 10, wherein the transport state selection is configured to include tempo speed control.

12. The system of claim 1, further comprising a data exchange module on a non-transitory computer readable storage medium and in operable communication with the processor for exchanging data with an external non-transitory computer readable storage media.

13. A system for providing users with an opportunity to learn music while viewing a video that is synchronized to a prerecorded variable tempo music synchronized with variations in a musical tempo, comprising:

a network interface; and

,

a server computer system having a processor in operable connection with a web server on a non-transitory computer readable storage medium, the web server having

custom audio files accessible to a user, the audio files including

a multi-track digital audio file of a preselected piece of music having a plurality of audio tracks that include an isolated instrument audio track containing only audio from the isolated instrument, and an emulation audio track consisting of the multi-track digital audio file having the isolated instrument audio track removed; and

,

a digital video file that is synchronized with the variations in the musical tempo; and

,

a variable timing reference track designed and provided for a user for the preselected piece of music, wherein the preselected piece of music was prerecorded, and the variable timing reference track includes a tempo map having variable tempos, rhythms, and beats using notes from the preselected piece of music;

wherein, the providing, transforming, and emulating provides the user with the opportunity to learn the variable tempos, rhythms, and beats of the isolated instrument audio track using a client computer system having the system of claim 1.

14. The system of claim 13 further comprising the system of claim 2 further configured with an emulation recording module on a non-transitory computer

readable storage medium for the user to

record the emulated instrument audio track on a non-transitory computer readable storage medium;

combine the emulated instrument audio track with the isolated instrument audio track;

the emulation audio track;

the variable timing reference track;

or a combination thereof;

to transform the multi-track digital audio file into the educational audio file;

listen to the educational audio track; and

,

repeat the emulating, recording, combining, and listening until the user has learned the isolated instrument audio track on the preselected musical instrument to the user'"'"'s satisfaction.

15. The system of claim 13, wherein the web server has a multi-track digital audio file of the preselected piece of music which is an original, multi-track recording or a re-creation of the original, multi-track recording.

16. The system of claim 13, wherein the emulating includes viewing the web server includes custom audio files configured to include a looping page showing a bar or bars of the preselected piece of music for repeated playback, wherein the bar or bars are selected by the user for the repeated playback through a transport state selection, the transport state selection configured to indicate a position in the piece of music according to the variable timing reference track.