Method and apparatus for producing audio tracks

• US 20100257994A1
• Filed: 04/13/2009
• Published: 10/14/2010
• Est. Priority Date: 04/13/2009
• Status: Active Grant

• Current Assignee: Smartsound Software Incorporated
• Original Assignee: Smartsound Software Incorporated
• Inventors: Hufford, Geoffrey C.
• Granted Patent: US 8,026,436 B2
• Time in Patent Office: Days
• US Class Current: 84/609
• CPC Class Codes: G10H 1/0025 Automatic or semi-automatic music composition, e.g. producing random music, applying rules from music theory or modifying a musical piece automatically producing a series of tones G10H1/26
• CPC Class Codes: G10H 1/368 displaying animated or moving pictures synchronized with the music or audio part
• CPC Class Codes: G10H 1/40 Rhythm
• CPC Class Codes: G10H 2210/005 Musical accompaniment, i.e. complete instrumental rhythm synthesis added to a performed melody, e.g. as output by drum machines
• CPC Class Codes: G10H 2210/076 for extraction of timing, tempo; Beat detection
• CPC Class Codes: G10H 2210/125 Medley, i.e. linking parts of different musical pieces in one single piece, e.g. sound collage, DJ mix
• CPC Class Codes: G10H 2210/361 Selection among a set of pre-established rhythm patterns
• CPC Class Codes: G10H 2240/131 Library retrieval, i.e. searching a database or selecting a specific musical piece, segment, pattern, rule or parameter set
• CPC Class Codes: G10H 2240/325 Synchronizing two or more audio tracks or files according to musical features or musical timings

Abstract

A system for automatically manipulating prerecorded audio data to produce an audio track synchronized to a target video track. The system allows a user to select a music source from multiple music sources stored in a music library. Each music source includes multiple audio portions having block data and beat data associated therewith. The block data includes data blocks respectively, specifying the duration of the associated audio portions. Each data block preferably also includes interblock compatibility data and/or suitability data. The beat data, generally referred to as a “beatmap”, comprises timing information specifying the rhythmic pulse, or “beat” for the associated music source portion. The system is operable to produce an audio track synchronized to a video timing specification (VTS) specifying successive timing segments delimited by successive video events. After the user selects a music source, the system generates a music segment for each defined timing segment. Each music segment is generated by assembling an ordered sequence of compatible data blocks selected at least in part based on their suitability and/or compatibility characteristics.

Claims

1. A system for use with a video timing specification defining multiple video events where each such video event occurs at a unique timing point relative to a start time, said system being operable to produce an audio track including music events synchronized with said video events, said system comprising:

a music library comprising a plurality of music sources each having a plurality of defined length data blocks associated therewith;

an input/output controller operable to select a music source;

a timing controller responsive to said timing specification for identifying successive timing segments, each timing segment having a duration delimited by successive video events;

a music segment generator operable to produce an untrimmed music segment for each timing segment, each untrimmed music segment being comprised of a sequence of one or more data blocks selected from said selected music source; and

a music segment trimmer operable to adjust the defined length of said untrimmed music segments to produce a plurality of final music segments each having a duration substantially equal to the duration of a corresponding timing segment.

2. The system of claim 1 further including an assembly configured to append said plurality of final music segments in an ordered sequence to produce said audio track.

3. The system of claim 1 further including:

compatibility data associated with each data block defining its compatibility with other data blocks; and

wherein

said music segment generator is responsive to said compatibility data for producing said sequence of data blocks.

4. The system of claim 1 wherein said music segment trimmer adjusts the length of an untrimmed music segment by truncating at least one of the data blocks therein.

5. The system of claim 1 wherein said music source has beat data associated therewith defining a rhythmic sequence of beats;

and wherein

said music segment trimmer adjusts the end time defined by one or more of said untrimmed music segment data blocks to be substantially coincident with one of said beats.

6. The system of claim 5 wherein said sequence of beats includes basic beats and downbeats;

and wherein

said music segment trimmer adjusts the end time defined by at least one of said untrimmed music segment data blocks to be substantially coincident with one of said downbeats.

7. The system of claim 1 further including a video specification analyzer for identifying which of said plurality of music sources has a tempo closely related to the timing of said video events.

8. A method for generating an audio track to accompany a video track comprised of an ordered sequence of video events, said method comprising:

providing a plurality of music sources where each source includes multiple portions and a data block for each such portion specifying its duration;

identifying a sequence of discrete timing segments where each such timing segment is delimited by successive video events;

generating for each timing segment an untrimmed music segment comprised of an ordered sequence of one or more selected data blocks;

comparing the duration of the data block sequence for each untrimmed music segment with the duration of the associated timing segment; and

processing each untrimmed music segment to produce a final music segment having a data block sequence defining a duration matching the duration of its associated timing segment.

9. The method of claim 8 including the further step of assembling multiple final music segments in an ordered sequence to produce said audio track.

10. The method of claim 8 wherein the data for each block further specifies interblock compatibility;

and wherein

said step of generating an untrimmed music segment includes assuring compatibility between adjacent blocks in said ordered sequence of data blocks.

11. The method of claim 8 including the further step of providing beat data for each music source portion specifying a rhythmic sequence of beats;

and wherein

said step of processing untrimmed music segments includes trimming one or more of the data blocks in each untrimmed music segment to a duration substantially coincident with one of said beats.

12. The method of claim 8 including the further step of providing beat data for each music source portion specifying a rhythmic sequence of basic beats and downbeats;

and wherein

said step of processing untrimmed music segments includes adjusting the end time of at least one of said untrimmed music segment data blocks to be substantially coincident with one of said downbeats.

13. The method of claim 8 including the further step of analyzing said sequence of video events of identify preferred music sources from said plurality of music sounds.