Method for creating a beat-synchronized media mix

• US 8,269,093 B2
• Filed: 08/21/2007
• Issued: 09/18/2012
• Est. Priority Date: 08/21/2007
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Naik, Devang K., Silverman, Kim E.
• Primary Examiner(s): Donels, Jeffrey
• Application Number:
  US11/842,879
• Publication Number:
  US 20090049979A1
• Time in Patent Office: 1,855 Days
• Field of Search: 846/12, 846/36
• US Class Current: 84/612
• CPC Class Codes: G10H 1/40 Rhythm
• CPC Class Codes: G10H 2210/076 for extraction of timing, tempo; Beat detection tempo display G10H2220/081; tempo control G10H2210/375
• CPC Class Codes: G10H 2210/125 Medley, i.e. linking parts of different musical pieces in one single piece, e.g. sound collage, DJ mix
• CPC Class Codes: G10H 2240/061 MP3, i.e. MPEG-1 or MPEG-2 Audio Layer III, lossy audio compression
• CPC Class Codes: G10H 2240/131 Library retrieval, i.e. searching a database or selecting a specific musical piece, segment, pattern, rule or parameter set
• CPC Class Codes: G10H 2240/325 Synchronizing two or more audio tracks or files according to musical features or musical timings synchronised lyrics, e.g. for karaoke G10H2220/011

Abstract

Methods for beat synchronization between media assets are described. In one embodiment, beat synchronized media mixes can be automatically created. By way of example, a beat synchronized event mix can be created by selecting a plurality of media assets, arranging the media assets into an unsynchronized media mix, determining the a profile of each of the media assets in the media mix, automatically beatmatching the beats of adjacent media assets in the media mix, and automatically beatmixing the beats of adjacent beatmatched media assets to create the beat-synchronized media mix. The media assets that can be used include both audio and video media. Media assets are selected based on a specific set of media asset selection criteria, which can include music speed or tempo, music genre, music intensity, media asset duration, user rating, and music mood. A beat synchronized event mix can be subdivided into one or more event mix segments. Each event mix segment can have its own selection criteria.

Claims

1. In a digital media player, a computer-implemented method for creating a beat-synchronized event mix, comprising:

(a) selecting a plurality of media assets;

(b) arranging the media assets into an unsynchronized media mix;

(c) determining a beat profile of each of the media assets in the media mix, the beat profile being across the media mix and provides a record of beat locations in each of the media assets in the media mix;

(d) automatically beatmatching the beats of adjacent media assets in the media mix; and

(e) automatically beatmixing the beats of adjacent beatmatched media assets to create the beat-synchronized media mix,

wherein the beat-synchronized media mix is created as arranged in the unsynchronized media mix.

2. The computer-implemented method of claim 1, wherein the plurality of media assets are selected from the group consisting MPEG-1 Layer 2, MPEG-1 Layer 3 (MP3), MPEG-AAC, WMA, Dolby AC-3, and Ogg Vorbis.

3. The computer-implemented method of claim 1, wherein the plurality of media assets are music videos.

4. The computer-implemented method of claim 1, wherein the selecting (a) further comprises:

(a)(1) examining the media assets in a media library; and

(a)(2) selecting from among the examined media assets, files that meet a specified media asset selection criteria.

5. The computer-implemented method of claim 3, wherein the specified criteria are selected from the group consisting of music tempo, music genre, music intensity, media asset duration, user rating, and music mood.

6. The computer-implemented method of claim 4, wherein the media library is stored locally.

7. The computer-implemented method of claim 4, wherein the media library is an online media store.

8. The computer-implemented method of claim 7, wherein the online media store suggests additional media assets for use in the beat-synchronized media mix.

9. The computer-implemented method of claim 8, wherein the additional media assets are selected based on online media store user ratings.

10. The computer-implemented method of claim 4, wherein the media library is an online media database.

11. The computer-implemented method of claim 1, further comprising concatenating two or more beat-synchronized media mixes.

12. The computer-implemented method of claim 11, wherein each beat-synchronized media mix corresponds to a beat-synchronized event mix segment.

13. The computer-implemented method of claim 12, wherein an event mix comprises one or more beat-synchronized event mix media segments.

14. The computer-implemented method of claim 13, wherein each beat-synchronized media segment has a different intensity.

15. The computer-implemented method of claim 13, wherein intensity is determined by media speed in beats per minute (BPM).

16. The computer-implemented method of claim 13, wherein intensity is determined by a user-assigned intensity rating.

17. The computer-implemented method of claim 1, wherein the beat profile of a media asset contains BPM information for the media asset measured at regular intervals.

18. The computer-implemented method of claim 1, wherein the beatmixing (e) occurs over a media asset overlap interval.

19. The computer-implemented method of claim 1, wherein the beat-synchronized media mix is an event mix, and wherein the event mix is subdivided into one or more event mix segments.

20. A computer-implemented method for beat-synchronizing a pair of media assets, comprising:

determining a beat profile of each media asset in the pair of media assets to identify beat locations in each media asset in the pair of media assets, the beat profile including;

the beat profile of at least an end segment of a first media asset in the pair of media assets and the beat profile of at least a beginning segment of a second media asset in the pair of media assets;

automatically adjusting the speed of the end segment of the first media asset in the pair of media assets to match the speed of the beginning segment of the second media asset in the pair of media assets;

determining the beat offset of the beginning segment of the second media asset in the pair of media assets;

automatically offsetting the beginning segment of the second media asset by the beat offset; and

automatically mixing the pair of media assets together.

21. A computer-implemented system for creating beat synchronized media mixes, comprising:

a beat-synchronized media mix creator;

a media database connected to the media mix creator;

media content storage connected to the media mix creator; and

media content storage connected to the media database,

wherein the beat-synchronized media mix creator is configured to determine a beat profile across a media mix having at least two media assets and identify beat locations in two or more of the at least two media assets in the media mix.

22. The computer-implemented system of claim 21, wherein the media database is connected to an online media store.

23. The computer-implemented system of claim 22, wherein the online media store makes media suggestions for the media mix creator.

24. The computer-implemented system of claim 23, wherein the media suggestions are available for purchase at the online media store.

25. The computer-implemented system of claim 23, wherein the beat-synchronized media mix creator creates event mixes.

26. The computer-implemented system of claim 25, wherein the event mix is selected from the group comprising a workout mix and a dance mix.

27. A computer readable media having at least executable computer program code tangibly embodied therein, comprising:

(a) computer code for selecting a plurality of media assets;

(b) computer code for arranging the media assets into an unsynchronized media mix;

(c) computer code for determining a beat profile of each of the media assets in the media mix, the beat profile being across the media mix and provides a record of beat locations in each of the media assets in the media mix;

(d) computer code for automatically beatmatching the beats of adjacent media assets in the media mix; and

(e) computer code for automatically beatmixing the beats of adjacent beatmatched media assets to create the beat-synchronized media mix,

wherein the beat-synchronized media mix is created as arranged in the unsynchronized media mix.

28. A computer readable media having at least executable computer program code tangibly embodied therein, comprising:

computer code for determining a beat profile of each media asset in the pair of media assets to identify beat locations in each media asset in the pair of media assets, the beat profile including;

the beat profile of at least an end segment of a first media asset in the pair of media assets and the beat profile of at least a beginning segment of a second media asset in the pair of media assets;

computer code for automatically adjusting the speed of the end segment of the first media asset in the pair of media assets to match the speed of the beginning segment of the second media asset in the pair of media assets;

computer code for determining the beginning segment of the second media asset in the pair of media assets;

computer code for automatically offsetting the beginning segment of the second media asset by the beat offset; and

computer code for automatically mixing the pair of media assets together.