Creating a new music video by intercutting user-supplied visual data with a pre-existing music video

• US 7,716,572 B2
• Filed: 07/14/2006
• Issued: 05/11/2010
• Est. Priority Date: 07/14/2006
• Status: Expired due to Fees

• Current Assignee: Muvee Technologies Pte Ltd.
• Original Assignee: Muvee Technologies Pte Ltd.
• Inventors: Kellock, Peter Rowan, Beauregard, Gerald Thomas, Subramanian, Srikumar Karaikudi
• Primary Examiner(s): Vital; Pierre M
• Assistant Examiner(s): LIAO, JASON G
• Application Number:
  US11/486,985
• Publication Number:
  US 20080016114A1
• Time in Patent Office: 1,397 Days
• Field of Search: None
• US Class Current: 715/223
• CPC Class Codes: G11B 27/005 Reproducing at a different information rate from the information rate of recording for television signals H04N5/783
• CPC Class Codes: G11B 27/031 Electronic editing of digitised analogue information signals, e.g. audio or video signals
• CPC Class Codes: G11B 27/032 on tapes G11B27/036, G11B27/038 take precedence
• CPC Class Codes: G11B 27/034 on discs G11B27/036, G11B27/038 take precedence
• CPC Class Codes: G11B 27/036 Insert-editing
• CPC Class Codes: G11B 27/10 Indexing; Addressing; Timing or synchronising; Measuring tape travel
• CPC Class Codes: G11B 27/28 by using information signals recorded by the same method as the main recording G11B27/22 takes precedence

Abstract

A method in which a pre-existing music video (which may be a professionally-created music video) is intercut with an end-user'"'"'s own additional visual data (pictures or video). In a first phase, a plurality of temporal sections are defined in a pre-existing music video. In a second phase, which may be performed by a non-professional end-user, video data specified by the end-user are intercut with the pre-existing music video according to the temporal sections.

Claims

1. A computerized method for making a new music video from a pre-existing music video, said new music video and pre-existing music video both including a music track and a visual track, said method including:

a) a first phase including;

(i) annotating the pre-existing music video by a first user to obtain location data defining the locations of a plurality of temporal sections within the pre-existing music video, and

(ii) associating a respective modification priority value with each of said plurality of temporal sections; and

b) a second phase in which the new music video is created by;

(i) a second user indicating a collection of additional visual data,

(ii) for at least one of said temporal sections of the pre-existing music video, automatically selecting at least one respective element from the indicated collection of additional visual data,

(iii) automatically selecting at least one of said plurality of temporal sections based on the respective modification priority values of said temporal sections and automatically modifying the visual track of said at least one of said plurality of temporal sections of the pre-existing music video using the respective at least one selected element from the collection of additional visual data to form at least one modified visual track section; and

(iv) automatically combining said at least one modified visual track section with other sections of the visual track of the pre-existing music video and the music track of the pre-existing music video to form the new music video, said music track of the new music video being said music track of the pre-existing video, and said visual track of the new music video incorporating said other sections of the visual track of the pre-existing music video, said other sections of the visual track of the pre-existing music video having the same timing with respect to the music track in the new music video as in the pre-existing music-video.

2. A method according to claim 1 in which:

said first phase of the method further includes the first user deriving, for one or more said temporal sections of the pre-existing music video, a respective set of modification data indicating a type of modification to be made to the respective temporal section, and

in said second phase of the method, said step of modifying said at least one temporal section of the pre-existing music video being performed according to the respective set of modification data.

3. A method according to claim 1 in which in said first phase said first user operates a first computer system, and in said second phase the second user operates a second computer system operationally independent from the first computer system, said location data being transferred between the first computer system and the second computer system following said first phase.

4. A method according to claim 2 in which said sets of modification data are derived by a process including an automatic analysis of said music track of the pre-existing motion video.

5. A method according to claim 2 in which in said first phase of the method, a respective said set of modification data is derived for each said temporal section of the pre-existing music video and for each of a plurality of values of a style parameter, and

said second phase of the method includes:

selecting a value for said style parameter, and

modifying said at least one temporal section of the pre-existing music video according to the respective set of modification data associated with the selected value of the style parameter.

6. A method according to claim 1 in which said second phase includes analyzing each selected element of the collection of additional visual data, said step of modifying said respective at least one temporal section of the pre-existing music video being performed according to the result of the analysis.

7. A method according to claim 1 in which said set of location data is obtained using an edit decision list describing the pre-existing music video.

8. A method according to claim 1 in which the step of obtaining the location data includes performing an automatic analysis of the music track and/or video track of the pre-existing music video.

9. A method according to claim 1 in which at least one said modification priority value specifies that the respective temporal section must be included among said at least one of said plurality of temporal sections.

10. A method according to claim 1 in which at least one said modification priority value specifies that the respective temporal section must not be included among said at least one of said plurality of temporal sections.

11. A method according to claim 1 in which for each of said plurality of temporal sections the modified priority values are obtained by an automatic analysis of said pre-existing music video.

12. A method according to claim 1 in which said step of automatically modifying the visual track of said at least one of said plurality of temporal sections of the pre-existing music video, comprises replacing the visual track of said at least one of said plurality of temporal sections of the pre-existing music video with the respective at least one selected element from the collection of additional visual data.

13. A method according to claim 1 in which said step of automatically modifying the visual track of said at least one of said plurality of temporal sections of the pre-existing music video, comprises combining the visual track of said at least one of said plurality of temporal sections of the pre-existing music video with the respective at least one selected element from the collection of additional visual data.

14. A method according to claim 1 in which said step of automatically selecting, for at least one of said temporal sections of the pre-existing music video, at least one respective element from the indicated collection of additional visual data includes:

(i) determining shot boundaries in the indicated collection of additional visual data, and

(ii) selecting the element from the indicated collection of additional visual data based on said shot boundaries.

15. A method according to claim 1 in which said step of automatically selecting, for at least one of said temporal sections of the pre-existing music video, at least one respective element from the indicated collection of additional visual data includes:

(i) deriving one or more descriptor values for the indicated collection of additional visual data, and

(ii) selecting the element from the indicated collection of additional visual data based on said one or more descriptor values.

16. A method according to claim 15 in which said element is selected according to a similarity criterion between said one or more derived descriptor values and one or more respective descriptor values for the visual track of the respective temporal section of the pre-existing music video.

17. A method according to claim 15 in which said element is selected according to a similarity criterion between said derived descriptor values and one or more descriptor value targets of the respective temporal section, said one or more descriptor value targets having been derived in said first phase.

18. A method according to claim 1 in which said modified visual track section incorporates at least one visual effect pertaining to the respective section of the visual track of the pre-existing music video.

19. A method according to claim 18 in which the visual effect is a slow motion or fast motion effect.

20. A method according to claim 1 in which said first phase includes specifying a respective speed value for one or more of said temporal sections, and each said modified visual track section has a slow motion or fast motion according to the respective specified speed value.

21. A method according to claim 1 in which a visual effect is applied to the whole of the new music video.

22. A method according to claim 1 in which the new music video includes at least one visual effect at a location in the new music video determined according to a feature of the music track.

23. A method according to claim 1 further including transferring the new music video to a portable handphone for use as a video ringtone.

24. A computerized method for making a new music video from a pre-existing music video, said new music video and pre-existing music video both including a music track and a visual track, said method including:

a) a first phase including;

(i) annotating the pre-existing music video by;

(1) obtaining location data defining the locations of a plurality of temporal sections within the pre-existing music video, and

(2) deriving, for one or more said temporal sections of the pre-existing music video, a respective set of modification data indicating a type of modification to be made to the respective temporal section; and

(ii) associating a respective modification priority value with each of said plurality of temporal sections; and

b) a second phase in which the new music video is created by a process comprising;

(i) a user indicating a collection of additional visual data,

(ii) for at least one of said temporal sections of the pre-existing music video, automatically selecting at least one respective element from the collection of additional visual data,

(iii) automatically selecting at least one of said plurality of temporal sections based on the respective modification priority values of said temporal sections and automatically modifying the visual track of said at least one temporal section of the pre-existing music video according to the respective set of modification data using the respective at least one selected element from the collection of additional visual data to form at least one modified visual track section; and

(iv) automatically combining said at least one modified visual track section with other sections of the visual track of the pre-existing music video and the music track of the pre-existing music video to form the new music video, said music track of the new music video being said music track of the pre-existing video, and said visual track of the new music video incorporating said other sections of the visual track of the pre-existing music video, said other sections of the visual track of the pre-existing music video having the same timing with respect to the music track in the new music video as in the pre-existing music-video.

25. A method according to claim 24 in which said sets of modification data are derived by a process including an automatic analysis of said music track of the pre-existing motion video.

26. A method according to claim 24 in which in said first phase of the method, a respective said set of modification data is derived for each said temporal section of the pre-existing music video and for each of a plurality of values of a style parameter, and

said second phase of the method includes:

selecting a value for said style parameter, and

modifying said at least one temporal section of the pre-existing music video according to the respective set of modification data associated with the selected value of the style parameter.

27. A method according to claim 24 in which said second phase includes analyzing each selected element of the collection of additional visual data, said step of modifying said respective at least one temporal section of the pre-existing music video being performed according to the result of the analysis.

28. A method according to claim 24 in which said set of location data is obtained using an edit decision list describing the pre-existing music video.

29. A method according to claim 24 in which the step of obtaining the location data includes performing an automatic analysis of the music track and/or video track of the pre-existing music video.

30. A method according to claim 24 in which at least one said modification priority value specifies that the respective temporal section must be included among said at least one of said plurality of temporal sections.

31. A method according to claim 24 in which at least one said modification priority value specifies that the respective temporal section must not be included among said at least one of said plurality of temporal sections.

32. A method according to claim 24 in which for each of said plurality of temporal sections the modified priority values are obtained by an automatic analysis of said pre-existing music video.

33. A method according to claim 24 in which said step of automatically modifying the visual track of said at least one of said plurality of temporal sections of the pre-existing music video, comprises replacing the visual track of said at least one of said plurality of temporal sections of the pre-existing music video with the respective at least one selected element from the collection of additional visual data.

34. A method according to claim 24 in which said step of automatically modifying the visual track of said at least one of said plurality of temporal sections of the pre-existing music video, comprises combining the visual track of said at least one of said plurality of temporal sections of the pre-existing music video with the respective at least one selected element from the collection of additional visual data.

35. A method according to claim 24 in which said step of automatically selecting, for at least one of said temporal sections of the pre-existing music video, at least one respective element from the indicated collection of additional visual data includes:

(i) determining shot boundaries in the indicated collection of additional visual data, and

(ii) selecting the element from the indicated collection of additional visual data based on said shot boundaries.

36. A method according to claim 24 in which said step of automatically selecting, for at least one of said temporal sections of the pre-existing music video, at least one respective element from the indicated collection of additional visual data includes:

(i) deriving one or more descriptor values for the indicated collection of additional visual data, and

(ii) selecting the element from the indicated collection of additional visual data based on said one or more descriptor values.

37. A method according to claim 36 in which said element is selected according to a similarity criterion between said one or more derived descriptor values and one or more respective descriptor values for the visual track of the respective temporal section of the pre-existing music video.

38. A method according to claim 36 in which said element is selected according to a similarity criterion between said derived descriptor values and one or more descriptor value targets of the respective temporal section, said one or more descriptor value targets having been derived in said first phase.

39. A method according to claim 24 in which said modified visual track section incorporates at least one visual effect pertaining to the respective section of the visual track of the pre-existing music video.

40. A method according to claim 39 in which the visual effect is a slow motion or fast motion effect.

41. A method according to claim 40 in which said first phase includes specifying a respective speed value for one or more of said temporal sections, and each said modified visual track section has a slow motion or fast motion according to the respective specified speed value.

42. A method according to claim 24 in which a visual effect is applied to the whole of the new music video.

43. A method according to claim 24 in which the new music video includes at least one visual effect at a location in the new music video determined according to a feature of the music track.

44. A method according to claim 24 further including transferring the new music video to a portable handphone for use as a video ringtone.