System and method of generating video from video clips based on moments of interest within the video clips

• US 10,186,298 B1
• Filed: 06/19/2017
• Issued: 01/22/2019
• Est. Priority Date: 10/20/2015
• Status: Active Grant

• Current Assignee: GoPro, Inc.
• Original Assignee: GoPro, Inc.
• Inventors: Matias, Joven, Phan, Ha
• Primary Examiner(s): Chowdhury, Nigar
• Application Number:
  US15/627,055
• Time in Patent Office: 582 Days
• Field of Search: 386278-287
• CPC Class Codes: G06V 20/41 Higher-level, semantic clustering, classification or understanding of video scenes, e.g. detection, labelling or Markovian modelling of sport events or news items segmenting video sequences G06V20/49
• CPC Class Codes: G06V 20/47 Detecting features for summarising video content
• CPC Class Codes: G06V 20/48 Matching video sequences
• CPC Class Codes: G11B 27/031 Electronic editing of digitised analogue information signals, e.g. audio or video signals
• CPC Class Codes: G11B 27/3081 used signal is a video-frame or a video-field (P.I.P)
• CPC Class Codes: G11B 27/34 Indicating arrangements indicating means incorporated in magazine or cassette G11B23/046 and G11B23/0875; indicating measured values in general G01D

Abstract

Videos may be automatically generated using a set of video clip. Individual moments of interest may be identified within individual video clips of a set of video clips. A moment of interest may correspond to a point in time within a video clip. The point in time may be associated with one or more values of one or more attributes of the video clip. Individual moments of interest may be associated with individual portions of a video. The video may be generated using the set of video clips based on the associations.

Claims

1. A system configured for generating videos from video clips based on one or more moments of interest within individual ones of the video clips, the system comprising:

one or more physical processors configured by machine-readable instructions to;

identify one or more moments of interest within individual video clips of a set of video clips for generating a video edit, the set of video clips comprising a first video clip and a second video clip such that a first moment of interest is identified within the first video clip and a second moment of interest is identified within the second video clip;

provide multiple preset storyboards for user selection, wherein individual ones of the preset storyboards define different edits of the video edit prior to the user selection of any of the preset storyboards, the preset storyboards including a first preset storyboard and a second preset storyboard different from the first preset storyboard, the first storyboard specifying a first quantity of video portions that make up the video edit and first lengths of the video portions that make up the video edit, and the second storyboard defining a second quantity of the video portions that make up the video edit and second lengths of the video portions that make up the video edit, wherein the first preset story board defines (1) a first video portion having a first length and (2) a second video portion having a second length;

based on user selection of the first preset storyboard, automatically and without additional user selection further defining the video portions of the video edit, determine the first quantity as a quantity of the video portions that make up the video edit and the first lengths as lengths of the video portions that make up the video edit;

associate individual moments of interest with individual video portions of the video edit, the associations including a first association of the first moment of interest with the first video portion of the video edit, and a second association of the second moment of interest with the second video portion of the video edit; and

generate the video edit using the set of video clips based on the associations and the first storyboard such that the video edit is generated using (1) the first length of the first video clip based on the first association and the first storyboard, and (2) the second length of the second video clip based on the second association and the first storyboard.

2. The system of claim 1, wherein the first moment of interest within the first video clip is identified based on a user-initiated identification of the first moment of interest.

3. The system of claim 2, wherein the user-initiated identification of the first moment of interest is provided during capture of the first video clip or post capture of the first video clip.

4. The system of claim 1, wherein the one or more physical processors are, to generate the video edit using the set of video clips based on the associations and the first storyboard, further configured by the machine-readable instructions to:

identify a first segment of the first video clip, the first segment being associated with the first moment of interest, the first segment comprising a first temporal span of the first video clip based on the first length of the first storyboard;

identify a second segment of the second video clip, the second segment being associated with the second moment of interest, the second segment comprising a second temporal span of the second video clip based on the second length of the first storyboard;

provide the first segment as the video portion of the first video edit; and

provide the second segment as the second video portion of the video edit.

5. The system of claim 4, wherein the one or more physical processors are, to provide the first segment as the first video portion of the video edit, further configured by the machine-readable instructions to change a temporal length of one or both of the first segment or the first video portion such that that the first segment and the first video portion have the same temporal length.

6. The system of claim 5, wherein the one or more physical processors are, to generate the video edit, further configured by the machine-readable instructions to provide supplemental audio to replace or add to audio of one or both of the first video clip or the second video clip.

7. The system of claim 6, wherein the one or more physical processors are, to provide the supplemental audio, further configured by the machine-readable instructions to synchronize a transition between an end of the first video portion of the video edit and a start of the second video portion of the video edit with the supplemental audio.

8. The system of claim 7, wherein the supplemental audio comprises a song, and the synchronization of the transition between the end of the first video portion and the start of the second video portion of the video edit with the supplemental audio comprises a synchronization of the transition with a beat of the song.

9. The system of claim 7, wherein the supplemental audio comprises a song, and the synchronization of the transition between the end of the first video portion and the start of the second video portion of the video edit with the supplemental audio comprises a synchronization of the transition with an orchestrated transition of the song.

10. The system of claim 6, wherein the first quantity of the video portions and the first lengths of the video portions defined by the first storyboard is determined based on the supplemental audio.

11. A method of generating videos from video clips based on one or more moments of interest within individual ones of the video clips, the method being implemented in a computer system comprising one or more physical processor and storage media storing machine-readable instructions, the method comprising:

identifying one or more moments of interest within individual video clips of a set of video clips for generating a video edit, the set of video clips comprising a first video clip and a second video, including identifying a first moment of interest within the first video clip and a second moment of interest within the second video clip;

providing multiple preset storyboards for user selection, wherein individual ones of the preset storyboards define different edits of the video edit prior to the user selection of any of the preset storyboards, the preset storyboards including a first preset storyboard and a second preset storyboard different from the first preset storyboard, the first storyboard specifying a first quantity of video portions that make up the video edit and first lengths of the video portions that make up the video edit, and the second storyboard defining a second quantity of the video portions that make up the video edit and second lengths of the video portions that make up the video edit, wherein the first preset story board defines (1) a first video portion having a first length and (2) a second video portion having a second length;

based on user selection of the first preset storyboard, automatically and without additional user selection further defining the video portions of the video edit, determining the first quantity as a quantity of the video portions that make up the video edit and the first lengths as lengths of the video portions that make up the video edit;

associating individual moments of interest with individual portions of the video portions of the video edit, the associations including a first association of the first moment of interest with the first video portion of the video edit, and a second association of the second moment of interest with the second video portion of the video edit; and

generating the video edit using the set of video clips based on the associations and the first storyboard such that the video edit is generated using (1) the first length of the first video clip based on the first association and the first storyboard, and (2) the second length of the second video clip based on the second association and the first storyboard.

12. The method of claim 11, wherein identifying the first moment of interest within the first video clip is based on a user-initiated identification of the first moment of interest.

13. The method of claim 12, wherein the user-initiated identification of the first moment of interest is provided during capture of the first video clip or post capture of the first video clip.

14. The method of claim 11, wherein generating the video edit using the set of video clips based on the associations and the first storyboard comprises:

identifying a first segment of the first video clip, the first segment being associated with the first moment of interest, the first segment comprising a first temporal span of the first video clip based on the first length of the first storyboard;

identifying a second segment of the second video clip, the second segment being associated with the second moment of interest, the second segment comprising a second temporal span of the second video clip based on the second length of the first storyboard;

providing the first segment as the first video portion of the video edit; and

providing the second segment as the second video portion of the video edit.

15. The method of claim 14, wherein providing the first segment as the first video portion of the video edit comprises changing a temporal length of one or both of the first segment or the first video portion such that that the first segment and the first video portion have the same temporal length.

16. The method of claim 15, wherein generating the video edit further comprises:

providing supplemental audio to replace or add to audio of one or both of the first video clip or the second video clip.

17. The method of claim 16, wherein providing the supplemental audio comprises synchronizing a transition between an end of the first portion of the video edit and a start of the second portion of the video edit with the supplemental audio.

18. The method of claim 17, wherein the supplemental audio comprises a song, and wherein synchronizing the transition between the end of the first video portion and the start of the second video portion of the video edit with the supplemental audio comprises synchronizing the transition with a beat of the song.

19. The method of claim 17, wherein the supplemental audio comprises a song, and the synchronization of the transition between the end of the first video portion and the start of the second video portion of the video edit with the supplemental audio comprises a synchronization of the transition with an orchestrated transition of the song.

20. The method of claim 16, wherein the first quantity of the video portions and the first lengths of the video portions defined by the first storyboard is determined based on the supplemental audio.