Variable playback speed template for video editing application

• US 9,966,108 B1
• Filed: 03/14/2017
• Issued: 05/08/2018
• Est. Priority Date: 01/29/2015
• Status: Active Grant

• Current Assignee: GoPro, Inc.
• Original Assignee: GoPro, Inc.
• Inventors: Matias, Joven Michael, Sievert, Otto Kenneth, Bodinet, Joshua Edward
• Primary Examiner(s): Tran, Thai
• Assistant Examiner(s): Yang, Nien-Ru
• Application Number:
  US15/458,759
• Time in Patent Office: 420 Days
• Field of Search: 386343
• CPC Class Codes: G06F 16/739 in form of a video summary, e.g. the video summary being a video sequence, a composite still image or having synthesized frames
• CPC Class Codes: G06F 16/78 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G11B 27/005 Reproducing at a different information rate from the information rate of recording for television signals H04N5/783
• CPC Class Codes: G11B 27/022 Electronic editing of analogue information signals, e.g. audio or video signals
• CPC Class Codes: G11B 27/031 Electronic editing of digitised analogue information signals, e.g. audio or video signals
• CPC Class Codes: G11B 27/19 by using information detectable on the record carrier
• CPC Class Codes: G11B 27/28 by using information signals recorded by the same method as the main recording G11B27/22 takes precedence
• CPC Class Codes: H04N 5/765 Interface circuits between an apparatus for recording and another apparatus
• CPC Class Codes: H04N 5/783 Adaptations for reproducing at a rate different from the recording rate
• CPC Class Codes: H04N 5/93 Regeneration of the television signal or of selected parts thereof
• CPC Class Codes: H04N 9/8205 involving the multiplexing of an additional signal and the colour video signal

Abstract

A playback speed effect is applied to a video using a playback speed template. The playback speed template specifies playback speed ratios (i.e., ratios between playback duration and capture duration) at the highlight moment, at a template start time, and at a template end time. A video associated with a highlight tag indicating a highlight capture time of a highlight moment within the video is accessed. An input portion of the video including the highlight moment is identified. The duration of the input portion has a duration depending on the template start time and the template end time. A playback speed template is applied to the input portion. A modified video including a modified video portion is generated from the input portion of the video according to the applied playback speed template and is provided for subsequent playback.

Claims

1. A computer-implemented method for applying a playback speed effect to videos, the method comprising:

accessing a video portion, the video portion having a portion start time and a portion end time;

accessing a previously stored playback speed template specifying playback speed ratios at template times comprising a template start time and a template end time, the playback speed ratios being ratios between playback durations and capture durations;

aligning the template start time to the portion start time and/or the template end time to the portion end time;

generating a modified video portion by applying the playback speed ratios dictated by the previously stored playback speed template to corresponding portions of the video portion subsequent to the alignment of the template start time to the portion start time and/or the template end time to the portion end time, the application of the playback speed ratios to the corresponding portions of the video portion modifying playback durations of the corresponding portions of the video portion according to the playback speed ratios; and

providing the modified video portion for subsequent playback.

2. The method of claim 1, wherein the previously stored playback speed template specifies one or more progressions of playback speed ratios at times between the template start time and the template end time.

3. The method of claim 1, wherein accessing the previously stored playback speed template comprises selecting the previously stored playback speed template based at least in part on a type of event tag or a type of activity associated with the video portion.

4. The method of claim 1, wherein the modified video portion is generated by a video server.

5. The method of claim 1, further comprising:

generating a summary video comprising the modified video portion placed in a slot of a video summary template,

wherein accessing the previously stored playback speed template comprises selecting the previously stored playback speed template based on the slot of the video summary template.

6. The method of claim 2, wherein the one or more progressions of playback speed ratios at times between the template start time and the template end time include a beginning progression and an ending progression of a one-to-one playback speed ratio, and a middle progression of a none-one-to-one playback speed ratio, wherein transitions between (1) the beginning progression and the middle progression, and (2) the middle progression and the ending progression include linear or nonlinear changes in the playback speed ratios.

7. The method of claim 1, wherein the corresponding portions of the video portion comprises video frames, and wherein applying the playback speed ratios comprises:

identifying a template frame time for individual video frame relatives to the template start time or the template end time by comparing a capture time of the individual video frames to the portion start time or the portion end time; and

determining a playback time for the individual video frames using the playback speed ratios to determine a duration of time accumulated between the template start time or the template end time and the template frame time for the individual video frames;

wherein the modified video portion is generated based on the playback time determined for the individual video frames.

8. The method of claim 7, wherein generating the modified video portion comprises generating additional frames interpolated between the video frames to match a frame rate of the modified video portion with a specified frame rate.

9. A non-transitory, computer-readable medium storing instructions for applying a playback speed effect to videos, the instructions when executed causing one or more physical processors to:

access a video portion, the video portion having a portion start time and a portion end time;

access a previously stored playback speed template specifying playback speed ratios at template times comprising a template start time and a template end time, the playback speed ratios being ratios between playback durations and capture durations;

align the template start time to the portion start time and/or the template end time to the portion end time;

generate a modified video portion by apply the playback speed ratios dictated by the previously stored playback speed template to corresponding portions of the video portion subsequent to the alignment of the template start time to the portion start time and/or the template end time to the portion end time, the application of the playback speed ratios to the corresponding portions of the video portion modifying playback durations of the corresponding portions of the video portion according to the playback speed ratios; and

provide the modified video portion for subsequent playback.

10. The medium of claim 9, wherein the previously stored playback speed template specifies one or more progressions of playback speed ratios at times between the template start time and the template end time.

11. The medium of claim 9, wherein accessing the previously stored playback speed template comprises selecting the previously stored playback speed template based at least in part on a type of event tag or a type of activity associated with the video portion.

12. The medium of claim 9, wherein the modified video portion is generated by a video server.

13. The medium of claim 9, wherein the execution of the instructions further causes the one or more physical processors to:

generate a summary video comprising the modified video portion placed in a slot of a video summary template;

wherein accessing the previously stored playback speed template comprises selecting the previously stored playback speed template based on the slot of the video summary template.

14. The medium of claim 10, wherein the one or more progressions of playback speed ratios at times between the template start time and the template end time include a beginning progression and an ending progression of a one-to-one playback speed ratio, and a middle progression of a none-one-to-one playback speed ratio, wherein transitions between (1) the beginning progression and the middle progression, and (2) the middle progression and the ending progression include linear or nonlinear changes in the playback speed ratios.

15. The medium of claim 9, wherein the corresponding portions of the video portion comprises video frames, and wherein applying the playback speed ratios comprises:

identifying a template frame time for individual video frame relatives to the template start time or the template end time by comparing a capture time of the individual video frames to the portion start time or the portion end time; and

determining a playback time for the individual video frames using the playback speed ratios to determine a duration of time accumulated between the template start time or the template end time and the template frame time for the individual video frames;

wherein the modified video portion is generated based on the playback time determined for the individual video frames.

16. The medium of claim 15, wherein generating the modified video portion comprises generating additional frames interpolated between the plurality of video frames to match a frame rate of the modified video portion with a specified frame rate.

17. A computing system for applying a playback speed effect to videos, the system comprising:

one or more physical processors configured by computer-readable instructions to;

access a video portion, the video portion having a portion start time and a portion end time;

access a previously stored playback speed template specifying playback speed ratios at template times comprising a template start time and a template end time, the playback speed ratios being ratios between playback durations and capture durations;

align the template start time to the portion start time and/or the template end time to the portion end time;

generate a modified video portion by apply the playback speed ratios dictated by the previously stored playback speed template to corresponding portions of the video portion subsequent to the alignment of the template start time to the portion start time and/or the template end time to the portion end time, the application of the playback speed ratios to the corresponding portions of the video portion modifying playback durations of the corresponding portions of the video portion according to the playback speed ratios; and

provide the modified video portion for subsequent playback.

18. The system of claim 17, wherein accessing the previously stored playback speed template comprises selecting the previously stored playback speed template based at least in part on a type of event tag or a type of activity associated with the video portion.

19. The system of claim 17, wherein the modified video portion is generated by a video server.

20. The system of claim 19, wherein the one or more physical processors are further configured to:

generate a summary video comprising the modified video portion placed in a slot of a video summary template;

wherein accessing the previously stored playback speed template comprises selecting the previously stored playback speed template based on the slot of the video summary template.