Variable playback speed template for video editing application

• US 9,679,605 B2
• Filed: 01/29/2015
• Issued: 06/13/2017
• Est. Priority Date: 01/29/2015
• Status: Active Grant

• Current Assignee: GoPro, Inc.
• Original Assignee: GoPro, Inc.
• Inventors: Matias, Joven Michael, Sievert, Otto Kenneth, Bodinet, Joshua Edward
• Primary Examiner(s): Tran, Thai
• Assistant Examiner(s): YANG, NIEN
• Application Number:
  US14/609,227
• Publication Number:
  US 20160225405A1
• Time in Patent Office: 866 Days
• Field of Search: 386343
• CPC Class Codes: G06F 16/739 in form of a video summary, e.g. the video summary being a video sequence, a composite still image or having synthesized frames
• CPC Class Codes: G06F 16/78 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G11B 27/005 Reproducing at a different information rate from the information rate of recording for television signals H04N5/783
• CPC Class Codes: G11B 27/022 Electronic editing of analogue information signals, e.g. audio or video signals
• CPC Class Codes: G11B 27/031 Electronic editing of digitised analogue information signals, e.g. audio or video signals
• CPC Class Codes: G11B 27/19 by using information detectable on the record carrier
• CPC Class Codes: G11B 27/28 by using information signals recorded by the same method as the main recording G11B27/22 takes precedence
• CPC Class Codes: H04N 5/765 Interface circuits between an apparatus for recording and another apparatus
• CPC Class Codes: H04N 5/783 Adaptations for reproducing at a rate different from the recording rate
• CPC Class Codes: H04N 5/93 Regeneration of the television signal or of selected parts thereof
• CPC Class Codes: H04N 9/8205 involving the multiplexing of an additional signal and the colour video signal

Abstract

A playback speed effect is applied to a video using a playback speed template. The playback speed template specifies playback speed ratios (i.e., ratios between playback duration and capture duration) at the highlight moment, at a template start time, and at a template end time. A video associated with a highlight tag indicating a highlight capture time of a highlight moment within the video is accessed. An input portion of the video including the highlight moment is identified. The duration of the input portion has a duration depending on the template start time and the template end time. A playback speed template is applied to the input portion. A modified video including a modified video portion is generated from the input portion of the video according to the applied playback speed template and is provided for subsequent playback.

Claims

1. A computer-implemented method for applying a playback speed effect to videos, the method comprising:

accessing a video associated with a highlight tag indicating a highlight capture time of a highlight moment within the video;

accessing a previously stored playback speed template specifying playback speed ratios at template times comprising a template highlight time, a template start time, and a template end time, the playback speed ratios being ratios between playback durations and capture durations;

aligning the template highlight time to the highlight capture time;

generating a modified video by applying the playback speed ratios dictated by the previously stored playback speed template to corresponding portions of the video subsequent to the alignment of the template highlight time to the highlight capture time of the video, the application of the playback speed ratios to the corresponding portions of the video modifying playback durations of the corresponding portions of the video according to the playback speed ratios;

and

providing the modified video for subsequent playback.

2. The method of claim 1, wherein the previously stored playback speed template specifies one or more progressions of playback speed ratios at times between the template start time, the template highlight time, and the template end time.

3. The method of claim 1, wherein accessing the previously stored playback speed template comprises selecting the previously stored playback speed template based at least in part on a type of event tag associated with the highlight moment.

4. The method of claim 1, wherein accessing the previously stored playback speed template comprises selecting the previously stored playback speed template based at least in part on an activity tag associated with one of the video and the input portion of the video.

5. The method of claim 1, further comprising:

generating a summary video comprising the modified video placed in a slot of a video summary template,

wherein accessing the previously stored playback speed template comprises selecting the previously stored playback speed template based on the slot of the video summary template.

6. The method of claim 5, wherein the slot of the video summary template has a slot duration, and wherein aligning the template highlight time to the highlight capture time comprises:

determining a default playback duration of the previously stored playback speed template according to the playback speed ratios at the template times between the template start time and the template end time;

modifying the previously stored playback speed template by temporally scaling template times of the previously stored playback speed template by a ratio of the slot duration to the default playback duration, the temporal scaling of the template times modifying the template highlight time; and

aligning the modified template highlight time to the highlight capture time.

7. The method of claim 1, wherein the corresponding portions of the video comprises video frames, and wherein applying the playback speed ratios comprises:

identifying a template frame time for individual video frame relatives to the template highlight time by comparing a capture time of the individual video frames to the highlight capture time; and

determining a playback time for the individual video frames using the playback speed ratios to determine a duration of time accumulated between the template highlight time and the template frame time for the individual video frames; and

wherein the modified video is generated based on the playback time determined for the individual video frames.

8. The method of claim 7, wherein generating the modified video comprises generating additional frames interpolated between the video frames to match a frame rate of the modified video with a specified frame rate.

9. A non-transitory, computer-readable medium storing instructions for applying a playback speed effect to videos, the instructions when executed causing one or more physical processors to:

access a video associated with a highlight tag indicating a highlight capture time of a highlight moment within the video;

access a previously stored playback speed template specifying playback speed ratios at template times comprising a template highlight time, a template start time, and a template end time, the playback speed ratios being ratios between playback durations and capture durations;

align the template highlight time to the highlight capture time;

generate a modified video by apply the playback speed ratios dictated by the previously stored playback speed template to corresponding portions of the video subsequent to the alignment of the template highlight time to the highlight capture time of the video, the application of the playback speed ratios to the corresponding portions of the video modifying playback durations of the corresponding portions of the video according to the playback speed ratios;

and

provide the modified video for subsequent playback.

10. The medium of claim 9, wherein the previously stored playback speed template specifies one or more progressions of playback speed ratios at times between the template start time, the template highlight time, and the template end time.

11. The medium of claim 9, wherein accessing the previously stored playback speed template comprises selecting the previously stored playback speed template based at least in part on a type of event tag associated with the highlight moment.

12. The medium of claim 9, wherein accessing the previously stored playback speed template comprises selecting the previously stored playback speed template based at least in part on an activity tag associated with one of the video and the input portion of the video.

13. The medium of claim 9, wherein the execution of the instructions further causes the one or more physical processors to:

generate a summary video comprising the modified video placed in a slot of a video summary template, and

wherein accessing the previously stored playback speed template comprises selecting the previously stored playback speed template based on the slot of the video summary template.

14. The medium of claim 13, wherein the slot of the video summary template has a slot duration, and wherein aligning the template highlight time to the highlight capture time comprises:

determining a default playback duration of the previously stored playback speed template according to the playback speed ratios at the template times between the template start time and the template end time;

modifying the previously stored playback speed template by temporally scaling template times of the previously stored playback speed template by a ratio of the slot duration to the default playback duration, the temporal scaling of the template times modifying the template highlight time; and

aligning the modified template highlight time to the highlight capture time.

15. The medium of claim 9, wherein the corresponding portions of the video comprises video frames, and wherein applying the playback speed ratios comprises:

identifying a template frame time for individual video frame relatives to the template highlight time by comparing a capture time of the individual video frames to the highlight capture time; and

determining a playback time for the individual video frames using the playback speed ratios to determine a duration of time accumulated between the template highlight time and the template frame time for the individual video frames; and

wherein the modified video is generated based on the playback time determined for the individual video frames.

16. The medium of claim 15, wherein generating the modified video comprises generating additional frames interpolated between the plurality of video frames to match a frame rate of the modified video with a specified frame rate.

17. A computing system for applying a playback speed effect to videos, the system comprising:

a non-transitory computer-readable memory storing computer-readable instructions; and

one or more physical processors configured by the computer-readable instructions to;

access a video associated with a highlight tag indicating a highlight capture time of a highlight moment within the video;

access a previously stored playback speed template specifying playback speed ratios at template times comprising a template highlight time, a template start time, and a template end time, the playback speed ratios being ratios between playback durations and capture durations;

align the template highlight time to the highlight capture time;

generate a modified video by applying the playback speed ratios dictated by the previously stored playback speed template to corresponding portions of the video subsequent to the alignment of the template highlight time to the highlight capture time of the video, the application of the playback speed ratios to the corresponding portions of the video modifying playback durations of the corresponding portions of the video according to the playback speed ratios; and

provide the modified video for subsequent playback.

18. The system of claim 17, wherein accessing the previously stored playback speed template comprises selecting the previously stored playback speed template based at least in part on a type of event tag associated with the highlight moment.

19. The system of claim 17, wherein accessing the previously stored playback speed template comprises selecting the previously stored playback speed template based at least in part on an activity tag associated with one of the video and the input portion of the video.

20. The system of claim 19, wherein the one or more physical processors are further configured to:

generate a summary video comprising the modified video placed in a slot of a video summary template,

wherein accessing the previously stored playback speed template comprises selecting the previously stored playback speed template based on the slot of the video summary template.