VARIABLE PLAYBACK SPEED TEMPLATE FOR VIDEO EDITING APPLICATION

• US 20160225405A1
• Filed: 01/29/2015
• Published: 08/04/2016
• Est. Priority Date: 01/29/2015
• Status: Active Grant

• Current Assignee: GoPro, Inc.
• Original Assignee: GoPro, Inc.
• Inventors: Matias, Joven Michael, Sievert, Otto Kenneth, Bodinet, Joshua Edward
• Granted Patent: US 9,679,605 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 16/739 in form of a video summary, e.g. the video summary being a video sequence, a composite still image or having synthesized frames
• CPC Class Codes: G06F 16/78 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G11B 27/005 Reproducing at a different information rate from the information rate of recording for television signals H04N5/783
• CPC Class Codes: G11B 27/022 Electronic editing of analogue information signals, e.g. audio or video signals
• CPC Class Codes: G11B 27/031 Electronic editing of digitised analogue information signals, e.g. audio or video signals
• CPC Class Codes: G11B 27/19 by using information detectable on the record carrier
• CPC Class Codes: G11B 27/28 by using information signals recorded by the same method as the main recording G11B27/22 takes precedence
• CPC Class Codes: H04N 5/765 Interface circuits between an apparatus for recording and another apparatus
• CPC Class Codes: H04N 5/783 Adaptations for reproducing at a rate different from the recording rate
• CPC Class Codes: H04N 5/93 Regeneration of the television signal or of selected parts thereof
• CPC Class Codes: H04N 9/8205 involving the multiplexing of an additional signal and the colour video signal

Abstract

A playback speed effect is applied to a video using a playback speed template. The playback speed template specifies playback speed ratios (i.e., ratios between playback duration and capture duration) at the highlight moment, at a template start time, and at a template end time. A video associated with a highlight tag indicating a highlight capture time of a highlight moment within the video is accessed. An input portion of the video including the highlight moment is identified. The duration of the input portion has a duration depending on the template start time and the template end time. A playback speed template is applied to the input portion. A modified video including a modified video portion is generated from the input portion of the video according to the applied playback speed template and is provided for subsequent playback.

Claims

1. A computer-implemented method for applying a playback speed effect to a video, the method comprising:

accessing a video associated with a highlight tag indicating a highlight capture time of a highlight moment within the video;

accessing a playback speed template specifying playback speed ratios at template times comprising a template highlight time, a template start time, and a template end time, the playback speed ratios being ratios between playback duration and capture duration;

identifying an input portion of the video comprising the highlight moment by aligning the template highlight time to the highlight capture time;

applying the playback speed template to the input portion of the video by modifying playback durations associated with the template times according to the playback speed ratios;

generating a modified video comprising a modified video portion generated according to the modified playback durations; and

providing the modified video for subsequent playback.

2. The method of claim 1, wherein the playback speed template specifies one or more progressions of playback speed ratios at times between the template start time, the template highlight time, and the template end time.

3. The method of claim 1, wherein accessing the playback speed template comprises selecting the playback speed template based at least in part on a type of event tag associated with the highlight moment.

4. The method of claim 1, wherein accessing the playback speed template comprises selecting the playback speed template based at least in part on an activity tag associated with one of the video and the input portion of the video.

5. The method of claim 1,

wherein generating the modified video comprises generating a summary video comprising the modified video portion in a slot of a video summary template, and

wherein accessing the playback speed template comprises selecting the playback speed template specified by the slot of the video summary template.

6. The method of claim 5, wherein the slot of the video summary template has a slot duration, and wherein identifying the input portion of the video comprises:

determining a default playback duration of the playback speed template according to the playback speed ratios at the template times between the start time and the template end time;

modifying the playback speed template by temporally scaling template times of the playback speed template by a ratio of the slot duration to the default playback duration; and

identifying the input portion of the video comprising the highlight moment by (a) aligning the template highlight time to the highlight capture time and (b) determining a portion start time and a portion end time of the identified input portion of the video according to a scaled template start time and a scaled template end time of the modified playback speed template.

7. The method of claim 1, wherein the input portion of the video comprises a plurality of video frames, and wherein applying the playback speed template comprises:

identifying a template frame time for each video frame relative to the template highlight time by comparing a capture time of each video frame to the highlight capture time;

determining a playback time for each video frame of the plurality using playback speed ratios to determine a duration of time accumulated between the template highlight time and the template time for each video frame; and

generating the modified video portion based on the playback time determined for each video frame.

8. The method of claim 7, wherein generating the modified video portion comprises generating additional frames interpolated between the plurality of frames to match a frame rate of the modified video with a specified frame rate.

9. A non-transitory, computer-readable medium storing instructions for applying a playback speed effect to a video, the instructions when executed causing one or more processors to:

access a video associated with a highlight tag indicating a highlight capture time of a highlight moment within the video;

access a playback speed template specifying playback speed ratios at template times comprising a template highlight time, a template start time, and a template end time, the playback speed ratios being ratios between playback duration and capture duration;

identify an input portion of the video comprising the highlight moment by aligning the template highlight time to the highlight capture time;

apply the playback speed template to the input portion of the video by modifying playback durations associated with the template times according to the playback speed ratios;

generate a modified video comprising a modified video portion generated according to the modified playback durations; and

provide the modified video for subsequent playback.

10. The medium of claim 9, wherein the playback speed template specifies one or more progressions of playback speed ratios at times between the template start time, the template highlight time, and the template end time.

11. The medium of claim 9, wherein accessing the playback speed template comprises selecting the playback speed template based at least in part on a type of event tag associated with the highlight moment.

12. The medium of claim 9, wherein accessing the playback speed template comprises selecting the playback speed template based at least in part on an activity tag associated with one of the video and the input portion of the video.

13. The medium of claim 9,

wherein generating the modified video comprises generating a summary video comprising the modified video portion in a slot of a video summary template, and

wherein accessing the playback speed template comprises selecting the playback speed template specified by the slot of the video summary template.

14. The medium of claim 13, wherein the slot of the video summary template has a slot duration, and wherein identifying the input portion of the video comprises:

determining a default playback duration of the playback speed template according to the playback speed ratios at the template times between the start time and the template end time;

modifying the playback speed template by temporally scaling template times of the playback speed template by a ratio of the slot duration to the default playback duration; and

identifying the input portion of the video comprising the highlight moment by (a) aligning the template highlight time to the highlight capture time and (b) determining a portion start time and a portion end time of the identified input portion of the video according to a scaled template start time and a scaled template end time of the modified playback speed template.

15. The medium of claim 9, wherein the input portion of the video comprises a plurality of video frames, and wherein applying the playback speed template comprises:

identifying a template frame time for each video frame relative to the template highlight time by comparing a capture time of each video frame to the highlight capture time;

determining a playback time for each video frame of the plurality using playback speed ratios to determine a duration of time accumulated between the template highlight time and the template time for each video frame; and

generating the modified video portion based on the playback time determined for each video frame.

16. The medium of claim 15, wherein generating the modified video portion comprises generating additional frames interpolated between the plurality of frames to match a frame rate of the modified video with a specified frame rate.

17. A computing system for applying a playback speed effect to a video, the system comprising:

a processor; and

a non-transitory, computer-readable memory storing instructions that when executed cause the processor to;

access a video associated with a highlight tag indicating a highlight capture time of a highlight moment within the video;

access a playback speed template specifying playback speed ratios at template times comprising a template highlight time, a template start time, and a template end time, the playback speed ratios being ratios between playback duration and capture duration;

identify an input portion of the video comprising the highlight moment by aligning the template highlight time to the highlight capture time;

apply the playback speed template to the input portion of the video by modifying playback durations associated with the template times according to the playback speed ratios;

generate a modified video comprising a modified video portion generated according to the modified playback durations; and

provide the modified video for subsequent playback.

18. The system of claim 17, wherein accessing the playback speed template comprises selecting the playback speed template based at least in part on a type of event tag associated with the highlight moment.

19. The system of claim 17, wherein accessing the playback speed template comprises selecting the playback speed template based at least in part on an activity tag associated with one of the video and the input portion of the video.

20. The system of claim 19,

wherein generating the modified video comprises generating a summary video comprising the modified video portion in a slot of a video summary template, and

wherein accessing the playback speed template comprises selecting the playback speed template specified by the slot of the video summary template.