SYSTEMS, METHODS, AND MEDIA FOR EDITING VIDEO DURING PLAYBACK VIA GESTURES

• US 20150058733A1
• Filed: 08/20/2014
• Published: 02/26/2015
• Est. Priority Date: 08/20/2013
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Fly Labs Inc. (Alphabet Inc.)
• Inventors: Novikoff, Timothy Priestley
• Granted Patent: US 9,881,645 B2
• Time in Patent Office: Days
• US Class Current: 715/723
• CPC Class Codes: G11B 27/031 Electronic editing of digitised analogue information signals, e.g. audio or video signals
• CPC Class Codes: G11B 27/038 Cross-faders therefor
• CPC Class Codes: G11B 27/34 Indicating arrangements indicating means incorporated in magazine or cassette G11B23/046 and G11B23/0875; indicating measured values in general G01D

Abstract

Described are computer-based systems, computer-implemented methods, and non-transitory computer-readable media for editing video in real-time, or substantially in real-time, using gestures to apply transitions and effects to a plurality of simultaneously played video sources to create an edited video output.

Claims

1. Non-transitory computer-readable storage media encoded with a computer program including instructions executable by a processor to create a gestural video editing application comprising:

a. a software module configured to present a plurality of video sources, the video sources played simultaneously in a video editing session;

b. a software module configured to receive gesture input from a user in the video editing session, the gesture input indicating one or more of the video sources, the gesture input indicating one or more transitions, effects, or configurations to apply to the indicated video sources; and

c. a software module configured to present a video output, the video output generated by editing one or more of the video sources in the video editing session, the editing comprising applying the indicated transitions, effects, or configurations to the indicated video sources.

2. The media of claim 1, wherein the software module configured to present a plurality of video sources presents 2 to 10 video sources.

3. The media of claim 1, wherein the software module configured to present a video output applies the one or more transitions, effects, or configurations to the indicated video sources in real-time during playback of the video output.

4. The media of claim 1, wherein the gesture input is a touch screen or multi-touch screen gesture.

5. The media of claim 4, wherein the gesture input comprises a one-finger tap, the tap on a video source, wherein the one-finger tap indicates a cut transition to the tapped source.

6. The media of claim 5, wherein the cut transition is for the visual content, the audio content, or for both the visual content and the audio content.

7. The media of claim 4, wherein the gesture input comprises a one-finger swipe, the swipe ending on a target video source, wherein the one-finger swipe indicates a dissolve transition from the video source currently providing content for the video output to the target video source.

8. The media of claim 7, wherein the dissolve transition is for the visual content, the audio content, or for both the visual content and the audio content.

9. The media of claim 4, wherein the gesture input comprises a multi-finger tap, each finger tapping a distinct video source, wherein the multi-finger tap indicates a transition to a split screen configuration displaying each tapped video source.

10. The media of claim 4, wherein the gesture input comprises a multi-finger tap, one finger tapping a first video source, two fingers tapping a second video source, wherein the multi-finger tap indicates a picture-in-picture configuration with the second video source set inside the first video source or with the first source set inside the second source.

11. The media of claim 4, wherein the gesture input comprises a two-finger swipe, the swipe ending on a target video source, wherein the two-finger swipe indicates a wipe transition from the video source currently providing content for the video output to the target video source.

12. The media of claim 1, wherein the software module configured to receive gesture input from a user receives the speed of the gesture, the speed used to configure a characteristic of the one or more transitions, effects, or configurations.

13. The media of claim 12, wherein the speed of the gesture is used to configure the speed of an indicated transition.

14. The media of claim 1, wherein the software module configured to receive gesture input from a user measures the length of the gesture, the length used to configure a characteristic of the one or more transitions, effects, or configurations.

15. The media of claim 14, wherein the length of the gesture is used to configure the speed of an indicated transition.

16. The media of claim 1, wherein the software module configured to receive gesture input from a user measures the duration of the gesture, the duration used to configure a characteristic of the one or more transitions, effects, or configurations.

17. The media of claim 16, wherein the duration of the gesture is used to configure the speed of an indicated transition.

18. The media of claim 1, wherein the application further comprises a software module configured to present a graphic representation of the video output, the graphic representation comprising an icon representing each temporal segment of the video output, each icon visually indicating the duration of the segment, a type of edit, and the number of video sources incorporated in that segment of the video output.

19. The media of claim 1, wherein the gesture input from the user is the sole input for the video editing.

20. The media of claim 1, wherein the application is a mobile application.

21. A computer-implemented gestural video editing system comprising:

a. a digital processing device comprising an operating system configured to perform executable instructions and a memory device;

b. a computer program including instructions executable by the digital processing device to create a gestural video editing application comprising;

i. a software module configured to present a plurality of video sources, the video sources played simultaneously in a live video editing session;

ii. a software module configured to receive gesture input from a user in the video editing session, the gesture input indicating one or more of the video sources, the gesture input indicating one or more transitions, effects, or configurations to apply to the indicated video sources; and

iii. a software module configured to present a video output, the video output generated by editing one or more of the video sources in the video editing session, the editing comprising applying the indicated transitions, effects, or configurations to the indicated video sources.

22. The system of claim 21, wherein the software module configured to present a plurality of video sources presents 2 to 10 video sources.

23. The system of claim 21, wherein the software module configured to present a video output applies the one or more transitions, effects, or configurations to the indicated video sources in real-time during playback of the video output.

24. The system of claim 21, wherein the gesture input is a touch screen or multi-touch screen gesture.

25. The system of claim 24, wherein the gesture input comprises a one-finger tap, the tap on a video source, wherein the one-finger tap indicates a cut transition to the tapped source.

26. The system of claim 25, wherein the cut transition is for the visual content, the audio content, or for both the visual content and the audio content.

27. The system of claim 24, wherein the gesture input comprises a one-finger swipe, the swipe ending on a target video source, wherein the one-finger swipe indicates a dissolve transition from the video source currently providing content for the video output to the target video source.

28. The system of claim 27, wherein the dissolve transition is for the visual content, the audio content, or for both the visual content and the audio content.

29. The system of claim 24, wherein the gesture input comprises a multi-finger tap, each finger tapping a distinct video source, wherein the multi-finger tap indicates a transition to a split screen configuration displaying each tapped video source.

30. The system of claim 24, wherein the gesture input comprises a multi-finger tap, one finger tapping a first video source, two fingers tapping a second video source, wherein the multi- finger tap indicates a picture-in-picture configuration with the second video source set inside the first video source or with the first source set inside the second source.

31. The system of claim 24, wherein the gesture input comprises a two-finger swipe, the swipe ending on a target video source, wherein the two-finger swipe indicates a wipe transition from the video source currently providing content for the video output to the target video source.

32. The system of claim 21, wherein the software module configured to receive gesture input from a user receives the speed of the gesture, the speed used to configure a characteristic of the one or more transitions, effects, or configurations.

33. The system of claim 32, wherein the speed of the gesture is used to configure the speed of an indicated transition.

34. The system of claim 21, wherein the software module configured to receive gesture input from a user measures the length of the gesture, the length used to configure a characteristic of the one or more transitions, effects, or configurations.

35. The system of claim 34, wherein the length of the gesture is used to configure the speed of an indicated transition.

36. The system of claim 21, wherein the software module configured to receive gesture input from a user measures the duration of the gesture, the duration used to configure a characteristic of the one or more transitions, effects, or configurations.

37. The system of claim 36, wherein the duration of the gesture is used to configure the speed of an indicated transition.

38. The system of claim 21, wherein the application further comprises a software module configured to present a graphic representation of the video output, the graphic representation comprising an icon representing each temporal segment of the video output, each icon visually indicating the duration of the segment, a type of edit, and the number of video sources incorporated in that segment of the video output.

39. The system of claim 21, wherein the gesture input from the user is the sole input for the video editing.

40. The system of claim 21, wherein the application is a mobile application.

41. Non-transitory computer-readable storage media encoded with a computer program including instructions executable by a processor to create a live video editing application comprising:

a. a software module configured to present a plurality of video sources, the video sources played simultaneously in a video editing session;

b. a software module configured to receive input from a user in the video editing session, the input indicating one or more of the video sources, the input further indicating one or more transitions, effects, or configurations to apply to the indicated video sources; and

c. a software module configured to dynamically generate a linear graphic representation of the video output in the video editing session, the graphic representation comprising an icon representing each temporal segment of the video output, each icon visually indicating the duration of the segment, an applied transition, effect, or configuration, the number of video sources incorporated in that segment of the video output, and the identity of each video source incorporated in that segment of the video output.

42. The media of claim 41, wherein the graphic representation of the video output visually indicates a dissolve transition with a color gradient, the colors identifying the video sources.

43. The media of claim 41, wherein the graphic representation of the video output visually indicates the audio of the video output, wherein the level and identity of each audio source is visually indicated.