Example based video editing
First Claim
1. A method, implemented at a computer system that includes one or more processors, for automatically editing storyboards based on a learned user-specific editing style, the method comprising:
- determining a first set of characteristics for a first plurality of media content items in a first storyboard, including;
receiving first user input associating each of the first plurality of media content items with one or more of a first plurality of cells of a first storyboard; and
analyzing each of the first plurality of media content items, including their associations with the first plurality of cells, to identify the first set of characteristics of the first plurality of media content items;
determining a set of user-specific editing characteristics applied to the first plurality of media content items in the first story board, including;
receiving second user input comprising a set of editing decisions, to create an edited first storyboard, the set of editing decisions including a plurality of editing decisions applied to the first plurality of cells to edit the first plurality of media content items in the first storyboard; and
based on receiving the second user input, automatically defining a user-specific editing style, including comparing the first storyboard to the edited first storyboard to determine one or more user-specific editing style rules corresponding to the set of editing decisions that resulted in the differences between the first storyboard and the edited first storyboard, and defining metadata representing at least one of the plurality of editing decisions applied to the first plurality of cells; and
automatically applying the user-specific editing style to a second plurality of media content items, including;
receiving third user input associating each of the second plurality of media content items with one or more of a second plurality of cells of a second storyboard;
analyzing each of the second plurality of media content items, including, their associations with the second plurality of cells, to identify a second set of characteristics of the second plurality of media content items;
comparing the first set of characteristics of the first plurality of media content items with the second set of characteristics of the second plurality of media content items, to identify at least one of the second plurality of media content items that has at least one characteristic that matches at least one characteristic of at least one of the first plurality of media content items;
automatically creating an edited second storyboard, by at least applying the user-specific editing style to the identified at least one of the second plurality of media content items that has at least one characteristic that matches at least one characteristic of at least one of the first plurality of media content items; and
displaying the edited second storyboard.
2 Assignments
0 Petitions
Accused Products
Abstract
Enabling creation of a user-specific storyboard style based on a storyboard edited by a user. Metadata defined by analyzing the editing decisions made by the user and the media content associated with the storyboard represents the user-specific style. The user-specific style may be applied to other media content to produce a fully edited storyboard that matches the style of the example storyboard from which the user-specific style was created. The produced storyboard is combined with the other media content to produce audio/video data for consumption by the user.
67 Citations
20 Claims
-
1. A method, implemented at a computer system that includes one or more processors, for automatically editing storyboards based on a learned user-specific editing style, the method comprising:
-
determining a first set of characteristics for a first plurality of media content items in a first storyboard, including; receiving first user input associating each of the first plurality of media content items with one or more of a first plurality of cells of a first storyboard; and analyzing each of the first plurality of media content items, including their associations with the first plurality of cells, to identify the first set of characteristics of the first plurality of media content items; determining a set of user-specific editing characteristics applied to the first plurality of media content items in the first story board, including; receiving second user input comprising a set of editing decisions, to create an edited first storyboard, the set of editing decisions including a plurality of editing decisions applied to the first plurality of cells to edit the first plurality of media content items in the first storyboard; and based on receiving the second user input, automatically defining a user-specific editing style, including comparing the first storyboard to the edited first storyboard to determine one or more user-specific editing style rules corresponding to the set of editing decisions that resulted in the differences between the first storyboard and the edited first storyboard, and defining metadata representing at least one of the plurality of editing decisions applied to the first plurality of cells; and automatically applying the user-specific editing style to a second plurality of media content items, including; receiving third user input associating each of the second plurality of media content items with one or more of a second plurality of cells of a second storyboard; analyzing each of the second plurality of media content items, including, their associations with the second plurality of cells, to identify a second set of characteristics of the second plurality of media content items; comparing the first set of characteristics of the first plurality of media content items with the second set of characteristics of the second plurality of media content items, to identify at least one of the second plurality of media content items that has at least one characteristic that matches at least one characteristic of at least one of the first plurality of media content items; automatically creating an edited second storyboard, by at least applying the user-specific editing style to the identified at least one of the second plurality of media content items that has at least one characteristic that matches at least one characteristic of at least one of the first plurality of media content items; and displaying the edited second storyboard. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9)
-
-
10. A computer system configured to automatically edit a second plurality of media content items based on a user editing style derived from editing decisions received from a user and applied to a first plurality of media content items, the system comprising:
-
one or more processors; a display device; and one or more storage media having stored thereon computer executable instructions that are executable by the one or more processors to cause the computer system to perform at least the following; present a first storyboard to the user representing a first timeline; receive a first plurality of media content items from the user; associate the first plurality media content items with one or more of a first plurality of cells of the first storyboard; analyze the first plurality of media content items and associated first plurality of cells to identify one or more first inherent properties; receive a set of editing decisions regarding the first plurality of media content items associated with the first storyboard; modify the first plurality of media content items and the first plurality of cells associated with the first storyboard according to the received editing decisions to create a first modified storyboard including a first modified plurality of media content items and a first modified plurality of cells; compare the first storyboard to the first modified storyboard to determine one or more user-specific editing style rules corresponding to editing, decisions of the user that resulted in the differences between the first plurality of media content items and the first plurality of cells associated with the first storyboard and the first modified plurality of media content items and first modified plurality of cells associated with the first modified storyboard; receive a second plurality of media content items from the user for association with a second plurality of cells of a second storyboard arranged according to a second timeline; analyze the second plurality of media content items and associated second plurality of cells to identify one or more second inherent properties; compare the one or more first inherent properties of the first plurality of media content items to the one or more second inherent properties of the second plurality of media content items to identify one or more of the second plurality of media content items having at least one inherent property in common with one or more of the first plurality of media Content items; apply the determined user-specific editing style rules to the one or more second plurality of media content items having at least one inherent property in common with one or more of the first plurality of media content items to create a second modified storyboard; present, at the display device, the second modified storyboard to the user as output data including at least one of audio data and video data. - View Dependent Claims (11, 12, 13, 14, 15)
-
-
16. A computer program product comprising one or more hardware storage devices having stored thereon computer-executable instructions that are executable by one or more processors to automatically edit storyboards based on a learned user-specific editing style, the computer-executable instructions including instructions that are executable to cause the computing device to perform at least the following:
-
determine a first set of characteristics for a first plurality of media content items in a first storyboard, including; receiving first user input associating each of the first plurality of media content items with one or more of a first plurality of cells of a first storyboard; and analyzing each of the first plurality of media content items, including their associations with the first plurality of cells, to identify the first set of characteristics of the first plurality of media content items; determine a set of user-specific editing characteristics applied to the first plurality of media content items in the first story board, including; receiving second user input comprising a set of editing decisions, to create an edited first storyboard, the set of editing decisions including a plurality of editing decisions applied to the first plurality of cells to edit the first plurality of media content items in the first storyboard; and based on receiving the second user input, automatically defining a user-specific editing style, including comparing the first storyboard to the edited first storyboard to determine one or more user-specific editing style rules corresponding to the set of editing decisions that resulted in the differences between the first storyboard and the edited first storyboard, and defining metadata representing at least one of the plurality of editing decisions applied to the first plurality of cells; and automatically apply the user-specific editing style to a second plurality of media content items, including; receiving third user input associating each of the second plurality of media content items with one or more of a second plurality of cells of a second storyboard; analyzing each of the second plurality of media content items, including their associations with the second plurality of cells, to identify a second set of characteristics of the second plurality of media content items; comparing the first set of characteristics of the first plurality of media content items with the second set of characteristics of the second plurality of media content items, to identify at least one of the second plurality of media content items that has at least one characteristic that matches at least one characteristic of at least one of the first plurality of media content items; automatically creating an edited second storyboard, by at least applying the user-specific editing style to the identified at least one of the second plurality of media content items that has at least one characteristic that matches at least one characteristic of at least one of the first plurality of media content items; and display the edited second storyboard. - View Dependent Claims (17, 18, 19, 20)
-
Specification