Digital media editing

• US 10,424,102 B2
• Filed: 02/03/2017
• Issued: 09/24/2019
• Est. Priority Date: 02/04/2016
• Status: Active Grant

• Current Assignee: GoPro, Inc.
• Original Assignee: GoPro, Inc.
• Inventors: McKaskle, Devin, Moore, Stephen Trey, Chinni, Ross
• Primary Examiner(s): Vaughn, Jr., William C
• Assistant Examiner(s): Tekle, Daniel T
• Application Number:
  US15/424,281
• Publication Number:
  US 20170229147A1
• Time in Patent Office: 963 Days
• Field of Search: None
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 40/169 Annotation, e.g. comment data or footnotes
• CPC Class Codes: G06T 13/40 of characters, e.g. humans, animals or virtual beings
• CPC Class Codes: G11B 27/02 Editing, e.g. varying the order of information signals recorded on, or reproduced from, record carriers
• CPC Class Codes: G11B 27/031 Electronic editing of digitised analogue information signals, e.g. audio or video signals
• CPC Class Codes: G11B 27/34 Indicating arrangements indicating means incorporated in magazine or cassette G11B23/046 and G11B23/0875; indicating measured values in general G01D
• CPC Class Codes: H04N 21/41407 embedded in a portable device, e.g. video client on a mobile phone, PDA, laptop constructional details of equipment or arrangements specially adapted for portable computer application G06F1/1626; arrangements specially adapted for mobile receivers in broadcast systems H04H20/57
• CPC Class Codes: H04N 21/42224 Touch pad or touch panel provided on the remote control
• CPC Class Codes: H04N 21/4223 Cameras H04N23/00 takes precedence
• CPC Class Codes: H04N 21/4402 involving reformatting operations of video signals for household redistribution, storage or real-time display details of conversion of video standards at pixel level H04N7/01; video transcoding H04N19/40; adapting incoming signals to the display format of the display terminal G09G5/005; media handling at the source in data packet switching networks H04L65/764
• CPC Class Codes: H04N 21/44218 Detecting physical presence or behaviour of the user, e.g. using sensors to detect if the user is leaving the room or changes his face expression during a TV program methods or arrangements for recognising human body or animal bodies or body parts G06V40/10; methods or arrangements for acquiring or recognising human faces, facial parts, facial sketches, facial expressions G06V40/16; methods or arrangements for recognising movements or behaviour G06V40/20; arrangements for identifying users in broadcast systems H04H60/45
• CPC Class Codes: H04N 21/47205 for manipulating displayed content, e.g. interacting with MPEG-4 objects, editing locally

Abstract

Implementations are directed to providing an edit profile including one or more suggested edits to a digital video, actions including receiving metadata associated with the digital video, the metadata including data representative of one or more of movement and an environment associated with recording of the digital video, processing the metadata to provide a suggested edit profile including at least one set of effects, the at least one set of effects including one or more effects configured to be applied to at least a portion of the digital video, providing a respective graphical representation of individual effect of the one or more effects within an effect interface, and receiving, through the effect interface, a user selection of a set of effects of the suggested edit profile, and in response, storing, in computer-readable memory, an edit profile comprising the set of effects for application to the digital video.

Claims

1. A computer-implemented method for providing an edit profile comprising one or more suggested edits to a digital video, the method being executed by one or more processors of a computing device and comprising:

receiving, by the one or more processors, metadata associated with the digital video, the metadata comprising data representative of a movement and an environment associated with recording of the digital video;

processing, by the one or more processors, the metadata to provide a suggested edit profile comprising at least one set of effects, the at least one set of effects comprising one or more effects configured to be applied to at least a portion of the digital video, the suggested edit profile determined based on the movement and the environment;

providing, by the one or more processors, a respective graphical representation of individual effect of the one or more effects within an effect interface; and

receiving, by the one or more processors, and through the effect interface, a user selection of a set of effects of the suggested edit profile, and in response, storing, in computer-readable memory, an edit profile comprising the set of effects for application to the digital video;

wherein the determination of the suggested edit profile based on the movement and the environment includes;

determining a first suggested edit profile based on the movement being of a first type of movement and the environment being of a first type of environment;

determining a second suggested edit profile based on the movement being of a first type of movement and the environment being of a second type of environment;

determining a third suggested edit profile based on the movement being of a second type of movement and the environment being of the first type of environment; and

determining a fourth suggested edit profile based on the movement being of the second type of movement and the environment being of the second type of environment;

wherein;

the first suggested edit profile is different from the second suggested edit profile, the third suggested edit profile, and the fourth suggested edit profile

the second suggested edit profile is different from the third suggested edit profile, and the fourth suggested edit profile; and

the third suggested edit profile is different from the fourth suggested edit profile.

2. The method of claim 1, wherein processing the metadata to provide a suggested edit profile comprises determining that at least one attribute value breaches a threshold, and in response, providing the at least one set of effects.

3. The method of claim 1, wherein processing the metadata to provide a suggested edit profile comprises determining a type of effect to include in the at least one set of effects based on the metadata.

4. The method of claim 1, wherein determining a type of effect comprises comparing at least one metadata value to a threshold value, and one of:

including a first effect in the at least one set of effects if the metadata value breaches the threshold value, and including a second effect in the at least one set of effects if the metadata value does not breach the threshold value.

5. The method of claim 1, wherein each effect is associated with one or more attributes.

6. The method of claim 5, further comprising receiving user input indicating a modification to at least one attribute.

7. The method of claim 5, wherein an attribute comprises one of a degree of a respective effect, a beginning of a respective effect, an end of a respective effect, and a duration of a respective effect.

8. The method of claim 1, wherein the at least one set of effects is associated with an event that is identified as an event of interest based on the metadata.

9. The method of claim 1, wherein the at least one set of effects is associated with an event that is not identified as an event of interest based on the metadata.

10. The method of claim 1, wherein an effect comprises slow motion, fast forward, zoom-in, zoom-out, a color effect, a sound effect, insertion of a music track, a volume effect, a pixilation effect.

11. A non-transitory computer-readable storage medium coupled to one or more processors and having instructions stored thereon which, when executed by the one or more processors, cause the one or more processors to perform operations providing an edit profile comprising one or more suggested edits to a digital video, the operations comprising:

receiving metadata associated with the digital video, the metadata comprising data representative of a movement and an environment associated with recording of the digital video;

processing the metadata to provide a suggested edit profile comprising at least one set of effects, the at least one set of effects comprising one or more effects configured to be applied to at least a portion of the digital video, the suggested edit profile determined based on the movement and the environment;

providing a respective graphical representation of individual effect of the one or more effects within an effect interface; and

receiving and through the effect interface, a user selection of a set of effects of the suggested edit profile, and in response, storing, in computer-readable memory, an edit profile comprising the set of effects for application to the digital video;

wherein the determination of the suggested edit profile based on the movement and the environment includes;

determining a first suggested edit profile based on the movement being of a first type of movement and the environment being of a first type of environment;

determining a second suggested edit profile based on the movement being of a first type of movement and the environment being of a second type of environment;

determining a third suggested edit profile based on the movement being of a second type of movement and the environment being of the first type of environment; and

determining a fourth suggested edit profile based on the movement being of the second type of movement and the environment being of the second type of environment;

wherein;

the first suggested edit profile is different from the second suggested edit profile, the third suggested edit profile, and the fourth suggested edit profile

the second suggested edit profile is different from the third suggested edit profile, and the fourth suggested edit profile; and

the third suggested edit profile is different from the fourth suggested edit profile.

12. The non-transitory computer-readable storage medium of claim 11, wherein processing the metadata to provide a suggested edit profile comprises determining that at least one attribute value breaches a threshold, and in response, providing the at least one set of effects.

13. The non-transitory computer-readable storage medium of claim 11, wherein processing the metadata to provide a suggested edit profile comprises determining a type of effect to include in the at least one set of effects based on the metadata.

14. The non-transitory computer-readable storage medium of claim 11, wherein determining a type of effect comprises comparing at least one metadata value to a threshold value, and one of:

including a first effect in the at least one set of effects if the metadata value breaches the threshold value, and including a second effect in the at least one set of effects if the metadata value does not breach the threshold value.

15. A system, comprising:

a data source; and

a computing device having a computer-readable storage device having instructions stored thereon which, when executed by the computing device, cause the computing device to perform operations for providing an edit profile comprising one or more suggested edits to a digital video, the operations comprising;

receiving metadata associated with the digital video, the metadata comprising data representative of a movement and an environment associated with recording of the digital video,

processing the metadata to provide a suggested edit profile comprising at least one set of effects, the at least one set of effects comprising one or more effects configured to be applied to at least a portion of the digital video, the suggested edit profile determined based on the movement and the environment,

providing a respective graphical representation of individual effect of the one or more effects within an effect interface, and

receiving and through the effect interface, a user selection of a set of effects of the suggested edit profile, and in response, storing, in computer-readable memory, an edit profile comprising the set of effects for application to the digital video;

wherein the determination of the suggested edit profile based on the movement and the environment includes;

determining a first suggested edit profile based on the movement being of a first type of movement and the environment being of a first type of environment;

determining a second suggested edit profile based on the movement being of a first type of movement and the environment being of a second type of environment;

determining a third suggested edit profile based on the movement being of a second type of movement and the environment being of the first type of environment; and

determining a fourth suggested edit profile based on the movement being of the second type of movement and the environment being of the second type of environment;

wherein;

the first suggested edit profile is different from the second suggested edit profile, the third suggested edit profile, and the fourth suggested edit profile

the second suggested edit profile is different from the third suggested edit profile, and the fourth suggested edit profile; and

the third suggested edit profile is different from the fourth suggested edit profile.

16. The system of claim 15, wherein processing the metadata to provide a suggested edit profile comprises determining that at least one attribute value breaches a threshold, and in response, providing the at least one set of effects.

17. The system of claim 15, wherein processing the metadata to provide a suggested edit profile comprises determining a type of effect to include in the at least one set of effects based on the metadata.

18. The system of claim 15, wherein determining a type of effect comprises comparing at least one metadata value to a threshold value, and one of:

including a first effect in the at least one set of effects if the metadata value breaches the threshold value, and including a second effect in the at least one set of effects if the metadata value does not breach the threshold value.

19. The system of claim 15, wherein each effect is associated with one or more attributes.