System and method of providing recommendations of moments of interest within video clips post capture

• US 10,204,273 B2
• Filed: 10/20/2015
• Issued: 02/12/2019
• Est. Priority Date: 10/20/2015
• Status: Active Grant

• Current Assignee: GoPro, Inc.
• Original Assignee: GoPro, Inc.
• Inventors: Matias, Joven, Phan, Ha
• Primary Examiner(s): Roz, Mark
• Application Number:
  US14/918,338
• Publication Number:
  US 20170109585A1
• Time in Patent Office: 1,211 Days
• Field of Search: None
• CPC Class Codes: G06F 16/78 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G06F 16/7867 using information manually generated, e.g. tags, keywords, comments, title and artist information, manually generated time, location and usage information, user ratings
• CPC Class Codes: G06V 20/41 Higher-level, semantic clustering, classification or understanding of video scenes, e.g. detection, labelling or Markovian modelling of sport events or news items segmenting video sequences G06V20/49
• CPC Class Codes: G06V 20/44 Event detection
• CPC Class Codes: G06V 20/47 Detecting features for summarising video content
• CPC Class Codes: G11B 27/031 Electronic editing of digitised analogue information signals, e.g. audio or video signals
• CPC Class Codes: G11B 27/34 Indicating arrangements indicating means incorporated in magazine or cassette G11B23/046 and G11B23/0875; indicating measured values in general G01D
• CPC Class Codes: H04N 21/251 Learning process for intelligent management, e.g. learning user preferences for recommending movies details of learning user preferences for the retrieval of video data in a video database G06F16/739; computer systems using learning methods G06N3/08
• CPC Class Codes: H04N 21/25891 being end-user preferences retrieval of video data in a video database based on user preferences G06F16/739; arrangements for recognizing users' preferences H04H60/46; user profiles in network data switching protocols H04L67/306; processing of user preferences or user profiles in wireless networks H04W8/18
• CPC Class Codes: H04N 21/44204 Monitoring of content usage, e.g. the number of times a movie has been viewed, copied or the amount which has been watched monitoring of user activities for profile generation for accessing a video database G06F16/739; protecting generic digital content where the protection is independent of the precise nature of the content G06F21/10; arrangements for monitoring the use made of the broadcast services in broadcast systems H04H60/31
• CPC Class Codes: H04N 21/4826 using recommendation lists, e.g. of programs or channels sorted out according to their score
• CPC Class Codes: H04N 23/64 Computer-aided capture of images, e.g. transfer from script file into camera, check of taken image quality, advice or proposal for image composition or decision on when to take image

Abstract

Users desiring to generate videos from video clips may want to locate moments of interest within the video clips. A system and method described herein may be configured to provide recommendations of moments of interest within video clips post capture of the video clips. User accounts associated with users of the system may include preference information that defines user preferences with respect to values of attributes of video clips. Moments of interest may be identified within individual video clips when the individual video clips have at least one value of at least one attribute specified by the user preferences. Recommendations of identified moments of interest may be provide to users.

Claims

1. A system configured to provide recommendations for creating videos from previously captured video clips, the system comprising:

one or more physical processors configured by machine-readable instructions to;

manage a user account associated with a user of the system, the user account comprising;

preference information that defines user preference criteria with respect to one or more attributes of video clips, the preference information defining a first preference criteria of the user with respect to a first attribute, the first preference criteria specifying a value or a range of values of the first attribute;

determine, among a set of video clips, video clips satisfying at least one of the user preference criteria such that a first video clip is determined to satisfy the first preference criteria and a second video clip is determined to not satisfy any of the user preference criteria;

identify individual moments of interest within individual video clips corresponding to individual points in time within the individual video clips based on the determination that the video clips satisfy at least one of the user preference criteria such that an identification of the moments of interest within the first video clip is performed based on the determination that the first video clip satisfies the first preference criteria and the identification of the moments of interest within the second video clip is not performed based on the determination that the second video clip does not satisfy any of the user preference criteria, wherein the individual moments of interest have at least one value of an attribute that satisfy at least one of the user preference criteria such that a first moment of interest is identified within the first video clip, the first moment of interest corresponding to a first point in time within the first video clip, the first point in time within the first video clip defining at least one value of the first attribute for the first video clip that is the same as the value of the first attribute specified by the first preference criteria or is within the range of values of the first attributed specified by the first preference criteria;

identify individual segments within the individual video clips that include at least one moment of interest previously identified within the individual video clips, such that a first segment within the first video clip is identified, the first segment including the previously identified first moment of interest, the first segment comprising a portion of the first video clip; and

generate and present a recommendation interface to the user, the recommendation interface facilitating a creation of a video, the recommendation interface displaying representations of the individual segments, including the previously identified individual moments of interest, such that the recommendation interface displays a representation of the first segment of the first video clip that includes the previously identified first moment of interest within the first video clip, wherein the recommendation interface facilitates the creation of the video based on subsequent user interaction with the recommendation interface.

2. The system of claim 1, wherein identifying the first moment of interest in the first video clip comprises:

determining individual values of individual attributes of the first video clip, including determining a first value of the first attribute of the first video clip;

determining whether the first value is the same as the value of the first attribute specified by the first preference criteria or is within the range of values of the first attributed specified by the first preference criteria;

responsive to the first value being the same as the value of the first attribute specified by the first preference criteria or being within the range of values of the first attributed specified by the first preference criteria, determining that the first point in time within the first video clip is associated with the first video clip having the first value of the first attribute; and

associating the first point in time with the first moment of interest, the association facilitating identification of the first moment of interest within the first video clip.

3. The system of claim 1, wherein an attribute of a video clip includes one or more of a geolocation attribute, a time attribute, a feature point detection attribute, or setting information attribute.

4. The system of claim 3, wherein the attribute of the video clip is the geolocation attribute, and wherein a value of the geolocation attribute comprises one or more geolocations of where the video clip was captured.

5. The system of claim 3, wherein the attribute of the video clip is the time attribute, and wherein a value of the time attribute comprises one or more timestamps associated with capture of the video clip.

6. The system of claim 3, wherein the attribute of the video clip is the feature point detection attribute, and wherein a value of the feature point detection attribute comprises a description of one or more a feature point, an object, or an action depicted within a video clip.

7. The system of claim 3, wherein the attribute of the video clip is the setting information attribute, and wherein a value of the setting information attribute comprises one or more cinematic settings associated with capture of the video clip.

8. The system of claim 7, wherein an individual cinematic setting includes one or more of a camera perspective, camera mounting position, shot framing, a filter, lighting arrangement, a shot transition, a frame rate, a shutter speed, or a resolution.

9. The system of claim 1, wherein the one or more physical processors are further configured by machine-readable instructions to:

determine user preference criteria based on one or more of;

monitoring system usage by the user;

monitoring usage of one or more applications external to the system by the user;

or

obtaining entry and/or selection of one or more preferences from the user.

10. The system of claim 9, wherein the determining of the user preference criteria is based the monitoring of the system usage, and wherein the monitoring of the system usage comprises determining user-initiated identifications of moment of interests within one or more video clips associated with the user, a user-initiated identification being provided by the user during capture of a video clip.

11. The system of claim 10, wherein the value of the first attribute specified by the first preference criteria comprises a first value, and wherein determining the first preference criteria comprises:

identifying, within a second video clip associated with the user, a user-initiated identification of a second moment of interest;

determining values of attributes of the second video clip, including determining that the first attribute of the second video clip has the first value;

determining that the second moment of interest is associated with the first attribute of the second video clip having the first value; and

associating the first preference criteria with the first attribute having at least the first value.

12. The system of claim 9, wherein the determining of the user preference criteria is based the monitoring of the system usage, and wherein the monitoring of the system usage comprises monitoring one or more video clips that the user has viewed.

13. The system of claim 12, wherein monitoring one or more video clips that the user has viewed further comprises determining whether the user has up-voted or down-voted individual ones of the one or more video clips.

14. The system of claim 13, wherein the value of the first attribute specified by the first preference criteria comprises a first value, and wherein determining the first preference criteria comprises:

responsive to determining that a user has up-voted a second video clip, determining values of attributes of the second video clip, including determining that the first attribute of the second video clip has the first value; and

associating the first preference criteria with the first attribute having at least the first value.

15. The system of claim 9, wherein the determining of the user preference criteria is based the monitoring usage of one or more applications external to the system by the user, and wherein the monitoring of the usage of the one or more applications external to the system comprises monitoring activity in one or more social networks.

31. The system of claim 1, wherein the subsequent user interaction with the recommendation interface includes providing input and/or selection of an acceptance of the creation of the video, wherein the provision of the input and/or selection causes the one or more physical processors to create the video including the first segment of the first video clip that includes the previously identified first moment of interest based on a video template.

16. A method to provide recommendations for creating videos from previously captured video clips, the method being implemented in a computer system comprising one or more physical processors and storage media storing machine-readable instructions, the method comprising:

managing a user account associated with a user of the system, the user account comprising;

preference information that defines user preference criteria with respect to one or more attributes of video clips, the preference information defining a first preference criteria of the user with respect to a first attribute, the first preference criteria specifying a value or a range of values of the first attribute;

determining, among a set of video clips, video clips satisfying at least one of the user preference criteria such that a first video clip is determined to satisfy the first preference criteria and a second video clip is determined to not satisfy any of the user preference criteria;

identifying individual moments of interest within individual video clips corresponding to individual points in time within the individual video clips based on the determination that the video clips satisfy at least one of the user preference criteria such that an identification of the moments of interest within the first video clip is performed based on the determination that the first video clip satisfies the first preference criteria and the identification of the moments of interest within the second video clip is not performed based on the determination that the second video clip does not satisfy any of the user preference criteria, wherein the individual moments of interest have at least one value of an attribute that satisfy at least one of the user preference criteria, including identifying a first moment of interest within the first video clip, the first moment of interest corresponding to a first point in time within the first video clip, the first point in time within the first video clip defining at least one value of the first attribute for the first video clip that is the same as the value of the first attribute specified by the first preference criteria or is within the range of values of the first attributed specified by the first preference criteria;

identifying individual segments within the individual video clips that include at least one moment of interest previously identified within the individual video clips, including identifying a first segment within the first video clip, the first segment including the previously identified first moment of interest, the first segment comprising a portion of the first video clip; and

generating and presenting a recommendation interface to the user, the recommendation interface facilitating a creation of a video, the recommendation interface displaying representations of the individual segments including the previously identified, such that the recommendation interface displays a representation of the first segment of the first video clip that includes the previously identified first moment of interest within the first video clip, wherein the recommendation interface facilitates the creation of the video based on subsequent user interaction with the recommendation interface.

17. The method of claim 16, wherein identifying the first moment of interest in the first video clip comprises:

determining individual values of individual attributes of the first video clip, including determining a first value of the first attribute of the first video clip;

determining whether the first value is the same as the value of the first attribute specified by the first preference criteria or is within the range of values of the first attributed specified by the first preference criteria;

responsive to the first value being the same as the value of the first attribute specified by the first preference criteria or being within the range of values of the first attributed specified by the first preference criteria, determining that the first point in time within the first video clip is associated with the first video clip having the first value of the first attribute; and

associating the first point in time with the first moment of interest, the association facilitating identification of the first moment of interest within the first video clip.

18. The method of claim 16, wherein an attribute of a video clip includes one or more of a geolocation attribute, a time attribute, a feature point detection attribute, or setting information attribute.

19. The method of claim 18, wherein the attribute of the video clip is the geolocation attribute, and wherein a value of the geolocation attribute comprises one or more geolocations of where the video clip was captured.

20. The method of claim 18, wherein the attribute of the video clip is the time attribute, and wherein a value of the time attribute comprises one or more timestamps associated with capture of the video clip.

21. The method of claim 18, wherein the attribute of the video clip is the feature point detection attribute, and wherein a value of the feature point detection attribute comprises a description of one or more a feature point, an object, or an action depicted within a video clip.

22. The method of claim 18, wherein the attribute of the video clip is the setting information attribute, and wherein a value of the setting information attribute comprises one or more cinematic settings associated with capture of the video clip.

23. The method of claim 22, wherein an individual cinematic setting includes one or more of a camera perspective, camera mounting position, shot framing, shot filter, lighting arrangement, a shot transition, a frame rate, or a resolution.

24. The method of claim 16, further comprising:

determining user preference criteria based on one or more of;

monitoring system usage by the user;

monitoring usage of one or more applications external to the system by the user;

or

obtaining entry and/or selection of one or more preferences from the user.

25. The method of claim 24, wherein the determining of the user preference criteria is based the monitoring of the system usage, and wherein the monitoring of the system usage comprises determining user-initiated identifications of moment of interests within one or more video clips associated with the user, a user-initiated identification being provided by the user during capture of a video clip.

26. The method of claim 25, wherein the value of the first attribute specified by the first preference criteria comprises a first value, and wherein determining the first preference criteria comprises:

identifying, within a second video clip associated with the user, a user-initiated identification of a second moment of interest;

determining values of attributes of the second video clip, including determining that the first attribute of the second video clip has the first value;

determining that the second moment of interest is associated with the first attribute of the second video clip having the first value; and

associating the first preference criteria with the first attribute having at least the first value.

27. The method of claim 24, wherein the determining of the user preference criteria is based the monitoring of the system usage, and wherein the monitoring of the system usage comprises monitoring one or more video clips that the user has viewed.

28. The method of claim 27, wherein monitoring one or more video clips that the user has viewed further comprises determining whether the user has up-voted or down-voted individual ones of the one or more video clips.

29. The method of claim 28, wherein the value of the first attribute specified by the first preference criteria comprises a first value, and wherein determining the first preference criteria comprises:

responsive to determining that a user has up-voted a second video clip, determining values of attributes of the second video clip, including determining that the first attribute of the second video clip has the first value; and

associating the first preference criteria with the first attribute having at least the first value.

30. The method of claim 24, wherein the determining of the user preference criteria is based the monitoring usage of one or more applications external to the system by the user, and wherein the monitoring of the usage of the one or more applications external to the system comprises monitoring activity in one or more social networks.

32. The method of claim 16, wherein the subsequent user interaction with the recommendation interface includes providing input and/or selection of an acceptance of the creation of the video, wherein the provision of the input and/or selection causes the method to perform an operation of creating the video including the first segment of the first video clip that includes the previously identified first moment of interest based on a video template.