Systems and methods for determining video highlight based on conveyance positions of video content capture

• US 10,268,896 B1
• Filed: 10/05/2016
• Issued: 04/23/2019
• Est. Priority Date: 10/05/2016
• Status: Active Grant

• Current Assignee: GoPro, Inc.
• Original Assignee: GoPro, Inc.
• Inventors: Delachanal, Christophe
• Primary Examiner(s): Jones, Heather R
• Application Number:
  US15/286,415
• Time in Patent Office: 930 Days
• Field of Search: None
• CPC Class Codes: G06F 16/739 in form of a video summary, e.g. the video summary being a video sequence, a composite still image or having synthesized frames
• CPC Class Codes: G06F 16/743 a collection of video files or sequences
• CPC Class Codes: G06T 2207/30244 Camera pose
• CPC Class Codes: G06T 7/70 Determining position or orientation of objects or cameras camera calibration G06T7/80
• CPC Class Codes: G06V 20/44 Event detection
• CPC Class Codes: G06V 20/47 Detecting features for summarising video content
• CPC Class Codes: G06V 20/49 Segmenting video sequences, i.e. computational techniques such as parsing or cutting the sequence, low-level clustering or determining units such as shots or scenes
• CPC Class Codes: G11B 27/10 Indexing; Addressing; Timing or synchronising; Measuring tape travel
• CPC Class Codes: G11B 27/105 of operating discs
• CPC Class Codes: G11B 27/28 by using information signals recorded by the same method as the main recording G11B27/22 takes precedence
• CPC Class Codes: H04N 23/51 Housings
• CPC Class Codes: H04N 23/698 for achieving an enlarged field of view, e.g. panoramic image capture
• CPC Class Codes: H04N 23/90 Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums

Abstract

First video information defining first video content may be accessed. The first video content may have been captured by a first image sensor from a first conveyance position. Second video information defining second video content may be accessed. The second video content may have been captured by a second image sensor from a second conveyance position. A first highlight criterion may be selected for the first video content based on the first conveyance position. A second highlight criterion may be selected for the second video content based on the second conveyance position. A first set of highlight moments within the first video content may be identified based on the first criterion. A second set of highlight moments within the second video content may be identified based on the second criterion. The identification of the first set of highlight moments and the second set of highlight moments may be stored.

Claims

1. A system for determining video highlights based on conveyance positions of video content capture, the system comprising:

one or more physical processors configured by machine-readable instructions to;

access first video information defining first video content, the first video content captured by a first image sensor from a first conveyance position;

access second video information defining second video content, the second video content captured by a second image sensor from a second conveyance position different from the first conveyance position;

select different highlight criterion for different video content based on different conveyance positions of image sensors that captured the different video content such that a first highlight criterion is selected for the first video content based on the first conveyance position of the first image sensor and a second highlight criterion is selected for the second video content based on the second conveyance position of the second image sensor, the second highlight criterion being different from the first highlight criterion;

identify a first set of highlight moments within the first video content based on the first criterion;

identify a second set of highlight moments within the second video content based on the second criterion; and

store the identification of the first set of highlight moments and the second set of highlight moments.

2. The system of claim 1, wherein the one or more physical processors are further configured to generate a video summary based on the first set of highlight moments and the second set of highlight moments.

3. The system of claim 2, wherein generating the video summary based on the first set of highlight moments and the second set of highlight moments includes:

identifying a first set of video segments from the first video content and a second set of video segments from the second video content, the first set of video segments including one or more of the first set of highlight moments and the second set of video segments including one or more of the second set of highlight moments; and

arranging one or more video segments from the first set of video segments and one or more video segments from the second set of video segments in the video summary based on times of capture of the one or more video segments from the first set of video segments and the one or more video segments from the second set of video segments.

4. The system of claim 2, wherein generating the video summary based on the first set of highlight moments and the second set of highlight moments includes:

identifying a first set of video segments from the first video content and a second set of video segments from the second video content, the first set of video segments including one or more of the first set of highlight moments and the second set of video segments including one or more of the second set of highlight moments; and

including one or more video segments from the first set of video segments and one or more video segments from the second set of video segments in the video summary, the one or more video segments from the first set of video segments and the one or more video segments from the second set of video segments including views of a same scene.

5. The system of claim 1, wherein the first video content and the second video content are time synced.

6. The system of claim 1, wherein the first conveyance position of the first image sensor indicates a type of the first image sensor.

7. The system of claim 6, wherein the type of first image sensor includes a handheld image sensor, a body-mounted image sensor, a head-mounted image sensor, or an object-mounted image sensor.

8. The system of claim 1, wherein the first conveyance position of the first image sensor is determined based on metadata associated with the first video content, visual analysis of the first video content, manual identification of the first conveyance position, or an image sensor mount for the first image sensor.

9. The system of claim 1, wherein the first highlight criterion includes a visual criterion, an audio criterion, and/or a metadata criterion.

10. A method for determining video highlights based on conveyance positions of video content capture, the method comprising:

accessing first video information defining first video content, the first video content captured by a first image sensor from a first conveyance position;

accessing second video information defining second video content, the second video content captured by a second image sensor from a second conveyance position different from the first conveyance position;

selecting different highlight criterion for different video content based on different conveyance positions of image sensors that captured the different video content such that a first highlight criterion is selected for the first video content based on the first conveyance position of the first image sensor and a second highlight criterion is selected for the second video content based on the second conveyance position of the second image sensor, the second highlight criterion being different from the first highlight criterion;

identifying a first set of highlight moments within the first video content based on the first criterion;

identifying a second set of highlight moments within the second video content based on the second criterion; and

storing the identification of the first set of highlight moments and the second set of highlight moments.

11. The method of claim 10, further comprising generating a video summary based on the first set of highlight moments and the second set of highlight moments.

12. The method of claim 11, wherein generating the video summary based on the first set of highlight moments and the second set of highlight moments includes:

identifying a first set of video segments from the first video content and a second set of video segments from the second video content, the first set of video segments including one or more of the first set of highlight moments and the second set of video segments including one or more of the second set of highlight moments; and

arranging one or more video segments from the first set of video segments and one or more video segments from the second set of video segments in the video summary based on times of capture of the one or more video segments from the first set of video segments and the one or more video segments from the second set of video segments.

13. The method of claim 11, wherein generating the video summary based on the first set of highlight moments and the second set of highlight moments includes:

identifying a first set of video segments from the first video content and a second set of video segments from the second video content, the first set of video segments including one or more of the first set of highlight moments and the second set of video segments including one or more of the second set of highlight moments; and

including one or more video segments from the first set of video segments and one or more video segments from the second set of video segments in the video summary, the one or more video segments from the first set of video segments and the one or more video segments from the second set of video segments including views of a same scene.

14. The method of claim 10, wherein the first video content and the second video content are time synced.

15. The method of claim 10, wherein the first conveyance position of the first image sensor indicates a type of the first image sensor.

16. The method of claim 15, wherein the type of first image sensor includes a handheld image sensor, a body-mounted image sensor, a head-mounted image sensor, or an object-mounted image sensor.

17. The method of claim 10, wherein the first conveyance position of the first image sensor is determined based on metadata associated with the first video content, visual analysis of the first video content, manual identification of the first conveyance position, or an image sensor mount for the first image sensor.

18. The method of claim 10, wherein the first highlight criterion includes a visual criterion, an audio criterion, and/or a metadata criterion.

19. A system for determining video highlights based on conveyance positions of video content capture, the system comprising:

one or more physical processors configured by machine-readable instructions to;

access first video information defining first video content, the first video content captured by a first image sensor from a first conveyance position, the first conveyance position indicating a type of the first image sensor;

access second video information defining second video content, the second video content captured by a second image sensor from a second conveyance position different from the first conveyance position, the second conveyance position indicating a type of the second image sensor, wherein the first video content and the second video content are time synced;

select different highlight criterion for different video content based on different conveyance positions of image sensors that captured the different video content such that a first highlight criterion is selected for the first video content based on the first conveyance position of the first image sensor and a second highlight criterion is selected for the second video content based on the second conveyance position of the second image sensor, the second highlight criterion being different from the first highlight criterion;

identify a first set of highlight moments within the first video content based on the first criterion;

identify a second set of highlight moments within the second video content based on the second criterion;

store the identification of the first set of highlight moments and the second set of highlight moments; and

generate a video summary based on the first set of highlight moments and the second set of highlight moments.

20. The system of claim 19, wherein the type of first image sensor includes a handheld image sensor, a body-mounted image sensor, a head-mounted image sensor, or an object-mounted image sensor.