Apparatus and methods for providing content context using session metadata

• US 9,871,994 B1
• Filed: 01/19/2016
• Issued: 01/16/2018
• Est. Priority Date: 01/19/2016
• Status: Active Grant

• Current Assignee: GoPro, Inc.
• Original Assignee: GoPro, Inc.
• Inventors: Vaden, Mark, Fischer, Rolf
• Primary Examiner(s): Hunter, Mishawn
• Application Number:
  US15/001,122
• Time in Patent Office: 728 Days
• Field of Search: 386239, 386248
• CPC Class Codes: G11B 27/11 by using information not detectable on the record carrier
• CPC Class Codes: G11B 27/19 by using information detectable on the record carrier
• CPC Class Codes: G11B 27/34 Indicating arrangements indicating means incorporated in magazine or cassette G11B23/046 and G11B23/0875; indicating measured values in general G01D
• CPC Class Codes: H04N 5/77 between a recording apparatus and a television camera
• CPC Class Codes: H04N 5/772 the recording apparatus and the television camera being placed in the same enclosure
• CPC Class Codes: H04N 5/9206 the additional signal being a character code signal
• CPC Class Codes: H04N 9/8205 involving the multiplexing of an additional signal and the colour video signal

Abstract

Content proxy may be obtained. Content may include video captured by an action camera. Content proxy may include metadata information obtained contemporaneous with the content and stored in a session container. Content proxy may include lower data rate version of the content (thumbnails). Content proxy information may be viewed and/or analyzed in order to obtain one or more highlights. Content portion corresponding to the highlight may be obtained. Multiple versions of content proxy obtained by multiple cameras may be used to identify, display, and/or share content portions in a multi-camera/multiuser applications.

Claims

1. A non-transitory computer readable medium storing a plurality of computer-readable instructions which, when executed by one or more processors of a user interface apparatus, cause the user interface apparatus to:

obtain a first video stream, the first video stream acquired during a first activity by a first capture device, the first video stream including a first sequence of images, the first sequence of images including visual capture of the first activity, the first sequence of images captured during a first time duration;

obtain a first metadata stream, the first metadata stream characterizing the first activity captured within the first sequence of images, the first metadata stream including values of a first parameter characterizing an aspect of the first activity captured within the first sequence of images, one or more of the values of the first parameter corresponding to one or more images of the first sequence of images;

obtain a second video stream, the second video stream acquired during a second activity by a second capture device, the second video stream including a second sequence of images, the second sequence of images including visual capture of the second activity, the second sequence of images captured during a second time duration, wherein at least a portion of the first time duration overlaps with at least a portion of the second time duration;

obtain a second metadata stream, the second metadata stream characterizing the second activity captured within the second sequence of images, the second metadata stream including values of a second parameter characterizing an aspect of the second activity captured within the second sequence of images, one or more of the values of the second parameter corresponding to one or more images of the second sequence of images;

present on a display of the user interface apparatus;

at least a portion of the first video stream, the portion of the first video stream including at least some of the images of the first sequence of images;

values of the first parameter corresponding to the presented images of the first sequence of images, the presented values of the first parameter characterizing the aspect of the first activity at one or more moments within the first time duration; and

values of the second parameter characterizing the aspect of the second activity at one or more moments within the second time duration, the one or more moments within the second time duration overlapping with the one or more moments within the first time duration;

identify an occurrence of a highlight event during the second activity based on the values of the second parameter, the highlight event occurring during some or all of the one or more moments within the second time duration; and

responsive to the identification of the highlight event during the second activity, present on the display of the user interface apparatus at least a portion of the second video stream, the portion of the second video stream including one or more of the images of the second sequence of images corresponding to the moments within the second time duration during which the highlight event occurred.

2. The non-transitory medium of claim 1, wherein the first metadata stream is obtained by a sensor disposed within the first capture device that is disposed remote from the user interface apparatus.

3. The non-transitory medium of claim 2, wherein the first metadata stream is obtained by the user interface apparatus via a first wireless link between the user interface apparatus and the first capture device.

4. The non-transitory medium of claim 3, wherein the second metadata stream is obtained via a second wireless link between the user interface apparatus and the second capture device.

5. The non-transitory medium of claim 1, wherein the occurrence of the highlight event is identified based on determination of one or more of the values of the second parameter breaching a threshold.

6. The non-transitory medium of claim 5, wherein the occurrence of the highlight event is identified further based on an activation of a user interface component of the user interface apparatus.

7. The non-transitory medium of claim 1, wherein the images of the second sequence of images are captured by the second capture device contemporaneously with one or more of:

capture of the images of the first sequence of images by the first capture device;

capture of the first metadata stream;

or

capture of the second metadata stream by the second capture device.

8. A system configured to provide content, the system comprising:

one or more physical processors configured by machine-readable instructions to;

obtain a first video stream, the first video stream acquired during a first activity by a first capture device, the first video stream including a first sequence of images, the first sequence of images including visual capture of the first activity, the first sequence of images captured during a first time duration;

obtain a first metadata stream, the first metadata stream characterizing the first activity captured within the first sequence of images, the first metadata stream including values of a first parameter characterizing an aspect of the first activity captured within the first sequence of images, one or more of the values of the first parameter corresponding to one or more images of the first sequence of images;

obtain a second video stream, the second video stream acquired during a second activity by a second capture device, the second video stream including a second sequence of images, the second sequence of images including visual capture of the second activity, the second sequence of images captured during a second time duration, wherein at least a portion of the first time duration overlaps with at least a portion of the second time duration;

obtain a second metadata stream, the second metadata stream characterizing the second activity captured within the second sequence of images, the second metadata stream including values of a second parameter characterizing an aspect of the second activity captured within the second sequence of images, one or more of the values of the second parameter corresponding to one or more images of the second sequence of images; and

present on a display of the user interface apparatus;

at least a portion of the first video stream, the portion of the first video stream including at least some of the images of the first sequence of images;

values of the first parameter corresponding to the presented images of the first sequence of images, the presented values of the first parameter characterizing the aspect of the first activity at one or more moments within the first time duration; and

values of the second parameter characterizing the aspect of the second activity at one or more moments within the second time duration, the one or more moments within the second time duration overlapping with the one or more moments within the first time duration;

identify an occurrence of a highlight event during the second activity based on the values of the second parameter, the highlight event occurring during some or all of the one or more moments within the second time duration; and

responsive to the identification of the highlight event during the second activity, present on the display of the user interface apparatus at least a portion of the second video stream, the portion of the second video stream including one or more of the images of the second sequence of images corresponding to the moments within the second time duration during which the highlight event occurred.

9. The system of claim 8, wherein the first metadata stream is obtained by a sensor disposed within the first capture device that is disposed remote from the user interface apparatus.

10. The system of claim 9, wherein the first metadata stream is obtained by the user interface apparatus via a first wireless link between the user interface apparatus and the first capture device.

11. The system of claim 10, wherein the second metadata stream is obtained via a second wireless link between the user interface apparatus and the second capture device.

12. The system of claim 8, wherein the occurrence of the highlight event is identified based on determination of one or more of the values of the second parameter breaching a threshold.

13. The system of claim 12, wherein the occurrence of the highlight event is identified further based on an activation of a user interface component of the user interface apparatus.

14. The system of claim 8, wherein the images of the second sequence of images are captured by the second capture device contemporaneously with one or more of:

capture of the images of the first sequence of images by the first capture device;

capture of the first metadata stream;

or

capture of the second metadata stream by the second capture device.

15. A method of providing content, the method being implemented in a computer system comprising one or more physical processors configured by machine-readable instructions, the method comprising:

obtaining a first video stream, the first video stream acquired during a first activity, the first video stream including a first sequence of images, the first sequence of images including visual capture of the first activity, the first sequence of images captured during a first time duration;

obtaining a first metadata stream, the first metadata stream characterizing the first activity captured within the first sequence of images, the first metadata stream including values of a first parameter characterizing an aspect of the first activity captured within the first sequence of images, one or more of the values of the first parameter corresponding to one or more images of the first sequence of images;

obtaining a second video stream, the second video stream acquired during a second activity by a second capture device, the second video stream including a second sequence of images, the second sequence of images including visual capture of the second activity, the second sequence of images captured during a second time duration, wherein at least a portion of the first time duration overlaps with at least a portion of the second time duration;

obtaining a second metadata stream, the second metadata stream characterizing the second activity captured within the second sequence of images, the second metadata stream including values of a second parameter characterizing an aspect of the second activity captured within the second sequence of images, one or more of the values of the second parameter corresponding to one or more images of the second sequence of images; and

presenting on a display of the user interface apparatus;

at least a portion of the first video stream, the portion of the first video stream including at least some of the images of the first sequence of images;

values of the first parameter corresponding to the presented images of the first sequence of images, the presented values of the first parameter characterizing the aspect of the first activity at one or more moments within the first time duration; and

values of the second parameter characterizing the aspect of the second activity at one or more moments within the second time duration, the one or more moments within the second time duration overlapping with the one or more moments within the first time duration;

identifying an occurrence of a highlight event during the second activity based on the values of the second parameter, the highlight event occurring during some or all of the one or more moments within the second time duration; and

responsive to the identification of the highlight event during the second activity, present on the display of the user interface apparatus at least a portion of the second video stream, the portion of the second video stream including one or more of the images of the second sequence of images corresponding to the moments within the second time duration during which the highlight event occurred.

16. The method of claim 15, wherein the first metadata stream is obtained by a sensor disposed within the first capture device that is disposed remote from the user interface apparatus.

17. The method of claim 16, wherein the first metadata stream is obtained by the user interface apparatus via a first wireless link between the user interface apparatus and the first capture device.

18. The method of claim 17, wherein the second metadata stream is obtained via a second wireless link between the user interface apparatus and the second capture device.

19. The method of claim 15, wherein the occurrence of the highlight event is identified based on determination of one or more of the values of the second parameter breaching a threshold.

20. The method of claim 15, wherein the images of the second sequence of images are captured by the second capture device contemporaneously with one or more of:

capture of the images of the first sequence of images by the first capture device;

capture of the first metadata stream;

or

capture of the second metadata stream by the second capture device.