Systems and methods for identifying moments in videos

• US 10,395,122 B1
• Filed: 05/12/2017
• Issued: 08/27/2019
• Est. Priority Date: 05/12/2017
• Status: Active Grant

• Current Assignee: GoPro, Inc.
• Original Assignee: GoPro, Inc.
• Inventors: Sievert, Otto, Krishnamurthy, Naveen
• Primary Examiner(s): Duley, Janese
• Application Number:
  US15/593,584
• Time in Patent Office: 837 Days
• CPC Class Codes: G06V 20/41 Higher-level, semantic clustering, classification or understanding of video scenes, e.g. detection, labelling or Markovian modelling of sport events or news items segmenting video sequences G06V20/49
• CPC Class Codes: G06V 20/49 Segmenting video sequences, i.e. computational techniques such as parsing or cutting the sequence, low-level clustering or determining units such as shots or scenes
• CPC Class Codes: H04N 23/65 Control of camera operation in relation to power supply
• CPC Class Codes: H04N 23/661 Transmitting camera control signals through networks, e.g. control via the Internet
• CPC Class Codes: H04N 23/667 Camera operation mode switching, e.g. between still and video, sport and normal or high- and low-resolution modes
• CPC Class Codes: H04N 7/18 Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
• CPC Class Codes: H04N 7/183 for receiving images from a single remote source

Abstract

Physical storage media accessible to a remote device may store video information defining video content. The video content may be characterized by capture information. The remote device may transmit at least a portion of the capture information to a computing device. The computing device may identify one or more portions of the video content based on the transmitted capture information. The remote device may receive the identification of the identified portion(s) of the video content from the computing device. Responsive to the reception of the identification, the remote device may transmit the video information defining at least some of the identified portion(s) of the video content to the computing device.

Claims

1. A system that identifies moments in videos, the system comprising:

physical storage media storing video information defining video content, wherein capture of the video content by an image capture device and/or the video content captured by the image capture device is characterized by capture information, the capture information enabling a computing device remote from the image capture device to identify one or more portions of the video content prior to reception of the video content; and

one or more physical processors configured by machine-readable instructions to;

transmit at least a portion of the capture information to the computing device prior to transmission of the video information to the computing device, the computing device identifying, prior to the reception of the video content, the one or more portions of the video content based on the transmitted capture information;

receive the identification of the one or more identified portions of the video content from the computing device; and

responsive to the reception of the identification, transmit the video information defining at least some of the one or more identified portions of the video content to the computing device.

2. The system of claim 1, wherein the capture information includes one or more of capture location information defining capture locations of the video content, capture time information defining capture times of the video content, capture motion information defining capture motion of the video content, audio information defining an audio track of the video content, interest curve information defining values of an interest metric for the video content, average color information defining average colors of visuals captured within the video content, or histogram information defining one or more histograms of the visuals captured within the video content, and the computing device identifies the one or more portions of the video content based on the one or more of the capture location information, the capture time information, the capture motion information, the audio information, the interest curve information, the average color information, or the histogram information.

3. The system of claim of 1, wherein at least a portion of the capture information is generated by an image signal processor of the image capture device that captured the video content.

4. The system of claim 1, wherein at least a portion of the capture information is generated by a signal processor external to the image capture device that captured the video content, the portion of the capture information generated by the signal processor during the capture of the video content, wherein the portion of the capture information is transmitted to the image capture device for storage.

5. The system of claim 1, wherein the one or more physical processors are, to transmit the video information defining at least some of the one or more identified portions of the video content, further configured by the machine-readable instructions to:

generate derivative visual information defining one or more derivative visual content based on the one or more identified portions of the video content, individual derivative visual content corresponding to and generated from the individual identified portions of the video content, the individual derivative visual content characterized by lower fidelity than the corresponding individual identified portions of the video content;

transmit the derivative visual information defining the one or more derivative visual content to the computing device;

receive one or more selections of the derivative visual content from the computing device; and

transmit the video information defining one or more of the identified portions of the video content corresponding to the one or more selected derivative visual content to the computing device.

6. The system of claim 1, wherein the computing device identifying the one or more portions of the video content based on the transmitted capture information includes:

the computing device identifying one or more undesired portions of the video content based on at least some of the transmitted capture information; and

the computing device identifying the one or more portions of the video content based on an inverse of the one or more undesired portions of the video content.

7. The system of claim 1, wherein the one or more physical processors are included in the image capture device, and the computing device includes a mobile device or a server.

8. The system of claim 7, wherein:

the image capture device is configured to switch between operation in an advertisement mode to advertise availability of the capture information to the computing device and operation in a transfer mode to transmit at least the portion of the capture information to the computing device;

the image capture device operates in the advertisement mode to detect when the computing device is ready to receive the capture information;

the image capture device operates in the transfer mode responsive to detection of the computing device; and

the image capture device operating in the advertisement mode consumes less power than the image capture device operating in the transfer mode.

22. The system of claim 1, wherein the computing device identifying the one or more portions of the video content based on the transmitted capture information includes:

the computing device identifying a first portion and a second portion of the video content based on the transmitted capture information; and

the computing device identifying a third portion of the video content based on the first portion and the second portion, the third portion including an overlap of the first portion and the second portion;

wherein the one or more identified portions of the video content include the third portion.

9. A system that identifies moments in videos, the system comprising:

one or more physical processors configured by machine-readable instructions to;

receive at least a portion of capture information from a remote device prior to reception of video information from the remote device, the remote device storing the video information defining video content, wherein capture of the video content by an image capture device and/or the video content captured by the image capture device is characterized by the capture information, the capture information enabling the one or more physical processors remote from the image capture device to identify one or more portions of the video content prior to reception of the video content;

identify, prior to the reception of the video content, the one or more portions of the video content based on the received capture information;

transmit the identification of the one or more identified portions of the video content to the remote device; and

receive the video information defining at least some of the one or more identified portions of the video content from the remote device.

10. The system of claim of 9, wherein at least a portion of the capture information is generated by an image signal processor of the image capture device that captured the video content.

11. The system of claim 9, wherein at least a portion of the capture information is generated by a signal processor external to the image capture device that captured the video content, the portion of the capture information generated by the signal processor during the capture of the video content, wherein the portion of the capture information is transmitted to the image capture device for storage.

12. The system of claim 9, wherein the remote device is configured to, responsive to the reception of the identification, transmit the video information defining at least some of the one or more identified portions of the video content.

13. The system of claim 12, wherein the remote device is, to transmit the video information defining at least some of the one or more identified portions of the video content, further configured to:

generate derivative visual information defining one or more derivative visual content based on the one or more identified portions of the video content, individual derivative visual content corresponding to and generated from the individual identified portions of the video content, the individual derivative visual content characterized by lower fidelity than the corresponding individual identified portions of the video content;

transmit the derivative visual information defining the one or more derivative visual content;

receive one or more selections of the derivative visual content; and

transmit the video information defining one or more of the identified portions of the video content corresponding to the one or more selected derivative visual content.

14. The system of claim 9, wherein the one or more physical processors are, to identify the one or more portions of the video content based on the received capture information, further configured by the machine-readable instructions to:

identify one or more undesired portions of the video content based on at least some of the received capture information; and

identify the one or more portions of the video content based on an inverse of the one or more undesired portions of the video content.

15. The system of claim 9, wherein the one or more physical processors are included in a mobile device or a server, and the remote device includes an image capture device.

16. The system of claim 15, wherein:

the image capture device is configured to switch between operation in an advertisement mode to advertise availability of the capture information to the mobile device or the server and operation in a transfer mode to transmit at least the portion of the capture information to the mobile device or the server;

the image capture device operates in the advertisement mode to detect when the computing device is ready to receive the capture information;

the image capture device operates in the transfer mode responsive to detection of the computing device; and

the image capture device operating in the advertisement mode consumes less power than the image capture device operating in the transfer mode.

17. A method for identifying moments in videos, the method comprising:

receiving at least a portion of capture information from a remote device prior to reception of video information from the remote device, the remote device storing the video information defining video content, wherein capture of the video content by an image capture device and/or the video content captured by the image capture device is characterized by the capture information, the capture information enabling identification of one or more portions of the video content prior to reception of the video content;

identifying, prior to the reception of the video content, the one or more portions of the video content based on the received capture information;

transmitting the identification of the one or more identified portions of the video content to the remote device; and

receiving the video information defining at least some of the one or more identified portions of the video content from the remote device.

18. The method of claim of 17, wherein at least a portion of the capture information is generated by an image signal processor of the image capture device that captured the video content.

19. The method of claim 17, wherein at least a portion of the capture information is generated by a signal processor external to the image capture device that captured the video content, the portion of the capture information generated by the signal processor during the capture of the video content, wherein the portion of the capture information is transmitted to the image capture device for storage.

20. The method of claim 17, wherein the remote device is configured to, responsive to the reception of the identification, transmit the video information defining at least some of the one or more identified portions of the video content.

21. The method of claim 17, wherein identifying the one or more portions of the video content based on the received capture information includes:

identifying one or more undesired portions of the video content based on at least some of the received capture information; and

identifying the one or more portions of the video content based on an inverse of the one or more undesired portions of the video content.