Media identifier generation for camera-captured media

• US 9,734,870 B2
• Filed: 10/15/2015
• Issued: 08/15/2017
• Est. Priority Date: 01/05/2015
• Status: Active Grant

• Current Assignee: GoPro, Inc.
• Original Assignee: GoPro, Inc.
• Inventors: Cheema, Gurprit, Sievert, Otto K., Newman, David A.
• Primary Examiner(s): Chevalier, Robert
• Application Number:
  US14/883,943
• Publication Number:
  US 20160196852A1
• Time in Patent Office: 670 Days
• Field of Search: 386224, 386223, 386239, 386248, 386353, 386290
• CPC Class Codes: G06V 20/41 Higher-level, semantic clustering, classification or understanding of video scenes, e.g. detection, labelling or Markovian modelling of sport events or news items segmenting video sequences G06V20/49
• CPC Class Codes: G06V 20/46 Extracting features or characteristics from the video content, e.g. video fingerprints, representative shots or key frames
• CPC Class Codes: G11B 27/036 Insert-editing
• CPC Class Codes: G11B 27/102 Programmed access in sequence to addressed parts of tracks of operating record carriers access by moving the head G11B3/08, G11B5/54, G11B7/085, G11B21/022; by moving the record carrier G11B15/005, G11B17/005, by driving of both record carrier and head G11B15/1816
• CPC Class Codes: G11B 27/3027 used signal is digitally coded
• CPC Class Codes: G11B 27/3081 used signal is a video-frame or a video-field (P.I.P)

Abstract

A video identifier uniquely identifying a video captured by a camera is generated. The video includes video frames and optionally concurrently captured audio as well as video metadata describing the video. Video data is extracted from at least two of the video'"'"'s frames. By combining the extracted video data in an order specified by an identifier generation protocol, an extracted data object is generated. The extracted data object is hashed to generate the unique media identifier, which is stored in association with the video. The identifier generation protocol may indicate the portions of the video data to extract, such as video data corresponding to particular video frames and audio data corresponding to particular audio samples. The extracted data object may include a size of particular video frames, a number of audio samples in the video, or the duration of the video, for example.

Claims

1. A camera system comprising:

an image sensor;

a microphone;

a processor; and

a non-transitory computer-readable medium comprising instructions executable by the processor for generating a media identifier for captured media, the instructions comprising instructions for;

capturing a video comprising video frames captured by the image sensor and audio concurrently captured by the microphone;

extracting first frame data corresponding to a first captured frame of the video and second video frame data corresponding to a last captured frame of the video;

determining a first data size of the first frame data and a second data size of the second frame data;

truncating the first frame data and the second frame data to a predetermined number of bits specified by an identifier generation protocol;

extracting audio data corresponding to a portion of the video specified by the identifier generation protocol, the portion of the video including the first captured frame;

generating an extracted data object comprising the first data size, the second data size, the truncated first frame data, the truncated second frame data, and the extracted audio data in an order specified by the identifier generation protocol;

generating a unique media identifier by hashing the extracted data object; and

modifying the video to include the generated unique media identifier.

2. A non-transitory computer-readable medium comprising instructions executable by a processor for generating a media identifier for media captured by a camera, the instructions comprising instructions for:

accessing a video comprising video frames captured by the camera and audio captured by the camera;

extracting video data corresponding to at least two non-consecutive video frames specified by an identifier generation protocol;

generating an extracted data object comprising the extracted video data combined, according to the identifier generation protocol, with video metadata associated with the accessed video;

generating a unique media identifier by hashing the extracted data object;

modifying the video to include the generated unique media identifier;

registering the video with a cloud server using the generated unique media identifier; and

sending a version of the video to the cloud server in response to a request from the cloud server comprising the generated unique media identifier.

3. The computer-readable medium of claim 2, wherein extracting the video data and generating the extracted data object comprise:

accessing, from the video, a first video frame having a first frame number and a second video frame having a second frame number, the first and second frame numbers specified by the identifier generation protocol;

determining a first size of first image data in the first video frame and a second size of second image data in the second video frame;

truncating the first image data and the second image data to a predetermined number of bits specified by the identifier generation protocol; and

generating the extracted data object by combining the determined first image data size, second image data size, truncated first image data, and truncated second image data in an order specified by the identifier generation protocol.

4. The computer-readable medium of claim 2, wherein extracting the video data and generating the extracted data object comprise:

accessing first video data corresponding to an initial video frame of the video;

accessing second video data corresponding to a video frame at a predetermined frame number specified by the identifier generation protocol;

accessing third video data corresponding to a last video frame of the video; and

generating the extracted data object by combining the first video data, the second video data, and the third video data into the extracted video data in an order specified by the identifier generation protocol.

5. The computer-readable medium of claim 4, wherein combining the first video data, the second video data, and the third video data into the extracted video data comprises:

truncating each of the first video data, the second video data, and the third video data to a predetermined number of bits specified by the identifier generation protocol; and

generating the extracted data object by combining the truncated first video data, the truncated second video data, and the truncated third video data into the extracted video data in an order specified by the identifier generation protocol.

6. The computer-readable medium of claim 4, wherein combining the first video data, the second video data, and the third video data into the extracted video data comprises:

determining whether the video includes a number of video frames exceeding the predetermined frame number specified by the identifier generation protocol;

generating the extracted data object by combining the second video data with the first video data and the third video data in an order specified by the identifier generation protocol in response to the number of video frames exceeding the predetermined frame number.

7. The computer-readable medium of claim 2, wherein extracting the video data and generating the extracted data object comprise:

accessing audio data corresponding to a channel of the audio data specified by the identifier generation protocol;

determining a number of audio samples in the accessed audio data;

accessing image data corresponding to at least one video frame of the video; and

generating the extracted data object by combining the number of audio samples and the image data into the extracted video data in an order specified by the identifier generation protocol.

8. The computer-readable medium of claim 2, wherein extracting the video data and generating the extracted data object comprise:

accessing audio data corresponding to a portion of the video, the portion specified by the identifier generation protocol;

accessing image data corresponding to at least one video frame of the video; and

generating the extracted data object by combining the audio data and the image data into the extracted video data in an order specified by the identifier generation protocol.

9. The computer-readable medium of claim 8, wherein combining the audio data and the image data into the extracted video data comprises:

determining whether the video includes a number of audio samples equaling or exceeding a threshold number of audio samples specified by the identifier generation protocol; and

responsive to the number of audio samples equaling or exceeding the threshold number of audio samples, combining the audio data with the image data in an order specified by the identifier generation protocol.

10. The computer-readable medium of claim 2, wherein generating the extracted data object comprising the extracted video data combined with the associated video metadata comprises:

accessing, from the video metadata, a duration value indicating a time duration of the video;

accessing, from the video metadata, a timescale value corresponding to a timescale of the duration value; and

generating the extracted data object comprising the extracted video data combined with the duration value and the timescale value in an order specified by the identifier generation protocol.

11. The computer-readable medium of claim 2, wherein the video is stored in an atom format comprising hierarchically nested atoms, wherein generating the extracted data object comprising the extracted video data combined with the associated video metadata comprises:

accessing a video frame atom comprising all of the video'"'"'s video frames and one or more headers to organize the video frames;

determining a number of atom bits in the accessed video frame atom; and

generating the extracted data object comprising the extracted video data combined with the determined number of atom bits in an order specified by the identifier generation protocol.

12. The computer-readable medium of claim 2, wherein the instructions further comprise instructions for modifying the video to include an equipment identifier associated with the camera used to capture the video.

13. The computer-readable medium of claim 12, wherein the camera is part of a camera rig comprising a plurality of image sensors mechanically coupled to capture multiple fields of view from the camera rig, wherein the equipment identifier comprises a camera rig identifier of the camera rig.

14. The computer-readable medium of claim 12, wherein the equipment identifier comprises a camera identifier of the camera used to capture the video, and the equipment identifier further comprises a sensor identifier of a metadata sensor communicatively coupled with the camera at a time the video was captured.

15. The computer-readable medium of claim 12, wherein the equipment identifier comprises a camera group identifier of a plurality of cameras in physical proximity while the video was captured, the plurality of cameras including the camera used to capture the video.

16. The computer-readable medium of claim 2, wherein the instructions further comprise instructions for modifying the video to include a shot identifier corresponding to a plurality of videos including the video, the plurality of videos recorded during at least partially overlapping times by a plurality of cameras in physical proximity while the video was captured.

17. The computer-readable medium of claim 2, wherein the instructions further comprise instructions for modifying the video to include an occasion identifier corresponding to a plurality of videos including the video, the plurality of videos grouped as an occasion in response to the plurality of videos being clustered in geographical location of capture and time of capture.

18. The computer-readable medium of claim 2, wherein the instructions further comprise instructions for modifying the video to include a parent media identifier of a parent video from which the video was generated by a video editor.

19. A method of generating a unique media identifier for a video, the method comprising:

receiving a video comprising video frames captured by the camera and audio captured by the camera;

extracting video data corresponding to at least two non-consecutive video frames specified by an identifier generation protocol;

generating an extracted data object comprising the extracted video data combined, according to the identifier generation protocol, with video metadata associated with the accessed video;

generating a unique media identifier by hashing the extracted data object;

modifying the video to include the generated unique media identifier;

transmitting a preview of the video and the generated unique media identifier to a client device; and

transmitting the video to the client device in response to receiving, from the client device, a request comprising the unique media identifier.

20. The method of claim 19, wherein extracting the video data and generating the extracted data object comprise:

accessing first video data corresponding to an initial video frame of the video;

accessing second video data corresponding to a video frame at a predetermined frame number specified by the identifier generation protocol;

accessing third video data corresponding to a last video frame of the video; and

generating the extracted data object by combining the first video data, the second video data, and the third video data into the extracted video data in an order specified by the identifier generation protocol.