Storing a video summary as metadata

• US 9,124,860 B2
• Filed: 08/20/2013
• Issued: 09/01/2015
• Est. Priority Date: 05/25/2010
• Status: Active Grant

• Current Assignee: Monument Peak Ventures, LLC (Dominion Harbor Enterprises, LLC)
• Original Assignee: Intellectual Ventures Fund 83 LLC (Intellectual Ventures LLC)
• Inventors: Deever, Aaron
• Primary Examiner(s): AGGARWAL, YOGESH K
• Application Number:
  US13/970,948
• Publication Number:
  US 20130336633A1
• Time in Patent Office: 742 Days
• Field of Search: 348/222.1, 386/4, 386/52, 386/55, 360/13, 369/83
• US Class Current: 1/1
• CPC Class Codes: G11B 27/10 Indexing; Addressing; Timing or synchronising; Measuring tape travel
• CPC Class Codes: H04N 9/87 Regeneration of colour television signals H04N9/80 takes precedence

Abstract

A method for storing a video summary for a digital video sequence captured with a digital video capture device, comprising: capturing a digital video sequence with the digital video capture device, wherein the digital video sequence includes a plurality of video frames; storing the digital video sequence in a processor-accessible memory; identifying one or more key video snippets, each key video snippet corresponding to a set of video frames from the stored digital video sequence; assembling the key video snippets to form a video summary; and storing the video summary in a processor-accessible memory by storing metadata associated with the stored digital video sequence, wherein the metadata provides an indication of the video frames corresponding to the video summary.

Claims

1. A method comprising:

capturing a video sequence with a video capture device, wherein the video sequence includes a plurality of video frames;

storing the video sequence in a processor-accessible memory;

identifying, using a processor, one or more key video snippets, to extract feature values from the stored video sequence without decompressing video frames of the stored video sequence, wherein each key video snippet corresponds to a set of video frames from the stored video sequence;

assembling the one or more key video snippets to form a video summary;

representing the video summary as metadata, wherein the metadata includes frame identification metadata providing an indication of the video frames in the video sequence corresponding to the video summary; and

storing the metadata representing the video summary in the processor-accessible memory in association with the stored video sequence.

2. The method of claim 1, further comprising re-sampling video frames to produce extracted video frames at different spatial resolution prior to compressing the video frames and forming a compressed video summary.

3. The method of claim 1, wherein the stored metadata representing the video summary also provides an indication of audio samples corresponding to the video summary.

4. The method of claim 3, further comprising extracting from the stored video sequence the audio samples corresponding to the video summary.

5. The method of claim 1, wherein the stored metadata representing the video summary includes metadata providing an indication of audio transition effects applied at boundaries between the one or more key video snippets.

6. A system comprising:

a display for viewing video frames; and

a processor configured to;

read metadata associated with a stored video sequence, wherein the metadata stores a representation of a video summary, the metadata including frame identification metadata providing an indication of video frames in the video sequence corresponding to the video summary;

extract from the stored video sequence the video frames corresponding to the video summary without decompressing video frames of the stored video sequence;

display the video frames corresponding to the video summary on the display.

7. The system of claim 6, wherein the processor is further configured to re-sample the video frames to produce extracted video frames at different spatial resolution prior to compressing the video frames and form a compressed video summary.

8. The system of claim 6, wherein the metadata representing the video summary includes metadata providing an indication of the audio samples corresponding to the video summary.

9. The system of claim 8, wherein the processor is further configured to extract from the stored video sequence the audio samples corresponding to the video summary.

10. The system of claim 6, wherein the metadata representing the video summary includes metadata providing an indication of video transition effects for the video summary.

11. The system of claim 6, wherein the processor is further configured to apply video transition effects to the video frames prior to display.

12. The system of claim 6, wherein the metadata representing the video summary is stored in a same file as the stored video sequence.

13. The system of claim 6, wherein the metadata representing the video summary is stored in a separate file from the stored video sequence.

14. An article of manufacture including a non-transitory computer readable medium having instructions stored thereon that, if executed by a computing device, cause the computing device to perform operations comprising:

capturing a video sequence with a video capture device, wherein the video sequence includes a plurality of video frames;

storing the video sequence in a processor-accessible memory;

identifying, using a processor, one or more key video snippets, to extract feature values from the stored video sequence without decompressing video frames of the stored video sequence, wherein each key video snippet corresponds to a set of video frames from the stored video sequence;

assembling the one or more key video snippets to form a video summary;

representing the video summary as metadata, wherein the metadata includes frame identification metadata providing an indication of the video frames in the video sequence corresponding to the video summary; and

storing the metadata representing the video summary in the processor-accessible memory in association with the stored video sequence.

15. The article of manufacture of claim 14, further comprising re-sampling video frames to produce extracted video frames at different spatial resolution prior to compressing the video frames and forming a compressed video summary.

16. The article of manufacture of claim 14, wherein the stored metadata representing the video summary also provides an indication of the audio samples corresponding to the video summary.

17. The article of manufacture of claim 14, wherein the stored metadata representing the video summary includes metadata providing an indication of audio transition effects applied at boundaries between the one or more key video snippets.

18. The article of manufacture of claim 14, wherein the metadata representing the video summary includes metadata providing an indication of video transition effects for the video summary.

19. The article of manufacture of claim 14, further comprising applying video transition effects to the video frames prior to display.

20. The article of manufacture of claim 14, wherein the metadata representing the video summary is stored in a same file as the stored video sequence.