Time-based video metadata system

• US 10,491,968 B2
• Filed: 10/27/2011
• Issued: 11/26/2019
• Est. Priority Date: 10/27/2011
• Status: Active Grant

• Current Assignee: Eco Digital, LLC
• Original Assignee: Eco Digital, LLC
• Inventors: Ryer, Mat, Jackson, Phil
• Primary Examiner(s): Vaughn, Jr., William C
• Assistant Examiner(s): Tekle, Daniel T
• Application Number:
  US13/283,100
• Publication Number:
  US 20130108239A1
• Time in Patent Office: 2,952 Days
• Field of Search: 386241
• CPC Class Codes: H04N 21/47205 for manipulating displayed content, e.g. interacting with MPEG-4 objects, editing locally
• CPC Class Codes: H04N 21/4755 for defining user preferences, e.g. favourite actors or genre retrieval personalisation and generation of user profiles for the retrieval of video data G06F16/739; user profiles in network data switching protocols H04L67/306
• CPC Class Codes: H04N 21/84 Generation or processing of descriptive data, e.g. content descriptors systems specially adapted for using meta-information in broadcast systems H04H60/73
• CPC Class Codes: H04N 21/8456 by decomposing the content in the time domain, e.g. in time segments
• CPC Class Codes: H04N 21/8549 Creating video summaries, e.g. movie trailer retrieval in video databases by using presentations in form of a video summary G06F16/739

Abstract

A video display device comprising a video source and a video playback mechanism. The video source comprises a plurality of time-based metadata. The video playback mechanism uses at least one of the plurality of time-based metadata to display at least one of the video source, and one or more menu options.

Claims

1. A video display device comprising:

a digital file comprising a video source and time based metadata, wherein the time-based metadata corresponds to one or more menu options, and each menu option corresponds to one or more objects, events, or persons present in a scene of the video source at one or more timestamps indicated by the time-based metadata; and

a video playback mechanism that identifies and displays at least a portion of the video source according to a first-selected one or more of the menu options, the video playback mechanism adapted, during playback of the at least a portion of the video source, to;

display each of the one or more menu options as its corresponding one or more objects, events, or persons is displayed;

receive a second selection of one of the displayed menu options; and

maintain and display a link in a follow-up list, the link adapted to provide additional information relating to a topic associated with the second-selected menu option.

2. The video display device of claim 1 wherein, the video playback mechanism,

comprises a user-interface comprising the one or more menu options;

and

is adapted to provide an automated review of at least a portion of the time-based metadata.

3. The video display device of claim 2 wherein,

the one or more menu options comprises at least one or more first menu options;

and further comprising,

one or more additional menu options corresponding to,

at least a portion of the time-based metadata, and

the at least one or more first menu options.

4. The video display device of claim 3 wherein,

the one or more additional menu options comprise at least one first additional menu option and at least one second additional menu option;

and

the at least one second additional menu option corresponds to at least one of the at least one first additional menu option and is adapted to display at least a portion of the video source.

5. The video display device of claim 3 wherein the display of at least a portion of the video source corresponds to,

the at least one or more first menu items;

and

the one or more additional menu options.

6. The video display device of claim 1 wherein, the time-based metadata, comprises information related to the video source;

and corresponds to a plurality of timestamps in the video source.

7. The video display device of claim 6 wherein the plurality of timestamps comprises:

a starting timestamp for one or more scenes including at least one of the one or more objects, the one or more events, or the one or more persons in the video source, and

an ending timestamp for one or more scenes including at least one the one or more objects, the one or more events, or the one or more persons in the video source.

8. The video display device of claim 1 wherein, the one or more menu items comprise one or more display restrictions.

9. The video display device of claim 8, wherein, the one or more display restrictions comprise age restrictions.

10. The video display device of claim 1 wherein, the one or more menu items are one of displayed and selected by choosing one of a person, event, and object in the video source.

11. A method of displaying at least a portion of one or more videos comprising:

identifying, in a digital file comprising a video source and time-based metadata, a set of one or more objects, one or more events, or one or more persons present in the video source at one or more timestamps indicated by the time-based metadata;

associating one or more menu option in a user interface with at least one of the set of objects, events, or persons;

reviewing the time-based metadata in response to a first selection of the one or more menu options;

displaying one or more sections of the video source comprising the associated at least one of the set of objects, events, or persons according to the time-based metadata; and

during playback of the one or more sections of the video source;

displaying each of the one or more menu options as its corresponding one or more objects, events, or persons is displayed;

receiving a second selection of one of the displayed menu options; and

maintaining and displaying a link in a follow-up list, the link adapted to provide additional information relating to a topic associated with the second-selected menu option.

12. The method of claim 11 wherein,

the reviewing comprises determining a starting timestamp and an ending timestamp for the one or more sections of the video source;

and

the displaying comprises displaying one or more sections of the video source beginning at the starting timestamp for one of the one or more sections of the video source and ending at the ending timestamp for one of the one or more sections of the video source.

13. The method of claim 12 wherein,

the one or more menu options comprises a first list of the at least one of the one or more objects, one or more events, and one or more persons;

and

further comprising,

selecting at least one of the one or more objects, one or more events, and

one or more persons from the first list of the at least one of the one or more objects, one or more events, and one or more persons prior to reviewing time-based metadata in the video source;

displaying a second list of at least one of the one or more objects, one or more events, and one or more persons, the second list corresponding to at least one of a selected one or more objects, one or events, and one or more persons prior to the displaying one or more sections of the video source; and

selecting an item from the second list of at least one of the one or more objects, one or more events, and one or more persons prior to the displaying one or more sections of the video source.

14. The method of claim 11 further comprising,

displaying the one or more sections of video source substantially simultaneously as reviewing time-based metadata in the video source;

and

displaying one or more real-time menu options, wherein the one or more real-time menu options correspond to one or more objects, one or more events, or one or more persons being displayed in the one or more sections of the video.

15. The method of claim 14 further comprising,

choosing at least one of the one or more real-time menu options;

and

saving the at least one of the one or more real-time menu options.

16. The method of claim 11,

further comprising, inputting the time-based metadata to the video source;

and

wherein, reviewing time-based metadata in the video source comprises determining when the one or more objects are present in the video.

17. A video display system comprising:

a digital file comprising a video source and a plurality of time-based metadata, the plurality of time-based metadata corresponding to a set of content in the video source, each of the set of the content comprising at least one object, event, or person present in the video source at one or more timestamps indicated by the time-based metadata;

a network device adapted to provide at least a portion of the video source based on at least one starting timestamp of the time-based metadata, and ending timestamp of the time-based metadata; and

a video display device comprising a user interface, the user interface comprising one or more menu items, wherein;

each of the one or more menu items corresponds to one or more of the set of content,

the video display device is adapted to receive the at least a portion of the video source in response to receiving a first selection of one or more of the menu items, such that the starting timestamp and the ending timestamp corresponds to presence of the associated content in the video source,

the video display device is adapted to display the at least a portion of the video source, and

during playback of the at least a portion of the video source, video display device is adapted to;

display each of the one or more menu options as its corresponding one or more objects, events, or persons is displayed;

receive a second selection of one of the displayed menu options; and

maintain and display a link in a follow-up list, the link adapted to provide additional information relating to a topic associated with the second-selected menu option.

18. The video display system of claim 17 wherein the at least a portion of the video source comprises at least a portion of a plurality of video sources.

19. The video display system of claim 17 further comprising,

a video source metadata input device;

a video selection mechanism providing a plurality of options for viewing one or more sections of the video source, the video selection mechanism using the video source metadata in obtaining the one or more sections of the video source; and

wherein,

the video display device displays the one or more sections of the video source.

20. The video system of claim 19 wherein,

the plurality of time-based metadata comprises information associated with the video source;

and

the video source metadata input device provides,

manually input metadata, and

automatically input metadata.

21. The video system of claim 20 wherein, an object recognition device provides information to automatically input the metadata.

22. The video display system of claim 17 wherein,

the video source comprises a first video source;

further comprising a second video source; and

wherein, the user interface is adapted to enable a user to create a compilation video comprising a portion of the first video source and the second video source.

23. The video display system of claim 22 wherein, the compilation video is displayed beginning at the starting timestamp for a first video section of the first video source and ending at the ending timestamp for a second video section of the second video source.