Techniques for constructing and browsing a hierarchical video structure
First Claim
1. A method of constructing and/or browsing a hierarchical representation of a content of a video, comprising:
- providing a content hierarchy module representing relationships between segments, sub-segments and shots of a video;
providing a visual content of a segment of current interest module representing visual information for a selected segment within the hierarchy;
providing a visual overview of a sequential content structure module;
providing a unified interaction module for coordinating the function of the content hierarchy module, the visual content of a segment module, and the visual overview of a sequential content structure module, and propagating any request of a module to others; and
providing a graphical user interface (GUI) screen for simultaneously showing the content hierarchy module, the visual content of a segment module, and the visual overview of a sequential content structure module.
2 Assignments
0 Petitions
Accused Products
Abstract
Techniques for providing an intuitive methodology for a user to control the process of constructing and/or browsing a semantic hierarchy of a video content with a computer controlled graphical user interface by utilizing a tree view of a video, a list view of a current segment, a view of visual rhythm and a view of hierarchical status bar. A graphical user interface (GUI) is used for constructing and browsing a hierarchical video structure. The GUI allows the easier video browsing of the final hierarchical video structure as well as the efficient construction or modeling of the intermediate hierarchies into the final one. The modeling can be done manually, automatically or semi-automatically. Especially during the process of manual or semi-automatic modeling, the convenient GUI increases the speed of the construction process, allowing the quick mechanism for checking the current status of intermediate hierarchies being constructed. The GUI also provides a set of modeling operations that allow the user to manually transform an initial sequential structure or any unwanted hierarchical structure into a desirable hierarchical structure in an instant. The GUI further provides a method for constructing the hierarchical video structure semi-automatically by applying the automatic semantic clustering and the manual modeling operations in any order.
384 Citations
27 Claims
-
1. A method of constructing and/or browsing a hierarchical representation of a content of a video, comprising:
-
providing a content hierarchy module representing relationships between segments, sub-segments and shots of a video;
providing a visual content of a segment of current interest module representing visual information for a selected segment within the hierarchy;
providing a visual overview of a sequential content structure module;
providing a unified interaction module for coordinating the function of the content hierarchy module, the visual content of a segment module, and the visual overview of a sequential content structure module, and propagating any request of a module to others; and
providing a graphical user interface (GUI) screen for simultaneously showing the content hierarchy module, the visual content of a segment module, and the visual overview of a sequential content structure module. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10)
-
-
11. A graphical user interface (GUI) for constructing and/or browsing a hierarchical representation of a content of a video, comprising:
-
means for showing a status of a content hierarchy, by which a user is able to see a current graphical tree structure the hierarchical representation being built, and to visually check the content of a video segment of current interest as well as the contents of the segment'"'"'s sub-segments;
means for showing the status of the video segment of current interest;
means for showing the status of a visual overview of a sequential content structure, including a visual pattern of the sequential structure, for providing both shot contents and positional information of shot boundaries, and for providing time scale information implicitly through the widths of the visual pattern, and for quickly verifying the video content, segment-by-segment, without repeatedly playing each video segment, and for finding a specific part of interest or identifying separate semantic units in order to define the video segments and their sub-segments by quickly skimming through the video content without playback;
means for displaying a visual representation of a nested relationship of the video segments and their relative temporal positions and durations, and for providing the user with an intuitive representation of a nested structure and related temporal information of the video segments; and
means for displaying results of a content-based key frame search. - View Dependent Claims (12, 13, 14)
-
-
15. A method for constructing or editing a hierarchical representation of a content of a video, said video comprising a plurality of shots, comprising:
-
providing automatic semantic clustering;
providing manual modeling operations;
providing manual shot verification/validation operations; and
interleaving the manual and automatic methods in any order, and applying them as many times as a user wants. - View Dependent Claims (16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27)
-
Specification