Visual indexing system
First Claim
1. A system for creating a visual index for source video, comprising:
- a frame grabber for extracting frames from the source video;
a DCT macroblock creator for converting the frames into macroblocks of DCT coefficients;
a significant scene processor for detecting significant scenes and for selecting a keyframe for each detected significant scene, based on the macroblocks of DCT coefficients;
a keyframe filterer for filtering of the selected keyframes to create a visual index; and
a storage medium for storing the visual index.
2 Assignments
0 Petitions
Accused Products
Abstract
A video indexing system analyzes contents of source video and develops a visual table of contents using selected images. The source video is analyzed to detect video cuts from one scene to another, and static scenes. Keyframes are selected for each significant scene. A keyframe filtering process filters out less desired frames including, for example, unicolor frames, or those frames having a same object as a primary focus or one primary focuses. A visual index is created from those frames remaining after the keyframe filtering and stored for retrieval. The visual index may be retrieved by a user who may then display the visual index on a display. The user may select one of the frames displayed in the visual index and the source video may be manually (by the user) or automatically advanced to that frame of the source video. Additionally, a user may print the visual index.
116 Citations
21 Claims
-
1. A system for creating a visual index for source video, comprising:
-
a frame grabber for extracting frames from the source video; a DCT macroblock creator for converting the frames into macroblocks of DCT coefficients; a significant scene processor for detecting significant scenes and for selecting a keyframe for each detected significant scene, based on the macroblocks of DCT coefficients; a keyframe filterer for filtering of the selected keyframes to create a visual index; and a storage medium for storing the visual index. - View Dependent Claims (2, 3, 4, 14)
-
-
5. A system for creating a visual index for source video comprising:
-
a frame grabber for extracting frames from the source video; a DCT macroblock creator for converting the frames into macroblocks of DCT coefficients; a keyframe filterer for filtering the frames, based on the macroblocks of DCT coefficients, to create a visual index; and a storage medium for storing the visual index, further comprising a significant scene processor adapted to detect static scenes.
-
-
6. A system for creating a visual index for source video, comprising:
-
a frame grabber for extracting frames from the source video; a DCT macroblock creator for converting the frames into macroblocks of DCT coefficients; a keyframe filterer for filtering the frames, based on the macroblocks of DCT coefficients, to create a visual index; and a storage medium for storing the visual index, wherein said keyframe filterer filters out unicolor frames.
-
-
7. A system for creating a visual index for source video, comprising:
-
a frame grabber for extracting frames from the source video; a DCT macroblock creator for converting the frames into macroblocks of DCT coefficients; a keyframe filterer for filtering the frames, based on the macroblocks of DCT coefficients, to create a visual index; and a storage medium for storing the visual index, wherein said keyframe filterer filters out keyframes which have a same object as a primary focus or one of the primary focuses of an image. - View Dependent Claims (15)
-
-
8. A system for creating a visual index for compressed source video, comprising:
-
a decoder for converting the compressed source video into frames and DCT macroblocks; a significant scene processor for detecting significant scenes and selecting keyframes, based on the frames and the DCT macroblocks; a keyframe filterer for filtering the keyframes, based on the macroblocks of DCT coefficients, to create a visual index; and a storage medium for storing the visual index. - View Dependent Claims (9, 10, 11, 16)
-
-
12. A system for video archival and retrieval, comprising:
-
video archival apparatus for creating a visual index of key frames based on stored or concurrently recorded source video; and video retrieval apparatus for retrieving the visual index for at least one of display on a display, manual or automatic forwarding to a key frame, and printing of the visual index, wherein video archival apparatus comprises; a significant scene processor for detecting significant scene and selecting keyframes to represent the significant scenes; and a keyframe filterer for filtering the keyframes to create the visual index. - View Dependent Claims (13)
-
-
17. A method for creating a visual index for source video comprising:
-
extracting frames from the source video; detecting significant scenes and a respective keyframe for each detected significant scene; filtering out some keyframes that are associated with significant scenes to create a visual index; embodying the visual index in a machine readable medium. - View Dependent Claims (18, 19, 20, 21)
-
Specification