Video summarization apparatus and method
First Claim
1. A video summarization apparatus comprising:
- a first memory to store video data including video and audio;
a second memory to store a plurality of metadata items corresponding to a plurality of video segments included in the video data respectively, each of the metadata items including a keyword and characteristic information of content of corresponding video segment;
a selecting unit configured to select metadata items each including a specified keyword from the metadata items, to obtain selected metadata items;
a first extraction unit configured to extract, from the video data, video segments corresponding to the selected metadata items, to obtain extracted video segments;
a generation unit configured to generate summarized video data by connecting extracted video segments in time series;
a detection unit configured to detect a plurality of audio breakpoints included in the video data, to obtain a plurality of audio segments segmented by the audio breakpoints;
a second extraction unit configured to extract, from the video data, audio segments corresponding to the extracted video segments as audio narrations, to obtain extracted audio segments; and
a modifying unit configured to modify an ending time of a video segment in the summarized video data so that the ending time of the video segment in the summarized video data coincides with or is later than an ending time of corresponding audio segment of the extracted audio segments.
1 Assignment
0 Petitions
Accused Products
Abstract
A video summarization apparatus stores, in memory, video data including video and audio, and metadata items corresponding to video segments included in the video data respectively, each of metadata items including keyword and characteristic information of content of corresponding video segment, selects metadata items including specified keyword from metadata items, to obtain selected metadata items, extracts, from video data, video segment corresponding to selected metadata items, to obtain selected video segments, generates summarized video data by connecting extracted video segments, detects audio breakpoints included in video data, to obtain audio segments segmented by audio breakpoints, extracts from video data, audio segments corresponding to extracted video segments as audio narrations, and modifies ending time of video segment in summarized video data so that ending time of video segment in summarized video data coincides with or is later than ending time of corresponding audio segment of extracted audio segments.
-
Citations
17 Claims
-
1. A video summarization apparatus comprising:
-
a first memory to store video data including video and audio;
a second memory to store a plurality of metadata items corresponding to a plurality of video segments included in the video data respectively, each of the metadata items including a keyword and characteristic information of content of corresponding video segment;
a selecting unit configured to select metadata items each including a specified keyword from the metadata items, to obtain selected metadata items;
a first extraction unit configured to extract, from the video data, video segments corresponding to the selected metadata items, to obtain extracted video segments;
a generation unit configured to generate summarized video data by connecting extracted video segments in time series;
a detection unit configured to detect a plurality of audio breakpoints included in the video data, to obtain a plurality of audio segments segmented by the audio breakpoints;
a second extraction unit configured to extract, from the video data, audio segments corresponding to the extracted video segments as audio narrations, to obtain extracted audio segments; and
a modifying unit configured to modify an ending time of a video segment in the summarized video data so that the ending time of the video segment in the summarized video data coincides with or is later than an ending time of corresponding audio segment of the extracted audio segments. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13)
-
-
14. A video summarization method including:
-
storing video data including video and audio in a first memory;
storing, in a second memory, a plurality of metadata items corresponding to a plurality of video segments included in the video data respectively, each of the metadata items including a keyword and characteristic information of content of corresponding video segment;
selecting metadata items each including a specified keyword from the metadata items, to obtain selected metadata items;
extracting, from the video data, video segments corresponding to the selected metadata items, to obtain selected video segments;
generating summarized video data by connecting the extracted video segments in time series;
detecting a plurality of audio breakpoints included in the video data, to obtain a plurality of audio segments segmented by the audio breakpoints;
extracting, from the video data, audio segments corresponding to the extracted video segments as audio narrations; and
modifying an ending time of a video segment in the summarized video data so that the ending time of the video segment in the summarized video data coincides with or is later than an ending time of corresponding audio segment of the extracted audio segments. - View Dependent Claims (15, 16, 17)
-
Specification