Systems and methods for automatically editing a video
First Claim
1. A method for automatically editing a video data sequence to generate a video summary, the method comprising:
- extracting sub-shots from the video data sequence;
calculating importance measures for at least a portion of the sub-shots;
identifying particular ones of the portion that have relatively higher importance measures as compared to importance measures of other sub-shots;
determining a relative distribution of each sub-shot in the particular ones;
based on relative distributions of each sub-shot of the particular ones, dropping sub-shots from the particular ones that do not have a uniform distribution with respect to other sub-shots in the particular ones; and
connecting remaining sub-shots in the particular ones with respective shot transitions to generate the video summary.
2 Assignments
0 Petitions
Accused Products
Abstract
Systems and methods to automatically edit a video to generate a video summary are described. In one aspect, sub-shots are extracted from the video. Importance measures are calculated for at least a portion of the extracted sub-shots. Respective relative distributions for sub-shots having relatively higher importance measures as compared to importance measures of other sub-shots are determined. Based on the determined relative distributions, sub-shots that do not exhibit a uniform distribution with respect to other sub-shots in the particular ones are dropped. The remaining sub-shots are connected with respective transitions to generate the video summary.
-
Citations
54 Claims
-
1. A method for automatically editing a video data sequence to generate a video summary, the method comprising:
-
extracting sub-shots from the video data sequence; calculating importance measures for at least a portion of the sub-shots; identifying particular ones of the portion that have relatively higher importance measures as compared to importance measures of other sub-shots; determining a relative distribution of each sub-shot in the particular ones; based on relative distributions of each sub-shot of the particular ones, dropping sub-shots from the particular ones that do not have a uniform distribution with respect to other sub-shots in the particular ones; and connecting remaining sub-shots in the particular ones with respective shot transitions to generate the video summary. - View Dependent Claims (2, 3)
-
-
4. A computer-readable medium comprising computer-program instructions for automatically editing a video data sequence to generate a video summary, the computer-program instructions being executable by a processor for:
-
extracting sub-shots from the video data sequence; calculating importance measures for at least a portion of the sub-shots; identifying particular ones of the portion that have relatively higher importance measures as compared to importance measures of other sub-shots; determining a relative distribution of each sub-shot in the particular ones; based on relative distributions of each sub-shot of the particular ones, dropping sub-shots from the particular ones that do not have a uniform distribution with respect to other sub-shots in the particular ones; and connecting remaining sub-shots in the particular ones with respective shot transitions to generate the video summary. - View Dependent Claims (5, 6)
-
-
7. A computing device for automatically editing a video data sequence to generate a video summary, the computing device comprising:
-
a processor; and a memory coupled to the processor, the memory comprising computer-program instructions being executable by the processor for; extracting sub-shots from the video data sequence; calculating importance measures for at least a portion of the sub-shots; identifying particular ones of the portion that have relatively higher importance measures as compared to importance measures of other sub-shots; determining a relative distribution of each sub-shot in the particular ones; based on relative distributions of each sub-shot of the particular ones, dropping sub-shots from the particular ones that do not have a uniform distribution with respect to other sub-shots in the particular ones; and connecting remaining sub-shots in the particular ones with respective shot transitions to generate the video summary. - View Dependent Claims (8, 9)
-
-
10. A method for automatically editing a video data sequence with respect to an independent music source, the method comprising:
-
extracting metadata from the video data sequence and the independent music source, the metadata comprising sub-shots and sub-musics; calculating importance measures for at least a portion of the sub-shots; identifying particular ones of the portion that have relatively higher importance measures as compared to importance measures of other sub-shots; identifying respective moods for each of the sub-musics; matching sub-shot motion intensity to sub-music moods to identify particular ones of the sub-shots; aligning the particular ones with corresponding sub-musics; and fusing aligned sub-shots with corresponding sub-musics to generate an auto-edited video. - View Dependent Claims (11, 12, 13, 14, 15, 16, 17, 18, 19, 20)
-
-
21. A computer-readable medium comprising computer-executable instructions for editing a video data sequence with respect to an independent music source, the computer-executable instructions comprising instructions for:
-
extracting metadata from the video data sequence and the independent music source, the metadata comprising sub-shots and sub-musics; calculating importance measures for at least a portion of the sub-shots; identifying particular ones of the portion that have relatively higher importance measures as compared to importance measures of other sub-shots; identifying respective moods for each of the sub-musics; matching respective sub-shot motion intensities to the respective moods to identify particular ones of the sub-shots to align and fuse with the independent music source; aligning the particular ones with corresponding sub-musics; and fusing aligned sub-shots with corresponding sub-musics to generate an auto-edited video. - View Dependent Claims (22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39)
-
-
40. A computing device for editing a video data sequence with respect to an independent music source, the computing device comprising:
-
a processor; and a memory coupled to the processor, the memory comprising computer-program instructions executable by the processor for; extracting metadata from the video data sequence and the independent music source, the metadata comprising sub-shots and sub-musics; calculating importance measures for at least a portion of the sub-shots; identifying particular ones of the portion that have relatively higher importance measures as compared to importance measures of other sub-shots; calculating respective moods for each of the sub-musics based on respective sub-music beats; matching respective sub-shot motion intensities to the respective moods to identify particular ones of the sub-shots to align and fuse with the independent music source; aligning the particular ones with corresponding sub-musics such that the particular ones are uniformly distributed across shots and/or scenes represented by the particular ones; and fusing aligned sub-shots with corresponding sub-musics to generate an auto-edited video. - View Dependent Claims (41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53)
-
-
54. A computing device for editing a video data sequence with respect to an independent music source, the computing device comprising:
-
means for extracting metadata from the video data sequence and the independent music source, the metadata comprising sub-shots and sub-musics; means for calculating importance measures for at least a portion of the sub-shots; means for identifying particular ones of the portion that have relatively higher importance measures as compared to importance measures of other sub-shots; means for calculating respective moods for each of the sub-musics based on respective sub-music beats; means for matching respective sub-shot motion intensities to the respective moods to identify particular ones of the sub-shots to align and fuse with the independent music source; means for aligning the particular ones with corresponding sub-musics such that the particular ones are uniformly distributed across shots and/or scenes represented by the particular ones; and means for fusing aligned sub-shots with corresponding sub-musics to generate an auto-edited video.
-
Specification