Rule-based video importance analysis
First Claim
1. One or more computer storage media storing computer-executable instructions that are executable to cause one or more processors to perform acts comprising:
- decoding a video file to obtain at least one of a video frame or audio data associated with the video frame;
analyzing one or more high-level features of the at least one of the video frame or the audio data associated with the video frame based on at least one of a local rule or a global rule to obtain one or more feature scores for the video frame, the one or more high-level features including at least one feature that is related to a movement or a position of a human face in the video frame;
combining the one or more feature scores of the video frame to derive a frame importance score for the video frame; and
segmenting the video file into video sections of different section importance values based at least on the frame importance scores of the video frame and other frame importance scores of additional video frames of the video file.
2 Assignments
0 Petitions
Accused Products
Abstract
The importance of video sections of a video file may be determined from features of the video file. The video file may be decoded to obtain video frames and audio data associated with the video frames. Feature scores for each video frame may be obtained by analyzing features of the video frame or the audio data associated with the video frame based on a local rule, a global rule, or both. The feature scores are further combined to derive a frame importance score for the video frame. Based on the feature scores of the video frames in the video file, the video file may be segmented into video sections of different section importance values.
-
Citations
20 Claims
-
1. One or more computer storage media storing computer-executable instructions that are executable to cause one or more processors to perform acts comprising:
-
decoding a video file to obtain at least one of a video frame or audio data associated with the video frame; analyzing one or more high-level features of the at least one of the video frame or the audio data associated with the video frame based on at least one of a local rule or a global rule to obtain one or more feature scores for the video frame, the one or more high-level features including at least one feature that is related to a movement or a position of a human face in the video frame; combining the one or more feature scores of the video frame to derive a frame importance score for the video frame; and segmenting the video file into video sections of different section importance values based at least on the frame importance scores of the video frame and other frame importance scores of additional video frames of the video file. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10)
-
-
11. A computer-implemented method, comprising:
-
decoding a video file to obtain at least one of a video frame or audio data associated with the video frame; analyzing one or more features of at least one of the video frame or the audio data associated with the video frame based on at least one of a local rule or a global rule to obtain one or more feature scores for the video frame; combining the one or more feature scores of the video frame to derive a frame importance score for the video frame; calculating a video importance value for the video file based at least on the frame importance scores of the video frame and other frame importance scores of additional video frames of the video file; segmenting the video file into video sections of different section importance based at least on the frame importance scores of video frames in the video file data associated with a plurality of video frames in the video file; and ranking the video file relative to additional video files based at least on video importance values of the video file and other video importance values of the additional video files. - View Dependent Claims (12, 13, 14, 15, 16)
-
-
17. A system, comprising:
-
one or more processors; a memory that includes a plurality of computer-executable components that are executable by the one or more processors to perform a plurality of actions, the plurality of actions comprising; decoding a video file to obtain at least one of a video frame or audio data associated with the video frame; analyzing one or more features of the at least one of the video frame or the audio data associated with the video frame based on at least one of a local rule or a global rule to obtain one or more feature scores for the video frame, the local rule affects an assignment of feature importance for the video frame and the global rule affects the assignment of feature importance for multiple video frames in the video file that includes the video frame; combining the one or more feature scores of the video frame to derive a frame importance score for the video frame; segmenting the video file into video sections of different section importance based at least on the frame importance scores of video frames in the video file associated with a plurality of video frames in the video file; and ranking the video sections according section importance values of the video sections that are calculated based at least on the frame importance scores of the video frame and the additional video frames in the video file. - View Dependent Claims (18, 19, 20)
-
Specification