Detection of Motion Activity Saliency in a Video Sequence
First Claim
1. A method comprising:
- generating, using a processor, a motion vector field including a motion vector for each of a plurality of pixels in a video;
partitioning the motion vector field into a plurality of grid blocks;
binning motion vectors assigned to each of the plurality of grid blocks into a plurality of orientation ranges; and
calculating, using the processor, a motion score based on a count of motion vectors for at least one of the orientation ranges.
1 Assignment
0 Petitions
Accused Products
Abstract
A streaming video or a stored video is analyzed to identify salient features. The salient features are the more interesting portions of the video because salient features include the most motion. A motion vector field including a motion vector for multiple pixels in the video is generated. The motion vector field is partitioned into grid blocks, and each of the grid blocks is divided into a set of orientation ranges. The vectors of the motion vector field for each grid block are binned into the orientation ranges. A motion score is calculated based on a count of motion vectors for the orientation ranges. The section of the video having higher or the highest motion score is designated as a salient feature. Among other applications, salient features may be used for thumbnail images, highlight reels, or video editing.
28 Citations
20 Claims
-
1. A method comprising:
-
generating, using a processor, a motion vector field including a motion vector for each of a plurality of pixels in a video; partitioning the motion vector field into a plurality of grid blocks; binning motion vectors assigned to each of the plurality of grid blocks into a plurality of orientation ranges; and calculating, using the processor, a motion score based on a count of motion vectors for at least one of the orientation ranges. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9)
-
-
10. An apparatus comprising:
-
at least one processor; and at least one memory including computer program code for one or more programs;
the at least one memory and the computer program code configured to, with the at least one processor, cause the apparatus to at least perform;calculating motion vector fields for time ranges in a video, wherein each of the motion vector fields includes motion vectors that describe movement of pixels in the video; sorting the motion vectors into a plurality of orientation ranges; performing a comparison of the motion vectors in pairs of subsequent time ranges; and calculating a motion score for each pair of subsequent time ranges based on the comparison. - View Dependent Claims (11, 12, 13, 14, 15, 16, 17)
-
-
18. A non-transitory computer readable medium including instructions that when executed are operable to:
-
collect a video comprising a series of video images; perform a comparison of motion scores for the series of video images, wherein the motion scores are calculated from motion vectors for tracking movement in the series of video images that are organized by orientation; and select one or more of the video images to represent the video based on the comparison of the motion scores. - View Dependent Claims (19, 20)
-
Specification