Content-based characterization of video frame sequences
First Claim
1. A computer-implemented process for characterizing a sequence of video frames, comprising:
- using a computer to perform the following process actions,deriving from the sequence of video frames comprising motion vector data, a separate value indicative of the intensity of the motion depicted over the sequence in a plurality of frame regions, said deriving comprising,inputting a number of frames in shot sequence order,extracting and storing motion vector data from the inputted frames, andcomputing a separate value indicative of the intensity of the motion depicted over the sequence for each of said frame regions based on the motion vector data; and
generating an image wherein each pixel of the image has a value indicating the intensity of the motion, relative to all such values, associated with the region containing a corresponding pixel location.
1 Assignment
0 Petitions
Accused Products
Abstract
A system and process for video characterization that facilitates video classification and retrieval, as well as motion detection, applications. This involves characterizing a video sequence with a gray scale image having pixel levels that reflect the intensity of motion associated with a corresponding region in the sequence of video frames. The intensity of motion is defined using any of three characterizing processes. Namely, a perceived motion energy spectrum (PMES) characterizing process that represents object-based motion intensity over the sequence of frames, a spatio-temporal entropy (STE) characterizing process that represents the intensity of motion based on color variation at each pixel location, a motion vector angle entropy (MVAE) characterizing process which represents the intensity of motion based on the variation of motion vector angles.
24 Citations
8 Claims
-
1. A computer-implemented process for characterizing a sequence of video frames, comprising:
using a computer to perform the following process actions, deriving from the sequence of video frames comprising motion vector data, a separate value indicative of the intensity of the motion depicted over the sequence in a plurality of frame regions, said deriving comprising, inputting a number of frames in shot sequence order, extracting and storing motion vector data from the inputted frames, and computing a separate value indicative of the intensity of the motion depicted over the sequence for each of said frame regions based on the motion vector data; and generating an image wherein each pixel of the image has a value indicating the intensity of the motion, relative to all such values, associated with the region containing a corresponding pixel location. - View Dependent Claims (2, 3)
-
4. A system for finding one or more video shots in a database, each of which comprises a sequence of video frames which depict motion similar to that specified by a user in a user query, comprising:
-
a general purpose computing device; the database which is accessible by the computing device and which comprises, a plurality of characterizing images each of which represents a shot, wherein a shot comprises a sequence of frames of a video that have been captured contiguously and which represent a continuous action in time or space, and wherein each characterizing image is an image comprising pixels each having a level reflecting value indicating the intensity of the motion associated with a corresponding region in the sequence of video frames containing the pixel; a computer program comprising program modules executable by the computing device, wherein the computing device is directed by the program modules of the computer program to, input the user query which comprises a characterizing image that characterizes motion in the same manner as at least some of the characterizing images contained in the database, and compare the user query image to characterizing images contained in the database that characterize motion in the same manner as the user query image to find characterizing images that exhibit a degree of similarity equaling or exceeding a minimum similarity threshold. - View Dependent Claims (5, 6, 7, 8)
-
Specification