Method and system for video indexing and video synopsis
First Claim
1. A method for generating a synopsis video from a substantially endless source video stream as generated by a video surveillance camera, the method comprising:
- receiving in real time object-based descriptions of at least three different source objects in said source video stream, each source object being a connected subset of image points from at least three different frames of the source video stream;
continuously maintaining a queue of said received object-based descriptions including for each respective source object its duration and location;
selecting a subset of at least three source objects from said queue based on given criteria, and sampling from each selected source object one or more synopsis objects by temporal sampling;
determining for each synopsis object a respective display time for starting its display in the synopsis video; and
generating the synopsis video by displaying selected synopsis objects or objects derived therefrom each at its respective predetermined display time;
such that at least three points, each derived from different respective times in the source video stream, are displayed simultaneously in the synopsis video and at least two points, both derived from the same time, are displayed at different times in the synopsis video.
2 Assignments
0 Petitions
Accused Products
Abstract
In a system and method for generating a synopsis video from a source video, at least three different source objects are selected according to one or more defined constraints, each source object being a connected subset of image points from at least three different frames of the source video. One or more synopsis objects are sampled from each selected source object by temporal sampling using image points derived from specified time periods. For each synopsis object a respective time for starting its display in the synopsis video is determined, and for each synopsis object and each frame a respective color transformation for displaying the synopsis object may be determined. The synopsis video is displayed by displaying selected synopsis objects at their respective time and color transformation, such that in the synopsis video at least three points that each derive from different respective times in the source video are displayed simultaneously.
-
Citations
37 Claims
-
1. A method for generating a synopsis video from a substantially endless source video stream as generated by a video surveillance camera, the method comprising:
-
receiving in real time object-based descriptions of at least three different source objects in said source video stream, each source object being a connected subset of image points from at least three different frames of the source video stream; continuously maintaining a queue of said received object-based descriptions including for each respective source object its duration and location; selecting a subset of at least three source objects from said queue based on given criteria, and sampling from each selected source object one or more synopsis objects by temporal sampling; determining for each synopsis object a respective display time for starting its display in the synopsis video; and generating the synopsis video by displaying selected synopsis objects or objects derived therefrom each at its respective predetermined display time; such that at least three points, each derived from different respective times in the source video stream, are displayed simultaneously in the synopsis video and at least two points, both derived from the same time, are displayed at different times in the synopsis video. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26)
-
-
27. A system for generating a synopsis video from a substantially endless a source video stream as generated by a surveillance camera, the system comprising:
-
a source object selector adapted to be coupled to an object memory that stores a continuously maintained queue of object-based descriptions of at least three different source objects in said source video stream, said object-based descriptions including for each respective source object its duration and location, the source object selector being adapted to select at least three different source objects according to one or more defined constraints, each source object being a connected subset of image points from at least three different frames of the source video stream; a synopsis object sampler coupled to the source object selector for sampling from each selected source object one or more synopsis objects by temporal sampling using image points derived from specified time periods; a time selection unit coupled to the synopsis object sampler for determining for each synopsis object a respective display time for starting its display in the synopsis video; a stitching unit coupled to the time selection unit for stitching each of the selected synopsis objects or objects derived therefrom at a respective display time so as to generate successive synopsis video frames, such that in the synopsis video frames at least three points that each derive from different respective times in the source video stream are displayed simultaneously; and a synopsis frame memory coupled to the stitching unit for storing said synopsis video frames. - View Dependent Claims (28, 29, 30, 31, 32, 33, 34, 35, 36)
-
-
37. A computer program product for generating a synopsis video from a substantially endless a source video stream as generated by a surveillance camera, the computer program product comprising:
-
a non-transitory readable computer medium having computer readable program embodied therewith, the computer readable program comprising; computer readable program configured to store continuously maintained queue of object-based descriptions of at least three different source objects in said source video stream, said object-based descriptions including for each respective source object its duration and location, the source object selector being adapted to select at least three different source objects according to one or more defined constraints, each source object being a connected subset of image points from at least three different frames of the source video stream; computer readable program configured to sample from each selected source object one or more synopsis objects by temporal sampling using image points derived from specified time periods; computer readable program configured to determine for each synopsis object a respective display time for starting its display in the synopsis video; computer readable program configured to stitch each of the selected synopsis objects or objects derived therefrom at a respective display time so as to generate successive synopsis video frames, such that in the synopsis video frames at least three points that each derive from different respective times in the source video stream are displayed simultaneously; and computer readable program configured to store said synopsis video frames.
-
Specification