Wide-area site-based video surveillance system
First Claim
1. A computer-readable medium containing software that, when read by a computer, causes the computer to perform a method for wide-area site-based surveillance, the method comprising:
- receiving surveillance data, including view targets, from a plurality of sensors at a site;
synchronizing said surveillance data to a single time source;
maintaining a site model of the site, wherein said site model comprises a site map, a human size map, and a sensor network model;
analyzing said synchronized data using said site model to determine if said view targets represent a same physical object in the site;
creating a map target corresponding to a physical object in the site, wherein said map target includes at least one view target;
receiving a user-defined global event of interest, wherein said user-defined global event of interest is based on said site map and based on a set of rules;
detecting said user-defined global event of interest in real time based on a behavior of said map target; and
responding to said detected event of interest according to a user-defined response to said user-defined global event of interest,wherein said analyzing further comprises;
updating existing view targets with new size, location and appearance information;
determining if a new view target corresponds to an existing map target by comparing location information; and
comparing appearances, wherein each view target includes an appearance model that includes a distributed intensity histogram, and wherein comparing appearances comprises;
determining an average correlation between said distributed intensity histograms for each of said view targets and said map targets;
merging said new view target into said existing map target, if said new view target corresponds to said existing map target, and updating said existing map target with said new view target;
producing a new map target corresponding to said new view target, if said new view target does not correspond to said existing map target; and
determining if two map targets correspond to the same physical object.
9 Assignments
0 Petitions
Accused Products
Abstract
A computer-readable medium contains software that, when read by a computer, causes the computer to perform a method for wide-area site-based surveillance. The method includes receiving surveillance data, including view targets, from a plurality of sensors at a site; synchronizing the surveillance data to a single time source; maintaining a site model of the site, wherein the site model comprises a site map, a human size map, and a sensor network model; analyzing the synchronized data using the site model to determine if the view targets represent a same physical object in the site; creating a map target corresponding to a physical object in the site, wherein the map target includes at least one view target; receiving a user-defined global event of interest, wherein the user-defined global event of interest is based on the site map and based on a set of rules; detecting the user-defined global event of interest in real time based on a behavior of the map target; and responding to the detected event of interest according to a user-defined response to the user-defined global event of interest.
77 Citations
21 Claims
-
1. A computer-readable medium containing software that, when read by a computer, causes the computer to perform a method for wide-area site-based surveillance, the method comprising:
-
receiving surveillance data, including view targets, from a plurality of sensors at a site; synchronizing said surveillance data to a single time source; maintaining a site model of the site, wherein said site model comprises a site map, a human size map, and a sensor network model; analyzing said synchronized data using said site model to determine if said view targets represent a same physical object in the site; creating a map target corresponding to a physical object in the site, wherein said map target includes at least one view target; receiving a user-defined global event of interest, wherein said user-defined global event of interest is based on said site map and based on a set of rules; detecting said user-defined global event of interest in real time based on a behavior of said map target; and responding to said detected event of interest according to a user-defined response to said user-defined global event of interest, wherein said analyzing further comprises; updating existing view targets with new size, location and appearance information; determining if a new view target corresponds to an existing map target by comparing location information; and
comparing appearances, wherein each view target includes an appearance model that includes a distributed intensity histogram, and wherein comparing appearances comprises;
determining an average correlation between said distributed intensity histograms for each of said view targets and said map targets;merging said new view target into said existing map target, if said new view target corresponds to said existing map target, and updating said existing map target with said new view target; producing a new map target corresponding to said new view target, if said new view target does not correspond to said existing map target; and determining if two map targets correspond to the same physical object. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8)
-
-
9. A computer-readable medium containing software that, when read by a computer, causes the computer to perform a method for wide-area site-based surveillance, the software comprising:
-
a data receiver module, adapted to receive and synchronize surveillance data, including view targets, from a plurality of sensors at a site; and a data fusion engine, adapted to receive said synchronized data, wherein said data fusion engine comprises; a site model manager, comprising;
a map-based calibrator, adapted to calibrate a sensor view to said site map and store said calibration in a map-view mapping;
a view-based calibrator, adapted to calibrate a view to an expected average human size and store said calibration in said human size map; and
a camera network model manager, adapted to create and store said sensor network model, wherein said site model manager is adapted to maintain a site model, and wherein said site model comprises a site map, a human size map, and a sensor network model;a target fusion engine, adapted to analyze said synchronized data using said site model to determine if said view targets represent a same physical object in the site, and create a map target corresponding to a physical object in the site, wherein said map target comprises at least one view target; and an event detect and response engine, adapted to detect an event of interest based on a behavior of said map target, wherein said map-based calibrator includes a static camera calibrator, a point-tilt-zoom (PTZ) camera calibrator, and an omni-camera calibrator, and wherein said PTZ camera calibrator is adapted to; (a) estimate a homograph using a set of control points from said site map; (b) estimate an effective field of view for each sensor from said homograph; (c) estimate initial PTZ camera parameters, including at least one of camera map location, camera height, pan, tilt, roll, zoom, or relative focal length compared to image size; (d) refine said camera parameters such that said camera parameters are consistent with said homograph; (e) produce a new set of control points; and (f) repeat steps (a) through (e) until an acceptable error based on said control points is achieved. - View Dependent Claims (10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20)
-
-
21. A computer-readable medium containing software that, when read by a computer, causes the computer to perform a method for wide-area site-based surveillance, the software comprising:
-
a data receiver module, adapted to receive and synchronize surveillance data, including view targets, from a plurality of sensors at a site; and a data fusion engine, adapted to receive said synchronized data, wherein said data fusion engine comprises; a site model manager, adapted to maintain a site model, wherein said site model comprises a site map, a human size map, and a sensor network model; a target fusion engine, adapted to analyze said synchronized data using said site model to determine if said view targets represent a same physical object in the site, and create a map target corresponding to a physical object in the site, wherein said map target comprises at least one view target; and an event detect and response engine, adapted to detect an event of interest based on a behavior of said map target, wherein said human size map comprises a data structure based on a frame size that provides, at each image position in said frame, an expected average human image height and image area, and wherein when a camera-to-map calibration is not available, a view-based calibrator is adapted to construct said data structure by; detecting and tracking a potential human object in a view over a time period; when said potential human object satisfies a human head model and a human shape model for a specified duration, updating a human size statistic data structure with a size of said potential human object, wherein each section of said human size statistic data structure corresponds to a section of said view, and represents the average size of a human detected in said section of said view; and for a section in said human size statistic data structure with insufficient data, interpolating values from surrounding sections to determine an average for said section in said table with insufficient data.
-
Specification