Method and apparatus for total situational awareness and monitoring
First Claim
1. A method for situational awareness and monitoring, comprising:
- receiving a plurality of video streams from a network of monocular and stereo video cameras;
receiving a plurality of identities from a plurality of sensors;
detecting a plurality of objects, events, and identities, the events and identities being associated with particular objects;
fusing a plurality of tracks for each object from the video cameras and sensors into a global track for each object; and
providing a display of a 3D model and a map display overlaid with at least a portion of the global tracks, the 3D model being of a site overlaid with a plurality of video streams.
2 Assignments
0 Petitions
Accused Products
Abstract
A sentient system combines detection, tracking, and immersive visualization of a cluttered and crowded environment, such as an office building, terminal, or other enclosed site using a network of stereo cameras. A guard monitors the site using a live 3D model, which is updated from different directions using the multiple video streams. As a person moves within the view of a camera, the system detects its motion and tracks the person'"'"'s path, it hands off the track to the next camera when the person goes out of that camera'"'"'s view. Multiple people can be tracked simultaneously both within and across cameras, with each track shown on a map display. The track system includes a track map browser that displays the tracks of all moving objects as well as a history of recent tracks and a video flashlight viewer that displays live immersive video of any person that is being tracked.
-
Citations
15 Claims
-
1. A method for situational awareness and monitoring, comprising:
-
receiving a plurality of video streams from a network of monocular and stereo video cameras;
receiving a plurality of identities from a plurality of sensors;
detecting a plurality of objects, events, and identities, the events and identities being associated with particular objects;
fusing a plurality of tracks for each object from the video cameras and sensors into a global track for each object; and
providing a display of a 3D model and a map display overlaid with at least a portion of the global tracks, the 3D model being of a site overlaid with a plurality of video streams. - View Dependent Claims (2, 3, 4, 5, 6, 7)
-
-
8. A system for situational awareness and monitoring, comprising:
-
a plurality of cameras and sensors to provide video streams and sensor information, the sensor information including identification information;
a tracker pipeline to perform stereo computation and to perform object tracking;
a global tracker resolver to receive the sensor information and track information from the tracker pipeline, to perform track fusion of video and sensor information, and to provide a plurality of global tracks, each global track being for a particular object and having an associated identity; and
a visualizer and integrated graphical user interface (GUI) to provide a 3D model of a site overlaid with a plurality of video streams and a map overlaid with at least a portion of the global tracks. - View Dependent Claims (9, 10, 11, 12, 13, 14)
-
-
15. A computer readable medium having instructions stored thereon to perform a method for situational awareness and monitoring, the method comprising:
-
receiving a plurality of video streams from a network of monocular and stereo video cameras;
receiving a plurality of identities from a plurality of sensors;
detecting a plurality of objects, events, and identities, the events and identities being associated with particular objects;
fusing a plurality of tracks for each object from the video cameras and sensors into a global track for each object; and
providing a display of a 3D model and a map display overlaid with at least a portion of the global tracks, the 3D model being of a site overlaid with a plurality of video streams.
-
Specification