Video surveillance system in which trajectory hypothesis spawning allows for trajectory splitting and/or merging
First Claim
1. A method for use in a video surveillance system, the method comprisinggenerating first and second extended hypotheses comprising respective different sets of hypothesized trajectories of particular objects hypothesized to have been moving through an area under surveillance at a previous time, the first and second extended hypotheses being at least one of a) an hypothesis with a merge and an hypothesis without the merge and b) an hypothesis with a split and an hypothesis without the split, the merge comprising at least two trajectories extended to the same one object and the split comprising a trajectory extended to at least two objects,generating a first further extended hypothesis comprising a first set of hypothesized trajectories of objects hypothesized to have been moving through the area under surveillance at a present time that is subsequent to the previous time, the trajectories of the first further extended hypothesis comprising 1) at least ones of the trajectories of the first extended hypothesis, 2) one or more of the objects hypothesized to have been moving through the area under surveillance at the present time, and 3) a particular set of connections extending at least ones of the trajectories of the first extended hypothesis to at least ones of the objects hypothesized to have been moving through an area under surveillance at the present time,generating a second further extended hypothesis comprising a second set of hypothesized trajectories of the objects hypothesized to have been moving through the area under surveillance at the present time, the trajectories of the second further extended hypothesis comprising 1) at least ones of the trajectories of the second extended hypothesis, 2) one or more of the objects hypothesized to have been moving through the area under surveillance at the present time, and 3) a particular set of connections extending at least ones of the trajectories of the second extended hypothesis to at least ones of the objects hypothesized to have been moving through the area under surveillance at the present time,generating a third further extended hypothesis comprising a third set of hypothesized trajectories of objects hypothesized to have been moving through the area under surveillance at the present time, the trajectories of the third further extended hypothesis comprising 1) at least ones of the trajectories of the first extended hypothesis, 2) one or more of the objects hypothesized to have been moving through the area under surveillance at the present time, and 3) a particular set of connections extending at least ones of the trajectories of the first extended hypothesis to at least ones of the objects hypothesized to have been moving through an area under surveillance at the present time, the third further extended hypothesis being different from the first further extended hypothesis, andgenerating a fourth further extended hypothesis comprising a fourth set of hypothesized trajectories of respective ones of the objects hypothesized to have been moving through the area under surveillance at the present time, the trajectories of the fourth further extended hypothesis comprising 1) at least ones of the trajectories of the second extended hypothesis, 2) one or more of the objects hypothesized to have been moving through the area under surveillance at the present time, and 3) a particular set of connections extending at least ones of the trajectories of the second extended hypothesis to at least ones of the objects hypothesized to have been moving through the area under surveillance at the present time, the fourth further extended hypothesis being different from the second further extended hypothesis.
16 Assignments
0 Petitions
Accused Products
Abstract
A video surveillance system uses rule-based reasoning and multiple-hypothesis scoring to detect predefined behaviors based on movement through zone patterns. Trajectory hypothesis spawning allows for trajectory splitting and/or merging and includes local pruning to managed hypothesis growth. Hypotheses are scored based on a number of criteria, illustratively including at least one non-spatial parameter. Connection probabilities computed during the hypothesis spawning process are based on a number of criteria, illustratively including object size. Object detection and probability scoring is illustratively based on object class.
-
Citations
8 Claims
-
1. A method for use in a video surveillance system, the method comprising
generating first and second extended hypotheses comprising respective different sets of hypothesized trajectories of particular objects hypothesized to have been moving through an area under surveillance at a previous time, the first and second extended hypotheses being at least one of a) an hypothesis with a merge and an hypothesis without the merge and b) an hypothesis with a split and an hypothesis without the split, the merge comprising at least two trajectories extended to the same one object and the split comprising a trajectory extended to at least two objects, generating a first further extended hypothesis comprising a first set of hypothesized trajectories of objects hypothesized to have been moving through the area under surveillance at a present time that is subsequent to the previous time, the trajectories of the first further extended hypothesis comprising 1) at least ones of the trajectories of the first extended hypothesis, 2) one or more of the objects hypothesized to have been moving through the area under surveillance at the present time, and 3) a particular set of connections extending at least ones of the trajectories of the first extended hypothesis to at least ones of the objects hypothesized to have been moving through an area under surveillance at the present time, generating a second further extended hypothesis comprising a second set of hypothesized trajectories of the objects hypothesized to have been moving through the area under surveillance at the present time, the trajectories of the second further extended hypothesis comprising 1) at least ones of the trajectories of the second extended hypothesis, 2) one or more of the objects hypothesized to have been moving through the area under surveillance at the present time, and 3) a particular set of connections extending at least ones of the trajectories of the second extended hypothesis to at least ones of the objects hypothesized to have been moving through the area under surveillance at the present time, generating a third further extended hypothesis comprising a third set of hypothesized trajectories of objects hypothesized to have been moving through the area under surveillance at the present time, the trajectories of the third further extended hypothesis comprising 1) at least ones of the trajectories of the first extended hypothesis, 2) one or more of the objects hypothesized to have been moving through the area under surveillance at the present time, and 3) a particular set of connections extending at least ones of the trajectories of the first extended hypothesis to at least ones of the objects hypothesized to have been moving through an area under surveillance at the present time, the third further extended hypothesis being different from the first further extended hypothesis, and generating a fourth further extended hypothesis comprising a fourth set of hypothesized trajectories of respective ones of the objects hypothesized to have been moving through the area under surveillance at the present time, the trajectories of the fourth further extended hypothesis comprising 1) at least ones of the trajectories of the second extended hypothesis, 2) one or more of the objects hypothesized to have been moving through the area under surveillance at the present time, and 3) a particular set of connections extending at least ones of the trajectories of the second extended hypothesis to at least ones of the objects hypothesized to have been moving through the area under surveillance at the present time, the fourth further extended hypothesis being different from the second further extended hypothesis.
Specification