Complex event recognition in a sensor network
First Claim
1. A surveillance system comprising a computing device comprising a processor and computer-readable storage device storing program instructions that, when executed by the processor, cause the computing device to perform operations comprising:
- tracking a target in an environment using sensors;
extracting information from images of the target provided by the sensors;
determining a plurality of confidences corresponding to the information extracted from images of the target;
the plurality of confidences including at least one confidence corresponding to at least one primitive event;
determining grounded formulae by instantiating predefined rules using the plurality of confidences;
inferring a complex event corresponding to the target using the grounded formulae; and
providing an output describing complex event,wherein;
the predefined rules comprise hard rules and soft rules,the hard rules comprise a first plurality of rules adapted to set a probability of the complex event to zero when violated,the soft rules comprise a second plurality of rules adapted to make the complex event less probable, but not impossible, when violated, andthe soft rules are associated with weights representing uncertainty.
5 Assignments
0 Petitions
Accused Products
Abstract
Systems, methods, and manufactures for a surveillance system are provided. The surveillance system includes sensors having at least one non-overlapping field of view. The surveillance system is operable to track a target in an environment using the sensors. The surveillance system is also operable to extract information from images of the target provided by the sensors. The surveillance system is further operable to determine probabilistic confidences corresponding to the information extracted from images of the target. The confidences include at least one confidence corresponding to at least one primitive event. Additionally, the surveillance system is operable to determine grounded formulae by instantiating predefined rules using the confidences. Further, the surveillance system is operable to infer a complex event corresponding to the target using the grounded formulae. Moreover, the surveillance system is operable to provide an output describing the complex event.
-
Citations
30 Claims
-
1. A surveillance system comprising a computing device comprising a processor and computer-readable storage device storing program instructions that, when executed by the processor, cause the computing device to perform operations comprising:
-
tracking a target in an environment using sensors; extracting information from images of the target provided by the sensors; determining a plurality of confidences corresponding to the information extracted from images of the target;
the plurality of confidences including at least one confidence corresponding to at least one primitive event;determining grounded formulae by instantiating predefined rules using the plurality of confidences; inferring a complex event corresponding to the target using the grounded formulae; and providing an output describing complex event, wherein; the predefined rules comprise hard rules and soft rules, the hard rules comprise a first plurality of rules adapted to set a probability of the complex event to zero when violated, the soft rules comprise a second plurality of rules adapted to make the complex event less probable, but not impossible, when violated, and the soft rules are associated with weights representing uncertainty. - View Dependent Claims (2, 3, 4, 5, 6, 18, 19, 21, 22, 23, 24, 25, 26, 27)
-
-
7. A method for a surveillance system comprising:
-
tracking a target n an environment using sensors; extracting information from images of the target provided by the sensors; determining a plurality of confidences corresponding to the information extracted from images of the target, the plurality of confidences including at least one confidence corresponding to at least one primitive event; determining grounded formulae by instantiating predefined rules using plurality of confidences; inferring a complex event corresponding to the target using the grounded formulae; and providing an output describing the complex event wherein; the predefined rules comprise hard rules and soft rules, the hard rules comprise a first plurality of rules adapted to set a probability of the complex event to zero when violated, the soft rules comprise a second plurality of rules adapted to make the complex event less probable, but not impossible, when violated, and the soft rules are associated with weights representing uncertainty. - View Dependent Claims (8, 9, 10, 11, 12, 28)
-
-
13. A non-transitory computer-readable medium storing computer-executable program instructions that, when executed by a computer, cause the computer to perform operations comprising:
-
tracking a target in an environment using sensors; extracting information from images of the target provided by the sensors; determining a plurality of confidences corresponding to the information extracted from images of the target;
the plurality of confidences including at least one confidence corresponding to at least one primitive event;determining grounded formulae by instantiating predefined rules using the plurality of confidences; inferring a complex event corresponding to the target using the grounded formulae; and providing an output describing the complex event wherein; the predefined rules comprise hard rules and soft rules, the hard rules comprise a first plurality of rules adapted to set a probability of the complex event to zero when violated, the soft rules comprise a second plurality of rules adapted to make the complex event less probable, but not impossible, when violated, and the soft rules are associated with weights representing uncertainty. - View Dependent Claims (14, 15, 16, 17, 29)
-
-
20. A surveillance system comprising a computing device comprising a processor and computer-readable storage device storing program instructions that, when executed by the processor, cause the computing device to perform operations comprising:
-
tracking a target in an environment using sensors; extracting information from images of the target provided by the sensors; determining a plurality of confidences corresponding to the information extracted from images of the target, the plurality of confidences including at least one confidence corresponding to at least one primitive event; determining grounded formulae by instantiating predefined rules using the plurality of confidences; inferring a complex event corresponding to the target using the grounded formulae; and providing an output describing the complex event, wherein; the predefined rules comprise hard rules and soft rules, the hard rules comprise a first plurality of rules adapted to set a probability of the complex event to zero when violated, the soft rules comprise a second plurality of rules adapted to make the complex event less probable, but not impossible, when violated, the hard rules and soft rules comprise first order predicate logic formulas of a Markov logic network, and the soft rules are associated with weights representing uncertainty.
-
-
30. A surveillance system comprising a computing device comprising a processor and computer-readable storage device storing program instructions that, when executed by the processor, cause the computing device to perform operations comprising:
-
observing events in relation to a target moving in an environment using one or more cameras; determining, based on the observed events, information describing the target in the environment, the information including attributes of the target and spatial-temporal interactions of the target in the environment; determining a plurality of confidences corresponding to the information describing the target, the plurality of confidences including at least one confidence corresponding to at least one primitive event; determining grounded formulae by instantiating a plurality of rules corresponding to the observed events using the plurality of confidences; inferring an occurrence of a complex event in the environment corresponding to the target using the grounded formulae; and providing an output describing the complex event, wherein; the predefined rules comprise hard rules and soft rules, the hard rules comprise a first plurality of rules adapted to set a probability of the complex event to zero when violated, the soft rules comprise a second plurality of rules adapted to make the complex event less probable, but not impossible, when violated, and the soft rules are associated with weights representing uncertainty.
-
Specification