Method and system for detecting semantic events
First Claim
Patent Images
1. A system for detecting a semantic temporal event included in unprocessed video or audio data of an event from at least one data source, said system comprising:
- a knowledge-based modeling unit for generating multiple-layer models for identifying said semantic temporal event;
a storage mechanism for storing said multiple-layer models;
an observation collection unit for extracting, from said unprocessed video or audio data from the at least one data source, temporal observations according to said multiple-layer models for the semantic temporal event; and
a temporal event detection unit for detecting one or more occurrences of the semantic temporal event based on said temporal observations and said multiple-layer models, wherein the semantic temporal event occurs during the event, the event has a start time and an end time, and the detected one or more occurrences of the semantic temporal event are used to facilitate selective delivery of the unprocessed video or audio data.
0 Assignments
0 Petitions
Accused Products
Abstract
A method and system is provided for detecting occurrences of semantic temporal events based on observations extracted from input data and event models. The input data is fed into the system from some data source. Based on specified event to be detected, multiple-layer models corresponding to the event are retrieved. The models are used to determine the types of temporal observations to be extracted from the input data. The extracted temporal observations are then used, in combination with the multiple-layer models of the event, to detect the occurrences of the event.
19 Citations
28 Claims
-
1. A system for detecting a semantic temporal event included in unprocessed video or audio data of an event from at least one data source, said system comprising:
-
a knowledge-based modeling unit for generating multiple-layer models for identifying said semantic temporal event; a storage mechanism for storing said multiple-layer models; an observation collection unit for extracting, from said unprocessed video or audio data from the at least one data source, temporal observations according to said multiple-layer models for the semantic temporal event; and a temporal event detection unit for detecting one or more occurrences of the semantic temporal event based on said temporal observations and said multiple-layer models, wherein the semantic temporal event occurs during the event, the event has a start time and an end time, and the detected one or more occurrences of the semantic temporal event are used to facilitate selective delivery of the unprocessed video or audio data. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15)
-
-
16. A system for detecting a semantic temporal event included in unprocessed video or audio data of an event from at least one data source, said system comprising:
-
a knowledge-based modeling unit for generating multiple-layer models for said semantic temporal event; a storage mechanism for storing said multiple-layer models; an observation collection unit for extracting, from said unprocessed video or audio data from said at least one data source, temporal observations according to said multiple-layer models for the semantic temporal event; a temporal event detection unit for detecting one or more occurrences of the semantic temporal event included in the unprocessed video or audio data based on said temporal observations and said multiple-layer models; an event characterization unit for characterizing said one or more occurrences of the semantic temporal event, detected by said temporal event detection unit, to produce a characterization for the one or more occurrences of the semantic temporal event; a storage mechanism for storing the characterization produced by said event characterization unit; an event prediction unit for performing temporal event prediction based on said characterization; an event model updating unit for modifying said multiple-layer models based on said characterization; and an event simulation unit for simulating parts of said semantic temporal event according to said characterization, wherein the semantic temporal event occurs during the event and the event has a start time and an end time. - View Dependent Claims (17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28)
-
Specification