Method for processing queries for surveillance tasks

• US 20070257986A1
• Filed: 05/05/2006
• Published: 11/08/2007
• Est. Priority Date: 05/05/2006
• Status: Abandoned Application

• Current Assignee: Mitsubishi Electric Research Laboratories, Inc. (Mitsubishi Electric Corporation)
• Original Assignee: Mitsubishi Electric Research Laboratories, Inc. (Mitsubishi Electric Corporation)
• Inventors: Wren, Christopher, Ivanov, Yuri
• Application Number:
  US11/429,024
• Publication Number:
  US 20070257986A1
• Time in Patent Office: Days
• US Class Current: 348/154
• CPC Class Codes: G08B 13/19671 Addition of non-video data, i.e. metadata, to video stream
• CPC Class Codes: G08B 13/19682 Graphic User Interface [GUI] presenting system data to the user, e.g. information on a screen helping a user interacting with an alarm system
• CPC Class Codes: G08B 13/19695 Arrangements wherein non-video detectors start video recording or forwarding but do not generate an alarm themselves

Abstract

A method for querying a surveillance database stores videos and events acquired by cameras and detectors in an environment. Each event includes a time at which the event was detected. The videos are indexed according to the events. A query specifies a spatial and temporal context. The database is searched for events that match the spatial and temporal context of the query, and only segment of the videos that correlate with the matching events are displayed.

Claims

1. A method for querying a surveillance database, comprising:

storing in a surveillance database videos and events, the videos acquired by cameras in an environment, and the events signaled by detectors in the environment, each event including a time at which the event was detected;

indexing the videos according to the events;

specifying a query including a spatial and temporal context;

searching the database for events that match the spatial and temporal context of the query; and

displaying only segment of the videos that correlate with the events.

2. The method of claim 1, in which the specifying of the spatial context comprises selecting an area of the environment, the selected area associated with a subset of the detectors and cameras, and the specifying of the temporal context comprises specifying an event timing sequence for the events.

3. The method of claim 1 in which the database stores a plan of the environment, and further comprising:

displaying the plan while specifying and displaying.

4. The method of claim 1, in which the detectors are motion detectors.

5. The method of claim 3, in which the plan includes locations of the detectors.

6. The method of claim 3, in which the specifying of the spatial context uses the plan.

7. The method of claim 1, further comprising:

time stamping the events.

8. The method of claim 1, in which the events include events detected in the videos.

9. The method of claim 8, in which the events in the video are detected using computer vision techniques.

10. The method of claim 1, in which a display interface includes a video playback window, a floor pan window, and an event time line window.

11. The method of claim 1, in which the spatial context defines a spatial ordering and a temporal ordering of the events.

12. The method of claim 1, in which the spatial ordering and the temporal ordering correspond to an object moving in the environment.

13. The method of claim 1, further comprising:

assigning a level of constraint to the query.

14. The method of claim 3, in which the plan is used for displaying the events and for specifying the query.