Video surveillance correlating detected moving objects and RF signals

• US 8,184,154 B2
• Filed: 02/27/2007
• Issued: 05/22/2012
• Est. Priority Date: 02/27/2006
• Status: Active Grant

• Current Assignee: Texas Instruments, Inc.
• Original Assignee: Texas Instruments, Inc.
• Inventors: Estevez, Leonardo W., Gutierrez, Keith G.
• Primary Examiner(s): Osman, Ramy M
• Application Number:
  US11/679,278
• Publication Number:
  US 20070257985A1
• Time in Patent Office: 1,911 Days
• Field of Search: 348142-149, 348152-155, 342/28, 386224-228, 396/153
• US Class Current: 348/142
• CPC Class Codes: G06V 40/103 Static body considered as a whole, e.g. static pedestrian or occupant recognition
• CPC Class Codes: G08B 13/19656 Network used to communicate with a camera, e.g. WAN, LAN, Internet
• CPC Class Codes: G08B 13/19663 Surveillance related processing done local to the camera
• CPC Class Codes: G08B 13/1968 Interfaces for setting up or customising the system
• CPC Class Codes: G08B 13/19695 Arrangements wherein non-video detectors start video recording or forwarding but do not generate an alarm themselves

Abstract

A surveillance method periodically detects an image of the area, identifies and tracks each moving object in a succession of the detected images, detects radio frequency emissions from the area and correlates an identified object with a detected radio frequency emission. The method detects events in the tracking of the moving object. The method stores corresponding data optionally including image data in non-volatile memory upon detection of a combination of an event and a corresponding radio frequency emission. The method triggers an alarm such as an audible alarm, a visual alarm, an email, a short text message or a telephone call detection of a combination of an event and a corresponding radio frequency emission.

Claims

1. A method of monitoring an area, comprising the steps of:

periodically detecting an image of the area;

identifying and tracking a moving object in a succession of the detected images;

forming a bounding box for each identified object in each image just large enough to include the identified object;

detecting radio frequency emissions from objects within the area including detection of corresponding radio frequency emission strength; and

correlating an identified moving object in the images with a detected radio frequency emission including correlating an identified moving object having a corresponding bounding box growing larger with time with a detected radio frequency emission strength growing larger with time.

2. A method of monitoring an area, comprising the steps of:

periodically detecting an image of the area;

identifying and tracking a moving object in a succession of the detected images;

detecting an event in the tracking of a moving object;

detecting radio frequency emissions from objects within the area;

correlating an identified moving object in the images with a detected radio frequency emission;

storing data in non-volatile memory upon detection of a predetermined combination of an event in the tracking of a moving object and no correlation to any detected radio frequency emission.

3. The method of claim 2, further comprising:

storing image data of a corresponding moving object in non-volatile memory data corresponding to said data stored upon detection of the predetermined combination of an event in the tracking of a moving object and no correlation to any detected radio frequency emission.

4. The method of claim 2, further comprising:

triggering an alarm upon said detection of a predetermined combination of an event in the tracking of a moving object and no correlation to any detected radio frequency emission.

5. A method of monitoring an area, comprising the steps of:

periodically detecting an image of the area;

identifying and tracking a moving object in a succession of the detected images;

forming a bounding box for each identified object in each image just large enough to include the identified object;

detecting radio frequency emissions from objects within the area including detection of corresponding radio frequency emission strength;

correlating an identified moving object with a detected radio frequency emission including correlating an identified moving object having a corresponding bounding box growing smaller with time with a detected radio frequency emission strength growing smaller with time.

6. A method of monitoring an area, comprising the steps of:

periodically detecting an image of the area;

identifying and tracking a moving object in a succession of the detected images;

detecting radio frequency emissions from objects within the area including detecting a RF emission with a directionality encompassing a sub-area less than all of the area; and

correlating an identified moving object in the images with a detected radio frequency emission including correlating an identified moving object in the images within said sub-area with said detected radio frequency emission.

7. A method of monitoring an area, comprising the steps of:

periodically detecting an image of the area including controlling pan, tilt and zoom of a camera; and

identifying and tracking a moving object in a succession of the detected images;

detecting radio frequency emissions from objects within the area;

correlating an identified moving object in the images with a detected radio frequency emission; and

said step of tracking the moving object includes detecting the moving object in screen coordinates within a frame of the image of the camera and converting a track of the moving object into map coordinates dependent upon a pan, tilt and zoom state of the camera.